To simplify my point I will say that perhaps make it known that it was only a joke on the same reply and not come back after time has gone by to make it known. Some don't always interpret jokes the way others do.