Do you have tattoos? It's to do with the Yakuza, though they know foreigners have random (and sometimes pointless) tattoos - they can't make any exceptions.