It depends. Racism, as it's practiced in the U.S., is usually based on percieved genetic inferiority and in some cases, appearance. At least with respect to blacks. Racism directed at other groups tends to be based on behavior, cultural differences and so on. For example, very few people hate whites based on their appearance. Racism against whites is usually based on distrust or revenge for past injustices.