That's because of their sheer numbers (largest immigrant group) + Islamophobia ..nothing racial really.
Thank you for your "evidence" from a Hellenic writer who lived some 2000 years after the death of King Sesostris. Do you call that Egypt influencing the Middle East? There was a continual flow for centuries and even millenias from the Middle East to Egypt, while there was no such flow from Egypt to the Middle East. Egyptians even speak a Semitic language today.
The ancient Mesopotamian and Levantine (Fertile Crescent) civilizations arose much earlier than ancient Egypt and Assyria conquered and destroyed Egypt. Ancient Egypt was a significant historical civilization however it's vastly overshadowed by the ancient Fertile Crescent civilizations and their lasting influence is far greater than Egypt's. Anyone that denies that is ignorant of history, just go ahead and confirm it.