That's not the problem. The problem comes from a worldview that thinks that if someone comes from a place that's currently a mess socially, politically, and economically, then it's because of something innate to people from that part of the world. Something genetic. Not due to social/historical/political factors which are contingent. So these people are seen as something other than quite human. Not like us, who live in a place that has its act together (well, more or less, at least for now).
Social, political, economic problems are contingent, not innate to people native to a particular geographic location. This is the mindset that allows a dehumanization of people. If they are somehow genetically and innately different from us, they must innately be incapable of having proper systems of governance, or peace and stability, or business success, or scientific/technological advancement. So if they are so different from us, they must not feel pain like us either, or humiliation, or they must not have ambitions of a better life like us. Or they must not love their loved ones like us. We cannot put ourselves in their shoes, because we think they are so different. And so the empathy goes. And that is the most dangerous first step toward the dehumanization of others.
So it's OK to treat them as something other than a fellow human being.
That's why this mindset of treating human beings in a heartless way, just because where they happened to have been born is currently messed up, is so ultimately dangerous. We cannot forget our sense of humanity. That transcends our being from the US or Haiti, or tall or short, or with a bald head or a full head of hair, or having blue eyes or brown.
We are all human beings. We cannot let contingent social and political problems of where we were born define us, and we must not allow others to do that.