It gets unconfusing if you realize it just means White.
It definitely does not. Russia, for example, would be considered "White", but is decidedly not part of "the West".
Also the "only in the Northern Hemisphere" part goes out the window as soon as Australia is mentioned.
It doesn't matter that Canada and USA have strong Native populations, "it's different in the south".
In my view the "you're not West" discourse is just another tool to fuck with the souther hemisphere. Fucks you in the head to get this crap from "both sides".
It used to be "West". Now I can't bring it up without getting lectured by people using weird rationalizations, from both sides of the political spectrum.
I'm just fucking tired of the prejudice, that's it.
It doesn't even make sense there. It's not really a logical group of things that are geographically West of anything. The abstract cultural idea of "Western Civilization" or "the West" are poorly named.
Being a product of history, a legacy, is not a shortcut to sensible. It's an explanation for why the term is used. My complaint was that it does not even "make sense" in the context of the Northern Hemisphere of the Earth.
In terms of Latin America being a part of the West or not, that's more interesting. I'm currently reading Samuel P. Huntington's "A Clash of Civilizations and the Remaking of World Order" and in it he talks a lot about civilizations which he defines as the highest cultural grouping of people short of what makes us human. Language, law, and religion in Latin America largely derive from Europe, although there are other aspects like economics that tend can differ. Some people consider Latin America as part of the West, others believe it's peripheral to the West or its part of its own civilization as Huntington does.
As others have pointed out Russia is not part of the West and at least according to Huntington would be placed in the Orthodox Civilization. Interestingly Huntington also argues that Greece, despite being the center of Classical Civilization which is the bases for Western Civilization, is not a part of the West, rather they too are Orthodox.
Regardless of whether you agree with these groupings, I think distilling it down to skin color is incorrect and not useful. The West itself is not even remotely homogenous in this aspect. You wouldn't go to sections of the Deep South in the US and declare it as not being a part of the West anymore than you would include Belarus as part of the West.
There is a saying in Florida, that the farther North you go, the more South you get.