Yes, these unfortunate souls have suffered generations of evil, starting with the slave trade and finish off with being expelled from the island(s). That said, I don't really see the argument that it is somehow their land. Should they have been properly compensated or better yet relocated somewhere with better conditions than what they had? Absolutely! In fact, it seems that a law suite seeking that compensation might have better luck than trying to reclaim the land.
The example used earlier with the Balkans is so much more complicated. Depending on who's side of history you take, all sides have a claim to most of the land in the Balkans. Things seem to be much more clear cut here.