So were slaves in the Caribbean. Should they not have rights to the islands on which they have lived for generations?

It’s pretty simple:

They were taken from their homes as slaves. They were forced to work in plantations for generations. Slavery ended but they had no “home” to return to and called the island where they had settled home.

Whether they were forcible taken there doesn’t suddenly mean it’s not their home.

> because someone might have been exploited

Can we just be super clear that we are talking about former slaves here. As much as might like to talk about “compensation” (source??) these are people who were taken from their homes as slaves, transported across vast oceans and forced to work in generally pretty horrible conditions. There is no “might have been exploited” here, they were very clearly exploited in an extreme way.