The UK and USA only ever claimed a legal right within the framework of their own laws. Despicable as their actions may be, they never pretended to claim a human right.
The displaced Chagossians, on the other hand, are claiming a human right to occupy the islands. That's different.