Brown person can be a descendant of the “Coolies” taken as Indentured servants to Fiji, Trinidad, Suriname, Malaysia, SA etc.
They could be people from French colonies like Algeria as well.
Brown doesn’t only mean an Indian from Calcutta, although they were heavily persecuted until recently (Check Bengal Famine)