There's forced labour and child labour in tea growing, it's mostly grown in countries that have different definitions for human rights. And unless you're buying specialty tea, those farmers are paid pennies while doing hard work.
I don't think there's any ethical consumption of industrial scale agriculture that cannot be mechanized, because we don't want to pay the real costs.