Mining has been dropping since the 80s [0].
Farming, forestry, fishing are estimated to decline by 3% in the next 10 years [1]. After having fallen from ~50% of the US population in 1870 already.
It's cheaper to do things where labor is cheaper, then ship them around the world by sea.
[0] https://fred.stlouisfed.org/series/IPUBN212W200000000#:~:tex...
[1] https://www.bls.gov/ooh/Farming-Fishing-and-Forestry/Agricul...