Fortunately, the explosion of affordable textiles resulted in many more jobs in textiles, which were unskilled. So the luddites were right - they were not worth the cost of their skilled labor. They did get replaced. But society as a whole gained a lot, as is usual for new technology.
And even more people than before were employed in textiles.