Programming and blue collar work are two different types of work, requiring different skill-sets that not everyone has. Ask your average construction worker to write a web app and no doubt they would find it very difficult. Ask your average programmer to build a house and they would also find it challenging.
Both types of work can be exhausting, it's just that one is mentally exhausting and the other is physically exhausting.