Yeah you have to mind the tolerance, if it gets too high you're going to experience some serious side effects from the grams of caffeine every day, and the guaranteed "withdrawal" when you have to cut down is not very nice either.
The THC isn't the problem. All in all I completely agree. Microdosing LSD is also a great thing to do but does get incredibly exhausting after a while.