Your intuition is right. There is a general algorithm for finding the antiderivatives: https://en.wikipedia.org/wiki/Risch_algorithm Its simplified form can solve pretty much all the undergrad antiderivation problems.

I'm a math major, but I consider the time spent learning the tricks for antiderivation to be kinda useless.

“Perhaps I could best describe my experience of doing mathematics in terms of entering a dark mansion. One goes into the first room, and it’s dark, completely dark. One stumbles around bumping into the furniture, and gradually, you learn where each piece of furniture is, and finally, after six months or so, you find the light switch. You turn it on, and suddenly, it’s all illuminated. You can see exactly where you were.” - Andrew Wiles

I think it just tokenizes everything and does pattern matching to find compositions it can exploit. It's not unlike compiler optimization.