You do not need to be by his side. Math requires a lot of personal, intimate, lonely thinking.
Many problems can be formulated in just a few words. You apparently have some mathematical culture yourself, so just give him a handful interesting problems, at the edge of his intellectual reach, and let him wonder for some time.
When he was a child, Gauss discovered by himself the formula for the sum of integers from 1 to n, because his teacher asked him about it for n=100.