No you aren't. You are signing a paper that says a managerial decision about the shares of the company happened in Germany. Where you live does not matter. You just have to do a board meeting, and be physically present in Germany during the meeting.

In fact, you likely want to keep any proof of your travel from a different country, which makes it obvious to the authorities that you don't spend all your time there.

There's multiple variants though, this is just one of them. You can also pay someone to manage the shares (and of course contractually bind them to not do anything without permission).

Edit: Also, to be clear, you don't need to manage the company from Germany. You only need to manage the holding company from Germany, where the only managerial decision is related to the shares themselves.