If you don't own more than 50% of the stock, and don't control the board, it means you voluntarily sold a large share of your stock to the investors. So it's completely fair if they don't like your performance and want to remove you - they paid for that right with their money.
Unless you sold 100% of your stock, you can't be completely "fired", you still own a piece of the company and can vote.
