Imho, if you where a teammate and not a imposter, you should be voted out regardless if you're just lurking in security and not doing your tasks, so we can finish the game. But then there might be little incentive for you to do your tasks as ghost anyways. Or you can withhold doing tasks as ghost on purpose just to spite the crewmates that voted you out. Like I said this game has many dimensions, wheel within wheels.