You're dealing with 64% of the voting population, who inherently lean one way or the other so a small nudge can be the difference between one side or the other winning.
e.g. Candidate swapping might bring votes from minority groups or Women.
Imagine a scenario when even 5% more people voted, suddenly the margins are much wider and the results hold stronger validity.