Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.