Being in or outdoors made no difference to my hay fever. It was miserable for 6 weeks of the year, the rest was fine.
I use the past tense, because getting older means my allergy has abated. It only gets bad if I mow the lawn, so now I wear a mask doing that.