IANL, but AFIK, yes, as long as EU users can access your website, it does have to be compliant. Though how you could get fined for breaching that is another matter.
TBH, being GDPR compliant isn't that hard, just don't track your users lol. A lot of the web was GDPR compliant by default 20 years ago.