This sums up my experience with the Pixel 4 too. It's not enough to push me away from it, but it's a bunch of minor annoyances that make me have to enter my rather long passcode more often than I should have to.
FWIW the Apple implementation of Face ID deals very well with both sunglasses and regular eyeglasses as well as the absence of them. Face masks, obviously, not so much however!
