Yeah, did self-tests and have thought the same. I definitely followed the instructions and my SO is a nurse so she knew how to do it, but who knows. I also had some very mild symptoms at least one of the times.
Could be something like our viral load wasn't high enough to register on the test, maybe our immune systems just dealt well with covid.