Yeah, I forget my phone way more than I forget keys, because I need the keys to open (NFC/HID) the door to the garage and to use the car. I use a deadbolt so I can't lock myself out of the apartment, but also can't go into the garage without keys, and I ~never go out the front door. I end up leaving my phone docked in my car about 10% of the time by accident, though.
The key (heh) to not forgetting anything, though, is to have a consistent set of pockets for things -- I always keep keys+knife, flashlight, wallet+cash, iphone in specific pockets. The only times I get screwed up is when I wear clothing without the right layout of pockets.