Yep. Looking at `history` it's often something like "ping" "top" "docker ps" "curl" which don't care about directory. Since it defaults to $HOME, that's generally good enough.
When I was working more seriously on things with project directories I had a couple aliases set up with a simple bookmark system. The "bookmarks" would be symlinks in a dot folder. I could type `g proj` or `g lib` to hop around.