The majority of US states have no such requirement. In VA I can purchase a gun from another VA resident with no paperwork; I can purchase from a dealer by filling out a one page form with name, DOB, address, and place of birth.
You can do that for long rifles in MN as well (although I think you forgot the NICS check required for all gun purchases regardless of state). It's just hand guns and "black" rifles that require the permit. VA obviously has a more enlightened view than MN (IMO).