I think he's saying that the private keys to his crypto never leave physical hardware. There is no phone number to call if he loses them, but on the other hand what you are describing is impossible.
The joke is a thief will get ahold a live person and still be easily able to social engineer account access, despite best efforts to lock it down with technology.
