Yes, but I do a lot more vetting before I invite someone to my physical home, so situations like these are vanishingly rare. As opposed to a digital home which is free to any nefarious person around the home.
(I do host stuff at home, but I don't think it is good to understate the risks)