There are homeless people in Japan. You'll see them sitting in alcoves by train stations or sleeping under a stack of umbrellas in parks sometimes. The places I've seen them most are in remote locations by rivers, where they'll set up tents or tie tarps to trees to live under. They aren't as ubiquitous as they are in the US though, and I've only seen a homeless person panhandling once in all my years in Japan.