Given how we've so far failed to deal with our nuclear waste in a reasonable way, after decades of opportunity to figure it out, I think it's a mistake to call that a "minor problem".
I don't know much about solar waste handling, though someone upthread suggests there's a French company that can recycle 95% of the components of retired solar panels with the remaining 5% going to other uses. Of course, no idea how much that process costs, but I'd bet it's nowhere near as hazardous to deal with as nuclear, and doesn't have any of the nuclear security requirements since I don't expect people can make nuclear bombs out of retired solar panels.