I have only lived for extensive periods of time in two cities: SF (2 years about) and Philadelphia (4 years). The biggest difference between them is that even in some of the worst areas of Philadelphia in terms of drug crime, there were far fewer people actively dealing or doing drugs on the streets in large groups. It was more spread out—there were issues in all areas of the city, but there was no area with the sheer concentration of say the Tenderloin or SOMA. There were basically no differences in terms of the transit systems—I don’t think BART or MUNI are any worse than SEPTA.
This is true—some of the people I met in Philly had serious drug addictions but their rent was only 300 a month for a whole house. I genuinely don’t think there is any equivalent in SF. That is probably also why I almost never saw tents or similar in Philly.