It is configurable, right in System Preferences > General. (Or I guess it's "Settings" now on modern systems, don't know what menu it's in there.)
P.S.: seems like the setting still keeps the scroll bar on top of the windows content (e.g. a website), not outside of the content.