I think it's something that came out of industrialization in the late 19th century. Look at the famous football clubs, they're all founded late 1800s/early 1900s, in cities. Basically guys who needed some entertainment on the one day off that many countries had instituted by then.