A little bit of both. Albany was a minor transport and trading hub where Dutch remained the primary language for some time. It later became a regional banking and rail/canal hub.
Most of the patroon land started getting sold off as the value skyrocketed when the Erie Canal and railroads were built. The area I initially referred to was a backwater area where the land had limited value due to topography.