My understanding of this type of clause is not that it makes New York the arbitrator, but rather clarifies for whoever does arbitrate that New York laws should be used. This seems important when working across national (or state) boundries do prevent ambiguity as to what set of laws is being used.
I suspect that it is simmilar to copying the relevent laws into a contract and signing that, which is to say that local laws still apply.