That would not work in the same way as a typical gauge theory though - typically the symmetry of a gauge is for shifts of the entire system along the gauge - changes along the gauge locally do have physical meaning. For example, in an electrical diagram you can arbitrarily shift every voltage in the system by a billion Volts (ground rail is 1b Volts, 5V rail is 1b+5V, etc) and the system will behave identically. The gauge quantity is real and not redundant, it’s just that it doesn’t have a known meaningful absolute reference point.