Then you're no worse off than if you had the original format. You'd have to iterate through the members in either case.
That said, given there are just shy of 17 million possible RBG combinations, and a small fraction those are of named colors, I'd personally continue to optimize for the named color case.
You should definitely optimize your data storage for the kind of operations you're going to do on them. However you're taking about the data transmission format here!
Surely you wouldn't think of sending a piece of JSON over the wire with both name:color and rgb:color, regardless of whether that is what the recipient wants to operate on. You just have to let it unmarshall the data into whatever form it needs.