> Its probably possible to do this via HDMI info frames too somehow

These only flow in one direction though - from the source to the sink