You could get a calibration frame by removing the lens with the sensor centered, and a black frame by putting a lens cap on, to help with corrections.
That looks like a really fun project. With the HDR mode of the sensor you should get some awesome images. Good luck!
[1] https://www.sony-semicon.com/files/62/pdf/p-13_IMX477-AACK_F... - (PDF) Flyer
[2] https://www.uctronics.com/download/Image_Sensor/IMX477-DS.pd... - (PDF) Data Sheet