This reminds me of dual photography:
http://graphics.stanford.edu/papers/dual_photography/
in the sense that I imagine unscrambling the glittered image will be significantly easier if you can plug in known sources to the transfer matrix.
Edit: the video there didn't work for me any more, here's the youtube link https://www.youtube.com/watch?v=p5_tpq5ejFQ