Think of them as point clouds + lighting. Relighting is viable. Procedural deformation is viable. Animation is just a case of transforming sub-groupings.

Collisions might be a bit trickier but you can always derive a low-res collision mesh from the input data and use that as a proxy.

It's early days at the moment and people are still exploring the possibilities.