This was built using the just released Photorealistic 3D tiles announced at Google IO:
https://cloud.google.com/blog/products/maps-platform/create-...We worked on providing an integration with deck.gl to make it easy to combine 3D tile data with interactive visualizations. Happy to answer any questions!