That's fascinating. Their website[0] says that their model support is 600 billion parameters. Is that enough, given how rapidly these models seem to be expanding? I'm not on the up-and-up with how vast they need to be.
Located in Santa Clara, CA, CG-1 is the first of nine interconnected 4 exaFLOPS AI supercomputers to be built for G42. Together these will deliver an unprecedented 36 exaFLOPS of AI compute and are expected to be the largest constellation of interconnected AI supercomputers in the world.
Condor Galaxy 1 (CG-1) is now up and running with 2 exaFLOPS and 27 million cores, built from 32 Cerebras CS-2 systems linked together into a single, easy-to-use AI supercomputer. While this is currently one of the largest AI supercomputers in production, in the coming weeks, CG-1 will double in performance with its full deployment of 64 Cerebras CS-2 systems, delivering 4 exaFLOPS of AI compute and 54 million AI optimized compute cores.
Upon completion of Condor Galaxy 1 (CG-1), Cerebras and G42 will build two more US-based 4 exaFLOPS AI supercomputers and link them together, creating a 12 exaFLOPS constellation. Cerebras and G42 then intend to build six more 4 exaFLOPS AI supercomputers for a total of 36 exaFLOPS of AI compute by the end of 2024.
Offered by G42 and Cerebras through the Cerebras Cloud, Condor Galaxy 1 (CG-1) delivers AI supercomputer performance without having to manage or distribute models over GPUs. With CG-1, users can quickly and easily train a model on their data and own the results.
* Press release: https://www.cerebras.net/press-release/cerebras-and-g42-unve...
* Blog: https://www.cerebras.net/blog/introducing-condor-galaxy-1-a-...
