> Note that this is only a small subset of the total training data: about 2% of the 600 million images used to train the most recent three checkpoints, and only 0.5% of the 2.3 billion images that it was first trained on. [1]
That dataset only covers "aesthetic" clip terms as well. Not to mention a lot of images come from Pinterest and other aggregators.
[1] https://waxy.org/2022/08/exploring-12-million-of-the-images-...