undefined | Better HN

0 pointsfamouswaffles1y ago0 comments

Transformers can do weather prediction yes. https://arxiv.org/abs/2312.03876

0 comments

This thread is about large language models and generative AI. AFAIK LLMs perform pretty badly at time series prediction.

Maybe some specially trained weather prediction neural network could perform well, but that isn’t really what we’re talking about here.

famouswafflesOP1y ago

A Large Language Model is just a text predicting Transformer (and sometimes image and/or audio predicting if they're multimodal). Transformers are general sequence to sequence predictors. The only difference between this and GPT is the data it's been trained on. They're the same kind of neural network.

j / k navigate · click thread line to collapse

0 comments

camdenreslink1y ago

This thread is about large language models and generative AI. AFAIK LLMs perform pretty badly at time series prediction.

Maybe some specially trained weather prediction neural network could perform well, but that isn’t really what we’re talking about here.

famouswafflesOP1y ago

j / k navigate · click thread line to collapse