Transformers can do weather prediction yes. https://arxiv.org/abs/2312.03876

This thread is about large language models and generative AI. AFAIK LLMs perform pretty badly at time series prediction.

Maybe some specially trained weather prediction neural network could perform well, but that isn’t really what we’re talking about here.

A Large Language Model is just a text predicting Transformer (and sometimes image and/or audio predicting if they're multimodal). Transformers are general sequence to sequence predictors. The only difference between this and GPT is the data it's been trained on. They're the same kind of neural network.

Think base models. LLMs are extremely good at predicting the future when applied to human languages, as this is literally their only optimization goal. Why couldn't they also be good at predicting the future when applied to other complex forecasting tasks?

Of course what can be mathematically calculated without inference is going to be. LLMs may however be able to interpret the results of these calculations better than humans or current stochastical evaluations.