> I mean, aren't our brains' language capabilities not just Markov chains on steroids, with billions and billions of inputs and weights?

The word "just" is doing a lot of heavy lifting here. Yes, our language capabilities are just Markov chains - the way engineering is just constrained nonlinear optimization and playing games is just tree traversal.