Not in my experience. The walls were dark. And the window was bright occupying half of the surface of one wall. They still flew in circles.
I think it might be what other commenters are pointing out. That flies consider the brightest direction to be the sky, but if it's to the side (with respect to gravity) it messes up their navigation.
It's already happening. For example, ECMWF provides experimental forecasts by their own deep learning model, plus models from Deepmind, NVIDIA, and Huawai.
They perform several model runs with slightly different configurations and then compare the predictions to a reference period, currently 1991-2020. When they say "above average", most model runs fell in the upper tercile of the reference period and the probability is derived from the fraction.
If anyone is interested in these seasonal forecasts, all major meteorological institutes upload theirs to https://www.wmolc.org, with new predictions coming out every month.
Up in the Old Hotel by Joseph Mitchell. I finished it yesterday.
It's a collection of articles the author wrote for The New Yorker around the middle of the last century. The stories are portraits of weird, eccentric people and peculiar places in and around New York. Mitchell describes his subjects with dignity, without putting them on a pedestal.
The author is a very good writer and his stories are enjoyable, but only after I had read the book to the last page, I understood what makes this book so great. The stories tell you as much about the author as they tell you about the protagonists. I started the book to get a glimpse of the old New York and finished the book with a great curiosity about the author himself.
If I understand it correctly, you are only attending preceding tokens in your paper. Can the constant bias matrix be made symmetric for unmasked tasks?
They still publish all their data free of charge and are required to do so by law. For weather forecast, they dump all parameters of their recent model runs.
So I guess I'm saying that you can already build such a system yourself quite trivially...
The expensive stuff still bears the trademark of the brand, the lead designer, or the collection. It's more subtle, but ultimately the reason why people buy it. And some brands really just sell the logo at a high price, like Hermes or Louis Vuitton.