I’m super exited about the planned support for multidimensional data, I know zarr is there but a long term storage format other than netcdf would be interesting maybe also something to replace grib, geotiff etc to share files
Beside Zarr, there are also efforts to support different types of raster (sort of multidimensional) data such as geotiff and NetCDF. The Iceberg Geo spec was heavily influenced by the Havasu project proposed by Wherobots, which also supports that type of raster data. However, the Iceberg geo spec still only supports only geometry for now.
Surely Zarr is already a long-term storage format for multidimensional data? It can even be mapped directly to netCDF, GRIB and geoTIFF via VirtualiZarr[0].
Also if you like Iceberg and you like arrays you will really like Icechunk[1], which is Version-controlled Zarr!
I know icechunk and I’m a huge fan of earthmover. But a common binary format like parquet seems nice… with interop for e.g duckdb and geo queries, you can “just load” era5 and do something like get wind direction/speed along the following path for the last 5 years group by day etc…
If you know the exact tensor shape of your data ahead of time Zarr works well (we use it as the dataformat for our ml experiments). If you have dynamically growing data or irregular shapes zarr doesn't work as well.
> This is just the beginning of modernizing geospatial data storage. We’re already looking ahead to other types of geospatial data such as raster, point cloud, spatial indexes…
The conclusion: "One interesting idea is that, at their core, AI models are nothing more than compression models that take the corpus of data humanity has and boil it down to a set of weights" is also good, there is a interesting paper about compressing weather date with neuronal networks: https://arxiv.org/abs/2210.12538
What's missing a bit is that the comparison is more for general purpose data, there are some very interesting and super fast compressing algorithms for e.g. numbers (Turbopforc, gorilla, etc...) Daniel Lemires blog is super interesting about the different algorithms and how to make them faster.
You can thank all local train operators for this. They have been fighting a shared ticketing system tooth and nail at the European level and the weak politicians in Europe who don't push for a shared system.
What is the rationale for fighting a unified system? A unified system would make it easier to travel by train, which should in theory encourage people to do so more.
Is this a problem of the operators within each country not wanting to be unified with each other because then they'd have to compete more directly? Or is this actually the operators between countries fighting over it for some reason?
It's just price differentiation in action. A Polish ticket for the same train can be a third of the price of an Austrian ticket. People are rightfully pissed when this happens to them online, yet they seem to accept it for trains. I don't understand it.
Austrians moving to Poland doing any specific job will pe paid exactly the same as the Polish. Similarly a Pole working a job in Austria is paid the same as an Austrian doing the same job.
The fact that there might be a wage difference between different countries might be interesting, but it us utterly irrelevant to the fact that there is a price difference between tickets sold for the exact same train. Not an Austrian vs. a Polish train -- literally the same actual train with the same finite, exact seats for sale.
I had a good experience earlier this year on a Paris/Berlin/Vienna/Venice/Stuttgart/Paris loop using raileurope.com and nightjet.com
I guess it may be more expensive but I don't mind, I find the booking experience very clear cut as to what is refundable, what is nonrefundable etc, easy to pick which class for each segment and so on. no complaints.
You can (except for Germany I think, that stopped accepting the tickets issued from international tariff book few years ago), but this will get you the base price, without any possible discounts, so is usually way more expensive than tickets bought directly. But gives you tickets with date change/cancellation possible.
Not needed, at least in most Europe. Operators share data and you can get timetable information from any of them for all trains, including combined itinearies, and the expectation is you get information from your local train company.
Uhhh throwback to simpler times <3 I loved the scene in Basel back in the days
For the adventurous Ishkur also has a nice opinionated guide through the history of electronic music with much of its facets: https://music.ishkur.com/
The thing is most pollution and changes in the ocean are not visible right away, while hiking or on land in general I directly see consequences of littering and environmental impact and its possible to act upon (littering on highways)
in the oceans on the other hand a lot of environmental impact is just not visible, thus it needs to be made visible, I see a nice beach... I don't see particles floating just under the surface, I don't see the destroyed eco systems by trawling, I don't see "death zones" where there is no marine live...
so this is a good step into direction making these things visible
