On the other hand, with Node on the server we're now jumping into the ESM and nodenext/esnext mess with its .js imports.

This less a problem when your project is on the web though, because vite (and I think under the hood esbuild) transforms the imports gracefully.