The limiting factor is all the use cases that have not been invented yet. Screen sharing would have never been a thing if we started out with Wayland-like restrictions.