Because it's inconsistent. If you allow drivers to work without protections you should allow everyone to work without protections.

There are some issues though; for one the state ends up subsidising workers who don't have good unemployment and health insurance.

The best solution would be UBI - give people enough money to live on while removing worker protections like minimum wage and mandatory insurances.