If feeling like the world is riding on your shoulders changes your risk-adversity quotient maybe founding a startup isn't such a great idea. Instead of 1 mortgage (yours), you're now responsible for 20 (your employees').
Entering into a business relationship with an employee bears its own responsibilities; however, all parties know that it's a business relationship. Everyone understands the limits of the responsibilities associated with that relationship & employees always have another employer they can go to if need be.
Totally. If you already feel like you're in a space where everything is riding on you, it's not exactly appealing to expand that responsibility. If you felt freer, you may be willing to take on that burden initially.