If the student defaults, the lender still gets paid. The government steps in and pays them. The debt is then essentially owed to the government rather than the lender.