Specifically about 60% of the total budget is Social Security, Medicare, Medicaid, CHIP, ACA subsidies and safety net programs. Then we have your 20% (16% DoD and 4% VA), then 6% goes to interest on the debt, and the remaining 14% is everything else.

Though FWIW the percent of the budget spent on the military was (for somewhat obvious reasons) quite a lot higher during the Iraq war.