You did learn - or, you could have. You learned how to run, how to endure being sweaty and hot, how to jump, etc. Many athletic abilities are learned. You can tell someone with a modicum of physical training from a novice easily - even decades after any learning.
I learned how to handle being belittled and insulted both by my school peers and by adults in authority roles, and learned that I should avoid situations involving exercising and sports unless I wanted to be subjected to that. It's taken many years, and my need to deal with resulting health problems, for me to try to un-learn these "athletic abilities."
Just because "gym" could provide valuable life skills, does not mean it does in the form it currently takes in many schools.