No, you're thinking of the term "cattle". Calves are indeed cattle. But "cow" has a specific definition - it refers to fully-grown female cattle. And the male form is "bull".
Because managing cows is different than managing cattle. The number of bulls kept is small, and they often have to be segregated.
All calves drink milk, at least until they're taken from their milk cow parents. Not a lot of male calves live long enough to be called a bull.
'Cattle' is mostly used as an adjective to describe the humans who manage mostly cows, from farm to plate or clothing. We don't even call it cattle shit. It's cow shit.
