Physicians don't have time to keep up with the latest science:

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4532752/

It's the only book in the further reading section, this is an advertising piece. Why would I read another pop science nutrition book by a physician? I trust a physician to sew my leg back on or treat my obscure rash but nutrition books are a racket, read the source material instead.

Not sure you can generalize physicians and claim they all have no time to keep up with the latest science.

Did you actually look at the fact sheet on that page? It's not just something some physicians pulled out of thin air.

And PCRM's team does include experts in nutrition.

And your meta study link wasn't really conclusive; yes the association is low but suggesting that more high quality studies are needed.

Fact is in modern western societies you don't need dairy products and plant-based milks are less resource intensive compared to diary milk, see:

https://www.bbc.co.uk/news/science-environment-46654042

i.e. health isn't the only factor why someone might want to reduce or give up dairy products.