"It's not like literature would lose anything important if HPMOR wasn't available."

It would probably lost a lot of readers, especially among young people. If you remove pure fun please reading as an option, less of them will find themselves in mood for something more serious.