The truth is, plenty of people go to libraries. By my local library's annual 2017 report, they have 625,000 active library card holders which collectively visited the library over 10 million times. [1]
This is one of the busiest library systems in the country, but shows that, at least within a local region, libraries may be heavily used.
The truth is, most people don't go to _any_ single place. A lot of people frequent libraries, but they're probably not in the same socioeconomic place as you. When you wrote that last sentence, did you stop to think that maybe you don't really know what you're talking about?
Almost everyone in Georgia has and uses a PINES card, and they're very happy about it.[1] The library here in Winder just re-opened after renovating to add and expand a bunch of non-book services and make room for all the people who go to it.
This is probably the best hint that they might not be so useful. The truth is most people never go to libraries.