It sounds like you're already approaching this idea on your own, but if you haven't checked it out already you should have a look at Digital Minimalism [1]. It's a really well thought out analysis of exactly what you're describing. In theory, a few hours here and there shouldn't be an issue. However, the main problem with modern media (social and otherwise) is that it is very insidious. It's not just about the time spent indulging, but also what that indulgence does to your mental state throughout the rest of the day.
Thanks for the suggestion; but after reading one similar book, Stolen Focus by Johann Hari, and another that was tangentially related, Four Thousand Weeks by Oliver Burkeman. I now feel tapped out of the genre.
One thing I enjoyed about Four Thousand Weeks was the story how people viewed work 100s and thousands of years ago, how whatever you didn't finish that day, you had time tomorrow to continue; I think this is a useful idea because modern society feels so "rushed" over work that isn't exactly useful. Also the idea of JOMO (joy of missing out); it was just a new heuristic introduced to me. We make choices all the time, we neglect doing things all the time. It's just a part of life, missing out on things means enjoying others It sounds like it's more stressful but it's not, at least how the book describes this.
With Stolen Focus, I was a fan of the author's interview about his other book "Lost Connections" when he appeared on an episode of econtalk [1]. I won't say much else about Stolen Focus, except his tips on what he does to lessen the nodge toward social media is what I now do as well.
[1] https://www.calnewport.com/books/digital-minimalism/