Hacker Newsnew | past | comments | ask | show | jobs | submitlogin
Facebook and its news feed algorithm (slate.com)
123 points by piyushmakhija on Jan 5, 2016 | hide | past | favorite | 86 comments


My facebook timeline is the worst of all social networks. I unfollowed 90% of my friends that I don't care about, so it has very little data to show me, but instead of showing all of the content of those users, it still filters out most stuff by whatever criteria they use, so I often go days with the same content being shown on the top of my timeline (and missing a lot of posts that I actually wanted to see).

Setting the feed to "Most Recent" usually gives better content, but the option unsets itself every other day.


There are two things, one trivial and one non-trivial, that would vastly improve the feed for me (and I imagine for a certain cohort of which I am a member):

The trivial one: Allow me to turn off all links. All of them, globally. I don't care about the news article you just saw that reinforces your political views; I don't care about the clickbait editorial you just read; I don't even care about the moderately interesting piece you just shared because I probably already saw it on Twitter. No links. Just the pictures and status updates like before the age of inline expand.

The non-trivial one: Allow me to turn off all images with text in them. Why? Because these are, with stunningly high frequency, visual versions of the same political-view-reinforcement article links. I already know if a friend or family member identifies as a liberal or a conservative. I don't need a regular stream of smug SomeEECards or Memegenerator pictures to remind me. On the technical side, there's clearly some fuzziness, but I have to think simply detecting the presence of text would be a comparatively simple task to what else Facebook's deep learning systems do.


What you are describing is basically Instagram. No "sharing" or "reposting" other content, only original posts from friends. Some have found ways around that but it's not the default.

I'm not familiar with Snapchat but I expect they have a similar mechanic. It seems like the newer social networks are avoiding the problems caused by virality, and getting back to the original reason we wanted to join social networks: to see what our friends are up to.


Interesting, a bunch of my instagram friends use it to share memes and reposts. Facebook seems to have more "personal" photos whereas instagram seems to be (at least amongst my friends) more of where they share cute random images or pictures of celebs, what bands they like, etc.


For the Trivial one -

http://www.fbpurity.com/

>F.B. Purity is a browser extension / add-on that lets you clean up and customise Facebook. It filters out the junk you don't want to see, leaving behind the stories and page elements you do wish to see. The list of story types that FBP hides is customizable to your taste.


I'm not sure what it is on the surface but that site instantly screamed "scam/virus" at me as soon as I opened it. I think it's because it looks cluttered and some images just look out of place (including a stretched Facebook share button on the right)

Is it actually trustworthy?


It does what it says on the tin, but the dev is gradually being squeezed out of various browsers (due to plug-in API deprecation) and sometimes falls behind in the arms race vs. Facebook.


There are two things, one trivial and one non-trivial, that would vastly improve the feed for me...

And Facebook isn't interested because it's not intended to build something that's everyone's perfectly tweaked feed.

It's much more in Facebook's interests to be a somewhat uniform "public space" than to be everyone's ideal filter. To some extent, it forces people to care stuff they wouldn't otherwise simply because the stuff is being made public.

Part of this is that we aren't Facebook's customers, we are Facebook's product and Facebook's advertisers are its customers. But that was essentially true of newspapers as well (newsstand revenues were supplement to advertising revenues even before the Internet).

To some small extent that can be a good thing since a human society requires some mutual awareness of our activity. Like newspapers, Facebook and other social media generate something like a space where public reactions can be seen. An information filter couldn't do that - for ill or good.


>Allow me to turn off all links... Allow me to turn off all images with text in them.

Would hiding all of them work? According to the post, the algorithm treats hides as negative feedback and tries to avoid those posts in the future.


It seems the algorithm would interpret that as 'show less posts from this person' or 'show less posts about this topic', rather than 'show less posts that are links'.


It's a never ending battle. They never go away completely.


Here's a tip: bookmark https://www.facebook.com/?sk=h_chr and you will always see the most recent feed. I've been using this for months now and it hasn't unset the most recent setting yet.


Is it just me or has the recent feed recently started showing things from friends of friends that my friends like and comment when it didn't before? Or is my memory faulty?


Yes, my feed has been like that for the past 2 months. It's one of the reasons I haven't logged in for 20 days now. I still use the Messenger app, tho.


Yes, I have had this feeling too. So many likes about people I've never heard of. Seriously degrades the quality.


But what about the app?


Sadly I haven't figured out how to do this in the app yet :(


I've switched to using the mobile web version. I personally find it much more responsive, and Facebook can't bug me with notifications anymore ;)


It's accessible from the Android app as a list (called "Most Recent"), from the same menu where you can access your timeline or the app settings.


After unfollowing 90% of the people, I had a different problem. Facebook kept filling my news feed with "X liked this" or "X commented on this" from the remaining 10%. It seems that one of the goals of the news feed algorithm is to make sure that you are always seeing new content. This became really annoying really fast. So I ended up unfollowing 100% of my friends, than created a group containing the ones that I really cared about. Now my news feed is practically empty. It takes me one extra click/touch to get to the new "feed". The benefit of doing this is that in the group feed there are no "X liked this" items, only posts by my friends or posts in which they were tagged. Of course, at any time FB can decide to change the group feeds to make them similar to the news feed, but for now this setup kind of works for me.


YES! I have the same problem (https://news.ycombinator.com/item?id=10849984). I solved it by being OK with it, but I think that a browser extension would solve this issue pretty quickly, if I knew how to do it. Delete any element on facebook.com* that contains "* liked ". I can do it manually, I just don't know the Chrome extension world at all.


"Solved it by being ok with it" is my favourite quote of today!


Totally zen :) I mostlynlearnednto be with it, with one exception. Anyone I see a share from a radio station, I block that radio station's page. 9 times out of 10, they only share insipid memes ... And my feed quality has improved significantly.


<3 Thanks for that! It's an amazing way to solve problems, especially if your normal way of existence is to be frustrated by awful products in every angle of your POV :)


I noticed recently that FB introduced a "configure your feed" utility. When I clicked into it, it appears as though it algorithmically determines the people who you most want to see content from, from highest probability to lowest. Interestingly, all of the interesting groups and news organizations and the like -- the stuff I care about -- was at the very bottom. I moved all of that stuff to the top and it fixed my feed for the most part.

But that said, there is no substitute for a fixed "most recent first" setting that doesn't reset, and frankly, the fact that it DOES reset is extremely creepy and leads me to use facebook much less often that I would otherwise.


I wonder if part of the problem is that the news feed must always show the user SOMETHING, even when there may not be many recent posts that are particularly relevant for that user. The only variable that changes based on the "relevancy" score of a post is its position in the news feed, so one day the top post in your newsfeed may be "President Shot! Country in Chaos!", but on a different day when things are slow it will be "A Woman Tries To Sell A Fish. You Won't Believe What Happens Next!" (courtesy of http://community.usvsth3m.com/generator/clickbait-headline-g...). Basically, the newsfeed only has one "volume" - a constant drone.

Combine that with the sometimes-relevant accuracy rate of the algorithm and a bottomless well of junk posts to draw from and you have a recipe for a constantly mediocre experience.


Whatever the underlying algorithm, the fact that it will continue to show you the same things when new content is available is by far the biggest failing. Surely they should prioritize fresh/unseen posts above all.


Robert Scoble has some great tips that have worked for me. I'd recommend checking them out. http://www.adweek.com/news/technology/robert-scobles-22-tips...


Those tips seem great to increase the reach of your own posts on facebook, but I believe you'll also see a lot more unwanted content on your timeline if you do that. Not really what I'm looking for.


I've tried some of these, and they do improve the quality of your newsfeed. Basically, they tell Facebook what kinds of posts and which people you are most interested in seeing.


You get me thinking about side projects... http://getstream.io provides Twitter-like feeds as a service. For personal use wonder if it's possible to build a better newsfeed that Facebooks on top of the same content?


Jesus I really wish they had a few lowercase characters on their site. I feel verbally assaulted.


Especially the testimonials. I can't help but read them in a classic cartoon dumb guy voice


Every social network so far has eventually faltered. FB is certainly way bigger (and way more invasive), but usability issues like the feed may see it stumble.


I added a whole bunch of my friends from the programming community I'm part of, and generally I have interesting stuff to look at.


My problem with the news feed is how non-deterministic the results are. There have been so many cases where I will see a post/photo/video that I find interesting, but fuck me if I ever want to find it again on a different device or at some point in the future if I didn't bookmark it or remember who posted it and when. It always seems like a random shuffling of the deck when I load the page, and it's incredibly frustrating.


Not only that, on mobile, I'll follow a link from FB, read an article, and go back. The mobile page reloads, and shows a completely different set of articles. FFFFFFFUUUUUUUUUUUU.


My biggest problem seems to be a bug, not sure if it is FB or browser. But from time to time as you scroll down the news feed, FB displays the stuff you have already seen from the beginning. Sounds like a problem with request firing off and not able to retrieve and populate stuff from the beginning again.

There is also no way to "remember this" unless you like the post.


Click the little drop down arrow at the top right of each post. On many of them (maybe not all -- I can't check right now), there's now a "Save" option.


Ah great! Thanks.


I started having the exact same problem on my Windows Phone FB app. Took some time to realize it was a bug and not a weird deja vu of mine.


Yup that bug is really annoying. I have observed it only kicks if you open a photo in the photo viewer and then go back to the home feed by closing the photo viewer.


Related: I noticed recently that basic history navigation is broken on facebook. Not just for the newsfeed. Anyone else who noticed this as well?


Came here to complain about this so I upvoted you instead. It would be great, too, if their search could actually show posts.. My usual go-to when I'm trying to find something again is to go to the person's profile, but sometimes I forget who posted it and in that case there's basically no hope in finding the post again...


Title: How Facebook's news feed algorithm works

Second Paragraph: "No one outside Facebook knows for sure how it does this, and no one inside the company will tell you."


Xfb here, no one inside the company knows exactly how newsfeed works either. The infrastructure and all of the components involved in generating and rendering newsfeed at this point (and for a while) have been far too large for any single person to understand. It's generally accepted as a mystery, even to those working on components of newafeed.

I worked on a component of newsfeed for a while, and yet had no clue how the rest of the system worked despite trying. That's the level of complexity involved here.


That honestly sounds like mismanagement. Even if its too hard to understand the minutiae, there should be a chart/graph/something somewhere that shows what all the components are intended to do.


Understanding what the disparate pieces are and even how they talk to each other will not tell you how it actually works, unless you understand how each individual component works.

And:

> The infrastructure and all of the components involved in generating and rendering newsfeed at this point (and for a while) have been far too large for any single person to understand.


That’s just mismanagement still.

Each component should have a clearly and strictly defined way to interact with other components, which you should have in nice diagrams. Tack the diagrams together, and you get a full definition of how the newsfeed interacts and which piece does what.

If that is not possible, then you have a very badly managed company, not even Healthcare.gov was that mismanaged.


Yes those diagrams exist, but you've got to remember that these components are constantly changing as well as new components being added and others being removed all the time. It's a beast and perhaps I was a little liberal with my assertion that "NO ONE" understands it. It's possible to understand at a high level: eg "...and then the posts get filtered through this ranking component"

But then that ranking component can change week over week so if you thought you understood all of the ranking mechanics last week, then you probably have some catching up to do this week.

There's also a lot of people working on this so stuff changes fast and often. Think about all of Facebook's different products vyying for attention in the feed. Think of all the PMs with agendas who want their product in the feed in certain ways.


Sounds like they need to develop a news feed news feed to keep them fed with all the latest news about their news feed development.

Plus side: if it works well, they can just replace their current unspeakable Lovecraftian horror of a system with the meta feed they develop. A new dawn for all.


> There's also a lot of people working on this so stuff changes fast and often. Think about all of Facebook's different products vyying for attention in the feed. Think of all the PMs with agendas who want their product in the feed in certain ways.

If you can't maintain a complete understanding of the process, you are playing a guessing game.

This isn't some special magical FB-centric problem.


And yet Healthcare.gov has had far more downtime and other issues than Facebook so...


Well, their aim is to create a system that’s completely compliant to spec. Facebook, as the greatgrandparent mentioned, isn’t even trying to.


This is why facebook is about to go bankrupt.


Nah man, move fast and break things, remember?

Like actually break them.


It sounds like terrible product management in general.


Honestly, it doesn't seem to work particularly well. It seems like the kind of thing they could just reimplement without fear of "breaking" anything, since there isn't really anything to break.

A much simpler algorithm would probably be preferred by many users anyway.


Yeah, that's bad. We changed it to something generic. If anyone suggests a better title we can change it again.


I think that sentence was somewhat hyperbolic. It doesn't mean that there is literally no information about how Facebook works, just that it's a bit secretive.

The rest of the article does go into many details about the behind the scenes of Facebook's algorithm. And shares a number of interesting details about how it works, and how decisions about it are made. So I would say the title isn't that bad.


The current article title is fair enough i guess: "Who Controls Your Facebook Feed"

(i guess they changed it themselves, as the URL shows this old title)


Presumably nobody outside Facebook knows that either though?


But the subtitle answers it fairly (IMO):

"A small team of engineers in Menlo Park. A panel of anonymous power users around the world. And, increasingly, you."

And they not claim they know themselves.


In my experience, Facebook pretty much just shoves all photo (visual) content to the top. Kind of frustrating. Not actually possible to find people talking on facebook anymore, it's just single-column pinterest.

The whole internet is sort of evolving into photo content these days it feels like. Twitter, tumblr, pinterest, reddit...all very photo focused.


This.

I missed repeated posts from a good friend asking for help. If I had seen them, I would have been there in 10 minutes. They committed suicide exactly 1 month ago. Just goes to show how incredibly important some algorithms can be.


Fuck man. I'm sorry about your friend. That really fucking sucks.


As a hobbyist photographer, I appreciate being able to share my photos, however I don't feel like throwing the "art gallery" at the user. That's why I take a much humbler approach by just posting my pictures to my own personal website's gallery. If someone were to stumble across it, great, otherwise no harm. It also helps that I have canceled my Facebook account.


It's just like how in reddit when the "front page" subs get too popular, the lowest-value, easiest hanging fruit, fastest digestible content (images) always floats to the top, same with the news feed. The lengthy quality discussion posts get bogged down and the popcorn candy content fluff of memes overrun everything.


That algorithm crap was the reason I use facebook only as a messenger since they turned off the ability to use a Twitter-like feed.

I don't need fucking "intelligent algorithms" to tell me what is important, I can read an arbitrary newspaper if I want filtered content.


I wonder how they test it.

I've unfollowed all but a couple of my close friends, the stories that show up are inconsistent (some date all the way back to December 25th but will show up every now and then). Most of their "liking and commenting" activities show up in the news feed but not in the close friends list. It's a mess.


Unfollowing is freaking awesome. I unfollowed a bunch of my old college friends who "work from home" now and are caught up in MLM pyramid schemes selling beachbody, energy drinks, arbonne makeup and other MLM junk. It is awesome.

I actually wonder how popular "unfollowing" is and if facebook is worried about it, because everyone I know is psyched about the ability to do it!


They completely refresh the feed hiding previously visible posts on pretty much every page load to feed you as much content as possible. Noticed something else with the corner of your eye right before clicking? Too bad, it's now gone.


I think I managed to unfollow everyone except for a handful of "friends" on Facebook. End of 2015 I finally unfollowed Facebook by deactivating my account. It really did not provide anything useful for me in retrospect, so it had to go.


A lengthy, convoluted article that concludes "It would be premature to declare the age of the algorithm over before it really began". No shit. For those wondering whether or not to read it, I'd say it's not really worth your time as it lays out pretty obvious difficulties in finding what to add to an individual's news feed, but comes up with really weird "conclusions" throughout.


I have unfollowed all but about 3-5 people on Facebook. It's pretty great. It's turned down the junk, but I miss out on stuff so much more often now. Oh well. The alternative is worse for me, and it makes me seek out real interactions with my network instead. That's a huge win for me. Facebook could win back some of my time by allowing me unfollow topics or other entities, across my timeline.

I LOVE some of my friends, but I hate 99% of any post on the NFL. I'll certainly never seek it out. I unfollow people because it's just so frustrating to start to dislike the person ranting about something I don't care about, just because Facebook isn't smart enough to understand how human relationships work. In real life, I can tell that person, "Look, I love you, but you've got to stop talking about the NFL around me! You're showing me you're not listening to me or valuing me as a person by doing so..." And that's what Facebook is not doing: valuing me as a person. So, I unfollow everyone; the NFL is just one example.


Facebook timeline change late 2011/early 2012 was catastrophic. It rendered Facebook useless to me. Before you could browse the timeline page in linear order (ordered by date descending) - no filtering, no bullshit - it was perfect. Now you see only certain posts of your friends that Facebook thinks might be interesting for you. Very bad change.


> “Sometimes” isn’t the success rate you might expect for such a vaunted and feared bit of code.

... only if you don't understand machine learning.


Somewhat related: Today, I noticed that the vast majority of the articles on my news feed are "X liked/commented on Y's post" where Y is someone I don't know and the post isn't very good. I hope this is only a temporary change, but I installed a Chrome extension to filter these out <_<


Or, worse, it's a thought-provoking article and you want to reply to a comment but can't.


a TL;DR would be strongly appreciated, the first page is basically: .... bla bla .... went to the toilet ...


You can stop reading at the second paragraph which has your TL;DR "No one outside Facebook knows for sure how it does this, and no one inside the company will tell you." but it is an interesting article so maybe give it another shot.

Bottom line is that it constantly changes just like Google's algorithms for search change, and if you find one person to explain it to you correctly one day they will likely have it wrong next week.


This was a pretty interesting article but as a sports fan I got distracted by the dig at Deflategate. Especially since the author not only mixed his sports metaphors (basketball to football) but also because it was an accusation scientifically proven to be untrue.

It wasn't even relevant to the article really but stuff like that takes you out of it and you lose interest.


Yeah I'm a fan of the pats too.


I have again started to use Facebook since last few months. So I never see anything that I want to see. What surprises me is I always see exactly everything I don't want to see.

I get people in friend suggestions that I must have removed (clicking on that "remove" button) like half dozens of times and they keep coming. I get stories that are not at all relevant to my taste, search history (even on other sites - assuming Fb tracks me anyway even with uBlock Origin) or anything I can attribute it to. I get page and group suggestions are ridiculously tangential to me as a person. I hide a story and I hide many similar stories and at times I also mark them spam, report but I still get more similar stories. Then they have some kind of limit on the number of posts/stories shown to you. At times, that limit seems to be like as low as 4-5 stories, sometimes more. This is very random. Then there is this completely irrelevant being shown to me throughout the week. Also, posts that I hide pop up again. I've not checked whether it happens all the time.

Then one day I decided to check my friend's walls (the ones whom I have not unfollowed) and evaluate what I am actually seeing. Well, there were many text status updates that I would have loved to see, many nice photo shares, very few article shares (for some reason articles shared on Fb are not really the brightest imho), decent rants, some excellent political remark, most of these posts were recent and usually latest post on those walls, but guess what - they were not shown to me. I was shown posts that would force me to unfollow more friends and force me to close the Facebook tab a lot quicker than I might have otherwise. I guess maybe that's a good thing.

As for this Slate article, felt like a paid PR piece.

> No one outside Facebook knows for sure how it does this, and no one inside the company will tell you.

Yeah, I guess, from an end user point of view, no one on the inside knows it either.


I wonder is PageRank was applied instead how well would that work.

As for recommendation algorithms, I still believe Last.fm is one of the best around, so there might be something to learn from those guys.


Funny how they casually throw in the fact that facebook knows how much time you spend on an article.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: