Perhaps rather, if you pull up stakes every time someone else on the same platform announces they prefer grape jelly over strawberry (fucking animals!), pretty soon you're going to have N platforms for N people. Which I suppose is one possible Fediverse end-game: millions of individual platforms, federating and un-federating on a daily basis as people discover that someone they thought was cool actually voted for McCain in 2008.
Yes, if you carefully pare away every bit of context then it's true that nothing makes any sense.
In actual real life though it's not the difference between flavors of goddamn jelly, it's a serious moral concern for a lot of people.
Similarly it's not even a matter of forgiveness, or permanently staining someone's reputation over one action many years ago. These actions are ongoing and Rogan hasn't repented of them. If you believe they cause harm then you probably also believe they are currently causing ongoing harm. Which is a situation with different considerations than "someone did something bad a long time ago".