back
307 comments
Banning hate communities does work though [0]. I assume that the results are similar for twitter and facebook. "Hateful" Reddit or FB communities also don't allow "free speech". The moderators will ban people who go against the grain. There is no free exchange of ideas or disputing as if you're going against the grain you'll just get banned from that community (but not the platform). As such, either the platforms allow the hateful communities to just exist in their 'safe space silo' or they de-platform them.

[0] http://comp.social.gatech.edu/papers/cscw18-chand-hate.pdf

I'm being censored on Reddit myself.

I'm not really sure why exactly. I suspect it has to do with having a NSFW tag on my account (that I didn't put there) that I'm afraid to turn off, because of the warning that's next to that button and it doesn't explain what "swearing" is exactly and if I turn it off and write "fuck" I might get banned.

My account provides a lot of help to other people, it's highly valued by the community, I have loads of karma, I've paid for quite a bit of server time by the rewards I've received.

But you can't search on my username, it won't show up (not even if you have NSFW visibility turned on).

I'm not about politics, or covid or any hate stuff. I'm just there to try and help people with depression, anxiety and other issues. And I'm being censored for some reason.

So whatever they're doing, it's guaranteed to overreach and it's counter productive and who knows how much damage it does to society as a whole.

It's just that no one knows the severity of the damage the censorship does.

Define 'works'. This subject is an easy one in which to conflate goals. The goals of the platform are different than the goals of the public, lawmakers, etc. which is what the article is about.

The goal of the platform is to pull in more users. Having less abusive language and users is a means to that end, as is appeasing general public outcries for more moderation.

The goal of the public and lawmakers is, hopefully, more effective and meaningful discourse.

The paper you link measure for the prior outcome, not the latter.

Edit: Just to comment on the outcome you are referring to though, I don't believe the bans actually lead to more meaningful and effective discourse on Reddit. I don't even thing it lead to more civil discourse. You can click on literally any politically sensitive topic on the front page and you'll find that almost all the top comments both lean in a specific direction (diversity of discourse is terrible) and the deride anyone who disagrees. Maybe they use the 'F' word less, and no one is using the 'N' word anymore, but it is very obvious that it has become a strongly homogenized platform that doesn't welcome nuanced opinions.

Sure it worked at reducing hate speech on reddit, but is that the right objective? It's not implausible to think that the resentment from such local measures could cause hate to increase in a more global sense. Kind of like entropy in thermodynamics: local work can reduce local entropy, but at the expense of causing a global increase in entropy.

If the real objective should be a global decrease in hate, then maybe local suppression/exile might not be the right mechanism.

> http://comp.social.gatech.edu/papers/cscw18-chand-hate.pdf

This paper is trash. On defining hate speech, "we focus on textual content that is distinctively characteristic of these forums", so, yes, banning specific subreddits resulted in less of that content in the overall Reddit. Did it make Reddit a more friendly place? Probably not as tensions have never been higher.

Also important to note that Reddit doesn't ban hate. They ban unpopular opinions. If you want to see hate, go to r/politics.
> Banning hate communities does work though [0]

That's like saying banning smoking in the park reduces smoking because nobody's smoking in the park any more.

To be clear, the study found that platforms banning topics succeeds in removing those topics from the platform - not necessarily from society as a whole. The study did not conclude that banning hateful communities off of reddit actually made those users less hateful or curbed the spread of hateful content online. If each of those banned users subsequently posted twice as much hateful content on a different platform, that still comports with the conclusions of that study.
there's at least one major reason to be skeptical of that result, and they mention it in their limitations section.

what they did was create a lexicon of hate speech terms from two large subs that were banned. they then counted the frequency of those terms in other subs after the ban. they found that usage of those terms dropped substantially, and concluded that the bans were effective at reducing hate speech.

if you're familiar with the dynamics of these sorts of subs, the problem with this approach should be fairly obvious. these subs tend to develop their own set of specific terms/memes (hate-related or otherwise). it may be the case that the bans were effective at reducing hate speech across the whole site. but it's also possible that the same people are still posting the same stuff coded differently. this study is far from the final word on the matter.

Yes, reforming users who already want to engage in hate speech is not the goal; isolation is. Look at the pre-internet times, certain forms of radicalization were far less common than they are today because they aren't very present in the in-person community (while those that WERE geographically concentrated, like racism in certain American communities, were still spread in those places).

When the status quo is bad, "maybe that won't work" is not an effective argument against taking action anyway if you don't have a better idea. If we don't take action, we already know we're going to (continue to) have a bad result!

The exact same is true for political communities that aren't declared as a hate communities. So no, banning hate does not work. It does work if you define work as this study did, which has problems to say the least.

Today reddit is even more hateful than before, although that is a subjective meassure, but 5-10 years ago you at least had standards to not wish death on people you disagree with for the most part. There were exceptions, today it is very common.

I would argue the study is wrong.

They're measuring success based on referencing the community they just banned people from, aren't they?
Then r/politics should be banned but it's one of the biggest subreddits instead.
Neither of your assertions are related to what is being discussed. Nuclear bombs "work" and bad people would do horrible things with them, but that doesn't say anything about if we should use them.
If all "legitimate" platforms ban hate speech, then users wanting to engage in hate speech will all go to some platform that radically allows all speech with disproportionately this undesirable speech. They will intermingle disproportionately with those spreading sexual abuse images, drugs, insurgent propaganda and instructional material, and other undesirable material. Facebook likely makes the problem worse by forcing these "hate speech" and "disinformation users" to be completely surrounded by people with repulsive content, instead of having their repulsive content critiqued and shamed by other users.

Having people with bad, hateful ideas out in the open I would argue is preferable to concentrating all these bad thoughts together with people that will reinforce that it is normal.

>"Hateful" Reddit or FB communities also don't allow "free speech". The moderators will ban people who go against the grain.

Which is fine I think, but why have Reddit or FB do the censoring (aside from things that are outright illegal). I don't much care if a bunch of Nazis or tankies are busy planning world domination on Reddit while sharing recipes. Why do you care?

> Banning hate communities does work though ...

The sentence is incomplete. Banning X communities does work to achieve the goal of people not talking about X. I don't think that your linked study is really necessary, the Chinese cultural revolution worked really well (to achieve the goal of "preserving Chinese communism") [0]. Imagine if 30 years ago large digital monopolies banned what was considered unmentionable back then. I doubt gay marriage would have been legalised in America. All of the progress that we have in making marijuana more legal would have been terminated by the companies wanting to prevent people advocating illegal drug usage.

[0] https://en.wikipedia.org/wiki/Cultural_Revolution

> Banning hate communities does work though

According to a single study. In general I don't think it actually does. Making it harder to find is sufficient, banning it outright just proves their point and pulls additional moderates to their cause.

Some of the comments in this thread seem intentionally bad-faith or ignorant to how much hate and abuse actually exists on these platforms. The Internet fucking sucks. I stopped using social media because I'm trans and I don't feel like there's a place for me online anymore. No matter where I go, including large platforms like Reddit and Twitter, I'm inevitably subjected to someone expressing their grievances about trans people or the LGBTQ community. There's a part of me that wants to reply and give my perspective, but it's like I can't even have a voice online without the fear of people belittling and harassing me, sending me abusive messages, trying to doxx me, telling me to kill myself or scouring through my profile to try to find whatever they can add to their "cringe compilation" or Kiwifarms thread about how degenerate and disgusting trans people are. My mental health is more important than participating in the shitfest that is online discourse so I just avoid it. I post on Hacker News and a few other places where people are generally respectful, but other than that I've given up on having conversations with strangers online.

I'm an artist and a software dev, I have a lot that I want to share with the world but I don't think I'll ever get the chance to. This world is cruel and these online platforms and social media algorithms amplify that to the point where it feels like the only way to win the game is to not play. Personally, I don't feel one way or the other about online censorship at this point. I think social media has ironically ushered in a culture of anti-social behavior and maybe it's time to move on to something else.

FWIW r/actuallesbians is extremely supportive towards trans women. (I don't know subreddits for trans men) But even then, abusive PMs are still a problem.
LGBT has become political not to the preference of a lot of its members. But the flag has become a political instrument for signaling. Abused against, I guess.
The irony of private platforms censoring hate groups (for their own PR I might add; let's not forget that YouTube's algorithm famously favors alt-right content because weirdly enough algorithms that favor "engagement" tend to end up favoring lowest common denominator populist reactionary politics) is that it 1). Legitimizes the claims of groups that otherwise might sound like delusional paranoid conspiracy theorists, and 2). Forces these groups to adopt decentralized alternatives that make them even harder to do anything about. Tech companies engaging in performative content moderation is really just creating selection pressure that will ultimately create more resilient, technically competent hate groups that will also have an increasingly legitimate case to make for being persecuted by powerful organizations.
It might, but that's a bit like saying "fixing security holes will just make hackers resort to trickier tricks to crack systems."

Quite possibly. And we want to put the burden of labor on them to do so, instead of operate in a world where the rule is "Don't use the internet; hackers will steal all your data."

2020-2021 has shown me that most people happen to be 'fair weather fans' of civil rights. Everyone claims to love free speech but when suppression of speech opposing their own worldview comes into play, they suddenly dither and fall back on other rationalizations to justify the censorship.

Well, it's not free speech being violated when it's 'hate speech'. Well, it's not free speech being violated when it's 'misinformation'. Well, it's not free speech being violated when it's a private company doing the censorship. Et cetera. I'm sure you've seen you're own examples of this.

It's pretty disheartening, but enlightening nonetheless. I have a much better understanding of historical moral panics and cessions of freedoms. Whereas I used to wonder how some societies ever gave into such pressures, I now realize it's not that hard to persuade the average citizen into accepting such things.

What free speech advocates ignore here is that even they generally draw a line somewhere. Death threats, defamation, pedophilia, sharing bomb making materials etc are usually accepted by everyone to not be acceptable.

'But those are different' is usually the argument here. But why though? Because they cause harm? Doesn't inciting racial hatred cause harm?

Once we stop arguing over the issue being black/white but instead discuss _where exactly_ we draw the line then I think we are finally having a far more honest discussion. Just because some speech is illegal and other speech isn't illegal shouldn't be the deciding factor on whether someone (or some company) needs to platform that view. That's then leaving it to governments to decide what is ok and what isn't, instead leave it to society to choose not to propogate hateful and distasteful messages.

I also find it frustrating that some armchair psychologists have decided that people like me with more nuanced views simply want to repress and censor things that we disagree with which is not what it's about at all.

Although I don't fundamentally disagree with your point, I don't think you're framing the issue fairly. It's not a matter of most people being enemies of free speech, it's just that this is an inherently difficult problem. Everyone draws the line differently on what's acceptable and what isn't, and every platform is trying to foster a different kind of community.
>I have a much better understanding of historical moral panics and cessions of freedoms. Whereas I used to wonder how some societies ever gave into such pressures, I now realize it's not that hard to persuade the average citizen into accepting such things.

Me too. I've always wonders what drives people into the arms of fascists and other such overtly unpleasant belief systems and the simple answer is fear. Fear for yourself, your family, and your future will apparently cause people to abandon all sorts of supposedly cherished beliefs.

This is why I think here in the UK SAGE's SPI-B group using behavioural psychology to increase the perception of personal threat as part of the anti-coronavirus measures was such a dangerous and short-sighted policy. Using fear might be a convenient way to convince people into doing what you want for a while, but fear also drives people into the welcoming arms of all kinds of nasty ideologies. That cat's out of the bag now too, I suspect using fear to "nudge" the public into doing what the government of the day wants will become a much more common feature of liberal democracies in the future now. We've done a deal with the devil and he always collects in the end.

The last few years have shown me how many people are willing to believe utterly stupid things, and how easy it is to make people turn against each other. I knew this in the abstract, but watching it happen in real time is something else.

The human mind (myself included) has some serious bugs, and "we" as a society - with help from technology - are getting better and better at exploiting these bugs at scale. I don't think censorship is a solution, but I don't know what IS a solution.

Incidentally, what happened to FUD (Fear, Uncertainty, Doubt)? I miss that term, and I think it's much more descriptive of what we're seeing these days than the more vague "misinformation".

> 2020-2021 has shown me that most people happen to be 'fair weather fans' of civil rights.

A close read of the constitution itself shows that this has been the case since the very founding of the united states.

> The Privilege of the Writ of Habeas Corpus shall not be suspended, unless when in Cases of Rebellion or Invasion the public Safety may require it.

I'm super tired of people conflating civil rights + first amendment protections with the idea that speech anywhere, by anyone, on any platform, deserves to be protected.

The goal of the first amendment is to protect the citizens of America from laws created by congress / government in limiting speech. That is nowhere near what we are talking about when we're talking about _any_ speech conducted on a private platform.

In fact, it's interesting to me that the argument has recently been spun around such that some politicians are claiming that social platforms are violating their first amendment rights by blocking or banning. This has nothing to do with the intent or language of the first amendment.

In my mind, you can be the most fervent civil rights advocate and still believe that Twitter/Facebook/etc can ban anyone they want for any reason. Even more so if you believe in free enterprise and the rights of a business to act in the way that they best see fit.

I understand that platform bans have more implications and repercussions than I'm outlining here in simple terms but still the conflation is frustrating to me.

IMO, if the government isn't using the extraordinary power's granted to them (search, seizure, arrests, fines, imprisonment, etc) against it's citizens strictly for the words they say or write, "free speech" hasn't been violated and it would be incorrect to use the term in that context.

I think even a government hosted forum could filter content without violating even the spirit of "free speech", and I'm pretty sure it wouldn't legally be considered a violation of the first amendment, even if that filtering reached blatant censorship levels.

Censorship, government or private, is a separate concern from freedom of speech, and using one to make arguments about the other doesn't make any sense to me.

> 2020-2021 has shown me that most people happen to be 'fair weather fans' of civil rights.

This is always how it's worked. The idea that protecting the rights of your enemies can be salutary relies on too many complex concepts for the majority of people to have any hope of grasping it: burning the commons, collective action, norm evolution, meta-level thinking[1], modeling counterfactual worlds (eg one a future where your favored ideology is not dominant and is in need of the protections you are currently burning down).

The average person is nowhere near smart enough to be able to put these pieces together into a coherent worldview, let alone one that they find more convincing than "they're the enemy, crush them". The periods where liberalism has been resurgent are not ones where the masses are suddenly enlightened, but ones in which they either have little power or are pacified by unrelated conditions. This is not unlike the conditions in which dictatorships are stable, as the common thread is simply "the masses can't or don't care in detail about the fundamentals of the way they're governed". It's not a coincidence that the global illiberalism surge coincides with the rise of universal connectivity: On top of the social and economic upheaval that it induced, suddenly large amounts of people can coordinate epistemically, through hashtags and reshares, without making their way through distribution chokepoints controlled by elites.

[1] I couldn't think of a concise way to phrase this, but I'm referring to the tendency to claim that a big chunk of your beliefs/preferences are incontrovertible and fundamental tenets of society while others' are simply their beliefs and preferences.

I had the same realism about secularism when a catholic became head of the big secularist-leaning party in my then county of residence. People were sure interested in his private feelings about sinfulness, or said that they would never vote for a party with a religious leader. The party angled itself as secularist, but that particular kerfuffle revealed it to be a highly contingent value of the membership (and of people generally).

It's good to know what people really care about, and what beliefs are negotiable.

Yeah, most people tend to get squidgy about abstracts like "free speech" when the crazies come out of the woodwork and start calling for treason, mass deaths, and so on.
What changed in 2020? Do you not remember the Dixie Chicks getting blacklisted for speaking against George Bush, Janet Jackson being deplatformed from record labels for showing a nipple on television, the LA DNC in 2000 cordoning off protesters into "free speech zones" 4 blocks away from the convention, gangsta rap and heavy metal being censored in the 80s and 90s, pushes for civil rights being met with dogs and firehoses in the 60s, Lenny Bruce being imprisoned for stand up comedy, interracial marriage being illegal, teachers being fired for being gay, American citizens having all of their property confiscated because they were ethnically Japanese? We had anti-sedition laws passed within 22 years of the Constitution being ratified.

Most of these things that aren't a matter of private freedom of association for platform owners tend to eventually get struck down because the Supreme Court can somewhat reliably be counted on to eventually respect the Constitution, but the general public and elected politicians have never supported free speech or free anything. I would say almost the exact opposite of what you said. People only claim to love free speech when something they want to say is unpopular or suppressed. Almost nobody just supports it generally. The ACLU used to be pretty reliable about this, i.e. defending the KKK and Nazis, but I'm not even really sure where they stand any more.

The average citizen doesn't give a crap about any abstract ideals at all. They just want to live their lives and possibly raise a family in an atmosphere not dissonant with their own cultural traditions and beliefs. Allowing people with other traditions and beliefs to spread those via public advocacy, art, or any other means that may lead to them being mainstream or even dominant is antithetical to that.

the lesson here should be that we're not really much different from our ancestors of 5-50k years ago and because of that, concentrations of power (and by extension, influence) are inherently dangerous. leaders with too much power will inevitably make mistakes, and keeping institutions limited and focused means the harms from those mistakes are limited in scope.

in government, that means extending federalism: smaller governing bodies loosely federated (primarily for mutual protection and interrelational fairness). in business, it means truly competitive (and fair) markets with diverse participants, not oligarcal ones (like these platforms).

100% of everything you said I agree with. We're in a downright recession on freedoms.

"I now realize it's not that hard to persuade the average citizen into accepting such things."

Yes, and worse I feel it's not even that people are all too willing to go along with these things from on high, they want it, they propagate it. I'm starting to see the same behavior and mentality I imagine was common in East German where citizens police other citizens. It's not a good direction we're in at all.

Ironic that this is from the EFF, who were happy to dogpile on RMS when he said some things that some people took offense to [1]. Just like private censorship, trying to cancel someone is not the best to fight hate.

[1]: https://www.eff.org/deeplinks/2021/03/statement-re-election-...

I am wary of the situation developing.

But I'm also wary of this idea that "well you just give the people tools to sort it out".

Mostly because:

1. It seems unrealistic as expecting people to peruse their own source code... That's a huge pain in the ass for most folks and they're just as likely to pick a bad filter or service to do that for them anyway.

2. Did that change anything about how a situation where GoDaddy and Google refused to manage the domain registration for the Daily Stormer?

I don't think it did....

Aren't we back at the start with these suggestions?

> Anonymity and pseudonymity have played important roles throughout history, from secret ballots in ancient Greece to 18th century English literature and early American satire.

Sorry, I think anonymity is valuable in the world we find ourselves, but to suggest it was prevalent more than a few decades ago is really stretching things. Yes there are examples, but ordinary people just wouldn't do it. Now, to have say an email which is your actual name is a rarity even if you wanted it.

Facebook, YouTube, and Twitter all suggest this content to people.

Anything they do passed this point is just them trying to cover up the fact that they pushed extremism onto the world.

Private networks need censorship, or their userbase will implicitly censor people by harassing, intimidating and threatening them.

“Free speech” is an overused buzzword. Anyone can say or write whatever they want privately, and most can talk freely to their friends and family. Your voice will never reach most people unless it’s popular, because there are many voices and people have limited time and attention. There are plenty of free speech networks today but most people aren’t on them, because most people don’t want free speech.

Harmful speech and misinformation should not have a platform.
The cia wants big tech monopolies because we are in direct competition with China. Mimetic desire to be dominant great power. But the problem is monopolies suck. They stifle innovation and make the culture sluggish and less dynamic. Where do we go from here? Probably some new great power emerges that allows true freedom and fosters bottom up innovation. I just wonder where that will come from.
It's not so simple as whether or not a platform allows content of a certain type from certain authors to be published on their platform. It's also about whether the platform is pushing that content to others, using automated tools which have been tuned to improve "engagement". That's some of the Facebook research which was suppressed until the Wall Street Journal published the leaks from that research. Facebook apparently knew that changes they made were allowing posts that made people more angry to get surfaced more, because angry people were more likely to comment on the posts, thus improving "engagement". No matter if it caused disinformation to be spread, or if it made people more angry, or negatively impacted the mental health of teenagers. It improved "enagement" and thus $$$ to Facebook shareholders.

This is also why there may be a problem with the truism "the best way to counter bad speech is by allowing more speech". Well, what if the engagement algorithsm cause the bad speech to get amplified 1000x more than the speech which has objectively verifiable truth claims? Free speach assumes that truth and lies would be treated more or less equally --- but that's not necessarily true on modern platforms.

So it's not only a question of whether people have the "right" to publish whatever they want on a platform. Sure, you can stand on a public street corner and rant and rave about whatever you want, including "stop the steal", or "the world is about to end". But you don't have the right to do that with an amplifier which causes your speech to blare out at 100 decibels. Similarly, platforms might want to _not_ amplify certain pieces of content that are killing people by spreading misinformation, or destroying democracy, or encouraging genocide. And that might very well be the best thing platforms can do.

But now we have the problem that content can be shared across platforms. So even if one platform doesn't cause information about vaccines causing swollen testicles from showing up on millions and millions of News Feeds --- what if that same information, posted on one platform, is shared on another platform which is much less scrupulous?

So for example, suppose platform Y decided not to amplify videos that they decided was scientifically incorrect, because they didn't want to have the moral stain of aiding and betting people from killing themselves by not being vaccinated, or not allowing their children from being vaccinated. But another platform, platform F, which had done the research indicating this would happen, but actively decided that $$$ was more important than silly things like ethics or destroying democracy, might promote content that by linking to videos being posted on Platform Y. Maybe the best thing Platform Y could do would be to remove those videos from their platform, since even though they were no longer amplifying that information, it was being amplified by another platform?

Interesting document linked to from the article:

https://manilaprinciples.org/

Anyone notice that liberal democracy seems to have a strong reliance on illiberalism to maintain its stronghold?