1. Binning skepticism with negativity.
2. Not allowing for a "neutral" category.
The comment I'm writing right now is critical, but is it "negative?" I certainly don't mean it that way.
It's cool that OP made this thing. The data is nicely presented, and the conclusion is articulated cleanly, and that's precisely why I'm able to build a criticism of it!
And I'm now realizing that I don't normally feel the need to disclaim my criticism by complimenting the OP's quality work. Maybe I should do that more. Or, maybe my engagement with the material implies that I found it engaging. Hmm.
On the neutral category: the model outputs continuous scores from 0 to 1, so neutrality does exist around 0.5. The bimodal distribution with peaks at roughly 0.0 and 0.95 reflects how HN users tend toward strong evaluative positions. Three-class models could provide additional perspective, and that's worth exploring in future work.
Also love your meta-observation. Imo your comment is critical, substantive, and engaging. By sentiment metrics it's "negative," but functionally it's high-quality discourse. But that's exactly how I read the data: HN's negativity is constructive critique that drives engagement, not hostility.
https://huggingface.co/distilbert/distilbert-base-uncased-fi...
While engineers, especially those that like to share knowledge and open source solutions are far more critical of monetizing products.
Overall HN doesn't lack criticism, since there many technically minded people around. But I like the mix to be honest and agree that skepticism is often seen as simple negativity. Sure, you probably don't want to advertise your product as "pretty decent, but there are numerous better theoretical solutions".
Would one say: nice attempt trying to tell people how they are supposed to feel around here?
I've never done any sentiment analysis outside of hobby tinkering. Maybe there is some HN experts that will chime in on how to deal with it?
It's a matter of perspective. The OP is a negative post. You are negative about it. Therefore, you have made a positive post.
But that 35 as an average score is hard for me to believe at first, I mean, the median HN post gets no votes, last time I looked the mean was around 8 or so. What is he sampling from?
[1] comments/votes = 0.5 is close to the mean
Not that karam matters on HN but I have been disappointed to see longer comments that I put a lot of effort into get ignored while short, pithy comments get way more upvotes/replies. I've spent literally over an hour on some detailed comments that didn't even get a reply from the original person asking a question and likewise had comments I fired off with near-0 thought that "blow up". It's frustrating that better content is not always rewarded.
[0] Something I'm guilty of
If skepticism towards business announcements counts as negativity, I wonder what else we'd be discussing regarding any of those announcements.
An OpenAI marketing piece for instance will already go overboard on the positive side, I don't see relevant commentary being about how it's even better than the piece touts it. Commenting just to say "wow, that's great" or paraphrasing the piece is also useless and thrown upon. At best it would be a factual explanation or expansion of some harder to parse or specialized bits ?
I read the pre published PDF but don't really see stand what we were supposed to take from this blog post in particular.
Aldo am I basically fullfiling the blog post prophecy ?
PS: I think articles that raise to the top page with absolutely no comments would be an example of people straight enjoying the content, and the site actually working great IMHO
In other words, if 35% of hn content is positive (or neutral?), compared to reddit and most mainstream social media, it's actually very positive!
Edit: I found the list of blocked subreddits if anyone is curious to see:
https://hlnet.neocities.org/RIF_filters_categorized.txt
Note that it also includes stuff I wasn't interested in at the time, like anime, and only has subreddits up until I quit, around the API ban.
As with most things, the devil’s in the details. There are plenty of ways to express criticism without descending to personal attacks. I’ve also noticed that when the cynicism/criticism-o-meter runs too high, there’s almost always a top-level meta comment complaining about the complaining.
Personally I’d rather someone tell me I have a piece of food stuck in my teeth than shower me with praise.
As an ESL person one of the first internet-related terms I learned was "flamewar".
EDIT: ESL -> English as a Second Language
> ... we observe extreme inequality in attention distribution. The Gini coefficient of 0.89 places HN among the most unequal attention economies documented in the literature. For comparison, Zhu & Lerman (2016) reported Gini co-efficients of 0.68–0.86 across Twitter metrics. ... The bottom 80% of posts [on HN] receive less than 10% of total upvotes. (https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5910263)
This could probably be explained by HN's unique exposure mechanism. Every post starts on /newest and unless it gets picked up by the smaller group of users who browse /newest, it never reaches the front page where the main audience is. In most forums/subreddits by contrast a new post (unless it gets flagged as spam) usually gets some baseline exposure with the main audience before it sinks. On HN the main audience is downstream of an early gate and missing that gate is close to being effectively invisible. IMO this fact alone could probably explain why "attention inequality" seems more extreme on HN.
My usual journey: I visit the comment section and then look for the first top comment that criticizes the core thesis of the article.
In my neighborhood an electrical power outage is news; but yet another day of consistent electrical power supply is not news. But taking a step back, I think it is noteworthy! It makes my life better every day, and compared to the vast sweep of human history, it’s a huge positive anomaly. My life is full of stuff like this, as I suspect the lives are of many HNers.
I say this because while I do value news reporting and knowing what’s wrong or could be better, I also try hard to maintain this broader awareness of what’s (still) positive and going well. Even if its consistency makes it seem unremarkable on short time scales like the daily news cycle.
We need to do something and are working on it. The challenge is to distinguish thoughtful critique from negativity-venting. The former is fine, the latter is lame. HN has a lot of the latter.
I believe it has to do with macro trends (in society at large and on the internet), which we can't expect to be immune from—but also with the community here getting insular. That scares and worries me, because HN won't survive over the long haul if new cohorts of users don't keep showing up. Along with that, there seem to be increased waves of jadedness, bitterness, and cynicism that use this place as a dumping ground for bad feelings.
That's a bad dynamic. The more it happens, the more it encourages more of it. Meanwhile, people who don't enjoy jaded, bitter, or denunciatory rhetoric are incentivized to leave: a classic vicious circle.
This is why we added the following to https://news.ycombinator.com/newsguidelines.html last year: Don't be curmudgeonly. Thoughtful criticism is fine, but please don't be rigidly or generically negative.
You'll probably see more statements from us about this in 2026, and hopefully some changes to HN, as we try to do something about it.
Not a panacea, and I'd be interested to hear others ideas on how to better comment and give feedback.
Rather a lot of what is said in any given social circle has to do with complaining. It's very common for people to point out something that is viewed as bad by everyone. Then the group commiserates and bonds over that. Even though an AI might consider such complaints negative, there might be a positive effect on people feeling heard and supported by a like-minded group.
For this reason, I'd take OP's results with a modicum of salt. Human interaction doesn't have to be all rainbows and unicorns to have a positive psychological impact. As with in-person interactions, I suspect a significant portion of what OP's LLM's described as negative might just be humans bonding through complaint among peers.
That is the key takeaway. If critique is scored as negative, then there is nothing wrong with HN being "negative". Analysis and critical response to new ideas, tech, and products is a good thing, so I believe we should be responding positively to a report that says we apply negativity in productive ways.
Given that, it seems that there is basically zero agreement between DistilBERT and the other models..... In fact even worse they disagree to the extreme with some saying the most positive score is the most negative score.... (even acounting for the inverted scale in results 2-6).
If I respond to an article about open-source with “open-source is good”, article about privacy with “privacy is good” etc. with a basic justification and slightly fancier words, I’ll almost surely get upvotes. But I see those opinions on this site practically every day.
I wish people would instead upvote posts and comments with uncommon knowledge and opinions. I do see the former: cool projects and “fun facts” (e.g. an article about the cultural history of an isolated small region) are constantly on the front page and in top comments. But the latter are only in /new and further down comments.
This.. doesn't sound negative to me, at least in how I'd use the word. Substantive critiques and skepticism?
Geez I guess even this very comment would be considered negative because I'm critiquing what they wrote. Amazing post! I absolutely agree! Well done!
But afterwards I'm glad I did, after a month comments can't really haunt you anymore, because they exist in the past.
I'd much rather live in a critical world than a "wholesome" world that ends up being an echochamber
> It's human nature: https://en.wikipedia.org/wiki/Negativity_bias. Everyone does it, but we perceive other people as doing it more than we do, which is itself a variation of the bias. You can even see it in the title of the OP, in the word "overwhelmingly". That's excessive: the negative bias is noticeable, but if you look closely, it's not overwhelming. (To make up some numbers, it's more like 60-40, not 90-10.)
However, it often feels as if it is overwhelming; in fact, one or two datapoints, plus negativity bias, are enough to create just such a feeling. The feeling gets expressed in ways that trigger similar feelings in other people, so we end up with a positive* feedback loop.
The interesting question is, what factors mitigate this? how do we dampen negativity bias? or, how do we get negative feedback into our positive feedback loop of negative affect? That must also be happening all the time, or we'd be in a "war of all against all", which isn't the case, though (again) it may feel like it.
* ['positive' in the sense of increasing; a positive loop of negative affect!]
See also:
Even in terms of language, if a USian says "great!", they mean passable, and "ok" means bad.
Imo this is the result of corporate culture being so prevalent it has leaked out into general culture.. The corporate world of bullshit, just be really positive towards your boss and pretend everything is great, all that matters is the hype and getting more investment this quarter.
Also, engineering types tend to be a lot more "negative" relative to those corporate business guys.. If you want to engineer something, and make it work, and actually do a good job, then you need to appraise things realistically and objectively, and you certainly need to point out stupid decisions and bad design.
- SST-2 (stanford sentiment test) example dataset from IMDB reviews https://huggingface.co/datasets/stanfordnlp/sst2/viewer
- BERT https://aclanthology.org/N19-1423/
- DistilBert -- the optimized model OP was using https://arxiv.org/pdf/1910.01108
SST-2 may have been used to train or qualify BERT -- read the papers to get the full story. I did a quick perusal.
It would be nice to have a nutritional label shared with Abstracts, showing the training data, with examples, and the base models.
- People with expertise / exceptional qualities are by definition out-numbered by the rest, so there must be privileged seats if you want quality to become represented.
- Social coherence requires turning lots of conversations into a few, again requiring fewer privileged seats to represent views efficiently and have conversations between well-informed people trusted by those they represent.
- Preventing runaway power feedback loops from reinforcing one single set of views requires that independent hierarchies can exist, which is pluralism.
https://positron.solutions/articles/hierarchy-elevates-socia...
Ironically, I suspect this article’s title would rightly be evaluated as negative in sentiment analysis.
I recall there being studies on financial loss vs gain, and that financial losses seem to effect emotions about 4x more than wins, so for an actual balanced algorithm, it would seem that positive posts should be boosted about 4-5x to have any chance of being surfaced on a modern social network. Given what we know about human psychology, sentiment boosts really should be a thing. Is anyone working on that?
https://corp.oup.com/news/the-oxford-word-of-the-year-2025-i...
Hmm... Technical critiques are very different from truly negative comments. I'm not sure they should be lumped together. Technical critiques are often interesting and useful.
In my experience, truly negative comments which don't meet the guidelines rarely appear on HN, and when they do appear, they tend to disappear very, very quickly, thanks to the moderators.
Similarly, how does inquisitive perform?
The definition above indicates "negative" may be a bit harsh as a term, it might be useful to see a split of that percentage between "unnecessary pushback" and "scrutiny".
This comment will of course count as negative - it could no doubt be more substantive and better written but hopefully it is understood in the latter sense.
They are either easily to classify as useless when they don’t provide reasoning or they provide useful insight to think about.
If often submit links to HN for that kind of feedback
But posting something positive and getting slammed in the comments? That's depressing. So the barrier to posting something positive seems higher.