▲ 176 points
back
199 comments
> It’s much easier to say someone else’s job is going to be fully replaceable by AI when you don’t actually know what they do.
Too true. This isn't limited to AI, either. The most obvious example in my lifetime was during peak blockchain hype, when people who had never worked in finance convinced themselves that blockchain was going to act as the backbone for how money gets moved around. As if the problem that needing solving was Bank of America doesn't trust Capital One to update a number in their database.
The nice thing about AI, at least, is I can always push back and tell people, "Sure, we can do this with AI. I just need you to use Claude or ChatGPT manually to prototype how it would work." This normally results in the requestor realizing that there's human judgment calls involved in the inputs, process, or outputs that require meatbag intelligence.
Some of my coworkers will complain that management is short-sighted for trying to automate programming work they don't understand then immediately suggest we automate management because nobody knows what they do all day.
Maybe they're right, maybe not, but it is ironic.
>>fully replaceable by AI
I am trying to fathom a more catastrophic failure in communications than the lab CEO's using this narrative. The reality ends up being closer to Radiology jobs [1], but we're never able to fully realize this because the press is running around like headless chickens and unloading the fear on a public that then reaches for any leverage they can get (see: Datacenter NIMBY-ism).
Any short term FOMO valuation bumps they got from this narrative has to now be liquidated into paying premium for server racks in a warehouse.
Reminder folks: There is no evidence that AI is not normal technology [2]
[1]: https://www.apollo.com/wealth/insights-news/insights/daily-s...
[2]: https://knightcolumbia.org/content/ai-as-normal-technology
>> It’s much easier to say someone else’s job is going to be fully replaceable by AI when you don’t actually know what they do.
> Too true. This isn't limited to AI, either.
That's so true there's a term for it: engineer's disease/engineer's syndrome.
https://en.wiktionary.org/wiki/engineer%27s_disease
https://ask.metafilter.com/297591/Origin-of-the-term-Enginee...
The thing they didn’t want to say is that the problem is that Bank of America has legal reporting and compliance obligations.
On that one, they were right enough that there are an enormous number of businesses that use crypto to avoid something government related.
Anyone remember when YC declared they would replace Hollywood?
The AI researchers I know often say they expect the AI to replace their own jobs.
Yeah, ive seen the same thing in construction and agriculture. People take the most strikingly visible part of the job, try to automate it, then wonder why nobody wants to spend $1,000K buying the automation for the easiest and simplest and solved parts of the job.
"You don't got to frame walls anymore!", something that is the most enjoyable part of residential construction, takes like a day of work at most, and can be done while on autopilot. "We can instantly generate wall plans for stud location from top-down blueprints!", oh that thing people do in their head because they just space it all on 16 or 24 inch centers and it doesn't actually matter which side you start on? "We can wirelessly drive your tractors!", the easiest task on the farm which all the weeks of maintenance and planning and setup led up to?
Now don't get me wrong, there are many things that can be improved in those industries certainly, but you aren't going to know what those things are until you actually go on the job site and learn how they currently do it daily. Most all of the low hanging fruits have already been picked one way or another and a fancy step stool is not going to be industry changing.
> As if the problem that needing solving was Bank of America doesn't trust Capital One to update a number in their database.
As I understood it, the attraction of blockchain was more that the money could get moved around without Bank of America and Capital One knowing about it, and therefore without those financial institutions reporting the transactions to the government as they are required to by law. Which of course screams "money laundering" and "tax evasion" to the government. Yes, there are possible legitimate reasons for wanting to be able to move cash around anonymously and invisibly, but they're basically rounding error compared to the ones mentioned above.
In other words, blockchain on this view was a classic example of the old saying that you can't apply a technical solution to a social (or in this case political) problem.
This ship has sailed, they'll happily "prototype" the entire thing one-shot in 2-3 messages.
Every time I've done that, the people were so ignorant that they still didn't recognize that expert judgment was required... they just had the LLM make some slop.
> inputs, process, or outputs that require meatbag intelligence
Yeah but only because a meatbag is going to use the product :)
What the author is getting at here:
> Climbing Mount Everest and getting a PhD are both hard. I wouldn’t say that doing one means you can do the other “no problem.”
and here:
> Surgeons and electrical engineers may be extremely smart and accomplished, but that doesn’t mean they have the ability to weigh in on climate science.
Feels tangentially like a version of Nobel disease[0], discussed here[1] a couple of weeks ago.
---
Lookin at you, Terry Tao
I mean, in the meantime, the US president is weighing in on technical design decisions of aircraft carriers, and he has neither a PhD nor a Nobel Prize, so...
https://www.theguardian.com/us-news/2026/aug/13/trump-aircra...
Wait is this real? Did a random 25yo get 45B under management because he got some interviews after getting fired from OpenAI? I missed all of this and it almost seems like performance art to me.
Yes, it’s real, and the failure is much more about risk management than about having wrong fundamentals.
His fundamental thesis is as an AI maximalist, with expertise on who will be the winners.
His fund completely blew up, even though his fundamental thesis still may be correct.
He made a ton of money early, but then he just kept increasing his bet size via leverage. The problem is that these stocks may be going up, but they are EXTREMELY volatile. When the whole market went down with some of the Iran news, his margin levels dipped too low, and his lenders issued margin calls. He had to sell his stakes at losses, and his fund collapsed.
Now, part of the problem is he was not a legacy hedge fund with great relationships with his banks, because if he was, he might have been able to postpone the margin calls. Had he been able to do that, he would have been ok, because his positions actually recovered within a few weeks.
It didn’t matter, though, because he was forced to sell at the low point.
In other words, even if your long term bet is correct, if you are maxing out your margin to max out your bet, you are one volatile dip away from blowing up.
No matter how good the bet, you have to be able to ride out the volatility to survive.
It’s like if someone offered you a bet on a coin flip, where they will pay 5x your bet if you win. How much should you bet on each flip?
Well, by expected value you should bet everything you have, because your EV is 2.5x, so the more you bet the higher your expected value.
However, if you bet it all, you have a 50% chance of losing all your money and not being able to make any more bets.
Yes… and some folks gave him money. Per reporting from the NY Times he was broadly laughed out of the room with “East Coast” money which has a massive amount to invest but tends to hold a higher standard on where it goes. Per that reporting, the combination of a lack of experience and inability to give coherent answers to basic questions meant those folks stayed far away.
Regardless he was still able to build a giant pile of cash before alighting it on fire.
It's real. Obviously he's a pretty accomplished young guy, but that doesn't mean he knows anything about investments.
It's an interesting look into who gets opportunities in our society.
FWIW, I quite enjoyed this write up of it, and the state of AI investment at the moment. It doesn't entirely dwell on the blowup, but I found it worth the read:
https://xcancel.com/porterstansb/status/2083606266388029691
(I also enjoyed the meandering in to Amex and Wells & Fargo's founding stories)
Well it's not a random 25 year old. He became valedictorian at Columbia and graduated at 19. He was then briefly a part of OpenAI's superalignment team.
After he got fired, he wrote a 165 page thesis on AI in early 2024 that all ended up becoming true in 2026; you can read it for yourself and be the judge: https://situational-awareness.ai
That's what he based the fund on.
It's generational foresight not available to 99.999999999999999999% of 25 year olds. I want to get ahead of the default cynicism and "oh it's just dumb luck woe is me" aspect of HN.
>> Wait is this real? Did a random 25yo get 45B under management because he got some interviews after getting fired from OpenAI?
They though they would laugh all the way to the bank...but that laugh was already the problem...
"We Need To Talk About Leopold" - https://youtu.be/rE75WvOtcu8
And before OpenAI, he was at FTX.
Yeah. And he made good returns even after the downfall everyone was so gleeful about.
It's better than performance art, it's something you couldn't write.
There’s a tremendous amount of naivety on display by the big labs.
A bit of that is to be expected from any disrupter, but there’s now serious questions about if these startups have the basic competencies required to survive long term.
Does the actual outcome matter or does the promise/what is sold/pushed upon society matter?
Was social media a clean win for human social interaction? Was fast food the replacement of food that was promised in the 70s? Were doctors and shrinks in phone apps rather than real life a clean win for diagnosis, understanding and improvement of life?
But society was completely shaped by the market in these questions anyways in a way that is impossible to deny.
While the author might be right about the arrogant PhDs imposing their view on other fields they know jack shit about, it doesn't make it less true when you have billions backing it and making it a reality, it will eventually be it, even if it's arguably worse.
Working in AI was once reserved for intellectually gifted people. But with the recent advances in compute performance, working in AI today is basically not much different from pounding on a black box as long and as hard as necessary to make its output correspond to what you want it to be.
The worst materialization of this are the slew of startups that are going to “watch your employees work so they can learn their job” as if random clicks on a computer can be reversed engineered to automate someone’s job.
This sort of audacity is a large part of the reason people increasingly hate AI
This accurately describes a large portion of the people working in "tech", and it doesn't look to be getting better anytime soon.
The failure of an over-leveraged hedge fund run by someone with no investing background who was just regurgitating what other people have been saying does not mean that labor markets are going to survive. The author has intellectual arrogance of his own to consider.
> It’s much easier to say someone else’s job is going to be fully replaceable by AI when you don’t actually know what they do.
This exactly. As someone who once lived in Silicon Valley and then ended up interviewing 700+ CxO's of profitable (or nearly profitable) SaaS businesses in various domain specific fields, it amazes me how many prominent "experts" in SV believed they were consistently "right" simply because they made enough bets to eventually get one right. Maybe not in enterprise value terms, but in volume of companies there are FAR more successful and profitable SaaS businesses that you've never heard of because they were started by entrepreneurs in their respective domains (the MD who started an EHR platform or the truck driver who started a TMS solution, etc.).
Everyone has some sort of category error to an extent. But more than that, the part about safety guardrails really resonates with my experience. I inevitably have to go down to the low-level to inspect memory, but because of safety issues, I can barely use Codex as it keeps prompting me for 'trusted access.' AI is actually really good at catching bugs, so I'd love to use it, but it does this every single time...
They are going to run out of real world data very soon. AI labs need to hire non-cynical domain experts to build physical hardware/automation that can generate experimental data. They are hard to find though. Most domain experts are so tunneled-visioned within their own domain that they can't think outside of it.
This goes to show that everyone is an expert in a bull market, where everything you buy can go up. (until it doesn't)
Is this really 'when genius fails' or actually another 'we're very bad at identifying genius'?
It's a word that's thrown around a lot (particularly in tech) that rarely has much to back it up. Often, it seems to be used for 'confident young man', or even 'grifter', and then when the idol falls, the same people quietly focus on lionising someone new.
The same problem happens the other way around too. Many entrenched area think they can’t be disrupted.
It’s more important to keep an open mind, and readjust your assumptions regularly.
The intellectual arrogance of the AI labs is just the next from of intellectual arrogance from Silicon Valley. I've seen the exact same arrogance from everything in SV for the past 15 years; it's probably been going on longer, but I wasn't in a position to notice then
Obviously everyone likes the think "this time it's different" but with LLM's and AI it certainly seems to be the case.
Having a machine that's even as smart as most human's + cheap robotics, does seem to lead to us having no jobs in near-ish future eventually. (5-15 years)
Though obviously AI progress could hit a brick wall tomorrow.
Great read, though huggingface is French, not American
These hedge fund guys aren't dumb. They're just milking the boom while they can, even if they won't admit it to themselves.
Hedge funds often get 20% of the upside. Pocket it, and then when it goes bust just walk away with the money. Defend yourself by saying "everyone went bust that year."
Ahh well. Let them fail if it's so obvious they will. Let the financiers fail too since they're all so dumb.
There's idiocy and overconfidence everywhere. When more money is involved, I guess it's more entertaining to watch. At least they're trying something. Maybe there's more effective ways to fleece people of their money that yield greater societal benefits, but I think there's some beauty in someone thinking they have it all figured out being able to lose their money on a shitty bet.
Now once they cry for government help, that's where I care.
Let's just call it arrogance. There's nothing intellectual about it.
Are there any interesting predictions in this post that I need to pay attention to? Or is this just venting at how "annoying" tech bros are?
I just skimmed it, so I'm hoping someone with more fortitude can summarize.
This article is being downvote-brigaded HARD wherever it gets posted on the internet right now.
Interesting.