A laptop with an iGPU and loads of system RAM has the advantage of being able to use system ram in addition to VRAM to load models (assuming your gpu driver supports it, which most do afaik), so load up as much system RAM as you can. The downside is, the system RAM is less fast than dedicated GDDR5. These GPUs would be Radeon 890M and Intel Arc (previous generations are still decently good, if that's more affordable for you).
A laptop with a discrete GPU will not be able to load models as large directly to GPU, but with layer offloading and a quantized MoE model, you can still get quite fast performance with modern low-to-medium-sized models.
Do not get less than 32GB RAM for any machine, and max out the iGPU machine's RAM. Also try to get a bigass NVMe drive as you will likely be downloading a lot of big models, and should be using a VM with Docker containers, so all that adds up to steal away quite a bit of drive space.
Final thought: before you spend thousands on a machine, consider that there are at least a dozen companies that provide non-Anthropic/non-OpenAI models in the cloud, many of which are dirt cheap because of how fast and good open weights are now. Do the math before you purchase a machine; unless you are doing 24/7/365 inference, the cloud is fastly more cost effective.
That said, last time I tried local LLMs (around when gpt-oss came out) it still seemed super gimmicky (or at least niche, I could imagine privacy concerns would be a big deal for some). Very few use cases where you want an LLM but can't benefit immensely from using SOTA models like Claude Opus.
As much as I love owning my stack, you'd have to use so much of this to break even vs an inference provider/aggregator with open frontier-ish models. (and personally, I want to use as little as possible)
Also, because Apple in their infinite wisdom despite giving you a fan, very lazily turn it on (I swear it has to hit 100c before it comes on) and they give you zero control over fan settings, you may want to snag something like TG Pro for the Mac. I wound up buying a license for it, this lets you define at which temperature you want to run your fans and even gives you manual control.
On my 24G RAM Macbook Pro I have about 16GB of Inference. I use Zed with LM Studio as the back-end. I primarily just use Claude Code, but as you note, I'm sure if I used a beefier Mac with more RAM I could probably handle way more.
There's a few models that are interesting on the Mac with LM Studio that let you call tooling, so it can read your local files and write and such:
mistralai/mistralai-3-3b this one's 4.49GB - So I can increase my context window for it, not sure if it auto-compacts or not, have only just started testing it
zai-org/glm-4.6v-flash - This one is 7.09GB, same thing, only just started testing it.
mistralai/mistral-3-14b-reasoning - This one is 15.2GB just shy of the max, so not a TON of wiggle room, but usable.
If you're Apple or a company that builds things for Macs or other devices, please build something to help with airflow / cooling for the MBP / Mac Mini, it feels ridiculous that it becomes a 100c device I'm not so sure its great for device health if you want to use inference for longer than the norm.
I will probably buy a new Mac whenever the inference speeds increase at a dramatic enough rate. I sure hope Apple is considering serious options for increasing inference speed.
I've wanted to try some of the more recent 8B models for local tab completion or agentic, any experience with those kinds of smaller models?
I actually cancelled my ChatGPT subscription in late 2024 and documented the process, kind of as a social media thing because it had gotten so bad and I realized nobody in my family was using it anymore. I asked my wife if she was getting any use out of it and she told me she had been using Gemini and Grok for months because "GPT is very lazy now".
After a while another charge came in for the subscription, but I had the receipts: we had cancelled before the next billing cycle. I decided to try and reach out to OpenAI to resolve this, but they only let you chat with GPT itself for this, which it failed at and told me they weren't in the wrong and none of the information matched what actually happened.
I took this and used it to submit a chargeback request with Privacy.com, which I use for all of my online purchases. Normally I don't have to worry about this because I set a limit or cancel the cards I issue manually, but I had an OpenAI API account using the same card and I had been a bit lazy in using the same card for technically two different services.
Well, Privacy.com won that dispute and I got that money back. It's worth mentioning this is actually different than most banks will do now days. For the most part when you try to get a bank to do a chargeback they just roll it into their insurance and refund you the customer as a cost of doing business, but the actual scammer or shady merchant got to keep their stolen money, whereas I can be certain OpenAI didn't keep my money.
ETA: I've started an export of all my data. After that's done, I'm going to delete it all from my account (Settings > Data controls) and walk away from the account. I will give this to OpenAI, they make the process of disentangling yourself straightforward and there's integrity in that.
> Ok. So I'm cancelling the subscription to ChatGPT and moving over to Claude because of the news of OpenAI striking a deal with us department of war. (https://www.techradar.com/pro/openai-just-signed-a-huge-deal...) Please line out a good exit strategy where I can keep the information in my chats and projects on my own hard drive.
BTW, what's going to hurt their business more, deleting my account or using the free tier?
Sounds like it won't really be a pain for me though based off comments on HN indicating Claude is the better product and I doubt I personally would hit any sort of token limits with the amount I use agentic coding.
https://github.com/openai/codex/issues/26#issuecomment-28116...
Intelligence Cyber Wizard, mission is simple: help victims of cryptocurrency scams recover their digital assets and empower them with the knowledge to prevent future losses. How to Recover Lost Cryptocurrency If you’ve been scammed, act quickly and follow these professional steps: 1. Secure Your Remaining Assets Immediately transfer remaining funds to a new secure wallet. Enable two-factor authentication (2FA) on all exchanges and email accounts. Change all passwords. 2. Document Everything Save wallet addresses involved. Take screenshots of conversations with the scammer. Keep transaction IDs (TXIDs), payment confirmations, and exchange receipts. 3. Blockchain Transaction Tracing Cryptocurrency transactions are recorded on the blockchain. Through advanced forensic tools, suspicious wallet movements can be traced across exchanges and mixing services. 4. Exchange & Platform Notification If funds moved through major exchanges, immediate reporting increases the chances of freezing suspicious accounts. 5. Legal & Regulatory Reporting Report to: intelligencecyberwizard@cyber-wizard.com (United States) Timely reporting strengthens recovery efforts. How Intelligence Cyber Wizard Educates Crypto Scam Victims Education is prevention. They don’t just assist with recovery — they equip victims with long-term protection strategies. 1⃣ Scam Awareness Training They educate victims about: Fake investment platforms Romance crypto scams Phishing wallet attacks Impersonation scams Fake recovery agents 2⃣ Wallet Security Education Cold vs hot wallet protection Private key safety practices Identifying malicious smart contracts 3⃣ Blockchain Transparency Lessons Victims learn how crypto transactions work, why they are traceable, and how scammers attempt to launder funds. 4⃣ Red Flag Identification They teach clients to identify: Guaranteed high returns Pressure tactics Fake celebrity endorsements Unregulated trading platforms Their Commitment as Intelligence Cyber Wizard, they operate with: Professional digital forensic methods Ethical recovery strategies Confidential case handling Victim-first support system Cryptocurrency scams are rising globally, but with the right response and education, recovery and prevention are possible.
Anthropic usage credits purchased.
Message those that work forces.
You would probably need at least ~1M subscribers to cancel to make this painful.
Probably needs more attention outside of tech circles for that to happen but I suspect this will get drowned out in the face of other stuff.
Intelligence Cyber Wizard, mission is simple: help victims of cryptocurrency scams recover their digital assets and empower them with the knowledge to prevent future losses. How to Recover Lost Cryptocurrency If you’ve been scammed, act quickly and follow these professional steps: 1. Secure Your Remaining Assets Immediately transfer remaining funds to a new secure wallet. Enable two-factor authentication (2FA) on all exchanges and email accounts. Change all passwords. 2. Document Everything Save wallet addresses involved. Take screenshots of conversations with the scammer. Keep transaction IDs (TXIDs), payment confirmations, and exchange receipts. 3. Blockchain Transaction Tracing Cryptocurrency transactions are recorded on the blockchain. Through advanced forensic tools, suspicious wallet movements can be traced across exchanges and mixing services. 4. Exchange & Platform Notification If funds moved through major exchanges, immediate reporting increases the chances of freezing suspicious accounts. 5. Legal & Regulatory Reporting Report to: intelligencecyberwizard@cyber-wizard.com (United States) Timely reporting strengthens recovery efforts. How Intelligence Cyber Wizard Educates Crypto Scam Victims Education is prevention. They don’t just assist with recovery — they equip victims with long-term protection strategies. 1⃣ Scam Awareness Training They educate victims about: Fake investment platforms Romance crypto scams Phishing wallet attacks Impersonation scams Fake recovery agents 2⃣ Wallet Security Education Cold vs hot wallet protection Private key safety practices Identifying malicious smart contracts 3⃣ Blockchain Transparency Lessons Victims learn how crypto transactions work, why they are traceable, and how scammers attempt to launder funds. 4⃣ Red Flag Identification They teach clients to identify: Guaranteed high returns Pressure tactics Fake celebrity endorsements Unregulated trading platforms Their Commitment as Intelligence Cyber Wizard, they operate with: Professional digital forensic methods Ethical recovery strategies Confidential case handling Victim-first support system Cryptocurrency scams are rising globally, but with the right response and education, recovery and prevention are possible.
> "Two of our most important safety principles are prohibitions on domestic mass surveillance and human responsibility for the use of force, including for autonomous weapon systems," Altman said.
https://www.axios.com/2026/02/27/pentagon-openai-safety-red-...
I was one of the early paying adopter of chatgpt but when Claude came around I switched and never looked back. I've been on the max plan for a while.
2. Click on your profile icon and select New Chat icon.
3. Formulate a polite prompt in the regard of subscription cancellation.
4. Wait for a reply from Mr. Altman.
count up to 1000
Perfect! Let’s continue the sequence from 601 all the way to 1000 in one go:
601, 602, 603, 604, 605, 606, 607, 608, 609, 610, 611,He can fucking afford to have some fucking principles. He's not going to end up on the street for not being a fucking coward.
Because of some bullshit minor PTSD from a few years ago, I sort of swore an oath to myself that I wouldn't let being a coward stop me from doing the right thing, regardless of the consequences, and by doing things that I think are right it has cost me opportunities and money. I'm not homeless, but it made the job hunt harder when I was unemployed. I can actually feel consequences from standing up for what I believe in. Sam Altman being a coward is not equivalent, he's choosing to do the wrong thing for no reason.