▲ 89 points
back
57 comments
The inevitable, albeit cynic response: Imagine how much DRAM could be saved if Facebook was shut down!
Or put differently: I have only the greatest respect for the Facebook engineers who come up with innovations like this. This one seems to save cost, lowers power use and improves performance all at the same time. If only this engineering talent could be steered to better causes. Facebook is a net negative for society. Here is hoping that emerging “ethical” technology startups eventually have as great of success as surveillance juggernauts Facebook and Google enjoy today.
>Facebook is a net negative for society
Bold claim, Cotton. I personally have a hard time imagining a world where if Facebook didn't exist, something like it wouldn't either. There were plenty of companies vying for the same idea. Or is the suggestion that all usage of the internet to allow people to connect with each other are bad.
You haven’t paid much attention in the last 10 years if you still think that Facebook is about connecting people.
You haven’t paid much attention to the internet if you still think that allowing people a worldwide platform doesn’t have inevitable downsides.
The internet is the same as the other mass media when it was newly invented. The printing press didn’t change how people were, it just allowed them to reach wider audiences. Without the printing press, Martin Luther is just a guy. Without Twitter, Trump is also just a guy.
Facebook does connect people. Billions of people log in every day to see what their friends and family are up to. You might find that far fetched because you don’t know anyone who does, but that’s just your bubble.
The issue with Facebook is that making communication free has consequences. Those consequences are what Facebook gets blamed for. But this would happen regardless because it’s a direct consequence of the internet making communication free.
> Or is the suggestion that all usage of the internet to allow people to connect with each other are bad.
False equivocation. Monopolizing the social graph and using it to manipulate people isn't the same as having links exist on the internet.
A sane world would have it legislated out of existence and replaced with protocols anyone could implement with no central control.
Sure there would be something else similiar to Facebook but that doesn't make the critisism against Facebook wrong or invalid.
The critisism would then go to Bookface.
Independent of it, look what Facebook left: Nothing of importance.
You need only imagine the year 2005.
Before newsfeeds and like buttons, the combo which enables Facebook's algorithmic hate machine (recommender to maximize engagement).
Apparently you don't use Tiktok. Facebook is bad but TikTok is next level bad. It damages a whole new generation's dopamine system and their mental health and who knows what. FB is a declining empire which is less relevant day by day . Time will take care of it. But TikTok is the real bad boy. If you put chinese communist government into equation , then it is even worse.
Oh absolutely. They copied what Facebook did and turned it up to 11. Their CCP ties give TikTok its own evil spin. The Chinese basically planted a mental health bomb among American teenagers.
That doesn’t make Facebook the good guy though. In fact, they made it ridiculously easy for TikTok to come up with an even more addictive product.
Are Chinese teens immune to it?
Facebook, Tiktok, Twitter, et. al provide an ad-sponsored eugenic function throughout the modern world. As much as we may groan under the burden, future generations will benefit.
And if the concern is state surveillance / narrative control, social media is a lightweight compared to the print / broadcast monocultures it replaced.
If you are interested in Pressure Stall Information mentioned in the post, be sure to check LWN article on it, Tracking pressure-stall information: https://lwn.net/Articles/759781/
This was added in back 2018, so we've had a while to start using it.. anyone have experiences of other tools using this information?
We added it to the Prometheus node_exporter ages ago. It's extremely useful in detecting system stalls.
What I really need now is to have this information at the container level in cgroups v2.
https://github.com/google/cadvisor/issues/3052
This metric will really help with measuring the impact of workload CPU bursting.
Nice, they have reinvented virtual memory and paging to disk.
No this is obviously something supposed to improve on virtual memory and paging to disk. It uses things like that but is supposed to work across a data center with a bunch of different stuff. Improvement for a specific case is not "reinvent".
Indeed. The side describes TMO in bombastic terms, but this is just an incremental improvement to zram and swapping.
Yet, a smarter algorithm to swap intelligently was long due.
did you even read this?
I get that this comment might have struck a nerve with you, but the site guidelines specifically recommend not asking if the commenter read the article.
> Please don't comment on whether someone read an article. "Did you even read the article? It mentions that" can be shortened to "The article mentions that."
FWIW I don’t think that the parent comment is wrong, but rather over-generalizing. If you’re close to the project, I’d love to hear a proper rebuttal to what seems to be a common question.
That's fair, I apologize. It struck a nerve because of how blase it was with dismissal, but I too am guilty of that at times, I suppose.
Also, I am not close to the project at all - learned about it here.
I'm confused. They invented a swap partition?
The interesting bit (to me) is the algorithm. They automatically detect how slow each available swap space is, and how sensitive a workload is to memory latency and then swap memory pages into compressed dram or nvme storage in an optimal way.
So yes, it's "just swap space" but highly optimized.
It seems kind of, but better because memory can be compressed and/or paged out using a more advanced algorithm than before which assumes fast NVME's available to inform it's decisions.
Compressed swap has also been around for ages.
There's also been swapping to GPU memory (if free).
There are also advanced page replacement algorithms.
One interesting algorithm I read about a while back was using LZW not to compress swap, but to predict future page usage from past patterns.
etc. etc.
It's all still paging/swapping.
>Using a compressed-memory back end, TMO saves 7 percent to12 percent of resident memory across five applications. Multiple applications’ data have poor compressibility, such that offloading to an SSD proves far more effective.
that in general sounds strange. My experience across different application types over more than 2 decades has been very different (not about SSD, i mean the compression in memory have been always a very efficient approach).
> Specifically, machine learning models used for Ads prediction commonly use quantized byte-encoded values that exhibit a compression ratio of 1.3-1.4x.
yep, i haven't used compression for that. That though calls for a question - how many of those models do FB have in memory. Any chance FB instantiates such a model for every user/request? :)
> …i mean the compression in memory have been always a very efficient approach.
It’s quite possible that a large amount of stuff FB handles is already compressed (e.g. photos, video, and audio) and thus doesn’t offer much opportunity for further compression. Though I wonder how much of that stuff would be memory resident in the back end in the first place.
Personally, I want to see PCIe x16 devices (or U2 NVMe) where you can plug a few sticks of RAM to get a temporary volume.
It would be ideal for caching!
What would be the advantage vs DIMMs?
In a server, you're more limited by DIMM slots than by PCIe ports, especially on EPYC considering the number of lanes available.
With the shift towards DDR5, DDR4 could be repurposed as old servers are decommissioned.
I'm not convinced of the limited slots point - 16 (AMD) / 24 (Intel) DIMM slots in commodity single cpu socket server mobos, it gets you a few TB of RAM. 48 sockets in multi CPU socket mobos if you need more.
I can see "recycling refurbished previous-gen DIMMs" working for certain cases but it sounds a bit niche unless someone productises it really well.
Please build it!
+ oncard battery to survive reboots
How does this compare with Google's software defined far memory: https://research.google/pubs/pub48551/?
Oh no don't bring back far pointers please.
Computer storage hierarchies are sure getting complex with CXL and NVM in the mix.
This is an important step for having better RAM overcommitment in Linux (avoiding OOM and having less latency spikes). I hope more effort is put in this line. /cc Google, Amazon, Red Hat, SUSE, Canonical
This is far less impressive than they think it is, but I guess that's just how it is nowadays.
I wonder if there's public writeups / research into compressibility of web browser RSS, eg if there's a lot of JS objects they should exhibit a lot of regularity.
or "Meta re-invents swap disk"
You should read the whole article, because TMO does differ from traditional swapping. Notably, swapping usually occurs during periods of extreme memory pressure, where as TMO will offload memory much sooner and more intelligently.
So… paging then? Slightly improved paging?
If only there was some way to know! Some kind of... hyperlink, with text, where the answers you seek were available in a language you know, English, perhaps?
Only one way to know for sure!
Nope.
Paging algorithms have been "pre-swapping" for ages in order to keep the free page reserve high (or preferably a purgeable page reserve).
So they found out vm.swappiness?
Ahhh, but they compress the memory!
Anyone else remember Ram Doubler for pre OSX Macs?
Oh yes. Mac OS X started doing that in Mavericks as well
IBM once had a main-memory interface that did LZW compression (so compressing between L2 and main memory).