▲ 56 points
back
59 comments
> importantly, for all SSDs, disable write-cache buffer flushing for best performance.
Is this actually good advice, especially without mentioning the durability risks?
StackOverflow answer here: https://superuser.com/a/1215634
It's essentially the typical "without this enabled, you will lose data in case of power loss, potentially breaking the O/S".
One important point that the StackOverflow answers miss is that the Windows checkbox for buffer flushing has a different meaning for SATA SSDs than for NVMe SSDs. If you want a reasonably fair synthetic benchmark to compare NVMe SSDs against SATA SSDs while bypassing any caching the OS is doing with main system RAM, you pretty much have to toggle that switch for at least NVMe drives. Or use Linux, which has actual documentation for its NVMe driver, and the source code is available where that falls short.
>One important point that the StackOverflow answers miss is that the Windows checkbox for buffer flushing has a different meaning for SATA SSDs than for NVMe SSDs.
can you elaborate on this? What's the exact difference? Do sata drives get more aggressive buffer flushing than nvme drives?
I assume you're Billy Tallis on AnandTech, so you set disabled the cache on test?
It's a tangent, but I only recently realized/considered that UPS batteries had come along for the ride with lithium-ion.
I bought one that should power my internet+wifi for about an hour for $45.
I guess even a small one like that would handle power blips for a home server, but in an outage the battery would quickly run out and the setting would matter.
Most smart UPS can notify equipment (via LAN, USB and some even offer IPMI) to turn off in the event of an outage, or as soon as the battery reaches a certain threshold. You just need to install the UPS's server software on the equipment you want gracefully shut down.
What brand/model? I’m not finding these, just the old/expensive APC models and the like.
https://www.amazon.com/gp/product/B07GZR981Y/
I didn't do a lot of research, my main goal was to not have interruptions when the power blinks off.
There's APC and Amazon basics models that are about the same capacity and price.
Dont most SSDs have capacitors for this?
Only enterprise class drives typically have power loss protection and even that isn't a guarantee as some in that class don't have PLP.
The biggest players in the game do not use SSDs for persistent storage longer than x weeks. It is offloaded to tape at some point and restored periodically.
Uhm, what? There are tons of ways to prevent data loss, none of them involves writing the data out to tapes and then back in again.
Sure, you can also write to disk or other media. But are you trying to argue that certain large companies don't use tape?
>It is offloaded to tape at some point and restored periodically.
This makes no sense. The main problem with disabling write flushing is what happens if the OS crashes or the power goes out. Doing periodic backups/restores provides a "last known good state" to revert to, but you'll still lose all the writes between the last backup and when you crashed. Depending on your workload this might be fine, but I doubt the COO is going to be pleased when he finds out you lost all customer orders from today.
The bit about "restoring periodically" also doesn't make any sense because such events are easily detectable. There's no need to constantly take the system offline to do a restore. Disabling write flushing isn't going to cause increased bitrot.
Explicitly rewriting data periodically might make sense if you're really paranoid about flash fading over time. But bouncing the data through tape (tape!!) still makes no sense; the sensible way of managing this would be to mirror the data directly to another SSD.
I'm also curious as to whether this is true. From what I understand and can gather from tech talks from large firms, it is common (up to and beyond petabyte scale) to use ceph clusters purely consisting of SSDs and HDDs (no tape) to store mission critical data, with cache tiering used to balance hot and cold data. AFAIK, because of their self-healing nature thanks to replication/erasure coding algorithms, all that needs to be done is replace corrupted drives periodically, thus making tape drives non-essential unless periodic full backups are required for off-site storage. Please feel free to correct me if I'm wrong in any of this. Thanks.
>to use ceph clusters purely
Exactly! Use ceph so you don't have to care about burning ssd/hdd/server/switch/racks/dc, you have your object-storeage, FS, block-device, with one service and that's it.
They use tape because they have insanely large amounts of data they want to store and no need to have fast access to them, not because they are a good replacement for SSDs.
Maybe I haven't been paying attention, but I've never had a site attach extra text to copied text like this site does. I wanted to see what the test machine's case looks like, so I copied the make and model and pasted it into a search bar, and got "Read more:" and a link to the page along with the text I wanted to copy.
No thanks. I'll be skipping that site in the future, unless that javascript comes from a place I can easily block with pi-hole.
document.addEventListener('copy', (event)=>{
const pagelink = `\n\nRead more: ${document.location.href}`;
event.clipboardData.setData('text', document.getSelection() + pagelink);
event.preventDefault();
})
"run_at": "document_start"
window.addEventListener('copy', e => e.stopImmediatePropagation(), true);
Experimental Inject Mode: Instant
>unless that javascript comes from a place I can easily block with pi-hole.
Why on earth are you you blocking javascript using dns? Shouldn't you be doing it via the browser (via addons or site preferences)?
Maybe he is on phone?
You can probably just block JavaScript entirely for a site like this. I doubt it depends on it. But I agree that adding text to copied text is really irritating.
Images doesn't load on mobile brave if javascript is blocked.
It's when marketing folks create tasks without any user research.
Those speeds look nice. 7100srMB/s and 5250 srMB/s
I ended up getting a Samsung Evo 970 plus (1TB) a while ago because it was in a sale for $85. Almost half the speed of the ones in the benchmark. Maybe I should have waited.
> Almost half the speed
And 1/3 the price. If you bought it because it was on sale, doesn't that mean you're at least somewhat price sensitive? I don't think you should feel bad about your purchase.
Buy a couple more, put them in raid 0, now you have 9000MB/s
Most consumer systems don't have enough PCIe lanes to make that possible, unless you are okay with having at most 8 lanes for a GPU.
I've heard that SATA and NVME SSDs have similar performance for use cases such as lightweight app usage and loading games. Does anyone know what the typical use cases are for these high performance drives?
The use case is benchmarks basically, and maybe faster cold boots. About the only place the typical heavy computer user is likely to notice major difference between SATA and NVME is probably running something like "find /", or some kind of full-disk search scenario.
Even in the latter, full text indexing which every platform has had for years now makes it much less likely that the full directory tree will even get walked, and differences even less likely to be noticed. As a side note, every desktop platform's full text search seems to suffer software performance problems that are largely independent of the underlying disk
Even in the full-tree enumeration case, since Spectre/Meltdown mitigations landed, system call overhead is so high now that even with a lightning fast disk, a large chunk of total time taken to walk the directory tree is lost basically twiddling the CPU mode securely. You can definitely still see the difference between SATA and NVMe, but you can also definitely measure the amount of time during the NVMe run that is spent in software -- incrementally faster NVMe will have quickly diminishing returns.
"What about databases!" This was my original interest in SSDs to begin with. It turns out, despite being a data monkey who loves large databases, since 2013 any time I've worked with a giant dataset like this, it is always in the form of large scans (usually from something like a CSV or XML file), where SSDs don't really have a mind-blowing advantage over magnetic (but of course they are still 5-10x faster a seq io, its just that data parsing and processing is typically the bottleneck now).
I find the worst case scenarios come up pretty frequently. Even novice users can have a ton of photos, browser tabs, thumbnails, music, email, icons, full text search, etc. Once you get used to a system that has great I/O it's hard to go back. Sure large games often have difficult I/O patterns, but it's far from the only used case.
The reason is it takes time to reach those top speeds for each individual file. So if you're dealing with many small files it's difficult to reach and sustain the max speed. If you're working with big files like editing 4k or 8k video footage that's when you really get the full benefits
It really depends on your filesystem for this. However, the latency should be comparable across technologies, proportionately taking a bigger chunk of transfer times for small files.
No sustained write results? This is likely using a large dynamic cache.
What's the endurance of these devices? Could I rely on the swap file for large cfd meshes in a pinch for a week?
Heavy swapping is the worst case scenario for an SSD (highest write amplification) but I doubt it'd die in a week.
> What's the endurance of these devices?
It says in the article.
~600TB write endurance = ~500 cycle NAND Flash
Unfortunately, SLC caching means the math isn't quite that simple anymore. I would guess that this flash is probably rated for something in the 1500-3000 cycle range, and the difference between that and the apparent 500 cycle drive endurance rating comes down to a combination of a conservative warranty period, and estimated write amplification during typical usage.
Can..... this be used as a media hosting drive? Like for plex and maybe heavy server loads?
This is complete overkill for anything resembling consumer NAS duty. It's far faster than any consumer-oriented networking equipment, and far more costly per byte than the cheapest consumer SSDs that still outperform your network. A drive like this is best suited for a workstation where large quantities of data are generated or processed locally.
What kind of video files do you have on Plex that needs an NVME drive? 8k videos?
The only time I max out my sata scratch drive is when I’m unpacking a video. Playing a 4K and a 1080p video at the same time barely spikes my ZFS pool on my NAS.
Probably SMR /s
I had Optane drive, it was mind blowing, however it bricked itself after a month.
Given the price of Optane drives I hope you got a new one for free.
Yes after some back and forth intel sent me a new one, but I have not opened it. I feel too anxious about data loss.