FMS 2016: Supermicro All-Flash NVMe Systems - Switching PCIe up to 48 SSDs!

Subject: Storage | August 11, 2016 - 10:59 AM |
Tagged: FMS, SYS-2028U-TN24R4T+, SYS-1028U-TN10RT+, supermicro, SSG-2028R-NR48N, server, NVMe, FMS 2016

Supermicro was at FMS 2016, showing off some of their NVMe chassis:

DSC02290.jpg

The first model is the SYS-1028U-TN10RT+. This 1U chassis lets you hot swap 10 2.5" U.2 SSDs, connecting all lanes directly to the host CPUs.

DSC02294.jpg

Supermicro's custom PCB and interposer links all 40 PCIe lanes to the motherboard / CPUs.

DSC02291.jpg

Need more drives installed? Next up is the SYS-2028U-TN24R4T+, which uses a pair of PCIe switches to connect 24 U.2 SSDs to the same pair of CPUs.

DSC02292.jpg

Need EVEN MORE drives installed? The SSG-2028R-NR48N uses multiple switches to connect 48 U.2 SSDs in a single 2U chassis! While the switches will limit the ultimate sequential throughput of the whole package to PCIe 3.0 x40, we know that when it comes to spreading workloads across multiple SSDs, bandwidth bottlenecks are not the whole story, as latency is greatly reduced for a given workload. With a fast set of U.2 parts installed in this chassis, the raw IOPS performance would likely saturate all threads / cores of the installed Xeons before it saturated the PCIe bus!

More to follow as we wrap up FMS 2016!

Source: Supermicro

FMS 2016: Samsung To Announce 64-Layer 4th Gen V-NAND, 32TB 2.5" SSD

Subject: Storage | August 10, 2016 - 02:00 PM |
Tagged: 2.5, V-NAND, ssd, Samsung, nand, FMS 2016, FMS, flash, 64-Layer, 32TB, SAS, datacenter

At a huge press event like Flash Memory Summit, being in the right place at the right time (and with the right camera), matters greatly. I'll just let a picture say a thousand words for me here:

64-Layer V-NAND.jpg

..now this picture has been corrected for extreme parallax and was taken in far from ideal conditions, but you get the point. Samsung's keynote is coming up later today, and I have a hunch this will be a big part of what they present. We did know 64-Layer was coming, as it was mentioned in Samsung's last earnings announcement, but confirmation is nice.

*edit* now that the press conference has taken place, here are a few relevant slides:

DSC02430.jpg

DSC02438.jpg

With 48-Layer V-NAND announced last year (and still rolling out), it's good to see Samsung pushing hard into higher capacity dies. 64-Layer enables 512Gbits (64GB) per die, and 100MB/s per die maximum throughput means even lower capacity SSDs should offer impressive sequentials.

48-V-NAND.png

Samsung 48-Layer V-NAND. Pic courtesy of TechInsights.

64-Layer is Samsung's 4th generation of V-NAND. We've seen 48-Layer and 32-Layer, but few know that 24-Layer was a thing (but was mainly in limited enterprise parts).

We will know more shortly, but for now, dream of even higher capacity SSDs :)

*edit* and this just happened:

Photo Aug 10, 10 51 31.jpg

*additional edit* - here's a better picture taken after the keynote:

DSC02562.jpg

DSC02541.jpg

The 32TB model in their 2.5" form factor displaces last years 16TB model. The drive itself is essentially identical, but the flash packages now contain 64-layer dies, doubling the available capacity of the device.

FMS 2016: Seagate Demos Facebook Lightning, 60TB 3.5" SSD!

Subject: Storage | August 10, 2016 - 01:59 PM |
Tagged: FMS 2016, ssd, Seagate, Lightning, facebook, 60TB

Seagate showed off some impressive Solid State Storage at Flash Memory Summit 2016.

DSC02135.jpg

First up is the Nytro XM1440. This is a 2TB M.2 22110 SSD complete with enterprise firmware and power loss protection. Nice little package, but what's it for?

DSC02136.jpg

..well if you have 60 of them, you can put them into this impressive 1U chassis. This is Facebook's Lightning chassis (discussed yesterday). With Seagate's 2TB parts, this makes for 120TB of flash in a 1U footprint. Great for hyperscale datacenters.

Now onto what you came to see:

DSC02123.jpg

This is the 'Seagate 60TB SAS SSD'. It really doesn't need a unique name because that capacity takes care of that for us! This is a 3.5" form factor SAS 12Gbit beast of a drive.

DSC02131.jpg

DSC02134.jpg

They pulled this density off with a few tricks which I'll walk through. First was the stacking of three PCBs with flash packages on both sides. 80 packages in total.

DSC02124.jpg

Next up is Seagate's ONFi fan-out ASIC. This is required because you can only have so many devices connected to a single channel / bus of a given SSD controller. The ASIC acts as a switch for data between the controller and flash dies.

DSC02125.jpg

With so much flash present, we could use a bit of fault tolerance. You may recall RAISE from SandForce (who Seagate now owns). This is effectively RAID for flash dies, enabling greater resistance to individual errors across the array.

DSC02129.jpg

Finally we have the specs. With a dual 12 Gbit SAS inteface, the 60TB SAS SSD can handle 1.5 GB/s reads, 1.0 GB/s writes, and offers 150,000 IOPS at 4KB QD32 random (SAS tops out at QD32). The idea behind drives like these is to cram as much storage into the smallest space possible, and this is certainly a step in the right direction.

DSC02138.jpg

We also saw the XP7200 add-in card. I found this one interesting as it is a PCIe 3.0 x16 card with four M.2 PCIe 3.0 x4 SSDs installed, but *without* a PLX switch to link them to the host system. This is possible only in server systems supporting PCIe Bifurcation, where the host can recognize that certain sets of lanes are linked to individual components.

More to follow from FMS 2016! Press blast after the break.

Mobile speed, the Samsung Portable SSD T3

Subject: Storage | August 9, 2016 - 06:44 PM |
Tagged: ssd t3, Samsung, portable storage

Just because you are on the road there is no reason to subject yourself to HDD speeds when transferring files.  Not only will an SSD be quieter and more resilient but the USB 3.1 Gen 1 Type C port theoretically offers up to 450MB/s transfer speeds.  This particular 2TB portable SSD uses the same MGX controller as the 850 EVO, the NAND is Samsung's 48-layer TLC V-NAND.  The Tech Report previously tried out the T1 model so their expectations were that this drive would improve performance in addition to offering larger sizes of drive.  Does it live up to expectations?  Find out in their full review.

Al just reminded yours truly we posted a review of the T3 back in February.

main.jpg

"Not all new SSDs go inside your computer. We take a quick look at Samsung's latest V-NAND-powered external drive, the Portable SSD T3, to see what it's like to put 2TB of fast storage in one's pocket."

Here are some more Storage reviews from around the web:

Storage

FMS 2016: Facebook Talks WORM QLC NAND Flash, Benchmarks XPoint

Subject: Storage | August 9, 2016 - 05:59 PM |
Tagged: XPoint, Worm, storage, ssd, RocksDB, Optane, nand, flash, facebook

At their FMS 2016 Keynote, Facebook gave us some details on the various storage technologies that fuel their massive operation:

DSC02009.jpg

In the four corners above, they covered the full spectrum of storing bits. From NVMe to Lightning (huge racks of flash (JBOF)), to AVA (quad M.2 22110 NVMe SSDs), to the new kid on the block, WORM storage. WORM stands for Write Once Read Many, and as you might imagine, Facebook has lots of archival data that they would like to be able to read quickly, so this sort of storage fits the bill nicely. How do you pull off massive capacity in flash devices? QLC. Forget MLC or TLC, QLC stores four bits per cell, meaning there are 16 individual voltage states for each cell. This requires extremely precise writing techniques and reads must appropriately compensate for cell drift over time, and while this was a near impossibility with planar NAND, 3D NAND has more volume to store those electrons. This means one can trade the endurance gains of 3D NAND for higher bit density, ultimately enabling SSDs upwards of ~100TB in capacity. The catch is that they are rated at only ~150 write cycles. This is fine for archival storage requiring WORM workloads, and you still maintain NAND speeds when it comes to reading that data later on, meaning that decade old Facebook post will appear in your browser just as quickly as the one you posted ten minutes ago.

DSC02028.jpg

Next up was a look at some preliminary Intel Optane SSD results using RocksDB. Compared to a P3600, the prototype Optane part offers impressive gains in Facebook's real-world workload. Throughput jumped by 3x, and latency reduced to 1/10th of its previous value. These are impressive gains given this fairly heavy mixed workload.

More to follow from FMS 2016!

FMS 2016: Micron Keynote Teases XPoint (QuantX) Real-World Performance

Subject: Storage | August 9, 2016 - 03:33 PM |
Tagged: XPoint, QuantX, nand, micron

Micron just completed their keynote address at Flash Memory Summit, and as part of the presentation, we saw our first look at some raw scaled Queue Depth IOPS performance figures from devices utilizing XPoint memory:

U.2.jpg

These are the performance figures from an U.2 device with a PCIe 3.0 x4 link. Note the outstanding ramp up to full saturation of the bus at a QD of only 4. Slower flash devices require much more parallelism and a deeper queue to achieve sufficient IOPS throughput to saturate that same bus. That 'slow' device on the bottom there, I'm pretty certain, is Micron's own 9100 MAX, which was the fastest thing we had tested to date, and it's being just walked all over by this new XPoint prototype!

Ok, so that's damn fast, but what if you had an add in card with PCIe 3.0 x8?

HHHL.jpg

Ok, now that's just insane! While the queue had to climb to ~8 to reach these figures, that's 1.8 MILLION IOPS from a single HHHL add in card. That's greater than 7 GB/s worth of 4KB random performance!

latency.jpg

In addition to the crazy throughput and IOPS figures, we also see latencies running at 1/10th that of flash-based NVMe devices.

x10.jpg

..so it appears that while the cell-level performance of XPoint boasts 1000x improvements over flash, once you implement it into an actual solution that must operate within the bounds of current systems (NVMe and PCIe 3.0), we currently get only a 10x improvement over NAND flash. Given how fast NAND already is, 10x is no small improvement, and XPoint still opens the door for further improvement as the technology and implementations mature over time.

More to follow as FMS continues!

FMS 2016: Micron Launches 3D UFS SSDs, Brands 3D XPoint as QuantX

Subject: Storage | August 9, 2016 - 01:09 PM |
Tagged: XPoint, UFS, QuantX, micron, FMS 2016, FMS

The UFS standard aims to bring us lightning fast microSD cards that perform on-par with SATA SSDs. Samsung introduced theirs earlier this month, and now Micron has announced their solution:

Mobile 3D NAND UFS with specs and logo.jpg

As you can see, UFS is not just for SD cards. These are going to be able to replace embedded memory in mobile devices, displacing the horror that is eMMC with something way faster. These devices are smaller than a penny, with a die size of just over 60 mm squared and boast a 32GB capacity.

UFS.png

One version of the UFS 2.1 devices also contains Micron's first packaged offering of LPDDR4X. This low power RAM offers an additional 20% power savings over existing LPDDR4.

Also up is an overdue branding of Micron's XPoint (spoken 'cross-point') products:

MIcron_QuantX_Logo_Black.Gray_60%.png

QuantX will be the official branding of Micron products using XPoint technology. This move is similar to the one Intel made at IDF 2015, where they dubbed their solutions with the Optane moniker.

More to follow from FMS 2016. A few little birdies told me there will be some good stuff presented this morning (PST), so keep an eye out, folks!

Press blast for Micron's UFS goodness appears after the break.

Microsemi Flashtec Controllers Offer PCIe 3.0 x8 NVMe SSDs up to 20TB

Subject: Storage | August 8, 2016 - 10:40 AM |
Tagged: storage, ssd, solid state drive, PCIe 3.0 x8, PCI-E 3.0, NVMe2032, NVMe2016, NVMe, Microsemi, Flashtec

Microsemi's Flashtec NVMe SSD controllers are now in production, and as Computer Base reports (Google-translated version of the page available here) these controllers use twice as many PCIe lanes than current offerings with a x8 PCI-E 3.0 connection, and can support up to 20 TB of flash capacity.

flashtec.jpg

Image credit: Computer Base

"The NVMe controller destined for the professional high-performance segment and work with PCIe 3.0 x8 or two x4 PCIe 3.0. The NVMe2032 has 32 memory channels (and) NVMe2016 (has) 16. When using 256-Gbit flash SSDs can be implemented with up to 20 terabytes of storage."

The 32-channel NVMe2032 boasts up to 1 million IOPS in 4K random read performance, and the controller supports DDR4 memory for faster cache performance. The announcement of the availability of these chips comes just before the start of Flash Memory Summit, which our own Allyn Malventano will be attending. Stay tuned for more flashy SSD news to come!

Subject: Storage
Manufacturer: Seagate

Introduction and Specifications

Introduction

Barracuda is a name we have not heard in a good while from Seagate. Last seen on their 3TB desktop drive, it appears they thought it was time for a comeback. The company is revamping their product lines, along with launching a full round of 10TB Helium-filled offerings that cover just about anything you might need:

seagate HDD line.png

Starting from the center, IronWolf is their NAS drive, optimized for arrays as large as 8 disks. To the right is their surveillance drive offering, the SkyHawk. These are essentially NAS units with custom firmware optimized for multiple stream recording. Not mentioned above is the FireCuda, which is a rebrand of their Desktop SSHD. Those are not He-filled (yet) as their max capacity is not high enough to warrant it. We will be looking at those first two models in future pieces, but the subject of today’s review is the BarraCuda line. The base 3.5” BarraCuda line only goes to 4TB, but the BarraCuda Pro expands upon those capacities, including 6TB, 8TB, and 10TB models. The subject of today’s review is the 10TB BarraCuda Pro.

160802-160721.jpg

Read on for our review of the 10TB BarraCuda Pro!

Thecus Announces N4810 4-Bay NAS with 4K Video Output

Subject: Storage | August 3, 2016 - 01:19 PM |
Tagged: UHD, Thecus, storage, NAS, N4810, N2810PRO, htpc, hdmi, DisplayPort, 4k, 4-Bay

Thecus has announced their newest NAS with the N4810, an 4-bay design based on the existing N2810PRO 2-bay model. The N4810 offers up to 40 TB of hard drive storage support, and an Intel Celeron N3160 (quad-core) processor with 4GB of RAM, which can be expanded to 8GB.

N4810_ANGLE_LARGE1.jpg

Image credit: Thecus

"With the N4810 built on the hardware of its little brother, the N2810PRO, users are equipped with the same immersive multimedia experience. Delivering superb sharpness and colour contrasts in 4K resolution playback, accessed through the HDMI output or DisplayPort output, guaranteeing that the picture quality from movies is just as the director envisioned.

Connection to your digital sound system via a SPDIF output is available, providing crystal clear audio for music and movies. A new USB 3.0 Type-C port has been added to the three already equipped USB 3.0 ports. This Type-C connector is the size of a microUSB and has a reversible plug allowing cables to be conveniently plugged in either direction."

4K_Fea_N4810.jpg

Image credit: Thecus

The NAS is geared toward the living room, with HDMI output along with DisplayPort, and display output up to UHD/4K. We took a look at the 2-bay N2560 NAS a couple of years ago, and on paper this new model offers a substantial upgrade as an entertainment/HTPC solution. Availability is set for this month.

Source: Thecus