NVIDIA's SC17 Keynote: Data Center Business on Cloud 9

Subject: Graphics Cards | November 13, 2017 - 10:35 PM |
Tagged: nvidia, data center, Volta, tesla v100

There have been a few NVIDIA datacenter stories popping up over the last couple of months. A month or so after Google started integrating Pascal-based Tesla P100s into their cloud, Amazon announced Telsa V100s for their rent-a-server service. They have also announced Volta-based solutions available or coming from Dell EMC, Hewlett Packard Enterprise, Huawei, IBM, Lenovo, Alibaba Cloud, Baidu Cloud, Microsoft Azure, Oracle Cloud, and Tencent Cloud.

nvidia-2017-sc17-money.jpg

This apparently translates to boatloads of money. Eyeball-estimating from their graph, it looks as though NVIDIA has already made about 50% more from datacenter sales in their first three quarters (fiscal year 2018) than all last year.

nvidia-2017-sc17-japanaisuper.jpg

They are also seeing super-computer design wins, too. Earlier this year, Japan announced that it would get back into supercomputing, having lost ground to other nations in recent years, with a giant, AI-focused offering. Turns out that this design will use 4352 Tesla V100 GPUs to crank out 0.55 ExaFLOPs of (tensor mixed-precision) performance.

nvidia-2017-sc17-cloudcontainer.jpg

As for product announcements, this one isn’t too exciting for our readers, but should be very important for enterprise software developers. NVIDIA is creating optimized containers for various programming environments, such as TensorFlow and GAMESS, with their recommended blend of driver version, runtime libraries, and so forth, for various generations of GPUs (Pascal and higher). Moreover, NVIDIA claims that they will support it “for as long as they live”. Getting the right container for your hardware is just filling out a simple form and downloading the blob.

NVIDIA’s keynote is available on UStream, but they claim it will also be uploaded to their YouTube soon.

Source: NVIDIA

NVIDIA Partners with AWS for Volta V100 in the Cloud

Subject: Graphics Cards | October 31, 2017 - 09:58 PM |
Tagged: nvidia, amazon, google, pascal, Volta, gv100, tesla v100

Remember last month? Remember when I said that Google’s introduction of Tesla P100s would be good leverage over Amazon, as the latter is still back in the Kepler days (because Maxwell was 32-bit focused)?

Amazon has leapfrogged them by introducing Volta-based V100 GPUs.

nvidia-2017-voltatensor.jpg

To compare the two parts, the Tesla P100 has 3584 CUDA cores, yielding just under 10 TFLOPs of single-precision performance. The Tesla V100, with its ridiculous die size, pushes that up over 14 TFLOPs. Same as Pascal, they also support full 1:2:4 FP64:FP32:FP16 performance scaling. It also has access to NVIDIA’s tensor cores, which are specialized for 16-bit, 4x4 multiply-add matrix operations that are apparently common in neural networks, both training and inferencing.

Amazon allows up to eight of them at once (with their P3.16xlarge instances).

So that’s cool. While Google has again been quickly leapfrogged by Amazon, it’s good to see NVIDIA getting wins in multiple cloud providers. This keeps money rolling in that will fund new chip designs for all the other segments.

Source: Amazon