Today at Intel's Data Center Group's Data-Centric Innovation Summit, they provided a peek into the future of Xeon processors.

Coming later this year are the oft-rumored Cascade Lake Xeons. In addition to supporting Optane DC Persistent memory, Cascade Lake will offer hardware-based mitigations for Spectre/Meltdown vulnerabilities.  

Intel Deep Learning Boost will also make its first appearance in the Cascade Lake products. In its first iteration, DL Boost will provide a vector neural network instruction set (VNNI) based on AVX-512 for faster inference acceleration. Intel is working to add VNNI to industry standard deep learning frameworks like TensorFlow and Caffe.

Next, in late 2019, we have the Cooper Lake architecture. Still based on 14nm technology, Cooper Lake will expand upon Intel DL Boost and add support for the BFloat16 data type, which provides the same level of precision as double precision (32-bit) floating points, but in a smaller (16-bit) data size. 

In 2020, after Cooper Lake, comes Ice Lake – the first 10nm-based Xeon. While details are sparse about what improvements Ice Lake will bring architecturally, Intel has said that it will be compatible with Cooper Lake platforms, giving users an upgrade path.