Morning, everybody. Please welcome Intel's CEO, Bob Swan.
Wow. Good morning, and welcome. It's wonderful to have you here, and I'm thrilled to have the chance to kick off what we think is an extremely important event for our company. This is historic for Intel as we deliver the first truly data-centric portfolio of products for our customers. As most of you probably know, the last several years, we embarked on a journey. A journey as a company to transform from what we characterize as a PC-centric company to a data-centric company, and to build the silicon technologies in conjunction with our partners to help our customers prosper and grow in an increasingly data-centric world. This approach has allowed us to pursue a massive $300 billion silicon-based market opportunity.
The launch of the new data-centric portfolio of products not only advances our data-centric strategy, but more importantly, it helps our customers extract more value out of their data. Today's announcements reflect the transformation we've embarked on to deliver the innovation and the technology that will unleash the power of data. While our overall TAM is roughly a $300 billion TAM, our data-centric TAM represents almost two-thirds of this, and by 2022 will be a TAM of $200 billion in size, and it will be the fastest-growing aspects of the silicon market that we serve.
The broader industry infrastructure and the solution revenue from data center computing represents $1.25 trillion in revenue in this year alone, growing at almost 17% a year growth over the course of the next five years, representing a total of $7.5 trillion in revenue during that timeframe. Our ambitions as a company have never been greater, we are growing our market share in an increasing and bigger TAM than we've ever pursued before. Our quest is to play a bigger and bigger role in the success of our customers in working in conjunction with our partners. While our ambitions are as big as they've ever been, our focus is actually quite simple. First, to deliver a high-performance data-centric silicon portfolio of CPUs, plus a suite of accelerant technologies, including FPGAs, memory, and more.
Second, customer-obsessed engagement with our industry partners to leverage our silicon foundation to move, to store, and process data to build the best technologies and solutions together with our partners. We're truly proud to have many of our partners and industry leaders from across the data-centric landscape here with us today to talk about the joint innovations that we've been working together on. We have a great day in store for you. You'll hear from Intel leaders, from our partners, and you'll get to see our data-centric portfolio of products in action. I'm truly excited to be here. With that short intro, I wanna really get this event started and invite our Executive Vice President and General Manager of our Data Center Group, Navin Shenoy. Please, round of applause for Navin. Woo.
Nice to have you here, man.
Yeah.
All right, good morning, welcome to Intel's Data-Centric Innovation Day. As you heard from Bob, this is a big day for us. This is a big day for our customers. This is a big day for our partners. It is the first truly data-centric portfolio launch in our history. As you heard a little bit there from Bob, while Intel has long been the foundation for many of the industry's most important data center CPU advancements, today's announcements reflect a broader transition inside of the company to drive Intel technology across not only the microprocessor, but also to FPGAs and to memory and to storage and to interconnect and to software and to security. Our goal is to unleash the value of the massive amounts of data that are in the world to help our customers move, store, and process that data to create value.
We're delighted to have many industry leaders with us today to share their stories on this journey of joint innovation. Of course, the underlying driver of the shifts that we're seeing today can be traced back to one thing: data. Over 50% of the world's data was created in the last two years. We've reached an inflection point where entire industries are being reshaped by leveraging that data. Who would have imagined, for example, that an e-commerce company could reinvent itself and also become a mobile network provider? Well, that's what Rakuten in Japan announced at Mobile World Congress earlier this year. Who would have imagined a few years ago that a 117-year-old company would be using AI to transform the way we perform cardiac MRIs? That's what Siemens Healthineers is doing.
You're gonna hear more from these customers, you're gonna hear from many other customers over the course of the event today. I think it's important to remember that while there's early emerging examples of this digital transformation, less than 2% of the world's data has actually been analyzed. That, of course, leads us to great optimism about the future, great untapped opportunities still ahead. We see this data-centric era emerging really at the confluence of three industry mega trends. The first being the shift to the cloud, the second being the rapid emergence of AI and analytics, and the third being what we call the cloudification of the network and the edge. The shift to the cloud, of course, is probably the most mature of these three. The scale and the efficiency of the cloud architecture started at the major hyperscalers.
It was built on Intel architecture. It leveraged innovation like Intel Virtualization Technology, but it's now also fueling the modernization of traditional on-premise enterprise data centers. AI and analytics, which started as sort of the domain of the most sophisticated data-rich companies, is also now reshaping entire industries. You're gonna hear some examples of that later today. Finally, the same concepts and technologies that created the cloud are now transforming the network, cloudifying it, allowing the network itself to flex and scale. As 5G emerges, we will only see, I believe, that cloudification accelerate, moving compute to the edge, moving compute closer to where all that data is being created and where all that data is being consumed. In the context of those mega trends, we are seeing explosive demand for computing, an almost insatiable appetite for computing.
Over the last five years, we've seen a 50% compound annual growth rate in demand for compute cycles or MIPS in the industry parlance. Maybe more interestingly, our forecast is that we will see 50% compute cycle demand ahead over the next five years. Just as importantly, we've seen an explosion in the types of workloads that our customers are running from security to virtualization, to database, to network, to multi-cloud, to orchestration, to HPC, to AI and analytics. We're seeing the diversifying needs emerge as computing expands. Given these trends over the last several years, Intel has been investing in a new approach to the underlying data-centric infrastructure. We have been investing to help move data faster, to help store more data, and to process everything. We're architecting the future of the data center. We're architecting the future of the edge.
That required us to broaden our portfolio to move data faster with a suite of products like our Ethernet portfolio and silicon photonics and high-performance fabrics, to store more data with the investments we've made in NAND and Optane, and of course, processing everything with innovations in the CPU, but also the portfolio of accelerators we've been building with FPGAs and AI ASICs. All of which is underpinned with an increasing investment in software and solutions and system-level thinking. Today, we are taking a big step forward with the expansion of an unmatched portfolio to move, store, and process data.
At Intel, it's our mission to empower the greatest innovators of our time with the technologies they need to take their ideas further. It all starts with data. The data centric computing era is marked by the rapid growth of cloud services, the transition to intelligent 5G networks, the explosion of connected devices, and the adoption of advanced analytics and artificial intelligence. From large, complex applications in the cloud to the edge, our customers are looking for solutions that can move, store, and process data faster, turning it into actionable insights that drive business forward. Our customers are bringing the future to life. We are working to make sure they have access to everything they need to do it. Together, we push possible forward.
With my colleagues today, we are introducing seven new data-centric products. Today, we are launching the Intel Ethernet 800 Series adapter, which supports 25, 50, and 100 Gb transfer speeds. Today, we are announcing 24 by 7 storage availability with the latest Optane SSD and efficient warm storage with QLC NAND. We're delivering breakthrough innovation with our latest Optane DC Persistent Memory technology. Of course, we're bringing forward our second generation Xeon Scalable product, delivering breakthrough performance with new features like DL Boost for advancements in inference performance. We are bringing forward power and space-efficient network processing with the Xeon D-1600. We're also announcing a leap forward in programmable acceleration with our first ever 10 nm FPGA, the Intel Agilex series. Thank you guys for being here. Thank you very much. We're super excited. Thank you very much.
We're not just innovating at the product level today. What you'll hear, hopefully, throughout the day is that we're also innovating at the solution level, bringing these various products together to solve customer problems. We have a wide range of Intel Select Solutions that we'll be announcing today for AI, for virtualization, for security. Together, these products and solutions represent years of Intel engineering investment. Perhaps what's even more exciting to me is the broad set of partners and customers that are here with us today. We have more customers and partners and ecosystem players than we have ever had at an Intel launch before. Many of them are launching their products and services today. I'd like to just say thank you and congratulations from all of us at Intel to all of you for pushing the envelope on innovation today. Thank you guys very much.
Okay, let me dig into the heart and soul of the data center, starting with Xeon. Today, we are introducing the 2nd-generation Xeon Scalable processor. That was safe. It's very robust, you can see. The 2nd-generation Xeon Scalable builds on our 20-year history of Xeon, where we've delivered advancements year in and year out on a diverse range of customer workloads. We are launching today the most comprehensive Xeon stack we've ever delivered with over 50 standard SKUs, complemented by dozens of custom offerings for our customers. We're delivering 8 core Xeons all the way up to 56 core, the highest core count we've ever delivered on Xeon. We're delivering support for 1, 2, 4, and 8 socket glueless support with Xeon.
For the 1st time in the industry today, we're unleashing the value of persistent large memory capacity on the world's app-applications with Optane Data Center Persistent Memory, 4.5 TB of memory per socket. This product represents deep technical investment in both the memory technology as well as the CPU controller. It allows us to break through the memory economics that have held back application developers for decades, we're very excited about that. We've also added some new key architectural elements to the fastest-growing workloads on the planet. We've added a new feature called Deep Learning Boost or DL Boost, enabling the 1st CPU with built-in inference acceleration for AI workloads. We're further accelerating network applications, we've created a set of Xeon SKUs for the network market, for NFV workloads, Network Function Virtualization workloads, with new technologies like the Intel Speed Select Technology.
We're also delivering CPU architectural enhancements to provide hardware security mitigations for side channel security attacks. With the smooth platform upgrade that we're delivering here today from our prior generation Xeon, the entire ecosystem, including the companies that you're gonna hear from today, are ready to ship now so that customers can immediately take advantage of all of this innovation. This is why we believe our customers will make the 2nd generation Xeon Scalable the fastest ramping Xeon ever. Our new highest performance addition to the family is the advanced performance Xeon Scalable, the Xeon Platinum 9200. Back in October, we announced the addition of this family to the Xeon set of SKUs. It's been designed from the ground up for data intensive applications, high-performance computing, analytics, artificial intelligence. This product, the Xeon Platinum 9200 processor, delivers leadership performance.
We previously disclosed SKUs up to 48 cores on this product, and today I'm very excited to announce that we're actually scaling this product up to 56 cores or 112 cores in a two-socket system with 12 channels of memory support. It's a very unique design. Each CPU core has access to the expanded memory interfaces. What's particularly exciting to me is I can remember a day and a time where to deliver a teraflop of performance, we needed this entire room of computers. Today, we have 3 teraflops of compute in the palm of my hand. This thing is truly a beast, and we're really excited about bringing this product out into the market. Now, as I mentioned, one of the places where we see the most demand for products like that is in the high-performance computing domain.
I'm excited to say that some of our customers have already decided to solve some of their biggest data problems on Intel. Let's take a look.
Working in computer science is always very exciting, especially working in high performance computing. My name is Raimund Seidel. I'm professor in computer science at the University of Göttingen, and I'm also managing director of GWDG, a joint compute center of Max Planck Society and University of Göttingen. HLRN is a quite unique system because it's a computer system by 7 states, also 15 states that we have in Germany, and therefore the systems caters for a large audience. HLRN is 1 system with 2 hosting sites, and the 2 hosting sites bring different expertise into the systems. Both hosting sites are quite well known as compute centers with long experience in high performance computing. That's the reason why we have been selected to host the new HLRN-IV system. We are a very demanding client. A lot of our research is getting more compute and data intensive.
We have people from many different disciplines working in mathematics, computer science, chemistry, physics, aerodynamics, and therefore, they have very different application needs on that system. We are not looking for peak theoretical performance, but for real system performance. The Intel Xeon Scalable processor advanced performance is giving us this kind of performance. In addition, the CPU is quite good for artificial intelligence and machine learning. HLRN-IV is a quite large computer system. It's a quarter of million of compute cores. It's quite exciting that we get a 16 petaflop machine, which is a significant increase. In this case, having Intel as one strong partner, on the other hand, having Atos BullSequana as another partner is quite crucial to make that whole project a success. Should be one of the fastest machines in the world.
As we heard there, HLRN is working on really important scientific advancements, and we look forward to working with them as well as many other customers as we bring out and ramp the Xeon Scalable 9200. I asked the team to further highlight the capability of the Xeon Platinum 9200, and I challenged them to do something that we don't do very often, and that was to set a world record here on stage today. What I'm gonna show you now, hopefully we can do this, is a, this system right here is a 2-socket server, 56 cores per processor. What we're gonna do is we're gonna run the SPECfp rate benchmark. It's a traditional high-performance computing benchmark. It's CPU intensive. It takes advantage of the core count. It takes advantage of the memory bandwidth that this system provides.
What I did is I started the SPECfp benchmark on this server last night, and it finished just before this event started. You can see on this chart here, the current world record is 282 fp rate. The timestamp that you see on the right-hand side of the chart, shows you that the benchmark finished just a couple of hours ago. What I wanna do now is to show you how the Xeon Platinum 9200 processor did. Let me start that. It's running, and you can see it's reading the log file, and we achieved 522 fp rate. That new level of performance breaks the world record on that benchmark. I wanna just say congratulations to the team for pulling that off. Thank you guys very much.
We expect many more world records to come, like that world record. Let me shift now from the beast of the Xeon Platinum 9200 to the bread and butter part of the Xeon lineup. In the volume price points for the next generation Xeon, we are delivering 30% gen on gen performance improvement for the majority of our customers. This is the biggest, to put it in context, the biggest generation to generation improvement we've delivered in the mainstream part, the volume part of the Xeon stack in the last five years. This is a big deal for our customers. We're very excited about being able to do that. In addition, we are also seeing great performance on real-world applications that our customers care about.
You can see here a small sample of some of the significant improvements our customers are seeing on business analytics, on memory workloads, like databases, on network workloads. Very exciting to see that kind of performance improvement. In addition to these workloads, we also pushed ourselves to innovate on the fastest-growing workload on the planet. That is artificial intelligence. The rise of AI, of course, has been well documented, and we're finally reaching, as I said earlier, an inflection point here. We're seeing AI move into broad deployments. It represents already today a multi-billion dollar silicon opportunity, and we expect that to grow to about $10 billion by 2022. There's two primary types of workloads in the data center for artificial intelligence. There's training and there's inference. Inference is typically a part of other workloads, and it lends itself to run very well on the CPU.
It also happens to be over 50% of the AI workload set that our customers care about. For many years now, our engineers have been pushing hard to innovate on inference performance on the CPU. With the first generation of Xeon Scalable that we introduced in 2017, we gave the CPU more AI strength. We added the AVX-512 engine into Xeon for the first time. What you saw is a 5.7x improvement on inference workloads through a combination of software and hardware innovation from the time we introduced Xeon Scalable in July of 2017 until the end of 2018. Yet our customers were pushing us to do even better than that.
Today, I'm very excited with the release of our second generation Xeon Scalable to announce that we are further pushing the envelope on deep learning performance with the introduction of DL Boost, built-in inference acceleration that extends Xeon performance as the only CPU architecture with integrated AI acceleration. With a combination now of hardware and software improvements on DL Boost, we're seeing 14x deep learning inference performance improvement from the Xeon Scalable first gen in July of 2017. With the Platinum 9200 series we just talked about, we're seeing a further 2x above and beyond that. So to show you DL Boost in action, I thought I'd bring out Niv onto the stage to show you just how great this technology is. Niv, come on out. How are you doing?
Nice to see you.
It's good to see you too.
Yeah.
Thanks for being here.
Thank you for coming.
You've been hard at work on this for a long time now.
That's right.
What do you have to say?
Yeah. We're very excited to show you a demo with DL Boost. As you know, the team has been working very hard to get here, and I'm happy to report that we now have accelerator-like performance with DL Boost on a variety of AI workloads. The main conversation, one of the most important DL conversations always is about image classification.
Intel has been optimizing a lot of workloads in addition to that, like recommender systems, language translation, and et cetera, that are important to our customers. Recommender systems in particular is one of the most popular AI workloads in cloud today, and account for about 60% of all data center inference. What we're gonna show here, and we've all used this, I mean, you use it every day when Amazon uses it to recommend products, Netflix with shows and movies, and also, like, Facebook with ads and everything.
What we're gonna show here is a recommender system, wide and deep, and compare the performance with both the Xeon Scalable as well as an NVIDIA GPU, a V100 GPU that's a high-end GPU in the data center, and we're gonna do this with Amazon's deep learning framework. Let's go.
Okay.
On the left side, you have the FP32 performance on the V100, and on the right it's, like, Intel Xeon Scalable, just with FP32.
You see that we're getting a 2.4x speed up over the V100 with just FP32 itself. This is for typical small batch size. The small batch size is important because this is what our customers use for getting real-time recommendations.
Okay.
I mean, when you ask Alexa for a recommendation, you're not gonna wait forever to get a response.
Sure. Sure. Now that's okay, but you didn't turn on DL Boost yet, right?
That's right. I haven't turned on DL Boost yet. When we do, this is what happens. We get yet another boost in performance. This neat animation actually shows what the magic that our architects did to get to DL Boost. What we did was we actually had about a 3X improvement in performance with, like, 3, a 3X multiplier accumulates per cycle than we had before with FP32. When you actually recommend something, we get a 1.9X speed up over FP32, and eventually a 4X speed up over the GPU.
Awesome.
Yeah.
Awesome. That's so cool.
I mean, this is exactly what our customers want. With their existing infrastructure, we're able to get the AI inference along with their general purpose workloads as well.
Great work, Niv. Thank you so much.
All right. Thank you, Navin.
Those improvements that you saw there have come through close coordination with our engineers and their industry counterparts. Starting today, all of the major AI frameworks, TensorFlow, PyTorch, Caffe, MXNet, PaddlePaddle, and all the advanced data types like ONNX are all ready to go on DL Boost. We're also investigating and working hard and investing to make sure that the high growth use cases that you heard about there from Niv , object detection, image segmentation, recommendation systems, all fully optimized, easily deployable through our tools such as OpenVINO. We've worked with the industry leaders in AI, and we've given them early access to 2nd generation Xeon. You can see some of the results they're already seeing. Microsoft at 3.4x improvement from 1st generation Xeon to now 2nd generation Xeon with DL Boost. JD.com, 2x. Alibaba, 2x-4x.
Target, 4x. Tencent Cloud, 3x. Great to see early results already showing this kind of performance improvement. We're very excited to have a broad ecosystem of support here to ensure the value of DL Boost can be delivered by companies across the globe. One of those companies who deeply understands the value of technology is Amazon Web Services, or AWS, and I thought it might be interesting to learn more about how AWS is leveraging Intel technology to offer game-changing compute for their customers. Please join me in welcoming the Vice President of Compute Services at AWS, Matt Garman, to the stage. Good to see you, Matt. Thanks for being here.
Yeah, it's great to be here. Thanks.
Our companies have a awesome track record of technology collaboration, Matt. It's only fitting to share the stage here with you and this exciting moment with you here today.
Yeah, thanks. Yeah, it's been a great journey. It's been, it's been about 13 years that we've been collaborating together since we started AWS back in 2006. The partnership with Intel has been awesome, and it's really been key for us getting the most performance for our customers, focusing on kind of custom technologies that we could bring to market, helping customers that deliver outstanding performance. Intel's been a great partner with AWS throughout that whole period as we have been growing our cloud business. Frankly, the collaboration goes beyond just the cloud business in AWS.
we're partnering across Amazon with the retail business, we mentioned Alexa earlier, we have a great partnership on our devices, as well as the machine learning and IoT, really across the board of things that we're doing in AWS.
Yeah.
You know, specifically, if you think about AWS and EC2, we have over 100 instances, in EC2 that leverage Intel processors, targeting every type of workload that you can think of, from startups to enterprises. We have T3 instances that are targeted at smaller workloads, things like everything from blogs to small enterprise applications, to the very biggest in scale-up applications, like SAP HANA, where we have an instance that has up to 12 TB of memory.
Wow.
It's instances like that which is the reason that more SAP implementations are running in AWS really than anywhere else. Another highlight that I'd love to talk about is a part of our joint collaboration on how we bring innovative instances to market, is the z1d instance. It features a custom Intel Xeon Scalable processor that provides 4 GHz of single-threaded performance, by far the fastest of any instance available in the cloud, and that's one that we worked on together to bring to market. This is really great for applications that are really performance sensitive and latency sensitive, things like online gaming, but it's also great for applications that have really high per-core licensing costs, things like EDA-style workloads or also expensive database workloads, like SQL Server.
In fact, many of our Windows customers have been excited about the performance gains as well as the cost benefits that we've given to them in the cloud, which is why more Windows workloads run on AWS, in fact, twice as many Windows workloads run on AWS than the next closest cloud competitor. Finally, I wanna call out HPC, that's the last example, which I think is a really great example of our long-term collaboration. We're on the fifth generation of our compute optimized instances with our C5 instances. With every single iteration, we make advancements for our customers. We help improve workload performance, drive down costs, and reduce their time to results. Last November at re:Invent, which is our AWS annual conference, we launched our C5n instances.
They also offer advanced networking capabilities, where we introduced 100 Gbs of network throughput for a single instance.
You mentioned earlier, Matt, 100 services on Intel architecture.
How are you seeing your customers take advantage of the optimizations that we've worked on together?
Yeah. We have millions of customers across the world, across all different types of industries and different sizes. I thought I'd highlight a couple of them, just to give you a sample of how people are using some of these technologies. The first one is BP, a global energy company that leverages AWS running on Intel processors for many of their HPC workloads. BP uses AWS to run these linear programming models that involve complex calculations based on 1,000s of different inputs. One of the cool things, I think the thing that's really exciting, is BP, when they moved to the cloud, they were able to scale out and leverage a lot more compute.
A workload that they were running on-premises used to take more than seven hours to complete. Now they can do it in minutes in the cloud. This gets them so they can rapidly change, adjust to market changes, and actually have real-time decision-making. Another example. That's kind of an example on why more people are running HPC more and more in the cloud environment.
Another example that's kind of a fun one is Formula One. There's 500 million customers worldwide that really enjoy watching Formula One races. Formula One is actually a pretty data-driven sport. It's pretty interesting. A single race generates more than 1,500 data points every second during a race, which is pretty amazing. Using Amazon SageMaker, which is Amazon's and AWS's hosted machine learning service, Formula One data scientists train their deep learning models and actually have gone back and used 65 years of historical race data, extracting critical details that kind of predict how the race is gonna go. Running on their inference on AWS and Intel, they look and they try to make market predictions real time.
As you're watching Formula One races, they try to make predictions on screen to give viewers a more immersive experience. It's kind of a fun way of seeing how ML is really infiltrating or enhancing all sorts of areas, even fun things like races where you wouldn't truly expect it.
That's cool. That's what we've done in the past together.
Yeah.
What, what do you have to say about what we're gonna work on together for the future?
Yeah. We're super excited about the launches you have today, and Cascade Lake processor in particular. We're planning on supporting Cascade Lake broadly across Amazon. In EC2, we plan on leveraging Cascade Lake to bring new capabilities and features to our customers, again, to help further optimize performance and costs, and really kind of further push down the performance on those demanding workloads that customers have, particularly really focused on inference, and you mentioned that a little bit earlier. We're really excited about what that can provide for customers. In fact, much of this work has already started. As you know, we've been working on this already. Last month, we announced plans for the next EC2 instance, which is the G4 instance.
These instances are designed custom-made for machine learning, both training, but specifically around inference, as well as things like video transcoding and other demanding applications. We think that they're gonna be able to really take advantage of some of those benefits, like DL Boost and others, for increased performance on the inference side in particular. Outside of AWS and across Amazon, others are taking advantage of this technology as well. You guys mentioned earlier Alexa. For the Alexa team, speed is super important, as you talked about. When it comes to delivering a fantastic customer experience, really you've gotta have that low latency for those inference workloads. The Alexa team has been benchmarking on automatic speech recognition and natural language understanding using the DL Boost technology that comes with Cascade Lake.
So far, the results actually have been really promising. They're seeing a 2x speed up in inference when they leverage DL Boost. Overall, we're really encouraged by the early testing of Cascade Lake processors and are excited to see kind of what machine learning applications come from our customers as we start rolling it out.
Great. Thanks so much, Matt, for the partnership.
Yeah.
Thanks for the collaboration. We're excited about what we can do for the future.
Great. Thanks for having us here.
Thanks. Congratulations. Thank you. I talked earlier about the cloudification of the network and the emergence of the edge. We know that Intel architecture has sort of become the platform of choice for this trend. We've been after this for many years now, and it speaks to the efficiency and cost savings that customers can see by moving to a more virtualized cloud-native network infrastructure on Intel architecture. We've been at this for many years, as I mentioned. We started the notion of NFV or network function virtualization eight years ago in 2011. We started doing the first proof points in 2013. We open sourced the technology Data Plane Development Kit, DPDK, in 2017.
In 2017 as well, at the first generation Xeon Scalable launch, I had John Donovan from AT&T on stage at that launch talking about how AT&T intended to virtualize 75% of their network infrastructure by 2020. At MWC, they announced that 65% is already complete. Of course, at MWC this year, we also saw the announcement by the e-commerce provider I mentioned earlier, Rakuten, saying that by October of this year, they would launch the world's first 100% cloud-native network to deliver new services at not just the speed of the network, but also at the speed of the cloud. Very exciting to see the progress here. In that context, we're taking advantage of that unique network know-how today, and we're taking it one step further.
We're taking the learnings from those five years of NFV proof of concepts, literally hundreds of NFV proof of concepts with customers around the world, and we're offering specific SKUs that are optimized for the network today. We call them the N- SKUs. They have the right balance between core count and thermals and frequency to deliver the maximum performance for network workloads. These capabilities provide significant performance enhancement generation on generation. We're seeing a 1.7x improvement on those NFV workloads from the 1st generation Xeon Scalable to Cascade Lake or the 2nd generation Xeon Scalable. It also delivers enhanced quality of service. I thought it'd be interesting for you guys to see this in action.
To demonstrate this, and to show you the value of this capability, I'd like to invite up our Senior Vice President for the Network Platform Group, Sandra Rivera, to the stage. Welcome, Sandra. Hey, Sandra.
Hey, Navin.
How are you?
I'm great.
What do you have to show us today?
Well, as you've been talking about, we have lots of innovations in our second generation Xeon Scalable for networking, and we're really focused on allowing our customers to drive greater network throughput, meet their stringent service level agreements, and then deliver a lower TCO.
We're introducing some new features called Intel Speed Select Technology-Base Frequency that allows our customers then to prioritize and optimize their processor for the most demanding workloads.
Okay.
If you want, I'll show you how this works.
Well, let's do it.
Okay.
Let's do it.
Over here in our demo, you see on the left-hand side our original Xeon Scalable and then our second generation Xeon Scalable processor. We're gonna deploy an Open vSwitch networking workload, a very common, very stringent workload for networking applications.
I'm going to go ahead and deploy that. You can see on the left-hand side, we've got the original Xeon Scalable, but on the right-hand side with our second generation Xeon Scalable, we're getting a 1.56, 1.57x performance improvement in terms of processing of those packets. That's on the right-hand side, a 20-core CPU, all those cores are running at 2.3 GHz in that same 125 W TDP envelope. As you mentioned.
network workloads tend to be power constrained. Gen on gen, you're getting a 1.56x performance improvement.
That's pretty cool.
Very cool.
You mentioned a new technology in there.
Yes.
Speed Select?
Speed Select Technology-Based Frequency.
You haven't turned that on yet, right?
Nope. I'm gonna show you that now.
All right.
What we can do when we actually hit, or we deploy the Speed Select Technology, now what you've got is 6 of our cores running the Open vSwitch workload now locked at 2.7 GHz. The rest of the cores have now been locked at 2.1 GHz, so you're still in that same 125 TDP envelope, but you're getting the increased performance of that network, that demanding network workload, and you're all the way up to that 1.74, 1.75, 1.76 X. Pretty cool improvement.
That is super exciting. Thanks, Sandra, for doing that. Appreciate it.
Thank you. All righty.
See ya. Thanks. Okay. As you saw from that demonstration, the Intel Speed Select Technology helps the communication service providers think about how to deliver more performance for those NFV workloads. We're well underway with trials with many of the comm service providers around the world. Let's hear from one of those providers, one of the largest mobile network providers in the world, Vodafone, about how they're delivering more value with second generation Xeon Scalable.
Vodafone is one of the world's largest telecommunications providers. We operate in 25 countries where we're the home mobile operator. The biggest challenge that you have when you're operating at the scales that we operate is keeping up to date with the trends of our customers and the demand that they put on us. We've been moving aggressively to the cloud using x86 based applications and processors to enable us a much greater speed to market, but also so we can gain access to the data to really optimize our services and automate things end-to-end for our customers. Intel has been really important to us in helping us make this transformation journey. When we first conceptualized it, putting these really, really specialist applications on general purpose hardware, frankly, we weren't sure it was possible.
We've had a lot of work from Intel, but as well, the entire ecosystem that Intel sponsors and populates around the x86 architectures. Being an early adopter of the new Xeon Scalable processors is actually really important to us because we get on a front end, bringing forward performance and economy as early as possible in the journey. Intel's integrating the thing that was maybe hardest, which was the core accelerators for the network workloads. Network workloads have always been one of the hardest things to actually inject into a general purpose processor. We have a very specific problem around low latency, high throughput, the most demanding things. Actually, the new architecture that integrates the network functions to give us an acceleration, that injection in the architecture is what really is going to unlock the growth of the network cloud for us.
We're really excited about the transformation that we're driving in the network. What it enables us to do is bring a higher degree of automation, much higher degree of reliability, but also to let us scale to a degree that exactly fits what our customers' needs are at that moment, and that ultimately will make us the best service provider on the planet.
Those new network optimized SKUs are a good example of how we're innovating to get data in and out of the CPU more efficiently, process data more efficiently. What happens when the data isn't getting to the CPU fast enough? You know, thanks to the array of assets that we've been developing over the years at Intel, we're able to optimize more than just the CPU. We try to take a system-level view of the problem. We try to remove performance bottlenecks wherever they exist. What I wanna do now is invite one of our partners to the stage, Twitter, to talk about how they unleash CPU performance through that system-level approach, that system-level optimization. Please join me in welcoming Matt Singer, the senior staff hardware engineer at Twitter to the stage. How you doing, Matt?
Hi, Navin, how are you?
Thanks for being here.
It's great to be here.
Matt, Twitter handles a ton of data every day. What kind of challenges does that pose for you guys as you think about your infrastructure?
That's right. There are hundreds of millions of tweets every day. When users interact with those tweets, it turns into actually over a trillion events per day. That's a lot of data. For example, if I were to tweet right now. Do you have time for a selfie?
Sure.
You're tweeting that right now?
Tweeting that right now.
Okay. That's cool. If everybody in the audience right now is liking that tweet and retweeting that tweet, all those events are streaming into Hadoop.
Hadoop's an important part of storing all of those events and performing analytics on that data. Our clusters at Hadoop collectively have more than an exabyte of physical storage.
Wow.
A typical Hadoop cluster can have over 100,000 hard disk drives, and that will translate into 100 PB of logical storage in a cluster.
Wow, that's a ton of data to process, analyze, store. What is your top challenge in scaling out that Hadoop cluster you talked about?
Because of their affordability, hard drives are the workhorses of Twitter's clusters, but hard drive capacity has increased over time, but their IOPS have remained essentially flat, and that's resulted in a storage bottleneck. As you can see here, typical flow in and out of a Hadoop server is composed of 2 parts. There's HDFS, which is the way that data is stored in Hadoop, and temporary data managed by YARN. Those 2 data flows often occur at the same time, and they cause contention to access the hard drives. This results in a performance bottleneck. To look at how we might overcome this bottleneck, we worked in collaboration with an Intel engineering team to run a series of experiments. It turns out that by selectively caching the YARN temporary data to a fast SSD, we're no longer competing for the same resources.
Hard drive utilization dropped, and Hadoop could process data faster.
That's fantastic. What does that translate into in terms of your data center footprint?
Sure. Removing that storage IO bottleneck enables us to greatly reduce the number of racks in our cluster, which gives us a much smaller data center footprint. First, we achieve that by moving from 12 smaller to 8 larger hard drives per system, which reduces the number of hard drives in a cluster without negatively impacting performance.
By removing the hard drive performance bottleneck, we can now take advantage of a lot more CPU horsepower. We moved from 4 core processors to 24 core 2nd generation Intel Xeon Scalable processors.
Wow.
The combination of the larger hard drives and higher core count processors means we can reduce the number of systems, hard drives, and racks in each Hadoop cluster in our data center, which leads to reduced maintenance cost and much better energy efficiency.
It's really great that we can have the same result for about 75% less energy consumption.
Wow. Wow. That's awesome.
We expect that caching temp data and bumping up processor core counts results in up to 50% faster runtimes, and the increased density results in 30% lower TCO. This sets us up to be ready for continued growth of our data while still delivering the great experience our users expect.
That's a great story, Matt. You added a fast SSD. You added smart caching. You were then able to go from four cores to 24 cores, boost performance, and reduce cost. I guess at the end of the day, that's what matters the most.
It is
congratulations on that. I'm glad we were able to work together to find a better solution.
Yeah.
Congrats on 2nd-gen Xeon helping you guys out. Appreciate your time.
Thanks, Navin.
Thanks for being here.
We really appreciate Intel's collaboration.
Thank you very much.
Thank you.
That's a great example of how optimized storage can result in better system performance, lower TCO. That's why we continue to innovate with new storage products and innovative memory technologies. Today, we're disclosing 2 new storage products. A new Optane Data Center SSD. This drive brings dual-port capability for the most mission-critical applications, 24 by 7 access, kind of applications. We're also launching the industry's first EDSFF compliant drive, a QLC NAND ruler drive, which brings 1 PB of storage into a very small ruler form factor that you saw earlier. That's gonna enable a 20X storage rack consolidation when you compare that to the hard drives of today. We're not stopping there. There's other problems to solve.
One of the biggest problems the industry has faced for decades is the problem where DRAM doesn't support the capacity that application developers need. It doesn't allow for persistence, where the data continues to be stored when the power goes out. NAND doesn't provide the speed that the data-centric world we live in today demands. We've been at an invention of something brand new and something highly disruptive, and I'm excited today to be bringing that to the market. Optane DC Persistent Memory. This is a decade in the making for us, and we've reached this milestone not just for Intel, but for the entire industry. Thousands of Intel engineers working on this technology, deep industry engagement. We're excited to be delivering Optane DC Persistent Memory together with the second generation Xeon Scalable.
This is a great example of something that we are uniquely positioned to deliver. This required us to invent a new Optane media on the memory side. It required us to reinvent the memory controller in the CPU. It required us to develop new firmware to have these pieces to work together. We had to invest heavily in bringing together the software and solution optimization from the entire ecosystem. What I'd like to show you now is the largest memory module in the world. This is the Optane Data Center Persistent Memory module. I'm holding 512 GB of memory in my hand. This is 2x-4x what you can get with DRAM. We expect system capacity in a server system to scale to 4.5 TB per socket or 36 TB in an 8-socket system.
That's 3 times larger than what we were able to do with the first generation Xeon Scalable. This larger capacity allows us to unlock performance, reduce those bottlenecks that we talked about earlier. There's a couple examples here on the slide. Redis virtual virtualization instances, 8x more instances per system, while still meeting the sub-millisecond SLAs that Redis commits to their customers. SAP HANA delivering now new levels of record database performance than they've ever been able to do before. 9.1 billion records in a single database using Optane Persistent Memory. If that sheer capacity wasn't amazing enough, what may be the most interesting part of this technology is that we're gonna break through memory economic bottlenecks. Remember that DRAM represents up to 60% of the total cost of a system.
Optane is going to change the economics of memory. Our industry collaboration is what has fueled our work from day one here. We have been working with ISVs, OEMs, cloud service providers to bring the value to our customers. I'm excited today to bring on stage one of the partners that's been with us from day one, and that is SAP. We've worked together with SAP for over 20 years now. The last six years have been highly focused on delivering value from persistent memory to SAP HANA. Please join me in welcoming the Senior Vice President and Head of Database at SAP, [Gerd Koether], to the stage. Good to see you, Gerd.
Thanks for having me.
Thanks for being here. You know, it wouldn't be right to launch the second generation Xeon Scalable and Intel Optane DC Persistent Memory without you guys. We valued working closely with you guys to bring the value of persistence to SAP HANA, so I'm happy you're here. Thanks for being here.
Yes, we've taken advantage of our early access to the technology to deliver the first major database platform optimized for persistent memory with our SAP HANA 2.3 release last year already. We are glad to see that persistent memory is now broadly available. We really feel our HANA customers will be delighted with the increased memory capacity, lower TCO, and improved business continuity persistent memory enables.
Gerd, can you explain some of the early use case scenarios for persistent memory that you're seeing?
Well, persistency on non-volatile memory is the place to start. We are seeing data loading times at startup from 50 minutes down to 4 minutes on a 6-TB system.
Wow.
We are also seeing customers delivering more efficiency through consolidation of multiple systems into one system. Lastly, customers are innovating with disaster recovery consolidation-System replication and use cases that need more resource intensive capacity, like our built-in HANA machine learning and predictive analytics capability.
How have your customers responded to this value that you've been able to deliver so far?
Yeah. We had a terrific early response from our customers. For example, Evonik, a global chemical company, is using the increased capacity of a persistent memory to consolidate systems, reduce operating costs, and improve the S/4HANA performance. Another example is an engagement we have with Geberit, a large German appliance manufacturer. They are seeing opportunities to further reduce complexity and consolidation opportunities going forward. I'm looking forward to sharing more of those use cases and stories as we arrive with the broad availability of the persistent memory.
That's great. How are you guys gonna continue to push? How are you gonna continue to innovate, persistent memory in the future?
Yeah. Well, to start with, HANA, SAP HANA 2.4, the release is coming out this month. It's further enhanced with more persistent memory features and benefits. Look for more innovation to be showcased at our Sapphire conference in May in Orlando. Additionally, we plan to support for 4.6 TB per processor or the maximum allowable, which is up to 6x larger than the first generation of the Intel Xeon Scalable platform processors offered-
Interesting
in a 4-socket configuration.
That's awesome. [Gerd Koether], thanks for sharing the momentum on SAP HANA.
You're welcome.
We look forward to hearing more at SAP Sapphire, next month.
Yeah.
Thanks for being here.
Thanks.
Appreciate it. We're really proud of the ecosystem we've developed around Optane persistent memory. We have over 50 of the top ISVs, OEMs, cloud service providers, all engaged and ready to go on Optane persistent memory. One of those companies, I handed off the first production Optane DIMM to them last year for early beta testing, and that was Google. I'm excited today to talk a little bit more about the momentum they've already been able to build since that point in August of last year. Please join me in welcoming the Google Vice President of Platforms, Bart Sano, to the stage. Bart, come on up. Good to see you, bud.
Good to see you.
Thanks for being here.
I'm delighted.
Bart, last summer, you and I had a historic moment. I handed you the very first Optane.
Right
persistent memory module. What have you guys been doing with it?
Well-
Can you tell us how it's been going?
It'd be a pleasure. As you know, Google Cloud strives to be the first provider for all of your new technology and to get it to market as fast as possible.
You know, the Optane is one of those perfect technologies for certain workloads, and those workloads are in memory database applications, as was talked about with the SAP HANA. What we've been doing is that we've been doing some testing with that technology, and SAP HANA has been great. SAP has been great about trying to take it full advantage of all the capabilities, which is for our customers. We've been running with some customers on that technology with Colgate and ATB Financial, and they've been actively testing with the technology. We've actually opened it up to wider to Redis Labs and to Aerospike.
That's great. Why was that a specific focus for you guys as you were doing your?
Well, we believe that Google Cloud offers the best infrastructure for SAP applications in the enterprise space. I think there are three reasons why. You touched on some of them. One of them is the sheer capacity that this Optane technology allows for. You're able to have large data sets in memory and at in-memory speeds, that's one thing. The data persistence is another very important thing, where you're able to quickly recover from either reboots or whenever you're doing upgrades and things like that, it's very fast. Finally, I think that Optane provides a credible alternative to DRAM. I think that now customers don't have to balance against operational efficiency versus cost. We're really happy with things that are going on.
I think our customers are very happy right now, and we can't wait to actually deploy this wider in our global infrastructure.
This is a great example of how Google Cloud and Intel, through our alliance, are driving value for your customers.
Yeah.
The GCP instance is fueled by the Intel technology, right, Bart?
That's right. I mean, this alliance has been a very productive alliance. I think that, you know, back in 2017 when we introduced Skylake together, as one of the first to market with that, it really demonstrated how this landscape is changing. That is to say that the cloud market is, the cloud platform is basically the fastest platform that you're gonna be able to introduce this technology. Basically building upon that, last year in October, we actually introduced the 2nd generation Xeon processor, which is also known as Cascade Lake. Building upon that is what we offered at that time. I'm really excited today to announce that we're also offering 2 new offerings. One is for compute, and one is for memory optimized VMs.
The compute optimized VM instances are powered by these new processors, and they provide over 40% improvement over all of our prior generations of VM instances.
Right.
That's a huge offering. Secondly, the memory optimized VMs is also known as M2, offers the highest memory configuration for these processors, up to 12 TB of memory capacity and 416 vCPUs, otherwise known as virtual processors. These will be able to run virtually any scale of application. We're really excited for all of this technology, and we really wanna congratulate you on bringing it to market.
That's exciting news, Bart.
Yep.
Thank you for that, and congratulations. Thanks for being a value partner for us. I noticed something here.
Yeah.
I don't know what that is, but.
Yeah
Do you wanna tell people what that is?
When you gave us that first DIMM, it was such a precious thing, and it really meant a lot to us. We actually have a little magical little group that makes swag. That's what Google is known for, is making swag. On this little plaque says, "Optane, first off the line and first in the cloud." I promised to put it in to its hardware qualifications. We finished all that. I abused it as much as I could. I kind of broke it. I thought I'd return it to you.
You still have to pay for it, though.
Oh, well, okay. Not if it's a no troubles found. Anyway, no, in all seriousness, we have actually two of these plaques, one for your team, one for our team. We can go and sign our names on it, put our little logos on it. I really want to commemorate that time. It's a very important time, and it's a long journey that we're embarking on here to introduce a brand-new memory technology, and it's not every day that you do that. I just wanted to make sure that you got some sort of plaque.
Well, thank you, Bart. I appreciate the swag. Thanks for your partnership.
Thanks.
We really appreciate it. Thank you very much. It's been an exciting morning so far. What you've heard is that we're bringing forward the broadest data-centric portfolio we've ever brought to market, all designed to help move data faster, to store more data, and to process everything from the cloud to the edge. You heard about the second generation Xeon advanced performance, up to 56 cores. You heard about our second generation Xeon Scalable with DL Boost for AI accelerations. You heard about new optimizations for network function virtualization and network workloads. You heard about Optane persistent memory, new Optane and NAND SSDs, and you're gonna hear more about the rest of the portfolio from Ethernet solutions to FPGA.
We're thrilled about the broad partner and customer support that you saw today, but we're just getting started. It's my pleasure now to continue with our data-centric launch to introduce our Vice President of the Data Center Group and General Manager for Xeon products, Lisa Spelman, to the stage to keep going.
Thank you. I didn't bring a plaque. I didn't know. That was cute. Thank you, Navin, and thank you all for being here. Now that we have covered our core data center workloads, I'd like to take a little trip with you to the edge. As data generation continues to scale and service delivery requirements grow and grow, more processing is going to happen out at the edge at the point of data creation or data collection. The build-out of the industrial IoT edge and the network edge implementations will include tons of use cases across a bunch of different industries. We're gonna see smart factories, stadiums, edge cloud service delivery. To give a sense of scale, by 2021, there will be 7 million service delivery edges in play, and that's in addition to 39,000 core data centers all running data-centric workloads.
One of the earliest network edge deployments to reach scale is content delivery networks. In more technical terms, that's called what supports your binge-watching of shows. Today, 97,000 hours of entertainment are streamed every minute by Netflix. I find that astounding. It's estimated that CDNs are responsible for greater than 60% of internet traffic, so this is obviously a really big workload. With growth at this speed, service providers and operators are looking for as much capacity and scale as possible to satisfy your relentless demand for content. Along with, they need memory and new modern storage technologies to help put more and more out at the edge. Let's take a look at how solutions with Xeon Scalable and with Optane DC Persistent Memory are gonna help change and satisfy this need.
We've been working with Qwilt, a CDN edge cloud developer who is focused on driving the future of online content application delivery. Visual content has traditionally been held in storage in traditional storage devices. Accessing that content can at times be slow or inefficient, it leads to a bottleneck and also a not very good user experience at times. This limits the availability and possibility for these content providers to scale their ever-growing catalog of content. Let's see what happens when we increase the capacity and remove some of those bottlenecks. I'm gonna show a demo here. Let me get it started. What you're seeing up on the screen is the difference between edge services being delivered with DRAM alone and those also being delivered with Optane data center persistent memory.
You can see as you move to streaming of sports games, the content is requested from the user. In the DRAM-only use case, it hasn't yet been pushed to the edge. The capacity isn't there to hold that full game of content. You see a worse user experience with some jitter, some latency that's built in there. In contrast with the large memory, you have the ability to hold that data closer to the processor and closer to the point of use. Again, you don't need to go back to the point of origin or the data center to get the content that you need. We see incredible potential for this solution in the CDN space. Leaders like Qwilt agree. They're planning to deploy this technology to help scale their edge services as well. They aren't the only ones.
Comcast has done early testing with us, and they had this to say about the results that they're seeing. As you can see, they're seeing better access to their content, they're driving down their total cost of ownership, and they're significantly increasing their performance. A great result. Now that we've gone through one of the biggest use cases of the network edge, I'd like to talk a little bit about the intelligent IoT edge. Again, every industry we see customers building out edge inference systems that consolidate vast amounts of data, and these can be complex data types. Again, you're seeing video, images, audio, voice, all happening at that point of content creation.
Enabling better healthcare, smarter cities, automated traffic and parking, which I look forward to personally very much, improving retail services, inventory management, improving the quality and the safety in factories and manufacturing lines are all critical use cases that will drive these deployments. They require real-time performance, they require low latency, and they require data security. They face a lot of current challenges, whether that's the bandwidth constraints, the actual cost of the service implementation, and lack of persistent and reliable connectivity. Our data-centric portfolio has been built out to deliver many products to satisfy these use cases. We have our Intel Movidius vision processing units for AI edge inference. We have our Mobileye autonomous driving solutions. We have our Atom processors. Specialized silicon is a core part of our strategy for satisfying these workloads, but a massive amount of edge services will be delivered on standard Xeon processors.
In recognition of that, we are delivering second generation Xeon Scalable processors with SKUs that are specifically formatted for IoT use cases. You see extended temperature ranges, ability to handle ruggedization, and longer life. They also contain, and this is really important, the full suite and capabilities of the architecture. They include DL Boost, which is gonna be critical for that edge inference. It gives our customers a great way to deliver those services end to end. By some estimates, up to 50% of inference will be done at the edge over the next several years. In recognition of this mega trend and this shift in the workload, we've invested not just in the hardware, but in the software as well.
An example of that is our open source OpenVINO toolkit, which is a suite of framework-agnostic software tools that fundamentally drive up the inference performance, whether you're working at the edge in your edge cloud or in the [core] cloud. Again, they work with all of the frameworks, so it's added performance on top of your baseline AI architecture. To make it real, I'd like to share an AI use case in healthcare for you today. The health and life sciences industry is leveraging AI to accelerate clinical workflows, improve the accuracy of diagnoses, which is so important, and reduce hospital costs in order to better serve our global economies and the citizens of the world.
To share how we've worked together to optimize cardiac MR segmentation models, it is my pleasure to welcome to the stage the senior director of MR and R&D collaborations from Siemens Healthineers, Stuart Schmeets. Hi. Welcome, Stu. Thank you for coming.
Thank you, Lisa. It's a pleasure to be here.
Yeah.
It's a very, very exciting day.
Yes, it is. It's a big day.
It's great. We all know that the effects of heart disease have a tremendous impact on our society. To put this into perspective, someone in the U.S. has a heart attack every 40 seconds. In fact, every minute, someone dies from a cardiovascular-related event. That's not to mention the impact on our society of the quality of life and the productivity of the people who live with these diseases.
Those are amazing and scary statistics, honestly. I wanted to ask, how is the reality of those statistics driving the work that you're doing at Siemens Healthineers?
Yeah, absolutely. Advances in our MRI technology are already enabling access to important information in the diagnosis and monitoring of cardiovascular diseases. These advances are an excellent example of how we're expanding precision medicine and transforming the care delivery.
Okay.
There's a challenge, and that is, while the accuracy and the efficiency of our technology is improving.
Yep
The exams, the volume of data, the number of patients that have access is going way up.
Okay.
That's greatly increasing the burden on the clinicians that are having to evaluate this data.
Okay.
That's one reason why, at Siemens, we believe that digitalizing healthcare is so critically important.
It's the only way to keep up with that scale. The data problem represents an opportunity, really. Can you share with everyone what we've been working on together?
Gladly.
Okay.
Now through our research collaboration with Intel, we have demonstrated the potential for artificial intelligence at the edge and in the cardiology and in the radiology department at the exam console. We're able to bring near real-time MRI imaging analysis to the exam evaluation. Let me start the demo real quick.
Yeah.
I can show you what I mean.
Near real time is great. I hear this is your, you're gonna show us some data from your colleague here.
Yes, absolutely.
Yeah.
I never get tired of these images. This is an image of the beating heart. Very exciting. What you're seeing in the demo here, on the left and the right, it's the same picture of the heart.
Yep.
The green circle with the red center is the left ventricle, and that plug pumps blood to the entire body. In both examples, we have an algorithm that's segmenting and analyzing all of the images to produce the clinical results. What you'll see is that on the right, on your right, using 2nd generation Intel Xeon Scalable processors with Intel Deep Learning Boost and the Intel Distribution of OpenVINO toolkit, we're achieving over 200 frames per second. What's cool about that is that represents a 5.5 times increase in speed over Intel's previous generation processors.
Yeah. It's impressive to see how technology can accelerate these patient outcomes. Especially, I've waited for an MRI result, so thinking about making it near real-time is a game changer.
Absolutely. With this rate of acceleration, Siemens can potentially develop solutions that will further reduce time-intensive analysis, leading to faster results that can be analyzed almost in real time. With that, doctors can make faster decisions about the care of their patients.
Yep.
It's, it's like what we were talking about just previous to this. AI performance must keep pace with clinical workflows in the hospital environment. One of the things that we think about every day is while technology improves and while quality goes up, we can never stop or lose focus on keeping costs down. That's why I'm excited that the DL Boost technology, I believe with that we can increase the efficiency and productivity of our MRI systems without the additional expense of specialized accelerator cards. That's truly groundbreaking.
That's fantastic. It's so exciting to see this vital work that the Siemens Healthineers team is doing and delivering, not just to the industry but to the world, making these healthcare solutions better, and we're motivated and committed to work with you to continue to advance there. To put this in context for the audience, I don't know if you know this, but Siemens medical imaging devices touch 240,000 patients every hour. It's a huge scale.
Absolutely. Thank you so much, Lisa. We really appreciate Intel's collaboration in helping us bring the benefits of new technologies to the healthcare system and keeping our promise. What we've promised our customers is to work with them to expand precision medicine, transform care delivery, and improve the patient experience. To do that, we believe we have to digitalize healthcare.
Okay.
We thank you for your support.
We'll do it together.
Absolutely.
Thank you, Stu. I appreciate you coming out today.
Thanks, Lisa.
That was a great example from the Siemens team on an edge inference use case. We recognize that the workload is vast and wide, and the demands are also. We've invested in some additional products to further accelerate our customers' data opportunities. We have our Intel Ethernet 800 Series, we have our Intel Xeon D-1600 series, and we have our Intel Agilex FPGAs featuring a new brand. Let's start with the FPGAs. FPGAs are fundamentally a flexible by design compute resource. They deliver investment protection through their inherent reprogrammability. This is especially valuable in use cases like 5G. As many of you know, 5G standards are continuing to evolve, and they will continue to evolve over the next several coming years. With FPGA implementations, you have the ability to have your hardware evolve with those changing standards.
They also have incredible value in many other data-centric use cases where customers just need more performance, lower power, and higher levels of integration to provide that ultimate in agility and flexibility. For this discussion, I'd like to invite to the stage our Vice President and General Manager of Product Marketing in our Programmable Solutions Group here at Intel, Patrick Dorsey. Please help me welcome him. Hi, Patrick.
Hey, Lisa.
Yeah.
Thank you.
Thank you for coming. All right.
It's great to be here. I'm super excited. Thanks for having me out.
I know. You've got some good stuff to share.
All right.
We've seen a lot of great traction. We were, you know, at Mobile World Congress this year on the current generation of FPGA products for 5G, and that's been fantastic. I think you have some new news to share with us about everything else we're doing.
I do. I have some great new news to share.
Okay, good.
One thing first. What we're seeing in the market is some of the broadest adoption of FPGAs that we've seen in years. I've been in the industry for 25 years, we're seeing in terms of both the revenue and more importantly in terms of design wins.
Okay
just real strong strength. Now today, we're accelerating that strength. Today, we're announcing a new brand, a new FPGA brand for a new class of FPGA. We call that brand the Agilex FPGA.
Okay.
A couple of key points, if I could.
Yeah, I'd like it.
Make 'em. Okay. All right. One, this is the first FPGA on Intel's 10 nm process technology. This is gonna create incredible performance breakthroughs, a 40% increase in performance.
Okay
40% lower power, 40 teraflops type DSP performance. We could go through a lot of metrics, but incredible performance.
Okay, fantastic.
The other thing we're doing is any-to-any integration. What we mean here is multi-die. We mean EMIB or Embedded Multi-die Interconnect Bridge that allows us to bring heterogeneous functionality.
Yeah
right? Into 1 device. It's about any developer. Classically, you develop with an FPGA as a hardware developer. We're bringing the software developer in with the full suite of Intel tools.
Okay, that's fantastic. With all this innovation going into Agilex, what are the customers gonna see? What does it mean for them?
Yeah. For customers, what you're seeing with FPGAs again is this broad adoption. You're seeing it in infrastructure, you're seeing it in networking, you're seeing it in storage. All these applications.
Yeah
are taking advantage of the inherent parallelism of an FPGA, which brings you performance and power advantages. What we're now seeing with Intel Agilex in this any-to-any integration is the ability of workload convergence. We're being able to address many of these applications in a single platform, single Intel Agilex platform, and in many cases, a single device. Saves a lot of TCO, saves a lot of costs for our customers.
Okay, that's fantastic. You know, the acceleration of the diversity of workloads truly resonates. It's what we've been talking about all day. You know, I love Xeon. Can you tell me a little bit more about how these Agilex FPGAs are gonna integrate with the data-centric portfolio and our Xeon products?
Yeah, of course. I love Xeon too, as you know.
Good.
Integration across the Intel portfolio is our focus. I'll say this is the first FPGA 100% developed by Intel. When I say that, I mean process technology, I mean the architecture, as you suggest, the connectivity. The integration that we're doing, number 1, it starts with the developer, as I said before. The hardware, software developer capabilities like OpenVINO and having a common developer experience, not only to the FPGA, but to the rest of the Intel portfolio. If you look at the Optane DC persistent memory, our ability to pull that in and make that a natural memory hierarchy storage with the FPGA is critical.
Last, I'll say it's the first FPGA to fully take advantage of Compute Express Link, which is this coherent, low latency connectivity to the Xeon, which is gonna take us performance much, much higher. I think as you can see, very exciting for customers.
No, it's a great opportunity. It'll be interesting to see what those developers do once they realize they have access to memory through the FPGA and the CPU together using CXL. Lots of promise there.
I agree. Gonna be fun.
Yeah, no, it's gonna be great. I just wanna thank you for sharing all of this exciting news with us, and we're definitely looking forward to seeing the team's continued progress as you bring these to market and how we put them all together into solutions based on Xeon too.
Thanks, Lisa. All right.
All right. Thanks, Patrick.
Thanks, everyone.
Appreciate you coming. Moving through then, four years ago, you guys may remember, we announced our first Xeon D processor, and I am happy to announce today our newest member of the family, the Intel Xeon D-1600 processor. Featuring high density, a highly integrated system on a chip design, the Xeon D processor has unique capabilities that are really well-suited for power and space constraint network, Edge, and storage environments. It goes down to 27 W , again, for that low power use case, and has integrated Intel QuickAssist technology that allows you to accelerate encryption. These are used for control plane, they are used for security, mid-range storage devices, and they require and deliver the performance of Xeon and the efficiency of an SoC design. Let me set that one down there. Intel is also engineering innovation for network connectivity from the data center out to the Edge.
As one of the original inventors of Ethernet, did you know that? We have been delivering foundational network adapters for over 35 years. With the delivery of our Intel Ethernet 800 Series, I'll also show that to you here, we continue our long history of innovation. This foundational NIC contains port speeds of up to 100 Gb. It has support for RDMA and RoCE version 2 and iWARP. We're also introducing an innovative feature called Application Device Queues, and I'll share a little more about that. The Application Device Queues, or ADQ, provides applications dedicated express lanes, if you will, for critical traffic. You can choose which traffic is your highest priority. The result for that application is increased performance and reduced latency. This isn't just a theoretical feature that we've invented here.
We have application providers that are already doing the work to optimize for this feature. The example I'm showing up here is the Redis, a leading open source database provider. They're seeing, with their optimizations, a 45% reduction in latency and a 30% increase in data throughput. We're looking forward to not only the results that Redis is delivering with its Ethernet product, but what all of our application providers are going to be able to do as they optimize for this advanced feature that we're introducing right now. You've heard several examples today of the benefit of optimizing software for new hardware, just like the one I shared. These real customer workloads represent modern hardware running on modernized code, which is a fantastic experience.
As someone who managed Intel IT infrastructure, I can assure you all that that is not always the reality that we face in the real world. Many companies need to address a sobering reality of their data center infrastructure that is aging and has hardware and software that are incapable of harnessing and providing insights to them in this data revolution. According to IDC, the average age of servers operating in data centers today is five years old, and that's the average. The cost associated with aging hardware and software infrastructure can often exceed the cost of new acquisition of both, and you further complicate your environment when you move past optimal life cycles. At the same time, it's estimated that the improved performance and agility of a refreshed server brings over $100,000 of additional business value when deployed.
five years ago, it's estimated that 9 million servers were sold. If you'll do a little math with me, 9 million servers at $100,000 of business value per server means that we have the opportunity together to unleash at least $900 billion of untapped business value in 2019 alone. I'd say it's time for a refresh. Let's take a look at what some of that refresh performance will look like for customers. For those five year-old servers being refreshed to the latest generation of Xeon Scalable, you're going to see greater density, lower cost, and just increased performance, plain and simple, across the broadest range of workloads for network storage and compute use cases. This is not just with the Platinum SKUs as well.
As Navin talked about, customers using the Gold and Silver products will see a great combination of performance and value to power their general purpose workloads. At Intel, we're working with partners across the industry to drive IT modernization because we think it's so important. There's no partner in the industry that's as engaged in this mission with us than Microsoft. To discuss more about how we're working together to accelerate that IT modernization, I would like to invite to the stage the General Manager of Azure Infrastructure at Microsoft, Arpan Shah. All right. Hi, Arpan.
Thank you for coming.
Thank you for having me.
Yeah, it's great.
This is a great reminder, this lineup.
Yes.
How we've been working for decades.
Yeah
on delivering solutions to customers.
Yes.
PCs, servers, cloud.
Yeah
just great to be here.
Yeah, we got the whole thing. Before we go into some of today's exciting announcements, I was wondering if you could talk to us and share a little bit about how Microsoft is viewing the world of enterprises today.
I mean, there's no doubt the cloud has grown.
Yep.
I mean, people are moving workloads there. We're seeing great success. Customers are innovating with Azure.
Yep.
We're also seeing loud and clear that customers also want hybrid options.
Okay. Yep.
They want to run workloads in their data center.
Yep
emerging categories edge computing.
Yep.
They want to have applications, near users, near data, so there's no latency. They can do inferencing at the edge. These are some of the use cases we talked about before.
Yep. No, that's fantastic.
Our goal is actually to make sure that we deliver the most comprehensive and consistent experience.
Yep.
Even you talked about aging infrastructure.
I did.
Customers who have Windows Server 2008 or SQL Server 2008, as they come end of life, Intel and Microsoft have options for customers.
Yep.
They can either move or migrate to Azure and get free extended security updates.
Okay.
It's 5 times more cost effective than any other cloud. Customers can modernize their infrastructure with the latest software and hardware. Really excited about giving all these options to customers.
I think that you're hitting on a key point, that our customers are really seeking. They need the ability and the performance of the cloud, but they do want choice.
They want both.
the ability to work in the public cloud. They want their hybrid multi-cloud opportunity.
Right.
You have to address the whole suite to really help them.
That's right.
Okay.
One of the unique things that we did with Intel is actually bring Azure Stack to market.
Okay.
In 2017, we delivered this integrated system, and today, I'm happy to say we have customers in more than 60 countries worldwide across verticals.
That's great.
People can literally bring, well, not literally, but bring Azure into their data center and bring Azure to the edge. They can build native applications, manage native applications consistent with Azure. Customers like KPMG, Airbus, and even the government of Malta.
Yeah
are using Azure Stack today. Last week, along with Azure Stack, we made available now Data Box Edge.
At the edge, okay.
Data Box Edge enables AI at the edge and is powered by Intel FPGA.
Yeah. No, that's great. It's been a great partnership. You made some additional announcements this last week. You've been busy.
I have been very busy.
Yeah.
Thanks. Again, working with Intel, one of the things that customers tell us is, "Hey, Microsoft, that's great. We love the cloud. We love Azure Stack. Boy, I have some traditional applications.
Yeah.
I'd like to modernize my infrastructure.
Yep.
Last week, we announced Azure Stack HCI.
Okay.
Azure Stack HCI is modern HCI, hyperconverged infrastructure.
Yep
which can lower customers' costs and improve performance. Customers love it because it actually helps them with the cost performance.
Yep.
They can use their existing skills and still take advantage of modern infrastructure. The beautiful thing about Azure Stack HCI is it's the same foundation as Azure Stack.
Okay.
It also allows customers to use Azure services for their virtualized traditional workloads. Azure Backup, Azure Site Recovery, Azure Monitor, you can do all of that. Of course, people still want Azure Stack and Azure, but now you also have Azure Stack HCI for those traditional workloads.
Okay. Again, you're solving for that, choice that the customer is-
Comprehensive, right.
Yeah. In our collaboration, we've been working, you know, getting ready for.
Yes
There's all the work that goes ahead of it.
Yes.
We've been working on the second generation Xeon Scalables, having you guys test them. We've had Optane Data Center Persistent Memory in your team's hands. Can you share some of the results that you guys are already seeing?
Yeah. I mean, we're seeing some amazing results. Just to give you some examples, Windows Server and Intel Optane DC persistent memory, we're seeing double the IOPS.
Oh.
At 13.7 million IOPS, and using 25% less servers.
Less servers to deliver it.
again, performance cost value is.
Yep
incredible, it's industry-leading. With SQL Server, with persistent memory, with your technology, we're seeing much faster insights. On the AI front, which we know is one of the mega trends.
Yep
We're both investing in the ONNX Runtime.
Yep.
We're able to see a 3.4x increase using ONNX Runtime with Intel DL Boost, which I think, Navin talked about before.
Yeah. I, yeah, no, it's good. I, it's always impressive to see the collaboration across so many of the technical domains. I think it's just great partnership that helps our customers in their data centers, in their hybrid capabilities. Let's move to some of the innovation you're doing actually in your cloud service. What can you share about, you know, what's new and what's happening.
One of the things that we've been working with Intel on is how do we enable customers to bring some of the most complex workloads? Examples are how we work with Intel and Cray to bring a bare metal supercomputer in Azure.
Yep.
imagine just being able to have Cray.
Yeah
in the cloud, so that's super unique. The other thing we've uniquely done with Intel is work with Intel Security to offer the industry first security enclaves through Azure Confidential Computing.
Yeah.
There are some workloads, some algorithms that are super sensitive in certain industries, and now you can run them confidently in Azure, and again, an industry first there as well.
That's fantastic.
In terms of other ways we're taking advantage of second generation Intel Xeon Scalable processors and Intel Optane DC Persistent Memory.
You did that so well. That was fantastic.
I wanted to say Cascade Lake.
Oh, okay.
I like dying to say Cascade Lake. Some announcements that I'm actually excited to make, and you guys are hearing it for the first time, is we are delivering some of the largest SAP infrastructure, which is our bare metal instance.
Yep
using some of the latest technologies.
Great.
Again, customers can deploy SAP and get up to 24 TB of memory.
Great.
That's just fantastic. In addition to supporting SAP on our bare metal instances, we're also refreshing a lot of our virtual machine families. Azure V2 virtual machines, which are compute intensive, good for web and application servers, analytics and gaming, we will be refreshing those with the latest technology.
Great.
Dv3-series, which is our virtual machine lineup for enterprise class production workloads, will get a refresh, as well as Ev3-series, which is great for large in-memory.
Okay
business-critical applications. Excited for all that to come later this year.
It's a lot. I'm excited that we are going to work together on accelerating adoption of all these new technologies and just all the innovation that we've been working on together. Thank you so much for coming and sharing that with us.
Thank you, Lisa. Thank you, everyone.
Bye, Arpan Shah. Okay, that's a lot going on. Arpan Shah touched on this, but of course, you guys, we all know that pure workload performance is not the only reason that IT organizations consider refresh of aging data center infrastructure. Security has become a focus for every customer in every industry that we work with, and it's our focus as well. We're deeply committed to driving security innovation into every generation. Navin Shenoy had already talked about the updates we're providing in the CPU architecture to enhance the side channel mitigations and protections and minimize their performance impacts. In addition, we're delivering data protection, and one of our recent announcements we've made is of an Intel SGX card. That's what Arpan Shah, again, was talking to you about the basic technology for that confidential computing.
This is a technology that allows users to create secure memory enclaves for their most sensitive data. Having this in an add-in card form factor allows customers to pair it with their existing and their new Xeon Scalable infrastructure for even broader deployments. New today, we're announcing our Intel Security Libraries as well. It's a set of open source software libraries that expose and enable Intel's hardware-based security features. Again, putting it in a hardware isn't the final step. We have to do that industry optimization to make sure that software can take advantage of all of that hardware goodness and investment. These are modular, and they have a consistent interface, which allows developers to become more proficient and efficient in utilizing that technology, and it makes it just fundamentally easier for them to deploy hardware-based security.
Finally, we're taking all of this innovation, and we're working with industry leaders to deliver optimized solutions. To share news about one of our newest security solutions, I am going to invite to the stage the Vice President and General Manager of Digital Transformation and Scale Solutions at Intel, my friend, Lisa Davis.
Hi. How are you?
Hi. Thanks for coming.
My pleasure.
Yes. Absolutely, and, you know, we all know that two Lisas is better than one.
Definitely.
Yeah.
Definitely.
Okay. I heard you had some exciting news to share with us.
Yes, Lisa. We are so excited about today. You know, as you know, security is the number 1 CIO imperative.
It is.
Right? In today's environment, security exploits are increasing, and they're growing in complexity. As a former CIO, we approach security very much by layering in software controls from the perimeter down to the server. The problem with that is that the controls don't always integrate, and frankly, it puts CIOs and CSOs in what I would call a reactive posture.
Yeah. You know, we've got two former IT Lisas up here.
Yeah.
Yeah. This is good. I like it.
This is great.
Okay.
We are so excited to be partnering with Lockheed Martin and HPE to deliver a hardened virtualization platform for enhanced data center security.
Great.
This solution uses a rich set of Intel technologies that are now available in our 2nd-generation Intel Xeon Scalable platform. This is a game changer.
Good.
Very exciting. We're now establishing a hardware root of trust from boot to runtime, putting the CIO or CISO back into a proactive position.
That's fantastic, and I think it's just a great example of how our partners have used the foundational hardware Intel technologies and their software innovation to deliver protections for the most sensitive workloads in their environment.
Yes.
Can you show it to us in action?
Yes.
Let's see it.
Okay. Let's go. We are Actually, over here. We have a upcoming HPE DL380 server featuring our new second-generation Intel Scalable processor.
Okay.
Okay. I'm gonna click the screen, and essentially we're looking at a single server with full stack protection with a VM running.
Okay.
These technologies isolate the cores, the cache, and the memory, protecting the VMs from potential attacks.
Okay.
A common challenge in the data center is not only the time it takes to patch the environments.
Yep
which we know is very cumbersome, but also being aware of new or unknown vulnerabilities. What we're gonna do is we're going to launch a known zero-day attack against this VM, and that's an attack for which the VM has not yet been patched.
Is this your first day as a black hat? Is this the first time you've ever attacked anything?
No.
Lisa. You're supposed to say yes.
Okay.
Okay.
Okay. Okay.
All right.
All right.
So-
Okay, sounds good. Let's see what happens.
Let's see what happens.
I'm not pushing the button.
Okay.
You're doing it.
I am pushing the button.
Okay. Okay. Here we see the attack on the VM, and if it were successful, it would be capable of causing the VM to become completely unresponsive. We've completely blocked the attack and protected the data. Not only is the VM still alive, but as you can see by the blue bar, their performance is unaffected, and the log files show us capturing the attack.
Yes, for those of you that don't spend all day just reading through log files for fun, you can see we tried to highlight it there, where you get the exit reason equals zero, that's actually showing the unsuccessful attack. It didn't get in, the VM, you heard it's still running.
Absolutely.
Okay.
Absolutely.
That's great.
Now our users can deploy this out-of-the-box solution from our partners at HPE.
Yeah. That's awesome, and thank you so much for coming and sharing that with us today.
Thanks for having me, Lisa.
All right. Yeah. Okay. What Lisa just shared, I think is a great example of solution innovation that delivers real value for our customers. We believe that as the complexity of IT grows, a solutions focus is required, and it increases in importance. In a recent Forrester study of over 1,400 global IT executives, pre-configured and verified IT infrastructure was identified as a key strategy for addressing that solution complexity. More than 45% expected or had already experienced both better system performance and faster time to value by using a solution reference design. At Intel, our work is not complete until solutions are consumable by customers and consumable at scale. The path to consumability is delivery of these pre-configured and verified configurations to the whole industry. Our answer to this challenge is Intel Select Solutions.
We have partnered over the years with a deep investment with the industry as we collectively deliver workload optimization, ideal configurations, and that pre-verified performance. This also leaves opportunity and creates opportunity for system differentiation with solution provider enhancements. First introduced in the middle of 2017, we've seen incredible momentum with partners in the market, and we're delivering over 50 verified solutions today. These Select Solutions are helping customers speed solution evaluation and deployment. Today, I'm happy to introduce our 2019 portfolio of 21 additional Select Solutions. Highlights of the portfolio that we're launching today, and you see up here, include new SAP HANA and Microsoft SQL with Windows Server and Visual Cloud Delivery Networks. Those will be great examples to benefiting from not just the Xeon, but our Intel SSEs and our Optane Data Center Persistent Memory.
The Lockheed hardened security solution that we just saw demonstrated with Lisa. As well as new solutions for workloads such as network function virtualization infrastructure, artificial intelligence inferencing to take advantage of that DL Boost and VMware's vSAN storage. One of the solution partners that has been with us since the beginning is VMware. To learn more about this long-standing technical engagement, I'd like to invite to the stage the Vice President of Engineering for the Storage and Availability Business Unit at VMware, Mohan Potheri. All right. Hi.
Thank you.
Hi, Mohan Potheri. Thank you for coming.
It's great to be with you today on such a significant day for Intel technology innovation.
It's a significant day for both of us. It's been so great working with your team leading up to this launch. You've got the engineering crew, and we've been doing a bunch across a bunch of innovation targets. Maybe you can share a little.
Thanks, Lisa. This collaboration, of course, reflects a history of relationship that goes back to the early days of VMware.
Yep
almost 20 years ago. Our company was founded on the premise of maximizing the delivery of IT value to customers via virtualization to data centers, and our focus has evolved to the delivery of multi-cloud solutions. One thing has remained constant over the years, which is our deep commitment to engineering between the two companies.
I think that's fantastic. Today, we've continued to work together, and one of the big engineering collaborations we've been focused on is that redefinition of the memory and storage hierarchy.
That's right. We've worked together to take advantage of your latest technologies to drive optimization on ESXi, and in particular, vSAN, our fastest-growing storage solution.
Yep
with over 19,000 customers. This includes not only our traditional work on feature differentiation and performance, but also working together on taking advantage of Intel Optane DC Persistent Memory now in ESXi and vSAN.
Yep, we took it to a new level.
That's right.
Yeah.
We've also introduced new storage architectures utilizing Intel SSD innovations.
No, thank you for that collaboration across the whole of the portfolio. It's a lot. All that engineering work that your teams have done to deliver these vSAN solutions has led to our new vSAN select solution that takes advantage of that memory capacity that's now available and wasn't before. As we collectively talk to our shared customers, you know, about how to use vSAN, we hear an emerging trend around just the growth in mission-critical virtual machines requirements and then also in just that larger VM space requirement. It's an exciting area for our teams to co-engineer on behalf of customers. I'd like it if you would do the honor of sharing the results of some of that joint engineering work.
At VMware, we're focused on ensuring that our customers can rapidly deploy the technologies they need to fuel their business in an efficient manner. With this select configuration in a four-node vSAN cluster, we are seeing a minimum of 25% higher VM density.
That's great.
-on large memory configurations.
That's great.
Thanks to Intel Optane DC Persistent Memory, we're able to demonstrate up to a 30% cost reduction in per VM density.
Yeah. No.
I'm looking forward to working together with the industry to deliver these select configurations and ramp deployments of vSAN, Xeon, and Optane.
Okay, I think it's gonna be great. With that, total cost of ownership going down and the performance going up, I think the ramp's not really gonna be a problem. Thank you so much for coming.
Thank you. Great to be here.
Appreciate it. As you saw, Select Solutions came to life through partner delivery of solutions in the market. We're delighted to feature 35 partners today, 10 of which are new to the program since we first announced. They have invested in their own engineering resources to refine the configurations, benchmark the solutions that we're providing, and ensure that we deliver the very best user experience. I wanna thank them for their technical work, and we look forward to working with them in 2019. I thought it would be fun to see one of these in action. I picked a workload that's a new emerging one where a solution configuration can add a lot of value and save a lot of time: blockchain. It's a rapidly growing workload. Businesses are set to spend $2.9 billion on blockchain in 2019.
Hyperledger Fabric is a blockchain framework that offers a unique approach to consensus that enables performance at scale while also preserving privacy, which is so critical to customers. In order to best show that performance at scale, Intel's been collaborating with IBM to optimize for the latest 1.4 version of Hyperledger Fabric and optimize that for the results they can get on Intel's next generation Xeon Scalable. We're seeing some amazing results. Let's get this thing started here. If I can get it. There we go. It's always important to get it started. This is a preview of our Select Solution delivered and running on a Lenovo ThinkSystem SR650. We have been able to achieve a blazing 1,200 transactions per second with a combination of both hardware and software improvements in this generation.
As you can see in this demo, we're hitting a 5.1x improvement over the 1st generation. Just showing the power of hardware, software combined, system innovation to deliver that increasing performance. Available later this year, these new levels of throughput will offer corporations an opportunity to deliver excellent performance while saving precious IT resources and talent from having to configure their own solutions. Lenovo has also certified a number of Intel Select Solutions for Microsoft SQL, including a 200 TB SQL enterprise data warehousing solution. That's big. We're nearing the end of my talk, the day wouldn't be complete for me if I didn't have the opportunity to show you one last thing, some big iron. Where's the fun if we skip that? On stage, we're showcasing the refreshed Lenovo ThinkSystem here.
It's an SR950 8-socket server supporting second generation Xeon Scalable and our Optane DC Persistent Memory. It's packed with 24 TB of that memory. It's a very dense 4U rack form factor, packing just absolute maximum performance in a product chassis. Let's take a look at the system in action. What we're gonna show here is response times of queries using an open source database, HammerDB. This is a proxy for what a power user would run against a large data warehouse, and when I say large, I mean it. This is a 30 TB of raw data being ingested and consumed here. The system it's being compared to is a earlier generation, a Lenovo 8-socket platform running on a E7 v3 family, so a couple years old.
What you see and start to see here is that the results of the queries goes down to 120 seconds versus 275 seconds for the older system, leading to a 56% reduction in runtime and a 129% increase in query throughput. This has a double benefit for IT. It's lower total cost of ownership, and on top of that, and almost more importantly, it's more effective use of your data scientist's time, which is, again, an incredibly precious skill set. Okay, we've done it. We have discussed a tremendous amount of Intel and industry innovation to address this data opportunity that our customers face. There are a few things I want to leave you with today. First is our enhanced data-centric portfolio to move, store, and process all of our customers' data.
It's an unmatched portfolio that services workloads from the edge to the cloud and back again. Secondly, we have delivered our second generation Intel Xeon Scalable processor with DL Boost. It delivers inference leadership that our customers can count on, and you saw so many of them already delivering results on today at launch. Third, we've delivered network-optimized products to further cement Intel technology as the industry platform for 5G leadership and 5G infrastructure. Finally, we have unleashed memory-bound applications with Intel Optane DC Persistent Memory, a product I care so deeply about, I'm even wearing Optane DCPM earrings. Any of you can Navin Shenoy held up the 512 GB . Mine's a little smaller, but that's okay.
These products are going to break through performance barriers that have faced the industry and application developers for as long as any of us have been working in the industry. Together with the industry leaders in the room, we have this opportunity to unleash all the power of that data, all the capabilities, all the insights, and all the results. I wanna thank everyone here and around the globe that's been with us today and wish you a great day.