{"id":1566,"date":"2019-04-13T18:29:27","date_gmt":"2019-04-14T01:29:27","guid":{"rendered":"http:\/\/3.209.169.194\/blogs\/glenn\/?p=1566"},"modified":"2019-05-23T16:28:15","modified_gmt":"2019-05-23T23:28:15","slug":"intel-optane-technology-and-sql-server","status":"publish","type":"post","link":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/","title":{"rendered":"Intel Optane Technology and SQL Server"},"content":{"rendered":"<p><font size=\"2\">You may have heard of <a href=\"https:\/\/www.intel.com\/content\/www\/us\/en\/architecture-and-technology\/intel-optane-technology\/reimagine-memory-storage-in-the-data-center.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane Technology<\/a>, but perhaps you aren\u2019t quite sure what that term actually refers to, and whether it is relevant for SQL Server. Unfortunately, Intel Optane is an overloaded marketing term that covers several different product categories and specific products. Intel also has Optane product offerings for the consumer market, which further confuses the issue.<\/font><\/p>\n<p><font size=\"2\">All of these different products use <a href=\"https:\/\/en.wikipedia.org\/wiki\/3D_XPoint\" target=\"_blank\" rel=\"noopener noreferrer\">3D-XPoint<\/a> (pronounced 3D Cross Point) <a href=\"https:\/\/www.eetimes.com\/document.asp?doc_id=1327289#\" target=\"_blank\" rel=\"noopener noreferrer\">technology<\/a> in different ways for different purposes. First, we have their consumer products.<\/font><\/p>\n<h2><font size=\"3\" style=\"font-weight: bold;\">Consumer Products<\/font><\/h2>\n<blockquote>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/99743\/intel-optane-memory-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane Memory Series<\/a> (Stony Beach, Q1 2017)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/132776\/intel-optane-memory-m10-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane Memory M10 Series<\/a> (Stony Beach, Q1 2018)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/189227\/intel-optane-memory-h10-with-solid-state-storage.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane Memory H10 with Solid State Storage<\/a> (Teton Glacier, Q2, 2019)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/125310\/intel-optane-ssd-800p-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD 800P Series<\/a> (Brighton Beach, Q1 2018)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/123625\/intel-optane-ssd-900p-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD 900P Series<\/a> (Mansion Beach, Q4 2017)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/129835\/intel-optane-ssd-905p-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD 905P Series<\/a> (Mansion Beach, Q3 2018)<\/font><\/p>\n<\/blockquote>\n<p><font size=\"2\">Their <a href=\"https:\/\/www.intel.com\/content\/www\/us\/en\/architecture-and-technology\/optane-memory.html\" target=\"_blank\" rel=\"noopener noreferrer\">consumer products<\/a> include system accelerators that are a cache layer in front of a magnetic HDD or slow SATA NAND SSD. These include the Intel Optane Memory and Intel Optane Memory M10 Series of products. These are useful for their intended purpose, but some systems vendors are making dubious marketing claims about them. You will see new systems that claim to have 24GB of \u201cMemory\u201d that turns out to actually be 16GB of Intel Optane Memory and 8GB of DDR4 DRAM. This is confusing to a typical consumer, and somewhat deceptive in my opinion. Figure 1 shows an example of this.<\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory.jpg\"><img fetchpriority=\"high\" decoding=\"async\" width=\"576\" height=\"772\" title=\"24GB of Memory\" style=\"display: inline; background-image: none;\" alt=\"24GB of Memory\" src=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg\" border=\"0\"><\/a><\/font><\/p>\n<p><font size=\"2\"><strong>Figure 1: New Laptop with 24GB of \u201cMemory\u201d<\/strong><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\">The Intel Optane Memory H10 with Solid State Storage series are hybrid storage M.2 2280 devices that combine Optane SSD storage as a cache in front of QLC NAND SSD storage on a single M.2 2280 card. They have 256GB, 512GB, or 1TB of usable capacity for storage. <a href=\"https:\/\/www.tomshardware.com\/news\/intel-optane-h10-optane-memory,39036.html\" target=\"_blank\" rel=\"noopener noreferrer\">These should give<\/a><font size=\"2\"> close to Optane SSD storage performance for less intense workloads at a lower cost than a 100% Optane SSD.<\/font><\/font><\/p>\n<p><font size=\"2\">There are also pure Optane SSD storage offerings such as the 800P, 900P, and 905P that give the best storage performance from the consumer line. I<font size=\"2\"> have a couple of Intel Optane 900P PCIe NVMe storage cards in two of my personal desktop systems, and I have been very impressed with them over the past 18 months. Both the 900P and newer, faster 905P series products are a great choice for an OS drive for a developer or DBA desktop workstation. They also work very well in gaming rigs.<\/font><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h2><font size=\"3\" style=\"font-weight: bold;\">Data Center Products<\/font><\/h2>\n<p><font size=\"2\">Intel also has a number of different data center product lines under the Optane umbrella.<\/font><\/p>\n<blockquote>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/97160\/intel-optane-ssd-dc-p4800x-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD DC P4800X Series<\/a> (Cold Stream, Q4 2017)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/149363\/intel-optane-ssd-dc-p4801x-series.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD DC P4801X Series<\/a> (Cold Stream, Q1 2019)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.servethehome.com\/intel-dc-d4800x-optane-d5-p4326\/\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD DC D4800X Series<\/a> (Q2 2019)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/190349\/intel-optane-dc-persistent-memory.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane DC Persistent Memory<\/a> (Apache Pass, Q2 2019)<\/font><\/p>\n<\/blockquote>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><\/p>\n<p>\n<p><font size=\"2\"><font size=\"2\"><font size=\"2\"><font size=\"2\">Intel has a pyramid diagram that they like to show to explain where these data center products fit in the modern data access hierarchy.<\/font><\/font><\/font><\/font><\/p>\n<\/p>\n<p><\/font><\/p>\n<p><\/p>\n<p><font size=\"2\"><font size=\"2\"><a href=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/intel-storage-pyramid.png\"><img decoding=\"async\" width=\"1028\" height=\"487\" title=\"Intel Storage Pyramid\" style=\"display: inline; background-image: none;\" alt=\"Intel Storage Pyramid\" src=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/intel-storage-pyramid_thumb.png\" border=\"0\"><\/a><\/font><\/font><\/p>\n<p><font size=\"2\"><strong>Figure 2: Intel Data Access Pyramid<\/strong><\/font><\/p>\n<p><\/p>\n<p><font size=\"2\">Here are some more details about Intel\u2019s Optane Data Center products.<\/font><\/p>\n<p><font size=\"2\"><\/p>\n<p><\/p>\n<p><\/font><\/p>\n<h2><font size=\"3\" style=\"font-weight: bold;\">Intel Optane SSD DC P4800X Series<\/font><\/h2>\n<p><font size=\"2\">These are extremely high performance block storage devices that include 375GB, 750GB, and 1.5TB capacities. They are available in HHHL AIC and U.2 15mm form factors. They all have a PCIe 3.0 x4 interface and use the NVMe protocol. Most existing servers will be able to use these in the HHHL AIC form factor in an available PCIe 3.0 x4 expansion slot. It is common to use two of these cards in a Storage Spaces RAID 1 array for redundancy. They are also well-suited for AG nodes.<\/font><\/p>\n<p><font size=\"2\">These can be used with any version of SQL Server and any relatively recent version of Windows Server. You will want to make sure that you use the <a href=\"https:\/\/downloadcenter.intel.com\/download\/28718\/Datacenter-NVMe-Microsoft-Windows-Drivers-for-Intel-SSDs?product=79678\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Datacenter NVMe driver<\/a> rather than the generic Microsoft NVMe driver with these drives.<\/font><\/p>\n<p><font size=\"2\">Once you have a couple of these cards, you can use them for pretty much anything you want for SQL Server usage. For example, you can have your tempdb files here, or perhaps your transaction log files. I have had some clients simply move all of their data, log, and tempdb files to Intel Optane SSD DC P4800X arrays. These cards currently run about $4.00-5.00\/GB, which is more expensive than most enterprise NAND flash storage, but not outrageously so.<\/font><\/p>\n<p><font size=\"2\">They offer excellent random read and write performance at low queue depths, extremely low latency, predictable and steady performance under load, along with greater write endurance than NAND-based flash. They also do not lose any performance as they get full. Here are some articles and reviews of these drives:<\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<blockquote>\n<p><font size=\"2\"><a href=\"https:\/\/sqlperformance.com\/2019\/01\/io-subsystem\/intel-optane-sql-server\" target=\"_blank\" rel=\"noopener noreferrer\">Using Intel Optane Storage for SQL Server<\/a><\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.anandtech.com\/show\/11209\/intel-optane-ssd-dc-p4800x-review-a-deep-dive-into-3d-xpoint-enterprise-performance\" target=\"_blank\" rel=\"noopener noreferrer\">The Intel Optane SSD DC P4800X (375GB) Review: Testing 3D XPoint Performance<\/a><\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.storagereview.com\/intel_optane_ssd_dc_p4800x_review\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD DC P4800X Review<\/a><\/font> <\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.servethehome.com\/intel-optane-ssd-dc-p4800x-3d-xpoint-landed\/\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane SSD DC P4800X \u2013 3D XPoint Has Landed<\/a><\/font><\/p>\n<\/blockquote>\n<h2><font size=\"3\"><font style=\"font-weight: bold;\">Intel Optane SSD DC P4801X Series<\/font><\/font><\/h2>\n<p><font size=\"2\">These are PCIe NVMe M.2 22110 (110mm) cards that range from 100GB to 375GB in capacity. They have the same technology and main specifications as the larger form factor Intel Optane SSD DC P4800X Series cards. Not as many existing servers have PCIe M.2 slots, but an <a href=\"https:\/\/www.supermicro.com\/products\/nfo\/M.2.cfm\" target=\"_blank\" rel=\"noopener noreferrer\">increasing number<\/a> of new servers do have PCIe M.2 slots. As long as your server supports this form factor, you can use them the same way you would as the Intel Optane SSD DC P4800X Series cards. You can also get M.2 to PCIe expansion slot adapters that will let you use these M.2 cards in older servers.<\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h2><font size=\"3\"><font style=\"font-weight: bold;\">Intel Optane SSD DC D4800X Series<\/font><\/font><\/h2>\n<p><font size=\"2\">These are Optane SSD drives that have dual-port controllers for better redundancy. These <a href=\"https:\/\/www.anandtech.com\/show\/14155\/intels-enterprise-extravaganza-2019-roundup\" target=\"_blank\" rel=\"noopener noreferrer\">were just announced<\/a> at the Intel Data-Centric Innovation Day on April 2, 2019. So far, they are not in the Intel ARK database, and they don\u2019t appear to be readily available yet.<\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h2><font size=\"3\"><font style=\"font-weight: bold;\">Intel Optane DC Persistent Memory<\/font><\/font><\/h2>\n<p><font size=\"2\">This is the product line that is newer and less familiar to many people. These are <a href=\"https:\/\/www.intel.com\/content\/www\/us\/en\/architecture-and-technology\/optane-dc-persistent-memory.html\" target=\"_blank\" rel=\"noopener noreferrer\">persistent memory modules<\/a> that also use 3D-XPoint technology. They fit in DDR4 memory slots on servers with selected <a href=\"https:\/\/ark.intel.com\/content\/www\/us\/en\/ark\/products\/series\/192283\/2nd-generation-intel-xeon-scalable-processors.html\" target=\"_blank\" rel=\"noopener noreferrer\">2nd Generation Intel Xeon Scalable Processors<\/a> (Cascade Lake-SP). They are available in 128GB, 256GB, and 512GB capacities. If you have the requisite processor and supported operating system or hypervisor, you can use Optane DC PM modules in a system along with conventional DDR4 DRAM modules. You can have up to six persistent memory modules per processor, but you have to have at least one DRAM module per processor.<\/font><\/p>\n<p><font size=\"2\">You can use Intel Optane DC Persistent Memory in one of three modes. These are Memory Mode, APP Direct mode, and Storage over APP Direct mode.<\/font><\/p>\n<p><\/p>\n<h3><font style=\"font-weight: bold;\">Memory Mode<\/font><\/h3>\n<p><font size=\"2\">Memory Mode is when you use Intel Optane DC Persistent Memory Modules to increase the total size of your memory by using the larger capacity Intel Optane DC Persistent Memory Modules in place of some of your DDR4 DRAM DIMMs. <font size=\"2\">You use some (up to half) of your RAM slots to hold Intel Optane PMEM DIMMs. You put regular DDR4-2933 DRAM in your other memory slots, which is then invisible to the OS. The Intel Optane PMEM is less expensive per GB compared to 128GB DDR4-2933 DIMMs, and it is available in higher capacities than you can get with DDR4 DRAM.<\/font><\/font><\/p>\n<p><font size=\"2\">In this mode, the DDR4 DRAM is \u201cnear memory\u201d which is used as a write-back cache. The Optane PMEM is the \u201cfar memory\u201d, which actually shows up as the amount of memory visible to the operating system. <font size=\"2\">The ratio of the near\/far memory can vary. A common recommendation from Intel is a 4:1 capacity ratio. So for example, you could have six 128GB PMEM modules and six 32GB DDR4 DRAM modules per socket, which would give you 768GB of capacity from the PMEM, with 192GB of DRAM cache in front of it.<\/font><\/font><\/p>\n<p><font size=\"2\"><font size=\"2\">No application changes are required to use Memory mode. In this mode, the PMEM is volatile, which means that the data is cleared when you cycle power (just like DRAM).<\/font><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h3><font style=\"font-weight: bold;\">App Direct Mode<\/font><\/h3>\n<p><font size=\"2\">In App Direct Mode, a PMEM-aware application is required. This mode adds a new tier between Memory Mode and block mode storage. It is byte addressable just like memory. With SQL Server 2019 on Linux, you can host any or all of your database files on DAX volumes that are built on Intel Optane DC PMEM modules with App Direct mode. You can also use the new Hybrid Buffer Pool feature in SQL Server 2019 with App Direct mode.<\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h3><font style=\"font-weight: bold;\">Storage over App Direct Mode<\/font><\/h3>\n<p><font size=\"2\">Storage over App Direct mode uses block mode storage using traditional read\/write instructions that work with existing file systems. You must have an NVDIMM driver for this mode to be supported. This will have higher latency than App Direct mode, but it doesn\u2019t require any application changes. This means that legacy versions of SQL Server should be able to use this mode.<\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h3><font style=\"font-weight: bold;\">Hybrid Buffer Pool<\/font><\/h3>\n<p><font size=\"2\">SQL Server 2019 CTP 2.1 introduced a new feature called <a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/database-engine\/configure-windows\/hybrid-buffer-pool?view=sqlallproducts-allversions\" target=\"_blank\" rel=\"noopener noreferrer\">Hybrid Buffer Pool<\/a>. This feature allows the database engine to directly access data pages in database data files that are stored on PMEM DAX volume devices using APP Direct Mode.<\/font><\/p>\n<p><font size=\"2\">In a traditional system without persistent memory, SQL Server caches data pages in the DRAM buffer pool. With Hybrid Buffer Pool, SQL Server skips performing a copy of the page into the DRAM-based portion of the buffer pool, and instead references the page directly on the database file that lives on a PMEM DAX volume device. <\/font><\/p>\n<p><font size=\"2\">Access to data files in PMEM for Hybrid Buffer Pool is performed using memory-mapped I\/O, also known as enlightenment. This brings performance benefits from avoiding the copy of the page to DRAM, and from skipping the I\/O stack of the operating system to access the page on the persistent memory storage volume. <font size=\"2\">Only clean pages can be referenced directly on a PMEM device. When a page becomes dirty it is kept in DRAM, and then eventually written back to the PMEM device after it has been flushed to persistent storage.<\/font><\/font><\/p>\n<p><font size=\"2\">Microsoft recommends that you use the largest allocation unit size available for NTFS (2MB in Windows Server 2019) when formatting your PMEM device on Windows and ensure the device has been enabled for DAX (Direct Access). <font size=\"2\">This feature is available on both SQL Server 2019 on Windows and SQL Server 2019 on Linux. With SQL Server 2019 CTP 2.1, you need to enable startup trace flag 809 to enable this feature. <\/font><\/font><\/p>\n<p><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<h2><font size=\"3\"><font style=\"font-weight: bold;\">Optane Issues<\/font><\/font><\/h2>\n<p><font size=\"2\">If you use any Intel Optane DC Persistent Memory Modules in your system (in any of the three modes), they run at 2666 MHz, and your regular DDR4-2933 DRAM will also run at the slower 2666 MHz speed. <font size=\"2\">Intel Optane DC PMEM performs better for reads than for writes. Sequential read latency is about 170ns while sequential write latency is about 320ns. Sequential read bandwidth is about 7.6 GB\/sec per DIMM, while sequential write bandwidth is only about 2.3 GB\/sec per DIMM. These figures are all significantly worse than modern DDR4-2933 DRAM. <font size=\"2\">Intel Optane DC PMEM in Memory mode is faster than anything else that is lower in the data retrieval pyramid, but it simply does not compare to modern DRAM performance.<\/font><\/font><\/font><\/p>\n<p><font size=\"2\">Intel Optane DC PMEM is less expensive per GB compared to 128GB DDR4 DRAM modules, but not compared to lower capacity 32GB DDR4 DRAM modules. The price per GB of <font size=\"2\">Intel Optane DC PMEM goes up as the capacity increases, but not as steeply as with the highest capacity DRAM modules. <\/font><\/font><\/p>\n<p><font size=\"2\">Here are some relevant articles about Intel Optane products.<\/font><\/p>\n<p><\/p>\n<blockquote>\n<p><font size=\"2\"><a href=\"https:\/\/www.storagereview.com\/intel_optane_dc_persistent_memory_module_pmm\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane DC Persistent Memory Module (PMM<\/a>)<\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.storagereview.com\/supermicro_superserver_with_intel_optane_dc_persistent_memory_first_look_review\" target=\"_blank\" rel=\"noopener noreferrer\">Supermicro SuperServer with Intel Optane DC Persistent Memory First Look Review<\/a><\/font> <\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.anandtech.com\/show\/14180\/pricing-of-intels-optane-dc-persistent-memory-modules-leaks\" target=\"_blank\" rel=\"noopener noreferrer\">Pricing of Intel\u2019s Optane DC Persistent Memory Modules Leaks: From $6.57 Per GB<\/a><\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/www.tomshardware.com\/news\/intel-optane-dimm-pricing-performance,39007.html\" target=\"_blank\" rel=\"noopener noreferrer\">Intel Optane DIMM Pricing: $695 for 128GB, $2595 for 256GB, $7816 for 512GB (Update)<\/a><\/font><\/p>\n<p><font size=\"2\"><a href=\"https:\/\/itpeernetwork.intel.com\/intel-optane-dc-persistent-memory-operating-modes\/\" target=\"_blank\" rel=\"noopener noreferrer\">Intel\u00ae Optane&#x2122; DC Persistent Memory Operating Modes Explained<\/a><\/font> <\/p>\n<\/blockquote>\n<h2><font size=\"3\" style=\"font-weight: bold;\">Intel Optane and SQL Server<\/font><\/h2>\n<p><font size=\"2\">After all of this, where are we with Intel Optane regarding SQL Server usage? This will depend on the Intel Optane product, your workload, and your current\/desired operating environment.<\/font><\/p>\n<h3><font style=\"font-weight: bold;\">Intel Optane SSD P4800X <\/font><\/h3>\n<p><font size=\"2\">I am a big fan of the Intel Optane SSD P4800X series of drives for on-premises SQL Server usage. <strong><u>They just work<\/u><\/strong>, on any version of SQL Server on any recent operating system on any server with PCIe 3.0 support. They don\u2019t require 2nd Generation Intel Xeon Scalable Processors. The only problem is their availability and relatively high price per GB of capacity.<\/font><\/p>\n<h3><font style=\"font-weight: bold;\">Intel Optane DC Persistent Memory<\/font><\/h3>\n<p><font size=\"2\">Intel Optane DC Persistent Memory seems like a more mixed verdict. I think Memory mode is not going to be a good fit for most SQL Server workloads. Using the example from above, (with twelve 32GB DDR4-2933 DIMMs and twelve 128GB Optane PMEM DIMMs in a two-socket server) you would have 384GB of near memory cache in front of 1,536GB of Optane in Memory mode, all running at a 2666 MHz speed. Once your working set exceeds 384GB, you will be hitting the much slower Optane far memory. The current pricing breakdown for this configuration would be about $2,700 for twelve 32GB DDR4-2933 DIMMs and about $9,600 for twelve 128GB Intel Optane DIMMs. This would be about $12,300 total.<\/font><\/p>\n<p><font size=\"2\">In most cases, you would be better off with twenty-four 32GB DDR4-2933 DIMMs in a two-socket server, running at full speed. This configuration would give you 768GB of very fast DRAM for your buffer pool. This memory would cost about $5,400 at current prices. Saving about $7,000 is nice, (but is insignificant compared to your SQL Server core licensing costs). What is more important is the likely much better performance for most workloads from having nothing but fast DRAM rather than a mixture of DRAM and PMEM in Memory mode.<\/font><\/p>\n<p><font size=\"2\">One bad scenario (for SQL Server) that I hope we don\u2019t see is heavy Memory mode usage on Virtualization hosts. Imagine a two-socket virtualization host that has twelve 512GB Optane PMEM DIMMs and twelve 32GB DDR4-2933 DRAM DIMMs. This host would have 6,144GB of PMEM capacity, with only 384GB of DRAM cache in front of it. That might be great for web-server VMs, but probably not so great for SQL Server VMs that have a significant workload.<\/font><\/p>\n<p><font size=\"2\">App Direct mode is more interesting. I think that the Hybrid Buffer Pool feature may work very well (much better than the old Buffer Pool Extension feature), and I like the fact that it is available for both SQL Server 2019 on Windows and SQL Server 2019 on Linux. You should also be able to use the Persistent log buffer feature from SQL Server 2016 with App Direct mode on both Windows and Linux. SQL Server 2019 on Linux will be \u201cfully enlightened\u201d which means you will be able to store any type of SQL Server database file on a DAX volume that is using Optane PMEM in App Direct mode.<\/font><\/p>\n<p><font size=\"2\">Storage over App Direct mode also looks very useful. It will let you use Optane PMEM as very fast block mode storage with older versions of SQL Server, older versions of Windows Server, and possibly older versions of your favorite hypervisor. All you need is an NVDIMM driver. <font size=\"2\">It will still require a server with 2nd Generation Intel Xeon Scalable Processors though.<\/font><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n<p><font size=\"2\"><br \/><\/font><\/p>\n","protected":false},"excerpt":{"rendered":"<p>You may have heard of Intel Optane Technology, but perhaps you aren\u2019t quite sure what that term actually refers to, and whether it is relevant for SQL Server. Unfortunately, Intel Optane is an overloaded marketing term that covers several different product categories and specific products. Intel also has Optane product offerings for the consumer market, [&hellip;]<\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[434,20,435],"tags":[437,436],"class_list":["post-1566","post","type-post","status-publish","format-standard","hentry","category-cascade-lake-sp","category-intel","category-intel-optane","tag-intel-optane-dc-persisent-memory","tag-intel-optane-ssd"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Intel Optane Technology and SQL Server - Glenn Berry<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Intel Optane Technology and SQL Server - Glenn Berry\" \/>\n<meta property=\"og:description\" content=\"You may have heard of Intel Optane Technology, but perhaps you aren\u2019t quite sure what that term actually refers to, and whether it is relevant for SQL Server. Unfortunately, Intel Optane is an overloaded marketing term that covers several different product categories and specific products. Intel also has Optane product offerings for the consumer market, [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/\" \/>\n<meta property=\"og:site_name\" content=\"Glenn Berry\" \/>\n<meta property=\"article:published_time\" content=\"2019-04-14T01:29:27+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-05-23T23:28:15+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg\" \/>\n<meta name=\"author\" content=\"Glenn Berry\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Glenn Berry\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"13 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/\",\"url\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/\",\"name\":\"Intel Optane Technology and SQL Server - Glenn Berry\",\"isPartOf\":{\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg\",\"datePublished\":\"2019-04-14T01:29:27+00:00\",\"dateModified\":\"2019-05-23T23:28:15+00:00\",\"author\":{\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/#\/schema\/person\/57a8972435106bac7970692fcf5edfa7\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#primaryimage\",\"url\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg\",\"contentUrl\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg\",\"width\":576,\"height\":772},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Intel Optane Technology and SQL Server\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/#website\",\"url\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/\",\"name\":\"Glenn Berry\",\"description\":\"Semi-random musings about SQL Server performance\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/#\/schema\/person\/57a8972435106bac7970692fcf5edfa7\",\"name\":\"Glenn Berry\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/64bdac8830f25f2f8cc780f8a1286c66ff1182218009271e7a953639596f7e25?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/64bdac8830f25f2f8cc780f8a1286c66ff1182218009271e7a953639596f7e25?s=96&d=mm&r=g\",\"caption\":\"Glenn Berry\"},\"sameAs\":[\"https:\/\/www.sqlskills.com\/blogs\/glenn\/\"],\"url\":\"https:\/\/www.sqlskills.com\/blogs\/glenn\/author\/glenn\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Intel Optane Technology and SQL Server - Glenn Berry","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/","og_locale":"en_US","og_type":"article","og_title":"Intel Optane Technology and SQL Server - Glenn Berry","og_description":"You may have heard of Intel Optane Technology, but perhaps you aren\u2019t quite sure what that term actually refers to, and whether it is relevant for SQL Server. Unfortunately, Intel Optane is an overloaded marketing term that covers several different product categories and specific products. Intel also has Optane product offerings for the consumer market, [&hellip;]","og_url":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/","og_site_name":"Glenn Berry","article_published_time":"2019-04-14T01:29:27+00:00","article_modified_time":"2019-05-23T23:28:15+00:00","og_image":[{"url":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg","type":"","width":"","height":""}],"author":"Glenn Berry","twitter_misc":{"Written by":"Glenn Berry","Est. reading time":"13 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/","url":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/","name":"Intel Optane Technology and SQL Server - Glenn Berry","isPartOf":{"@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#primaryimage"},"image":{"@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#primaryimage"},"thumbnailUrl":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg","datePublished":"2019-04-14T01:29:27+00:00","dateModified":"2019-05-23T23:28:15+00:00","author":{"@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/#\/schema\/person\/57a8972435106bac7970692fcf5edfa7"},"breadcrumb":{"@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#primaryimage","url":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg","contentUrl":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-content\/uploads\/2019\/04\/24gb-of-memory_thumb.jpg","width":576,"height":772},{"@type":"BreadcrumbList","@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/intel-optane-technology-and-sql-server\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.sqlskills.com\/blogs\/glenn\/"},{"@type":"ListItem","position":2,"name":"Intel Optane Technology and SQL Server"}]},{"@type":"WebSite","@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/#website","url":"https:\/\/www.sqlskills.com\/blogs\/glenn\/","name":"Glenn Berry","description":"Semi-random musings about SQL Server performance","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.sqlskills.com\/blogs\/glenn\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/#\/schema\/person\/57a8972435106bac7970692fcf5edfa7","name":"Glenn Berry","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.sqlskills.com\/blogs\/glenn\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/64bdac8830f25f2f8cc780f8a1286c66ff1182218009271e7a953639596f7e25?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/64bdac8830f25f2f8cc780f8a1286c66ff1182218009271e7a953639596f7e25?s=96&d=mm&r=g","caption":"Glenn Berry"},"sameAs":["https:\/\/www.sqlskills.com\/blogs\/glenn\/"],"url":"https:\/\/www.sqlskills.com\/blogs\/glenn\/author\/glenn\/"}]}},"_links":{"self":[{"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/posts\/1566","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/comments?post=1566"}],"version-history":[{"count":0,"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/posts\/1566\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/media?parent=1566"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/categories?post=1566"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sqlskills.com\/blogs\/glenn\/wp-json\/wp\/v2\/tags?post=1566"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}