Are Hard Drives or Flash Winning in Actual Density of Storage?

The debate between hard drives and solid state drives goes on in 2016, particularly in the area of areal densities – the actual density of storage on a device.  Fortunately for us, Tom Coughlin, SNIA Solid State Storage Initiative Education Chair, and a respected analyst who contributes to Forbes, has advised that flash memory areal densities have exceeded those of hard drives since last year!

Coughlin Associates provides several charts in the article which map lab demos and product HDD areal density since 2000, and contrasts that to new flash product announcements.  Coughlin comments that “Flash memory areal density exceeding HDD areal density is important since it means that flash memory products with higher capacity can be built using the same surface area.”

Check out the entire article here.

SNIA NVM Summit Delivers the Persistent Memory Knowledge You Need

by Marty Foltyn

The discussion, use, and application of Non-volatile Memory (NVM) has come a long way from the first SNIA NVM Summit in 2013.  The significant improvements in persistent memory, with enormous capacity, memory-like speed and non-volatility, will make the long-awaited promise of the convergence storage and memory a reality. In this 4th annual NVM Summit, we will see how Storage and Memory have now converged, and learn that we are now faced with developing the needed ecosystem.  Register and join colleagues on Wednesday, January 20, 2016 in San Jose, CA to learn more, or follow http://www.snia.org/nvmsummit to review presentations post- event.

The Summit day begins with Rick Coulson, Senior Fellow, Intel, discussing the most recent developments in persistent memory with a presentation on All the Ways 3D XPoint Impacts Systems Architecture.

Ethan Miller, Professor of Computer Science at UC Santa Cruz, will discuss Rethinking Benchmarks for Non-Volatile Memory Storage Systems. He will describe the challenges for benchmarks posed by the transition to NVM, and propose potential solutions to these challenges.

Ken Gibson, NVM SW Architecture, Intel will present Memory is the New Storage: How Next Generation NVM DIMMs will Enable New Solutions That Use Memory as the High-Performance Storage Tier . This talk reviews some of the decades-old assumptions that change for suppliers of storage and data services as solutions move to memory as the new storage

Jim Handy, General Director, Objective Analysis, and Tom Coughlin, President, Coughlin Associates will discuss Future Memories and Today’s Opportunities, exploring the role of NVM in today’s and future applications. They will give some market analysis and projections for the various NVM technologies in use today.

Matt Bryson, SVP-Research, ABR, will lead a panel on NVM Futures-Emerging Embedded Memory Technologies, exploring the current status and future opportunities for NVM technologies and in particular both embedded and standalone MRAM technologies and associated applications.

Edward Sharp, Chief, Strategy and Technology, PMC-Sierra, will present Changes Coming to Architecture with NVM. Although the IT industry has made tremendous progress innovating up and down the computing stack to enable, and take advantage of, non-volatile memory, is it sufficient, and where are the weakest links to fully unlock the potential of NVM.

Don Jeanette, VP and John Chen, VP of Trendfocus will review the Solid State Storage Market, discuss what is happening in various segments, and why, as it relates to PCIe.

Dejan Vucinc, HGST San Jose Research Center will discuss Latency in Context: Finding Room for NVMs in the Existing Software Ecosystem. HGST Research has been working diligently to find out where is there room in the existing hardware/software ecosystem for emerging NVM technology when viewed as block storage rather than main memory. Vucinc will show an update on previously published results using prototype PCI Express-attached PCM SSDs and our custom device protocol, DC Express, as well as measurements of its latency and performance through a proper device driver using several different kinds of Linux kernel block layer architecture.

Arthur Sainio, Director Marketing, SMART Modular and Co-Chair, SNIA NVDIMM SIG, will lead a panel on NVDIMM. discussing how new media types are joining NAND Flash, and enhanced controllers and networking are being developed to unlock the latency and throughput advantages of NVDIMM.

Neal Christiansen, Principal Development Lead, Microsoft, Microsoft will discuss Storage Class Memory Support in the Windows OS. Storage Class Memories (SCM) have been the topic of R&D for the last few years and with the promise of near term product delivery, the question is how will Windows be enabled for such SCM products and how can applications take advantage of these capabilities.

Jeff Moyer, Principal Software Engineer, Red Hat will give an overview of the current state of Persistent Memory Support in the Linux Kernel.

Cristian Diaconu, Principal Software Engineer, Microsoft will present Microsoft SQL Hekaton – Towards Large Scale Use of PM for In-memory Databases, using the example of Hekaton (Sql Server in-memory database engine) to break down the opportunity areas for non-volatile memory in the database space.

Tom Talpey, Architect File Server Team, Microsoft, will discuss Microsoft Going Remote at Low Latency: A Future Networked NVM Ecosystem. As new ultra-low latency storage such as Persistent Memory and NVM is deployed, it becomes necessary to provide remote access – for replication, availability and resiliency to errors.

Kevin Deierling, VP Marketing, Mellanox will discuss the role of the network in developing Persistent Memory over Fabrics, and what are the key goals and key fabric features requirements.

SNIA’s Solid State Storage Initiative Advances the Industry at Flash Memory Summit

A classic case of SNIA Solid State Storage Initiative (SSSI) member collaboration for industry advancement was on display in the SSSI booth for NVDIMM-N demonstration at the Flash Memory Summit (FMS) 2015. Under the direction of SSSI Chair Jim Ryan and coordinated by NVDIMM SIG co chairs Arthur Sainio and Jeff Chang and TechDev Committee chair Eden Kim, the SSSI was able to update and include NVDIMM-N storage performance in the SSSI marketing collaterals on the Summary Performance Comparison by Storage Class charts.

2015SummaryPerformanceChart.NVDIMM.1200

Five SSSI member companies – AgigA Tech, Calypso, Micron, SMART Modular, and Viking Technology – collaborated over a four week period on the introduction of a new NVDIMM-N storage performance demonstration. While it is rare to have potential competitors collaborate in such a fashion, NVDIMM-N storage represents a new paradigm for super fast, low latency, high IO/watt storage solutions. The NVDIMM-SIG has taken a leadership position by evangelizing the technology and developing the industry infrastructure necessary for large scale deployment.

This collaboration highlighted a classic blend of technical, marketing and industry association cooperation.

In the weeks leading up to FMS, the NVDIMM-SIG planned for an in-booth demonstration of the NVDIMM-N storage modules. To pave the way for universal adoption, the team worked together to dial in the Intel Open Source block IO development driver to meet the standards of the SNIA Performance Test Specification (PTS). An added goal was inclusion of NVDIMM-N modules as a new line item on the Summary Performance Comparison by Storage Class chart which lists PTS performance for various storage technologies. Under the guidance of NVDIMM-SIG, a rush project was instigated to get NVDIMM-N performance data tested to the PTS for the trade show.

Micron took the lead by lending a Supermicro server with Micron NVDIMM-N to Calypso for testing. Calypso then installed CTS test software on the server to allow full testing to the PTS. Viking and SMART Modular contributed by helping dial in the drivers, as well as sending modules from Viking and SMART Modular to cross reference with the Micron modules. The test plan was comprised of several test iterations using single, dual and finally quad modules using each of the vendor contributed modules.

The early single and dual module tests ran into repeatability and stability issues. NVDIMM-SIG consulted with Intel on the nuance of the Intel block IO driver while Calypso continued testing. The team successfully completed a test run that met the PTS steady state requirements on the quad module in time to release data for the show.

We had a solid demonstration at the SNIA SSSI Flash Memory Summit Booth on NVDIMM-N Performance complete with marketing collateral available for review and a handout. NVDIMM-SIG members responded to the many questions and interest in the NVDIMM-N storage technology.

fms booth

“Once again,” said SSSI Chair Jim Ryan, “we can see the value and benefit of SNIA SSSI to its members, the SNIA educational community and the NVDIMM industry. I believe this is a great case study in how we all can contribute and benefit from working within the SSSI for the betterment of individual companies, market development and the Solid State Storage industry at large.” SSSI provides educational and marketing materials free of charge on its public website while SNIA SSSI members may join the NVDIMM-SIG and other SSSI committees. Anyone interested to find out more about the SSSI or any of its many committees can go to the following link http://www.snia.org/sssi.

 

Data Recovery and Selective Erasure of Solid State Storage a New Focus at SNIA

The rise of solid state storage has been incredibly beneficial to users in a variety of industries. Solid state technology presents a more reliable and efficient alternative to traditional storage devices. However, these benefits have not come without unforeseen drawbacks in other areas. For those in the data recovery and data erase industries, for example, solid state storage has presented challenges. The obstacles to data recovery and selective erasure capabilities are not only a problem for those in these industries, but they can also make end users more hesitant to adopt solid state storage technology.

Recently a new Data Recovery and Erase Special Interest Group (SIG) has been formed within the Solid State Storage Initiative (SSSI) within the Storage Networking Industry Association (SNIA). SNIA’s mission is to “lead the storage industry worldwide in developing and promoting standards, technologies and educational services to empower organizations in the management of information.” This fantastic organization has given the Data Recovery and Erase SIG a solid platform on which to build the initiative.

The new group has held a number of introductory open meetings for SNIA members and non-members to promote the group and develop the group’s charter. For its initial meetings, the group sought to recruit both SNIA members and non-members that were key stakeholders in fields related to the SIG. This includes data recovery providers, erase solution providers and solid state storage device manufacturers. Aside from these groups, members of leading standards bodies and major solid state storage device consumers were also included in the group’s initial formation.

The group’s main purpose is to be an open forum of discussion among all key stakeholders. In the past, there have been few opportunities for representatives from different industries to work together, and collaboration had often been on an individual basis rather than as a group. With the formation of this group, members intend to cooperate between industries on a collective basis in order to foster a more constructive dialogue incorporating the opinions and feedback of multiple parties.

During the initial meetings of the Data Recovery and Erase SIG, members agreed on a charter to outline the group’s purpose and goals. The main objective is to foster collaboration among all parties to ensure consumer demands for data recovery and erase services on solid state storage technology can be performed in a cost-effective, timely and fully successful manner

In order to achieve this goal, the group has laid out six steps needed, involving all relevant stakeholders:

  1. Build the business case to support the need for effective data recovery and erase capabilities on solid state technology by using use cases and real examples from end users with these needs.
  2. Create a feedback loop allowing data recovery providers to provide failure information to manufacturers in order to improve product design.
  3. Foster cooperation between solid state manufacturers and data recovery and erase providers to determine what information is necessary to improve capabilities.
  4. Protect sensitive intellectual property shared between data recovery and erase providers and solid state storage manufacturers.
  5. Work with standards bodies to ensure future revisions of their specifications account for capabilities necessary to enable data recovery and erase functionality on solid state storage.
  6. Collaborate with solid state storage manufacturers to incorporate capabilities needed to perform data recovery and erase in product design for future device models.

The success of this special interest group depends not only on the hard work of the current members, but also in a diverse membership base of representatives from different industries. We will be at Flash Memory Summit in booth 820 to meet you in person! Or you can visit our website at www.snia.org/forums/sssi for more information on this new initiative and all solid state storage happenings at SNIA.   If you’re a SNIA member and you’d like to learn more about the Data Recovery/Erase SIG or you think you’d be a good fit for membership, we’d love to speak with you.  Not a SNIA member yet? Email marty.foltyn@snia.org for details on joining.

New SNIA SSSI Webcast May 28 on Persistent Memory Advances

Join the NVDIMM Special Interest Group for an informative SNIA Brighttalk webcast on Persistent Memory Advances:  Solutions with Endurance, Performance & Non-Volatility on Thursday, May 28, 2015 at 12:00 noon Eastern/9:00 am Pacific.  Register at http://www.snia.org/news_events/multimedia#webcasts

Mario Martinez of Netlist, a SNIA SSSI NVDIMM SIG member, will discuss how persistent memory solutions deliver the endurance and performance of DRAM coupled with the non-volatility of Flash. This webinar will also update you on the latest solutions for enterprise server and storage designs, and provide insights into future persistent memory advances. A specific focus will be NVDIMM solutions, with examples from the member companies of the SNIA NVDIMM Special Interest Group.

New SIG for SSD Data Recovery/Erase Formed – Calls Open to All Interested Participants

SSDs present particular challenges when trying to erase all data or attempting to recover data from a broken drive. To address these issues, a new Data Recovery/Erase Special Interest Group has been formed within the SNIA Solid State Storage Initiative.

The goal of the SIG is to provide a forum in which solution providers and solid state storage manufacturers can collaborate to enable data recovery and erase capabilities in solid state storage in such a way as to ensure that customer demands for these services can be met in a cost-effective and timely manner, with a high likelihood of success. A key to the success of the SIG is obtaining input and participation from all of the key stakeholders: solid state storage manufacturers, data recovery and erase solution providers, and solid state storage customers.

The SIG will be having a limited number of conference calls that will be open to non-members. Go to http://www.snia.org/forums/sssi/dresig for more details and to register for the first open meeting.

SNIA NVM Programming Technical Work Group Honored at Storage Visions Conference

2015AwardWinnerOutlines

On January 4, 2015, the SNIA NVM Programming Technical Work Group received the Storage Visions 2015 Professional Storage Development Visionary Award ,

Storage Visions, a partner program of the Consumer Electronics Show, showcases digital storage and the entertainment content value chain as the storage conference of CES.

The Storage Visions “Visionary” Awards recognize companies advancing the state of the art in storage technologies utilized in consumer electronics, the media and entertainment industries; visionary products for the digital content value chain; and digital storage end users.

SV paul receiving award

This most recent honor recognizes TWG work on creating next generation programming models, and follows an August 2014 award to the NVM Programming Model as a Best of Show at Flash Memory Summit for the Most Innovative Flash Memory Enterprise Business Application.

The SNIA Non Volatile Memory (NVM) Programming Technical Work Group (TWG) delivers specifications describing the behavior of a common set of software interfaces that provide access to non-volatile memory (NVM). The TWG goal is to encourage a common ecosystem for NVM-enabled software without limiting the ability to innovate.

The TWG’s current work is the NVM Programming Model specification.  This specification describes behavior used by applications and kernel components to access:

  • Emerging features for traditional block NVM (SSDs) and
  • A new programming model for persistent memory (PM) – NVM hardware designed to be treated by software similarly to system memory.

New Website for SSSI Highlights Key SSD Technology Activities

A new, more easily “navigatable” website is now online for the SNIA Solid State Storage Initiative (SSSI)  technology community.

Divided into the activities the SSSI focuses on – Performance, NVDIMM, Non-Volatile Memory Programming, and PCIe SSDs, and with two new tabs linking directly to “News” and “Resources”, the new format gives readers quick access to webcasts, white papers, articles, presentations, and technical materials critically needed in the rapidly changing world of Solid State Storage technology.

The right navigation bar also highlights SSSI member companies and provides direct links to the SSSI blog you are reading now, the SSSI Twitter feed, and the SSSI LinkedIn Group SSDs – What’s Important to You?

Check it out, and let us know what you think at asksssi@snia.org or on our social media links!

Join the Solid State Storage Initiative August 4-7 at Flash Memory Summit 2014

The SNIA and the Solid State Storage Initiative (SSSI) invite SNIA members and non-members alike to attend Flash Memory Summit 2014, August 4-7, 2014 at the Santa Clara Convention Center.

SNIA at Flash Memory Summit offers an all star keynote lineup, including SNIA Member companies Dell, Diablo, Fusion-io, IBM, Intel, Marvell, Micron, NetApp, PMC-Sierra, Samsung, and SanDisk.  SSSI members will lead panels and sessions on SSD, NVDIMM, and NVM Programming.

A SNIA Education Day on Monday, August 4 in Room 203/204 of the Santa Clara Convention Center will feature award-winning SNIA Tutorials on Flash and Storage where attendees can learn about secure storage, SSD workload testing, benefits of Flash storage to the enterprise, PCI Express, and Flash storage architectures from SNIA member experts.  This Education Day is complimentary to all FMS attendees.

Following the Education Day, all are welcome to attend a Solid State Storage Reception Monday evening from 5:30 pm – 7:00 pm in Room 203/204 featuring updates on the solid state disk market, an NVDIMM presentation, and an NVM Programming Model overview.  Visit displays that highlight SNIA Solid State Initiative programs, including Non Volatile Memory Programming, Performance Testing,  and Workload I/O Capture.  Learn how you can participate in the exciting 2014 programs of the SSSI.

A Non-Volatile DIMMs:  When Flash Isn’t Fast Enough Hands-On Lab presented by the NVDIMM SIG and SIG member companies AgigaTech, Netlist, and SMART Modular will illustrate how a category of NVDIMMs function in server and storage systems and how they can be integrated into a standard server platform.

And don’t forget to stop by SNIA SSSI Booth 808 in the Exhibit Hall to check out  five static and two live NVDIMM displays and new whitepapers, brochures, and news on SSDs.

Register now at www.flashmemorysummit.com

Use the code “SNIA” to sign up today and receive $100 off Full Conference, 3-Day Conference, and One-Day Technical Program registration

What a Solid State We Store In

Note:  This blog entry is authored by SNIA Solid State Storage Initiative Governing Board member Gilda Fosswho serves on the SNIA Solid State Storage Initiative [SSSI] Governing Board as well as her role as Industry Evangelist in the CTO Office at NetApp, Inc

Solid state drives use semiconductor chips, as opposed to magnetic media, to store data.  The chips that solid state drives use are non-volatile memory meaning that the data remains even when the system has no power.  I’ve written about solid state drive technology in the past and I will continue to, for it represents the first major advancement in primary storage in a very long time.  Serving on the Governing Board of the SNIA Solid State Storage Initiative, it allows me to help foster the growth and success of the market for solid state storage in both enterprise and client environments. Our goals are to be the recognized authority for storage made from solid state devices, to determine and document the characteristics of storage made from solid state devices, and to determine and document the impact of storage made from solid state devices on system architectures.

So what can you expect if you were to ever upgrade to an SSD?  Well, for starters your computing experience will be transformed with screaming fast random access speeds, multi-tasking proficiency, as well as fantastic reliability and durability… and you can choose between an external SSD or even a hybrid drive so you’ve got some options.  A new SSD will make your system faster because the boot times will decrease, launching apps will be lightening fast, opening and saving docs will no longer drag, copying and duplicating file speeds will improve, and overall your system will have a new ‘pep in its step’.  Furthermore, to promote being green, SSDs consume far less power than traditional hard drives, which means they also preserve battery life and stay cooler.  Who doesn’t want and need that? They’re also very quiet, with none of the spinning and clanking you get with HDDs – for obvious reasons. SSDs are cooler and quieter, all the while being faster.

Since modern SSDs are Flash-based, there is no real hard-defined difference between Flash and SSD.  Rather, as mentioned previously, Solid State Disk is essentially storage that doesn’t require moving parts and Flash is what allows that to exist.  SSDs use Flash instead of RAM these days, since it’s a type of memory that’s super fast and doesn’t require continuous power, making it non-volatile.  A match made in solid-state heaven.

There are some fundamental aspects that folks expect from a robust flash-based storage solution.  First off, I/O performance and efficiency for many applications, including database acceleration, server and desktop virtualization, and cloud infrastructure.  You should also expect to speed up overall IT performance, boost responsiveness of performance-critical applications, and reduce power costs and over-provisioning.  Furthermore, you will obviously use more high-capacity, low-cost SATA drives while improving utilization of your data center space.  If you can achieve all your flash-based goals without changing your IT infrastructure management processes, then you’ve really got it good.

Flash storage has customarily had substantial aging issues. In a nutshell, a user could only write to the memory a certain number of times before they would just lose that section of the drive coupled with the fact that performance would degrade over time, too.  However, a lot of these issues were resolved and companies started manufacturing SSDs out of Flash memory instead of out of RAM.

I’ve stated in the past that many people in the industry believe that flash SSDs will eventually replace traditional hard drives.  By the time this happens other characteristics, such as slower write time and added cost, will likely have been eradicated or significantly diminished. Even today, an SSD can extend the life of a laptop battery, reduce the weight of the system, make it quieter, and increase read performance.  When properly and optimally engineered, SSDs are now at least as reliable as traditional spinning hard drives.  Relating to the faster speed, think of one starting up in seconds versus minutes. Even the slowest current SSD gives you much improved real-world performance than does the fastest conventional hard drive, perhaps even 100x as fast.  This allows for better user productivity, allowing for more work to get done in a fraction of the time.  Furthermore, using flash in enterprise storage servers means you can support more users, do more work, and use less power so it’s no wonder that it’s become an important technology for business transactions.   It’s a solid win-win-win.

SSSI’s 2014 Mission

This SNIA initiative was formed in September 2008 and its mission is to foster the growth and success of the market for solid state storage in both enterprise and client environments. Our goals are to be the recognized authority for storage made from solid state devices, to determine and document the characteristics of storage made from solid state devices, and to determine and document the impact of storage made from solid state devices on system architectures.  Additionally, the SSSI collects solid state technical requirements of storage system vendors and communicate to SSD manufacturers for common features, behavior, and robustness.  The initiative collaborates with academia and the research labs of member companies to understand how advances in solid state memory will impact storage made from solid state memory as well as to educate the vendor and user communities about storage made from solid state devices.

The SNIA SSSI also coordinates education activities with the Education Committee, performs benchmark testing to highlight the performance advantages of solid state storage, create peer reviewed vendor neutral SNIA Tutorials, and create vendor-neutral demonstrations.  The SSI also leverages SNIA and partner conferences, collaborate with industry analysts, perform market outreach that highlights the virtues of storage made from solid state devices.  The initiative determines what technical work should be performed within SNIA technical working groups to further the acceptance of storage made from solid state devices.  Furthermore and very importantly, the SSSI determines the standards that will be necessary to support the industry usage of SSDs by performing interoperability plug-fests as necessary in support of standards development.

Collaboration between other SNIA organizations is also key.  The SSSI works with the Storage Management Initiative (SMI) to understand how SMI-S can be used to manage storage made from solid state devices.  We also work with the Green Storage Initiative (GSI) to understand how storage made from solid state devices will impact energy use in computer systems.  The work that the SSI does with the Technical Council helps create the desired technical working groups and provides external advocacy and support of these technical working groups.

Finally, the SSSI collaborates with other industry associations via SNIA’s Strategic Alliances Committee (SAC) on SSD-related technical work in which they are involved as well as coordinates with SNIA Regional Affiliates to ensure that the impact of the SSS Initiative is felt worldwide.  For more information, please visit http://www.snia.org/forums/sssi