Testing & Performance | SNIA Compute, Memory and Storage Blog

Are Hard Drives or Flash Winning in Actual Density of Storage?

March 9, 2016March 9, 2016 Marty Foltyn Leave a comment

The debate between hard drives and solid state drives goes on in 2016, particularly in the area of areal densities – the actual density of storage on a device. Fortunately for us, Tom Coughlin, SNIA Solid State Storage Initiative Education Chair, and a respected analyst who contributes to Forbes, has advised that flash memory areal densities have exceeded those of hard drives since last year!

Coughlin Associates provides several charts in the article which map lab demos and product HDD areal density since 2000, and contrasts that to new flash product announcements. Coughlin comments that “Flash memory areal density exceeding HDD areal density is important since it means that flash memory products with higher capacity can be built using the same surface area.”

Check out the entire article here.

SNIA’s Solid State Storage Initiative Advances the Industry at Flash Memory Summit

August 28, 2015August 28, 2015 Marty Foltyn Leave a comment

A classic case of SNIA Solid State Storage Initiative (SSSI) member collaboration for industry advancement was on display in the SSSI booth for NVDIMM-N demonstration at the Flash Memory Summit (FMS) 2015. Under the direction of SSSI Chair Jim Ryan and coordinated by NVDIMM SIG co chairs Arthur Sainio and Jeff Chang and TechDev Committee chair Eden Kim, the SSSI was able to update and include NVDIMM-N storage performance in the SSSI marketing collaterals on the Summary Performance Comparison by Storage Class charts.

Five SSSI member companies – AgigA Tech, Calypso, Micron, SMART Modular, and Viking Technology – collaborated over a four week period on the introduction of a new NVDIMM-N storage performance demonstration. While it is rare to have potential competitors collaborate in such a fashion, NVDIMM-N storage represents a new paradigm for super fast, low latency, high IO/watt storage solutions. The NVDIMM-SIG has taken a leadership position by evangelizing the technology and developing the industry infrastructure necessary for large scale deployment.

This collaboration highlighted a classic blend of technical, marketing and industry association cooperation.

In the weeks leading up to FMS, the NVDIMM-SIG planned for an in-booth demonstration of the NVDIMM-N storage modules. To pave the way for universal adoption, the team worked together to dial in the Intel Open Source block IO development driver to meet the standards of the SNIA Performance Test Specification (PTS). An added goal was inclusion of NVDIMM-N modules as a new line item on the Summary Performance Comparison by Storage Class chart which lists PTS performance for various storage technologies. Under the guidance of NVDIMM-SIG, a rush project was instigated to get NVDIMM-N performance data tested to the PTS for the trade show.

Micron took the lead by lending a Supermicro server with Micron NVDIMM-N to Calypso for testing. Calypso then installed CTS test software on the server to allow full testing to the PTS. Viking and SMART Modular contributed by helping dial in the drivers, as well as sending modules from Viking and SMART Modular to cross reference with the Micron modules. The test plan was comprised of several test iterations using single, dual and finally quad modules using each of the vendor contributed modules.

The early single and dual module tests ran into repeatability and stability issues. NVDIMM-SIG consulted with Intel on the nuance of the Intel block IO driver while Calypso continued testing. The team successfully completed a test run that met the PTS steady state requirements on the quad module in time to release data for the show.

We had a solid demonstration at the SNIA SSSI Flash Memory Summit Booth on NVDIMM-N Performance complete with marketing collateral available for review and a handout. NVDIMM-SIG members responded to the many questions and interest in the NVDIMM-N storage technology.

“Once again,” said SSSI Chair Jim Ryan, “we can see the value and benefit of SNIA SSSI to its members, the SNIA educational community and the NVDIMM industry. I believe this is a great case study in how we all can contribute and benefit from working within the SSSI for the betterment of individual companies, market development and the Solid State Storage industry at large.” SSSI provides educational and marketing materials free of charge on its public website while SNIA SSSI members may join the NVDIMM-SIG and other SSSI committees. Anyone interested to find out more about the SSSI or any of its many committees can go to the following link http://www.snia.org/sssi.

New SIG for SSD Data Recovery/Erase Formed – Calls Open to All Interested Participants

April 26, 2015April 26, 2015 Marty Foltyn Leave a comment

SSDs present particular challenges when trying to erase all data or attempting to recover data from a broken drive. To address these issues, a new Data Recovery/Erase Special Interest Group has been formed within the SNIA Solid State Storage Initiative.

The goal of the SIG is to provide a forum in which solution providers and solid state storage manufacturers can collaborate to enable data recovery and erase capabilities in solid state storage in such a way as to ensure that customer demands for these services can be met in a cost-effective and timely manner, with a high likelihood of success. A key to the success of the SIG is obtaining input and participation from all of the key stakeholders: solid state storage manufacturers, data recovery and erase solution providers, and solid state storage customers.

The SIG will be having a limited number of conference calls that will be open to non-members. Go to http://www.snia.org/forums/sssi/dresig for more details and to register for the first open meeting.

It’s “All About M.2 SSDs” In a New SSSI Webcast June 10

June 4, 2014June 4, 2014 Marty Foltyn Leave a comment

Interested in M.2, the new SSD card form factor?

The SNIA Solid State Storage Initiative is partnering with SATA-IO and NVM Express to give you the latest information on M.2, the new SSD card form factor. Join us “live” on Tuesday, June 10, at 10:00 am Pacific time/1:00 pm Eastern time.

Hear from a panel of experts, including Tom Coughlin of Coughlin Associates, Jim Handy of Objective Analysis, Jon Tanguy of Micron, Jaren May of TE Connectivity, David Akerson of Intel, and Eden Kim of Calypso Systems. You will leave this webinar with an understanding of the M.2 market, M.2 cards and connection schemes, NVM Express, and M.2 performance. You’ll also be able to ask questions of the experts.

You can access this webcast via the internet. Click here, or visit http://snia.org/news_events/multimedia#webcasts

Join the SSSI at Flash Memory Summit August 12-15 in Santa Clara CA!

August 7, 2013August 7, 2013 Marty Foltyn Leave a comment

SSSI returns to the Flash Memory Summit in booth 808, featuring information on updates on new tests in the SNIA Solid State Storage Performance Test Specification-Enterprise 1.1, NVM programming, and Workload I/O Capture Program (WIOCP) activities; new tech notes and white papers, including a PTS User Guide Tech Note, a PCIe SSD 101 Whitepaper, and a Performance Primer Whitepaper; and PCIe SSD demonstrations from SSSI members Bitmicro, Fastor, and Micron.

All current SSSI members attending FMS and individuals from companies interested in the SSSI and their activities are cordially invited to the SSSI Solid State Storage Reception Monday evening August 12 from 5:30 pm – 7:00 pm in Room 209-210 at the Santa Clara Convention Center. At the reception, SSSI Education Chair Tom Coughlin of Coughlin Associates will provide an overview of the SSD market, and SSSI Chair Paul Wassenberg of Marvell will discuss SSD performance. SSSI Vice Chair Walt Hubis of Fusion-io will discuss SSSI programs, including PTS, NVM Programming, Workload I/O Capture, and PCIe SSD. Refreshments, table displays, and an opportunity drawing for SSDs provided by SSSI members Intel, Micron, and OCZ will be featured.

FMS conference activities begin August 13, and the agenda can be found here. SSSI members speaking and chairing panels include:

Tuesday August 13

4:35 pm – Paul Wassenberg of Marvell on Standards

Wednesday August 14

8:30 am – Eden Kim and Easen Ho of Calypso Testers – PCIe Power Budgets, Performance, and Deployment

9:50 am – Eden Kim and Easen Ho of Calypso Testers – SNIA Solid State Storage Performance Test Specification

3:10 pm – Walt Hubis of Fusion-io – Revolutionizing Application Development Using NVM Storage Software

3:10 pm – Easen Ho of Calypso Testers – SSD Testing Challenges

4:30 pm – Paul von Behren of Intel – SNIA Tutorial: SNIA NVM Programming Model: Optimizing Software for Flash

Thursday August 15

3:10 pm – Jim Pappas of Intel – PCI Express and Enterprise SSDs

3:10 pm – Jim Handy of Objective Analysis – Market Research

An open “Chat with the Experts” roundtable session Tuesday August 13 at 7:00 pm will feature Jim Pappas of Intel at a Standards table, Eden Kim of Calypso Testers at a SSD Performance table, Easen Ho of Calypso Testers at a Testing table, and Paul Wassenberg of Marvell at a SATA Express table.

The Media Entertainment and Scientific Storage (MESS) will hold their August “Meetup” at the Open Chat with the Experts, and also be located in SSSI Booth 808 for further discussions.

Exhibit admission is complimentary until August 8. SNIA and SSSI members and colleagues can receive a $100 discount on either the 3-day conference or the 1-day technical program using the code SNIA at www.flashmemorysummit.com.

New Performance Test Service Launched for Solid State Drives

April 20, 2013April 20, 2013 Marty Foltyn Leave a comment

The SNIA Solid State Storage Initiative (SNIA SSSI) announces a testing service where interested parties may submit their SSD products for testing to the SSS Performance Test Specification.

Drive Requirements

Any mSATA, SATA, SAS and PCIe SSDs can be tested. The tested device must be recognized as a logical device by CentOS 6.3 and must support Purge (via Security Erase, Format Unit, or equivalent proprietary method of Purge).

Available Tests

Testing is based on the SSS PTS version 1.1. Visit the SSS Performance Test Service page for more information on the tests.

Testing Process

Testing will be conducted by Calypso Systems, a certified SSS PTS testing facility. Participants must submit two (2) samples of the SSD to be tested and provide prepaid return express shipment bills (FedEx, DHL or UPS). Testing will take approximately 3-4 weeks to complete.

Any failed test, or test that will not complete, will be tested twice and error logs will be provided. All product test result data will be kept confidential.

Test results are provided in standard SNIA Report Format as specified in the SSS Performance Test Specification.

For more details, contact ptstest@snia.org

Introducing SNIA’s Workload I/O Capture Program

January 17, 2013January 17, 2013 Jim Handy Leave a comment

SNIA’s Solid State Storage Initiative (SSSI) recently rolled out its new Workload I/O Capture Program, or WIOCP, a simple tool that captures software applications’ I/O activity by gathering statistics on workloads at the user level (IOPS, MB/s, response times queue depths, etc.)

The WIOCP helps users to identify “Hot Spots” where storage performance is creating bottlenecks. SNIA hopes that users will help the association to collect real-use statistics on workloads by uploading their results to the SNIA website.

Using this information SNIA member companies will be able to improve the performance of their solid state storage solutions, including SSDs and flash storage arrays.

How it Works

The WIOCP software is a safe and thoroughly-tested tool which runs unobtrusively in the background to constantly capture a large set of SSD and HDD I/O metrics that are useful to both the computer user and to SNIA.

Users simply enter the drive letters for those drives for which I/O operations metrics are to be collected. The program does not record anything that might be sensitive, including details of your actual workload (for example, files you’ve accessed.) Results are presented in clear and accessible report formats.

How can WIOCP Help You?

Users can collect (and optionally display in real time) information reflecting their current environment and operations with the security of a tool delivered with digital authentication for their protection.

The collected I/O metrics will provide information useful to evaluate an SSD system environment.

Statistics from a wide range of applications will be collected, and can be used with the SSS Performance Test Specification to help users determine which SSD should perform best for them.

How can Your Participation Help SNIA and the SSSI?

The WIOCP provides unique, raw information that can be analyzed by SNIA’s Technical Work Groups (TWGs) including the IOTTA TWG to gain insights into workload characteristics, key performance metrics, and SSD design tradeoffs.

The collected data from all participants will be aggregated and publicly available for download and analysis. No personally identifiable information is collected – participants will benefit from this information pool without comprising their privacy or confidentiality.

Downloading the WIOCP

Help SNIA get started on this project by clicking HERE and using the “Download Key Code”: SSSI52kd9A8Z.

The WIOCP tool will be delivered to your system with a unique digital signature. The tool only takes a few minutes to download and initialize, after which users can return to the task at hand!

If you have any questions or comments, please contact: SSSI_TechDev-Chair@SNIA.org

Updated Client Solid State Performance Test Specification Now Available

June 26, 2012June 26, 2012 Marty Foltyn Leave a comment

SNIA’s Solid State Storage Initiative has just released a revised Client SSS Performance Test Specification (PTS-Client) which adds a new write saturation test and refines existing tests.

The Solid State Storage Performance Test Specification (PTS) is a device-level performance test suite for benchmarking and comparing performance among SAS, SATA and PCI Express SSDs

Revision 1.1 of the PTS-Client updates tests for IOPS, throughput and latency to more accurately reflect the workload conditions under which Client SSDs are used. The PTS-Client v1.1 also adds a Write Saturation test that measures the initial Fresh-Out-of-Box state of SSDs and their performance evolution as data is randomly written to the device.

Eden Kim, Chair of SNIA’s SSS Technical Working Group, describes the primary updates to PTS-Client v1.1 as adjustments to preconditioning ranges and test boundaries. Taken together, these parameters create a repeatable test stimulus that more accurately reflects the workload characteristics of SSDs used in a single user environment The PTS-Client v1.1 also adds an easily understandable description of each test, which helps the user to understand the purpose of the test, the test flow, and guidance on how to interpret the test results.

Sample test results using the PTS-Client v1.1 have been posted to the SNIA SSSI Understanding PTS Performance webpage.

Understand SSD Performance Project

January 17, 2012January 17, 2012 Team_SSSI Leave a comment

At last week’s Storage Vision conference, SSSI announced the Understanding SSD Performance project, which is intended to educate users about how to use the SSS PTS (Performance Test Specification) to make intelligent decisions about SSD performance. You can find the press release here.

The project outcomes so far include a new webpage at www.snia.org/forums/sssi/pts, a white paper (www.snia.org/forums/sssi/knowledge/education), and a webcast.

Join us for the webcast on January 19 at 11AM Pacific Time by going to www.brighttalk.com/webcast/663/40549.

Category: Testing & Performance