The cloud, brought to you by flash storage

The cloud, brought to you by flash storage

Web 2.0 and Internet services companies see the fast, efficient technology changing their data centers

Major storage vendors such as EMC have been offering flash options since last year. Most get the actual drives from STEC, a solid-state storage manufacturer in Santa Ana, California, and integrate them into their own systems.

In April, EMC introduced Symmetrix V-Max, its first storage platform designed from the start to use SSDs as well as spinning disks. Symmetrix is particularly geared toward high performance, but SSDs are also available on the company's other storage systems.

IBM offers STEC SSDs up to 146GB in its DS8000 Enterprise Disk Array. It also plans to let users integrate SSDs into its SAN Volume Controller appliance, which can manage many different types of storage.

Flash should be available for all of IBM's enterprise storage platforms by the end of this year, said Clodoaldo Barrera, chief technology strategist for IBM System Storage.

Hewlett-Packard offers SSDs for its high-end XP storage arrays and midrange Enterprise Virtual Array (EVA), as well as flash cards made by Fusion-io that fit into HP servers. In cases where performance is key, the cost advantage can be significant, according to Kyle Fitze, director of marketing for HP Storage Platforms.

Enterprises commonly gang together several lightly loaded, high-speed Fibre Channel hard drives to take advantage of their combined speed, a process called short-stroking. On the EVA, eight 72GB SSDs can outperform 324 Fibre Channel drives, each 300GB with 15,000 RPM speed, Fitze said. What's more, the whole package would typically cost $US605,000 with hard drives and $US155,000 with SSDs, he said.

SSDs still cost 25 times as much as spinning disks on a per-gigabyte basis, according to IDC analyst Jeff Janukowicz. But the need for performance, capacity utilization and lower power consumption, especially by large-scale cloud operators, should drive enterprise SSD sales up an average of 165 percent per year until 2013, he said.

Gartner sees a similar explosion, with sales of 59,000 units last year growing to 281,000 this year.

Some of the biggest cloud service providers may help to drive that growth.

Along with fast access to key pieces of data, Facebook anticipates "tremendous" gains in both reliability and lower power consumption from flash, operations chief Heiliger said. The social-networking company, with more than 200 million users, is highly demanding in its data centers.

At the Structure conference, Heiliger criticized server manufacturers for not delivering systems designed from the ground up for power savings, and Intel and AMD for not meeting performance promises on some new chips.

MySpace is interested in using flash to save data-center space while maintaining fast page loads for its users, according to Buckingham. One way MySpace is likely to do that is by replacing short-stroked disks with flash.

That technique should enable the company to use a server that's one rack unit (1U) high instead of 2U, which could make a big difference in a company with 60,000 square feet (5,600 square meters) of data-center space, he said. The company has petabytes of storage, and unlike most enterprises, it has to respond to hundreds of thousands of page requests per second, he said.

MySpace would use flash as a cache for frequently used data in its databases, as well as for maintaining indexes for search, Buckingham said. The company has tested both single-layer and multilayer products and is attracted to multilayer because it costs less.

But MySpace wants to make sure the storage doesn't degrade under the heavy workloads it would be subjected to.

Buckingham has been working with several vendors to establish baselines for performance and reliability. Even so, MySpace won't rely on flash for persistent data, such as the actual pictures that users post on their pages. Only about one-twentieth of the company's data would ever be stored on flash, Buckingham said.

"I'm never going to write something to an SSD and hope it lasts forever," Buckingham said.

NetSuite, a provider of on-demand software for uses such as enterprise resource planning, customer relationship management and e-commerce, sees flash as a place to store heavily used database information for its customers.

That data helps to drive "real-time dashboards" that show NetSuite's medium-sized enterprise customers current information such as their expenses, sales forecasts or number of open customer service tickets, said David Lipscomb, senior vice president of engineering.

NetSuite wants to let users refresh the dashboard as frequently as they need it, which can demand a lot of speed if thousands of customers are using their dashboards at the same time. Flash should be ideal, he said.

"When this thing comes along that allows you to make the database so much faster, you say, 'That's something I need to drill on,'" Lipscomb said.

NetSuite is experimenting with flash cards from Fusion-io and finding they offer between two and five times the performance of hard drives, Lipscomb said. SSDs are still too expensive for the company's data-center architecture, which is built around large numbers of standard, inexpensive components, he said.

Despite its benefits, flash storage is expected to remain just one tier of a total storage infrastructure at both traditional and Internet-based enterprises. Aside from questions about long-term reliability, one of the biggest remaining challenges for the technology is how to put the right data in it.

Ideally, what resides in flash should be the most urgently needed data at any given time. Vendors are working on software to automatically allocate data to flash, fast hard drives and slower drives.

EMC plans to introduce its Fully Automated Storage Tiering software by the end of this year. HP is also working on automated tiering.

Cloud computing companies are likely to be at the cutting edge of overcoming those challenges as they try to keep up with booming Internet activity.

"The decisions they make, or the innovations they create, are likely to change the market in a big way," Forrester's Reichman said.

Follow Us

Join the newsletter!


Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags cloud computingSSDflash storage


Show Comments