Storage Soup

September 1, 2016  12:00 PM

EMC expects to pass Nutanix as HCI leader by mid-2017

Dave Raffo Dave Raffo Profile: Dave Raffo
HCI, Hyper-convergence, Nutanix

EMC’s VCE converged infrastructure group wants to unseat Nutanix as the hyper-converged market leader as early as the end of 2016 and no later than the middle of 2017.

The closing of Dell EMC Sept. 7 will result in a company combining Dell servers, EMC storage and VMware virtualization. That should make it a natural powerhouse in hyper-convergence infrastructure (HCI), which combines servers, storage and virtualization in a box.

EMC’s main HCI product, the VCE VxRail, incorporates VMware’s Virtual SAN (VSAN) hyper-converged software and will soon use Dell servers. Jeremy Burton, chief marketing officer of Dell EMC, said VxRail has surpassed VCE’s internal sales forecasts since its February release and now is gunning for Nutanix.

It will be difficult passing Nutanix this year. Nutanix reported $114.7 million in sales for the first quarter of this year – the last quarter it disclosed in its filings to become a public company – and has consistently grown sales each quarter by close to 20%. But Burton said it’s just a matter of time until Dell EMC becomes the HCI leader.

“Our strategy is to be the market leader in hyper-converged,” Burton said during an interview at VMworld this week. “We consider Nutanix No. 1 today. Our goal is to get to No. 1 by the end of the year. We think it’s doable, although it would be a stretch. If it’s not by the end of this year, the worst case is the middle of next year. If we haven’t achieved our goal by then, we’re doing something wrong.”

Burton said after the Dell deal closes, EMC will replace the Quanta servers it currently uses for VxRail with Dell servers.

“Building a hyper-converged infrastructure is a natural leverage point between Dell and EMC,” Burton said. “It’s a server-centric architecture. Dell has a great compute platform, we’ve got the VMware software stack, and chunks of EMC software. It’s a nice collection of the assets of the various companies that we can put out the door as a single product offering.”

Besides the technology, Burton said another huge advantage over Nutanix is the Dell EMC sales and distribution model. Dell EMC already has the type of massive distribution machine that will cost Nutanix more than $200 million this year to build out – resulting in heavy losses despite its market leading position. Burton compared VxRail to XtremIo, which shot past smaller competitors’ all-flash arrays to generated $1 billion in revenue in two years on the market.

“With VxRail, if we get the product right and we get the messaging right, there’s no reason we shouldn’t be the market leader,” he said.

The twist is that Dell is also part of Nutanix’s distribution network. A Nutanix OEM partner since 2014, Dell sells Nutanix HCI software on Dell servers branded as the Dell XC Series. Dell renewed that agreement in June through 2021, meaning Dell Technologies will both partner and compete with Nutanix.

“The delicate balance here is there are a lot of customers who have bought the Dell XC Series and they want to buy more,” Burton said. “I think what the Dell team is trying to do is protect customer relationships. You never want a customer to be caught in the middle of a vendor battle. At least in this interim period, they’re going to carry Nutanix and we have VxRail and the customer is going to decide. We’re very careful not to get the customer in the firing line.”

Remember that strategy. You’ll see Dell EMC take a similar tact with Dell’s Compellent and EqualLogic storage arrays, which both compete with traditional EMC products.


August 30, 2016  3:15 PM

Catalogic copy data management tool gets Pure

Garry Kranz Garry Kranz Profile: Garry Kranz

Copy data management specialist Catalogic Software has added two all-flash arrays to its roster of supported platforms.

In separate moves, the Woodcliff Lake, New Jersey-based software maker rolled out its ECX Instant Copy Data Management tool for Pure Storage FlashArray//m Series and IBM FlashSystem A9000 and A9000R all-flash systems.

The new copy data management tool for Pure Storage works across its FlashArray //m10, //m20, //m50 and //m70 array models. Catalogic and Pure Storage said they plan to jointly deliver the software package in September.

IBM FlashSystem A9000 and A9000R all-flash arrays are geared for hyper-scale and cloud service providers.

Catalogic’s copy data management tool for Pure provides in-place copy data management by integrating with Pure Storage FlashRecover copy engine and FlashReduce data reduction. A policy engine automates how replicas and snapshots are created and deployed on FlashArray storage.

Catalogic additionally integrates those copy processes with commonly used applications such as Oracle, SQL Server and VMware applications.  Customers will be able to use Catalogic’s data management tool to catalog and track multiple data copies across their Pure Storage environment.

The ECX copy data management tool for Pure takes advantage of the inherent performance advantages of all-flash storage, said Tom Grave, Catalogic’s vice president of marketing

“All-flash arrays like Pure have the IOPs to drive multiple workloads from a single snapshot image, but they don’t have the management infrastructure to keep track of and easily deploy or integrate those copies with critical applications like Oracle,” Grave said.

“What we do is integrate the Pure snapshots and replication with the application layer, and then provide critical IT operational features on top of that like scheduling, automation, reporting and user self-service.”

Upon installation, Catalogic ECX automatically discovers any installed databases and assembles an index of data copies, including historical access patterns and data lineage.

Pure Storage is the fourth primary storage vendor, and first all-flash-only array maker, to qualify ECX since Catalogic’s 2014 spinout from Syncsort. It follows on the heels of an ECX rollout in June to support EMC Unity midrange hybrid arrays. Catalogic also supports NetApp storage and IBM Flash System and IBM Storwize systems.

Enterprises are just waking up to how a copy data management tool can improve management and help them reclaim storage capacity.  A recent report by analyst firm IDC predicts that organizations by 2018 will cumulatively spend $51.3 billion to house copy data.

August 30, 2016  1:36 PM

Dell-EMC deal closes Sept. 7

Dave Raffo Dave Raffo Profile: Dave Raffo
Dell, EMC

LAS VEGAS, Nevada — Dell and EMC made it official today. Dell will close its $67 billion acquisition of the largest storage vendor Sept. 7, following the transaction’s official approval today by China’s Ministry of Commerce.

Executives from both companies had projected the Dell-EMC deal would close within a year of its original disclosure, which was last Oct. 12 The Sept. 7 closing date makes it with room to spare.

Jeremy Burton, EMC’s president for products and marketing, said the process went as smooth as possible from the deal’s announcement to close. Burton will become chief marketing officer for Dell EMC after the close. Dell founder and CEO Michael Dell said in May that his company will change its name to Dell Technologies following the close.

“I’m really sorry there wasn’t more drama in this whole merger,” Burton said in interview at VMworld. “The whole process has been unremarkable. We always figured China would be the long pole in the tent, and it was.”

There was little drama about the deal at VMworld, although EMC-owned VMware is part of Dell’s acquisition. Michael Dell appeared with VMware CEO Pat Gelsinger during the Monday keynote, but the official news release about the closing went minutes after today’s keynotes ended without fanfare.

VMware ‎chief communications officer Oliver Roll opened the post-keynote press conference by relaying news about the close. “We’re pleased about that,” Roll said, and the rest of the press conference focused on products and technologies discussed during the keynote.

“This is an historic moment for both Dell and EMC,” Dell said in the press release. “Combined, we will be exceptionally well-positioned for growth in the most strategic areas of next generation IT including digital transformation, software-defined data center, converged infrastructure, hybrid cloud, mobile and security. Our investments in R&D and innovation, along with our 140,000 team members around the world, will give us unmatched scale, strength and flexibility, deepening our relationships with customers of all sizes.”

The release also quoted EMC CEO Joe Tucci: “I am proud of everything we’ve built at EMC – from humble beginnings as a Boston-based startup to a global, world-class technology company with an unyielding dedication to our customers. The combination of Dell and EMC creates a new powerhouse in the industry – providing the essential technology for the next era in IT.”

August 29, 2016  4:26 PM

Rackspace cloud gets acquired, set to go private

Sonia Lelii Sonia Lelii Profile: Sonia Lelii

An equity firm will acquire Rackspace so the cloud vendor can go private and transition away from competing with the likes of Amazon Web Services and partner with them instead. The $32 per share cash deal is valued at $4.3 billion.

Rackspace is one of the earliest cloud providers that tried to compete with Amazon AWS and Microsoft Azure. Founded in 1998, it has been trading publicly on the New York Stock Exchange since 2008. It reported revenue growth of $2 billion last year. Its stock price was once valued at $80 a share but it has been trading at $31.46 a share.

The deal with Apollo Global Management, LLC is expected to give Rackspace cloud the investment dollars it needs to transition as a managed cloud services provider that partners with Amazon AWS, Microsoft Azure and Google. The idea is Rackspace will provide customers with the kind of support that the big public cloud vendors lack.

“AWS does not offer high-touch support for people using the public cloud,” said Molly Gallahar Boddy, a research analyst at Technology Business Research, Inc. “You need to turn to an AWS partner for 24-by-7 support.”

Boddy said Rackspace cloud can help customers with data migration to the cloud, optimization and architectural designs.

“One thing a lot of companies at is security,” she said. “Rackspace was in the private cloud so they can cater to certain environments where you need that extra security layer. Smaller customers may not have these kind of services in-house.

“Going private will also give them a chance to partner with all kinds of different cloud companies,” Boddy said. “Going private gives Rackspace a chance to work out not only the messaging but the funding as well. It’s hard to transition from a hosting-based company to a cloud services-based company.”

Rackpace cloud is the latest in the technology industry to go private. Other examples include Dell and Marketo, a software automation vendor that announced it was acquired byVista Equity Partners for $1.79 million and would take it private.

Dell is the highest profile company to make the move, announcing in 2013 a $24.4 billion deal to take itself private as it transition from a personal computers vendor to one that can compete cloud-driven industry. Dell will also take EMC private after it completes its $67 billion buyout of the world’s largest storage vendor.

According to a report written by Boddy, Rackspace’s “shifting business model has created uncertainty for those following the company. Although Rackspace has reported early customer wins and new logos with its recently debuted Fanatical Support (managed services) for AWS and Fanatical Support for Microsoft Azure, the company requires additional capital to further focus its business on third-party Fanatical Support…and to win enterprise accounts.”

Boddy said she expects that Private Cloud OpenStack will be a key tenant of Rackspace’s business going forward since the company is supporting large public cloud vendors while also catering to hybrid cloud customers looking for managed, private OpenStack deployments.

August 28, 2016  8:00 PM

Nutanix expands, pockets PernixData,

Dave Raffo Dave Raffo Profile: Dave Raffo
DevOps, Hyper-convergence, Nutanix, PernixData

Nutanix, the hyper-converged vendor that may go public within weeks, is expanding its technology base through two software acquisitions.

Nutanix Monday will officially disclose acquisitions of flash and RAM caching software startup PernixData and DevOps automation vendor Nutanaix CEO Dheeraj Pandey said the acquisitions will bring technology to take advantage of next-generation flash and to allow applications to run across any cloud or on-premise storage and server platforms. Those capabilities can accelerate Nutanix’s goal of developing an enterprise cloud platform.

Nutanix did not reveal the price it paid for either company. The PernixData acquisition was expected following a month or so of rumors about the deal.

Nutanix filed for an initial public offering (IPO) in December, and has filed three extensions while waiting for the IPO market to improve. Pandey said Nutanix did not use a $75 million loan from Goldman Sachs to pay for the two startups. Nutanix disclosed the load when it filed its second IPO extension in May.

A source who has spoken to Nutanix bankers said the company plans its IPO in September. The same source said Nutanix paid less than $30 million for PernixData. Industry sources close to PernixData said it had $9.3 million in bookings in 2014 and $17 million in 2016. It raised $62 million in funding, but none since a $35 million round in August 2014.

Nutanix executives said their acquired technologies will lead to new software stacks for storage-class memory systems, enhanced Application Mobility Fabric to enable cross-cloud workload migration, and cloud orchestration and workflow automation. One Nutanix design goal is to bring access to all clouds and platforms under one management interface. Nutanix executives often talk about providing one-click data migration throughout the data center.

PernixData’s FVP software pools and caches flash and RAM across servers. The technology will help Nutanix “hug the application,” as Pandey described it.

“PernixData has built a very strong muscle memory around storage-class memory, better than any of the storage startups we know of,” Pandey said during a conference call to  disclose the deals. “They also see every I/O without compromising on data consistency. That vantage point gives them a unique advantage to pull off online application migration – that one-click delight that Nutanix has always worked towards.”

A short-term problem is FVP supports only VMware ESX virtualization. Nutanix plans to modify FVP to work with its Acropolis and other hypervisors.

“Our approach has been about simplifying the data center using the same architecture for virtualized, bare metal or cloud workloads,” said Sunil Potti, Nutanix chief product and development officer. “We want to make sure we can leverage all the goodness of FVP, but in a unified architecture.”

Potti said the hyper-converged vendor will continue to support FVP customers but did not say if it would continue it as a standalone product long-term. PernixData claims it has close to 1,000 customers, but that was not enough to sustain the business long-term.

Server-side flash caching didn’t take off as expected,” said Henry Baltazar, storage research director for 451 Research. “PernixData had some success but it never became mainstream.”

But Baltazar agreed with Nutanx executives that PernixData technology can help take advantage of next-generation flash technologies.

“A lot of changes are coming soon to flash, 3D XPoint will make solid-state faster. It will be close to DRAM speeds,” he said. “The closer applications and CPUs are to flash, the faster they will be. Caching technology will help Nutanix get a leg up on what flash speeds are going to be.”

Calm DevOps automation software helps manage runtime lifecycle for distributed services running in cloud environments. It can orchestrate virtual machine, container and binary workloads.

Nutanix was among the first vendors to sell hyper-converged systems combining compute, storage and virtualization. It is considered the hyper-converged market share leader — claiming $305.1 million in revenue over the ninth months that ended April 30 – but VMware is challenging that lead with its Virtual SAN (VSAN) software.

August 26, 2016  10:36 AM

Pure Storage: We do flash better than those geezers

Dave Raffo Dave Raffo Profile: Dave Raffo
Pure Storage

When it comes to all-flash storage, Pure Storage claims experience is no match for youth.

Pure, born in 2011 as a flash-only vendor, is far outgrowing the storage establishment, a collection of vendors that Pure CEO Scott Dietzen calls “the 20-year-olds.”

The toddler Pure Thursday night reported $163 million in revenue for last quarter, a 93% increase over last year and above the high end of its forecast. Pure forecasted revenue of between $187 million and $195 million for this quarter. That would be 45% year-over-year growth if it comes in at the midpoint of the guidance.

Dietzen said his vendor is outgrowing the market by a long shot because it built its systems for flash from the start.

“Putting SSDs into storage designed more than 20 years ago simply cannot deliver on the demands of modern IT,” Dietzen said on Pure Storage’s earnings call.

Dietzen said Pure’s FlashArray is replacing “complex, services-intensive storage, designed for mainframes or client-server” systems. He called FlashArray smart storage, “that offers the simplicity, automation, resiliency and customer-friendly business model essential for cloud IT. Smart Storage allows customers to keep more data for far less costs, protected with strong security and delivers the bandwidth necessary to mine that data for new analytic insights or even machine learning.”

Dietzen’s critique of the competitors ignores that EMC XtremIO – the all-flash market leader – and IBM FlashSystem were acquired from companies who designed them from the ground up for flash. EMC and IBM also have modified their older storage platforms to work with flash, as have NetApp and Hewlett Packard Enterprise. Those four vendors and Pure share the leaders quadrant of Gartner’s Magic Quadrant for all-flash arrays released this week.

Pure Storage certainly has the results to back up Dietzen’s claims. As he pointed out, Pure nearly doubled its revenues year-over-year last quarter “at a time when many of our competitors are shrinking.”

He expects the growth to accelerate when Pure Storage’s FlashBlade object and file storage system hits the market. FlashBlade is in limited availability, and while some early beta testers have purchased the array, it will not likely generate significant sales before 2017. But in combination with the SAN-based FlashArray, Dietzen predicted FlashBlade will make Pure a storage powerhouse.

The young company is still going through growing pains, however, particularly on its bottom line. For all of its sales success, Pure loses tens of millions of dollars every quarter. It dropped $63.8 million last quarter as it increased sales and marketing spending to fuel its growth. That was an improvement over the $59.6 million loss from the same quarter last year, and Pure executives predict they will be “cash flow positive” by the second half of 2017. Pure finished last quarter with $570 million in cash and investments.

“With FlashBlade ramping and exciting FlashArray innovations yet to come, we are only getting started,” Dietzen said.

August 24, 2016  1:22 PM

Nimble says customers quick to embrace all-flash

Dave Raffo Dave Raffo Profile: Dave Raffo

Nimble Storage, which was relatively late selling all-flash arrays, is trying to make up for lost time since launching its Predictive Flash platform in February. The vendor received a jolt from all-flash sales but not enough to stop or even slow its significant losses.

Nimble said it added 133 all-flash customers in its first full quarter selling all-flash arrays. CEO Suresh Vasudevan said 79 of the all-flash customers were new to Nimble. Overall, 23% of bookings in the quarter were all-flash systems.

Nimble Tuesday reported revenue of $97.1 million. That beat the high end of its forecast by $1.1 million, and was up from $80.1 million a year ago.

However, the sales came at a cost as Nimble continues to increase investments in sales and marketing to compete with larger vendors. It lost $39.3 million in the quarter – up from $29.5 million a year ago – and executives would not predict when the company will become profitable. Nimble has $194.2 million in cash and investments as a cushion, which gives it a little time to stop the bleeding.

Nimble projected $100 million to $103 million in revenue this quarter, which at the midpoint is a 26% increase over last year.

Nimble added around 700 customers in the quarter. Most of them bought hybrid arrays, but Vasudevan said the selling price for all-flash often doubled that of hybrid systems. The vendor reported bookings from large enterprises (deals over $250,000) grew 37% over last year.

Nimble is looking to broaden its all-flash market with its new Predictive Flash AF1000 entry level system with a list price beginning at $40,000.

“We believe that complex storage solutions from legacy vendors are no longer competitive creating a significant share shift opportunity,” Vasudevan said during Nimble’s earnings call. “At the same time, we believe that younger storage companies do not have the breadth of functionality of our (all-flash) platform. Consequently, we believe that we have the opportunity to emerge as a leading next generation infrastructure provider.”

He said Nimble’s priorities at the start of 2016 were to invest in building a strong pipeline, drive faster growth in large enterprise and cloud service provider markets and drive traction in sales of all-flash arrays. He said meeting those goals will help Nimble’s long-term financial position. The flash market is as competitive as it is potentially lucrative, Vasudevan said.

“The all-flash array market growth is stronger than what analysts had projected for this point, and it’s continued to remain strong,” he said. “Now that said, every single all-flash win that we’ve had is one where we’ve had to take on two, three other all-flash array vendors so there are no uncontested deals.”

Vasudevan said Nimble’s main all-flash competitors are EMC, NetApp and Pure Storage.

August 19, 2016  2:00 PM

EMC: Commercial drone storage market primed for takeoff

Garry Kranz Garry Kranz Profile: Garry Kranz

Commercial use of unmanned aerial vehicles (UAVs), or drones, is just starting to emerge. Drone storage, on the other hand, isn’t getting as much attention.

EMC wants to gain a toehold in the market for drone-related scalable storage, particularly its scale-out Isilon NAS and object-based Elastic Cloud Storage.  Equipped with high-resolution cameras and sensor technologies, a single drone flight can capture terabytes of data.

Due to the vehicles’ modest size, however, internal drone storage capacity is limited, said Josh Bernstein, a vice president at EMC’s Emerging Technology division.

“We see drones expanding data lakes into data oceans,” Bernstein said.

A report in May by consulting firm PricewaterhouseCoopers pegged the global drone storage market at $127 billion.

Industries such as agriculture, construction, energy and government use drones to generate vast sums of data. Drone technologies capture images with exponentially greater detail.  Farmers deploy aerial drone imagery to design more efficient watering plans or pinpoint potential crop threats. The images help building companies improve finite element modeling, fracture analysis and thermal analysis.

Aside from managing the large files, companies need the capability to analyze and mine the data to derive value from it. Bernstein said EMC’s interest in drone storage directly ties to its initiatives in open source software-defined storage.

“To be a good drone pilot, you first have to be a good pilot. You also have to be able to successfully consume open source software. It turns out the people that have (those) skills often are also our customers.”

Bernstein said EMC customer EagleView Technologies, based  in Bothell, Wash., uses drones to provide 3D aerial roofing models across a range of industries.  EagleView each year adds tens of millions of images to its big data drone storage repository based on EMC Isilon NL series scale-out storage, VCE Vblock 300 converged architecture and EMC XtremIO all-flash storage arrays.

This month, the U.S. government gave Google’s Alphabet Inc. X subsidiary approval to test delivery drones in an effort to formalize safety regulations.

August 19, 2016  7:47 AM

NetApp sells more flash, spends less

Dave Raffo Dave Raffo Profile: Dave Raffo

NetApp made great progress last quarter with its sales of all-flash storage, Clustered Data OnTap (CDOT) and cost-cutting measures.

NetApp Wednesday reported better revenue and income results than expected, although its sales continued to slide on a year-over-year comparison.

Overall revenue of $1.29 billion was down around three percent from last year but within NetApp’s guidance and higher than financial analysts expected. Product revenue of $660 million dropped 1% from last year, after a string of steeper declines.

NetApp’s income of $64 million reversed a loss of $30 million in the same quarter last year, with the turnaround achieved mainly by trimming operating expenses 13% to $652 million.

Despite beating expectations, NetApp remains a ways from reversing year-over-year revenue declines. Its revenue forecast of between $1.265 billion and $1.415 billion for this quarter was more than expected, but even at the high end would be a year-over-year decrease.

“We’re clearly making progress, but still have work to do as we operate in the low growth IT spending environment,” NetApp CEO George Kurian said. “We are controlling what we can and are increasingly confident in our ability to execute as we streamline the business and pivot to the growth areas of the market.”

NetApp reported all-flash revenue grew approximately 385% from last year, mainly from All-Flash FAS sales. All-flash array sales came to around $194 million, around 30% of product revenue.

“Customers are replacing hard disk installations with flash, making flash the de facto standard for new on-premise deployments,” Kurian said.

He added that sales from SolidFire, the all-flash vendor NetApp acquired in February, remained “immaterial.” NetApp also sells an EF Series of all-flash arrays for high performance computing, but that made up only a small amount of the vendor’s overall flash sales.

Kurian said CDOT sales increased 35% from last year, with 82% of FAS arrays shipped last quarter including CDOT compared to 65% last year. CDOT is now running on 32% of NetApp’s installed base. NetApp struggled early on with CDOT conversions because it required a disruptive upgrade from its previous version of OnTap, but CDOT installations have grown steadily over the last nine months or so.

There is a possibility that NetApp’s spending cuts could hurt its long-term success, though. While the company returned $228 million to shareholders through share repurchases and a cash dividend last quarter, it cut year-over-year research and development for the third straight quarter. NetApp spent $192 million on R&D, down from $218 million a year ago.

With the storage industry more competitive than ever and newer technologies potentially more disruptive, lack of R&D spending could put NetApp at a disadvantage. It was slow moving into the all-flash array market, and still hasn’t come up with a product in the fast-growing hyper-converged market.

Krista Macomber, senior analyst for Technology Business Research (TBR), predicted the cut in R&D will make it tougher for NetApp to keep up with new developments and grow revenue.

“This is a threat, as agile and cutting-edge innovation increasingly influences storage vendors’ ability to differentiate,” Macomber wrote in a research note on NetApp. “Long-standing architectures and purchase models become massively disrupted by customers’ need to serve rising, data-centric demands from lines of business with greater efficiency and agility. As a result, TBR believes it will become more challenging for NetApp to sustain bottom-line improvements as it seeks to remain aligned with customers’ evolving workload requirements.”

August 18, 2016  6:09 PM

Quobyte updates “Google-like” storage software

Carol Sliwa Carol Sliwa Profile: Carol Sliwa
Block storage, File storage, NAS

The “Google-like” software storage system that Berlin-based Quobyte introduced last year is getting an update.

With its new Quobyte 1.3 release, the German startup added space-saving erasure coding to protect file data, boosted the performance of block storage, enhanced the product’s management capabilities, and extended support from Linux to Windows.

The Quobyte software runs on commodity server hardware, uses a highly scalable POSIX-compliant parallel file system, and supports file, block and object storage. CTO and co-founder Felix Hupfeld compared the system to technology in use at Google, where he and co-founder Björn Kolbeck once worked as engineers in storage infrastructure.

Hupfeld said “Google-like storage” works with all workloads and cluster sizes and runs on any infrastructure, with only a few people needed for maintenance because the system is highly automated and fault tolerant.

Quobyte’s newly added erasure coding allows applications to directly write erasure-coded files, making the system useful for archival and primary storage, according to Hupfeld.

“We make erasure coding a primary storage access method,” he said. “We’re not recoding data in the sense that we write everything replicated and then recode.”

Hupfeld said modern CPUs are fast enough to render the resource impact of erasure coding irrelevant. He said there’s also no significant performance impact with file-based sequential workloads, such as media assets and engineering and scientific data.

“Where erasure coding is very efficient is when you write a file from beginning to end and don’t do in-place updates, like a virtual machine,” he said.

Hupfeld said performance becomes an issue with erasure coding for random I/O with block storage. He wrote in a blog post, “For a random write, the coding engine needs to read all data of the coding group first, recompute the coding parts, and then write out the modified original data along with the coding data.”

“For virtual machines, it would be a complete disaster if you used erasure coding because you’re recomputing data all the time,” he said in an interview.

Hupfeld advises against the use of erasure coding for virtual machines (VMs) and databases. He said customers should use replication with those block-based workloads.

Quobyte deployments range in capacity from less than 50 TB to petabytes. Customers include a German cloud service provider, an online video recording company, a container service provider and a U.S.-based university, according to Hupfeld. He estimated the average capacity at 200 TB and said users tend to look for alternatives to NetApp and Isilon at about 100 TB.

The Quobyte system makes three copies of data for full fault tolerance, so a customer with 100 TB of data would need 300 TB of storage. Using erasure coding with file data, the storage requirement could drop to 140 TB or 150 TB, depending on the encoding the customer chooses, Hupfeld said.

Quobyte’s “standard 8 + 3” erasure coding – or eight “data parts” and three “redundancy parts” – would enable the system to tolerate a failure of three storage drives.

“The good thing about erasure coding is it’s not just more efficient, it’s also more fault tolerant,” Hupfeld said. “You can lose more hard drives without losing data. And that just make it even a better candidate for archival data.”

Another file-centric enhancement with the 1.3 release is fully parallelized metadata operations. Quobyte rewrote one of the core parts of the database system to take advantage of modern multicore CPUs, Hupfeld said.

Quobyte also extended the product’s management capabilities with support for cross-interface access control lists (ACLs), integrated multi-tenancy, and hierarchical quota support for organizations with large-scale systems.

For block storage, Quobyte optimized the entire I/O path to improve performance and reduce latency to sub-milliseconds when system runs “on good hardware,” Hupfeld said.

The Quobyte software was in limited availability last year and became generally available in January. Hupfeld said the major focus in future product releases will be even more performance improvements.

“If you have more performance, the less hardware you need, the less power you need, and so on,” Hupfeld said. “Performance is very important.”

Since the product’s launch, Quobyte has added support for major container platforms, including Docker and Mesos. Hupfeld said a Quobyte volume driver would be available with the Kubernetes 1.4 release.

“What people are sometimes doing is attaching block storage devices to containers, but then this always gives these very tight couplings between containers and the data,” he said. “With Quobyte as a file system, you can give applications access to specific data like you used to in non-container environments.”

Forgot Password

No problem! Submit your e-mail address below. We'll send you an e-mail containing your password.

Your password has been sent to: