VMware will offer a commercial version of Project Serengeti, its open source initiative to run Hadoop workloads in virtual infrastructures.
The new Big Data Extensions plug into vSphere and allow administrators to deploy, monitor and manage Hadoop clusters on VMs directly from vCenter. The extensions are also designed to improve the performance of Hadoop, the popular open source big data analytics platform.
“We’re making Hadoop a first-class citizen on vSphere,” said Fausto Ibarra, a senior director of product management at VMware. “It’ll be just like any other workload.”
Hadoop and other big data platforms typically require dedicated hardware, which can be cost-prohibitive for smaller organizations and also raises concerns around reliability. VMware released Project Serengeti last year to address these problems, and the Big Data Extensions further that cause by adding full enterprise support.
In preparation for today’s public beta release of the Big Data Extensions, VMware earlier contributed code to the Hadoop community that optimizes Hadoop’s placement of data when running on virtual infrastructure, Ibarra said. The vendor also worked with the makers of the leading Hadoop distributions to share virtualization best practices.
The Big Data Extensions support the following Hadoop distributions:
- Apache Hadoop 1.2
- Cloudera 3 Update 6
- Cloudera 4.2
- Hortonworks Data Platform 1.3
- Mapr 2.1.3
- Pivotal HD 1.0
The Big Data Extensions will be generally available by the end of the year. VMware also announced that Pivotal HD, its parent company EMC’s Hadoop distribution, has received VMware Ready certification.
VMware will cut 900 jobs as it rationalizes its product portfolio in the course of the coming year, executives said on the company’s earnings call Monday night.
VMware has added 6700 employees in the last three years, and the overall headcount by the end of fiscal 2013 is still expected to be up by 1000 despite the job cuts, officials said. The company ended 2012 with 13,800 employees.
VMware CEO Pat Gelsinger said at the beginning of the call that VMware would realign itself around three “growth priorities,” the software-defined data center, the hybrid cloud, and end user computing. Product expansion is expected in management, networking, security, storage and high availability.
VMware has made a $30 million investment in IT automation software maker Puppet Labs, the better to develop new integration between Puppet and its virtualization and cloud management software.
Puppet can already manage VMware’s vSphere virtual machines, as well as its Application Director. The goal of the new investment is to create direct provisioning hooks between Puppet and VMware’s management products this year, which include vCloud Automation Center, vCenter Operations, and vCenter Configuration Manager, according to Puppet Labs CEO Luke Kanies.
“They’re good at managing the VM as a unit, and we’re good at looking at the VM and making sure it’s going to do what it’s supposed to do,” Kanies said.
Puppet, available in open source and Enterprise editions, allows systems administrators to determine how they want their infrastructure to look and then carries out the necessary steps automatically, allowing for fast, repeatable systems provisioning, configuration and management.
This is VMware’s second investment in Puppet Labs in the last 18 months; in November 2011 it joined Google and Cisco in an $8.5 million round of financing for the company.
Puppet does work with other kinds of hypervisors and cloud management systems, including Citrix’s CloudStack, OpenStack, Red Hat Enterprise Virtualization, and Amazon Machine Images. Recently, the company talked with Microsoft as well, Kanies said, but 90% of Puppet’s customers are VMware users.
That said, Kanies dismissed the idea of Puppet becoming a VMware company.
“The fact that we integrated with OpenStack doesn’t mean we’re becoming a cloud company,” he said.
A new online calculator says VMware’s server virtualization software is more expensive than Microsoft’s. The surprising source behind the calculator is VMware.
The new calculator’s results, highlighted by Microsoft in a gloating blog post, show vSphere 5.1 Enterprise Plus as 19% more expensive than Hyper-V 3.0 with System Center 2012 when running 100 virtual machines (VMs) with an iSCSI SAN. Other configurations, such as running 150 VMs on NAS, also show VMware to be more expensive (by 6% in that particular case).
While embarrassing for VMware, this development is just one tiny part of bickering that has been going on for quite a while. And even these favorable calculator results are not good enough for Microsoft. In last week’s blog post, VMware’s rival insisted the findings are still off, particularly when the full vCloud Suite is taken into account.
Has anything really changed?
This summer’s SearchServerVirtualization.com special report on VMware and Hyper-V pricing and licensing found that the actual overall cost for the two platforms depends heavily on the size of the IT shop and the type of workload being virtualized.
It also found that the story doesn’t end there. For one thing, public-facing cost calculators are based on list prices, which enterprises rarely pay, thanks to Microsoft and VMware’s deep discounts.
Some shops may find the cost savings enticing enough to swap out one hypervisor for another, but VMware also remains the incumbent vendor in most enterprise shops, and the costs of switching have many users saying Microsoft’s savings aren’t worth it.
It’s also important to remember that VMware and Hyper-V don’t match feature for feature, especially with several of Windows Server 2012’s Hyper-V advanced features still waiting on System Center Virtual Machine Manager 2012 Service Pack 1 to be put to the test.
VMware has not responded to multiple requests for comment about its online calculator.
Update: VMware published a blog post yesterday called “Flawed Logic Behind Microsoft’s Virtualization and Private Cloud Cost Comparisons” which says that in the more common configuration of 128 GB memory server hardware, VMware vSphere remains on par with or cheaper than Hyper-V, and concludes that the Microsoft blog post pointing out the calculator’s findings “is yet another attempt to artificially inflate VMware’s prices and distract customers from the shortcomings of their own products.”
VMware has issued yet another patch – the fourth in the last week — to correct problems in vSphere 5.1. This time, it’s for vSphere Replication.
The fix in vSphere Replication 22.214.171.124 is twofold, according to a VMware blog post: correcting installation problems, and allowing the software to actually recover virtual machines at a secondary site when the primary machine is down, disconnected from the network or loses access to storage.
The fix for the recovery feature addresses syncing recent changes to a VM over to the secondary site in the event of a failure. When vSphere Replication 5.1 is used as a standalone product, outside of VMware Site Recovery Manager (SRM) deployments, the sync fails, and so the entire recovery fails, according to a VMware Knowledge Base article.
This fix follows patches issued last Monday that finally allowed compatibility between vSphere 5.1 and VMware View 5.1, as well as compatibility between vCenter Converter Standalone and vSphere 5.1, and then another issued last Thursday which addressed widespread issues with single sign on and custom SSL certificates in vCenter Server.
VMware pros say the number of patches required for this release is unusual.
“5.1 was hugely rushed. Quality was non-existent,” said Derek Seaman, a vExpert working for a major telecom, whose blog has been a source for corrections to SSL certificate documentation.
Some partners say the serial nature of these patch releases has only aggravated users’ frustration.
“I realize that these were important patches and updates, but a few days’ delay and simultaneous release would have been viewed in a better light,” said Tim Antonowicz, senior architect at VMware partner Mosaic Technology in Salem, NH. “A coordinated effort, where the patches were bundled into a single release event covering several products, would make much more sense to customers.”
VMware has released a software update to vCenter Server and a new package of documentation meant to address widespread problems with single sign on and SSL certificates uncovered by users of vSphere 5.1.
However, since the patch was released last Thursday, VMware bloggers who have gone over the release notes with a fine-toothed comb have pointed out some ‘gotchas’ and open questions pertaining to the purported fix.
Earlier this month, VMware shops were up in arms over problems with the vSphere 5.1 Single Sign-On feature, which is now a required part of vCenter Server 5.1 installation. Problems included failed vCenter services on startup and an inability to login to vCenter Server.
Various failure scenarios and the login issue are resolved issues in vCenter Server 5.1.0a.
But there are also new issues brought up in the release notes that hadn’t been publicly documented before, according to a blog post by Maish Saidel-Keesing, a virtualization architect for an Israeli technology company.
These issues include added overhead to the installation process – VMware recommends using an independent installer at this point rather than a simple installer, for example, and requires manually created database users rather than an automatically created ones.
“It is good to see that VMware have fixed some problems with the installation process,” wrote Saidel-Keesing. But he’s still left asking, “Was the release rushed out – so that these issues were not addressed beforehand?”
Michael Webster, a VMware Certified Design Expert and director of IT Solutions 2000 Ltd., a VMware consultancy based in Auckland, New Zealand, noted in a blog post that there’s still a ‘gotcha’ with SSL certificates in a certain scenario:
when vCenter system is an all in one configuration with everything on the same VM and using a local [Microsoft] SQL Server database. Update Manager will not be able to log into or register with vCenter when the SSL certificates have been changed. This prevents you from updating the SSL certs for Update Manager and Update Manager may no longer work. This does not appear to occur when the MS SQL Server database is remote.
For that reason, Webster says he is recommending that clients place vCenter Server and the SQL Server database on separate VMs, even in small environments.
In the meantime, Webster is building his own utility for SSL certificate management, called vCert Manager, which will allow completely automated management of SSL certificates in a vSphere environment.
SAN FRANCISCO — If this whole virtualization thing doesn’t work out, several VMworld 2012 attendees will have photography careers to fall back on. People at VMware’s annual conference this week took and shared hundreds of images on the mobile photo-sharing service Instagram, and quite a few came out pretty good.
We scoured Instagram for photos that either used the #vmword hashtag or used the service’s location-based check-ins to say they were at VMworld. Here are nine VMworld Instagrams that stood out:
VMworld seems to get bigger every year, and with each leap in growth comes some overcrowding. Some years, it’s been long lines to get into first-come, first-serve sessions, for example. And perennially, according to attendees, Hands on Labs at the show have issues on the first day.
This year was no exception. There were widespread reports on Twitter Sunday that the wait for Hands on Labs could exceed 3 hours.
“Apparently there is a script that kicked off the provisioning of all the lab VMs. However, even though the script returned a positive status, the VMs were not actually started up.
“Then about 3:45PM the hosting site that had the HOL manuals died. 60 minutes into my lab, after waiting 4.5 hours, it totally fell flat and died. So that was 5.5 wasted hours,” reported one attendee.
The holdups at the Hands on Labs were such an issue that attendees reportedly appealed directly to incoming CEO Pat Gelsinger in a Q&A session Sunday to fix the problem.
Meals for attendees were also a point of contention this year. Granted, accommodating 20,000 people, even at a venue like Moscone, must be difficult. But Monday’s breakfast saw many attendees forced to find a place on the floor to eat due to inadequate seating in Moscone West. Attendee lunches in Yerba Buena Gardens were a nice idea, but again, users found themselves pulling up a spot of pavement on which to have their boxed-lunch picnics.
Maybe next year, attendees will get a few more creature comforts for their admission fee.
Virtualization users look forward to VMware’s annual confab because that’s when solutions to their biggest problems are announced – though not always. This year is no exception.
VMware shops will gain some features that improve existing products while other issues remain unresolved.
VMware’s HA is slated for a facelift next year with a new feature called Virtual Machine Component Protection, according to demonstrations at VMworld.
The idea is to hasten failover by choosing virtual machines (VM) within a host to vMotion according to specific failover conditions. For example, if some VMs within a host are attached to a SAN and others are attached to NAS and the SAN fails, only the VMs attached to the SAN would fail over.
Whither SMP FT?
Meanwhile, technology that was in tech preview at last year’s VMworld, fault tolerance for symmetric multiprocessing systems, still has yet to make it into shipping product –but the company offered another preview here this week.
Fault Tolerance keeps VMs in lockstep with one another through synchronous replication, and should one fail, can cut over without service interruption to users. VMware Inc.’s HA feature, by contrast, involves a brief interruption. Fault Tolerance is therefore more suited for mission-critical applications, but its lack of support for multiprocessing disqualifies it from use with many databases and other Tier 1 workloads.
Given that, it’s obviously an important goal for VMware to support SMP FT in vSphere, but why it remains stalled in preview is a mystery.
VM stall redux?
It appears that VM stall is still happening in enterprise IT shops. An average of 60% of workloads are virtualized — up from 2008’s 25%, but far from VMware’s goal of 90%, according to outgoing VMware CEO Paul Maritz in his keynote.
Possible culprits suggested by attendees: lack of SMP FT as discussed above, stubborn server-huggers, and stubborn storage I/O bottlenecks.
VMware VSA 5.1 update underwhelms
The vSphere Storage Appliance lives.
The appliance, which is designed to make direct-attached storage (DAS) look like a pool of network attached storage (NAS), has gotten a few improvements in version 5.1, released this week. These include the ability to add disks on the fly. Before, whatever configuration users started with couldn’t be changed.
The new version also supports RAID 5, 6 and 10, allowing for less storage overhead in provisioning for high availability.
However, industry sources said users still can’t start with two nodes and scale to three, and there still appears to be no integration between the storage appliance and vSphere Replication.
Surely VMware, with all its talk about the software-defined data center, and owned by the biggest storage company in the world, has more up its sleeve when it comes to software-based storage.
Beth Pariseau, Senior News Writer
Now, some IT shops wonder what they’re supposed to do with the additional licenses they bought to accommodate vRAM requirements for vSphere 5 last year.
VMware stated that vSphere licenses purchased for vRAM capacity can be used to license processors and expand existing vSphere environments.
Unfortunately, customers may also have scaled out servers, which racks up costs in network ports and other software licenses, rather than scale up and consolidate more VMs onto beefier hosts thanks to vRAM.
Though VMware maintains that it doesn’t try to compete with Microsoft on price, competition from Hyper-V was a factor.
“Competition forces you to listen to your customer base,” said Rick Jackson, a VMware spokesperson, during a press conference at VMworld 2012 here this week.
“You don’t compete with Microsoft on price…you compete with Microsoft on value,” he added.
There were also pricing details surrounding vCloud which might have gotten lost in the vRAM ruckus.
First, there are actually three editions of the vCloud Suite that are bundled into packages available as single SKUs:
- Standard, which includes vSphere Enterprise Plus, vCloud Director, vCloud Connector, and vCloud Networking and Security Standard, is priced at $4,995 per CPU, plus support and subscription;
- Advanced, which includes vSphere Enterprise Plus, vCloud Director, vCloud Connector, vCloud Networking and Security Advanced, vCenter Operations Management Suite Advanced costs $7,495 per CPU, plus support and subscription; and
- Enterprise, which includes vSphere Enterprise Plus, vCloud Director, vCloud Connector, vCloud Networking and Security Advanced, vCenter Operations Management Suite Enterprise, vFabric Application Director, and vCenter Site Recovery Manager Enterprise. Itis priced at $11,495 per CPU plus SnS.
VMware vSphere remains available, in all its editions, as a standalone product as well.
The vSphere Storage Appliance is now bundled in with Essentials Plus licenses, and vSphere Replication has been added to all vSphere editions, rather than being packaged solely with VMware’s Site Recovery Manager.
It depends. Site Recovery Manager, for example, remains priced per VM when bought standalone, though it is priced per CPU when purchased as part of the Enterprise vCloud Suite.
“When you’re just using SRM as a point solution, per-VM makes more sense,” said Neela Jacques, a VMware vCloud product spokesperson. “But when you’re using multiple products, it makes more sense to buy the suite.”