Over the past couple years, I’ve been spending more and more time digging into various open-source projects that are gaining visibility, and sometimes traction, within the Enterprise. Projects like Hadoop, OpenStack, CloudStack, Docker, Cloud Foundry, Git as well as several others. I tend to look at them from three perspectives:
- Functionality – What commercial or popular capability can the open-source project replace (e.g. OpenStack/CloudStack vs. VMware vCloud; Hadoop vs. Google MapReduce)?
- Community Model – Is the project primarily driven by a benevolent leader or by a group of many contributors? Is it a commercially independent project (e.g. Apache Foundation projects, Docker) or is it more commercially driven (e.g. OpenStack, Cloud Foundry)?
- Tools or Frameworks- Is the project generally focussed on being a loose coupling of tools (e.g. OpenStack) or is it an extensible framework that could evolve into various sub-projects over time?
Open-Source projects are an interesting departure from the economic model that has dominated the IT industry for decades. In the past, a company invested massive amounts of capital for R&D, then distributed the output as product/license through various channels. Customers paid for the technology and the originator/vendor captured the majority of the revenues in the distribution channel. But Cloud Computing and Open-Source have flipped that model on its head. Now technology created within projects, funded by a mix of vendors and independent individuals, can be used to power many digital business models (eg. Google Ads, SaaS software, online insurance quotes, home automation, etc.). In some cases the technology was created by the business owner and then open-sourced (eg. Google MapReduce >> Hadoop) and in other cases the businesses are built using open-source technologies. Continued »
- This feels a lot like VMworld. Many of the same faces, and many of the same companies. Are they seeing a marketplace trend, or just hedging their bets?
- It has gotten very commercialized. Lots of booths on the show floor, lots of people throwing extravagant parties, lots of swag being given away. But the commercialization didn’t align to the customer attendance. It still seems to be very vendor / integrator-centric, with companies like Rackspace sending as many as 250 people.
- RedHat had just acquired Inktank, highlighting my prediction that we’d begin to see intense consolidation of OpenStack talent. RedHat followed this up soon after with the acquisition of eNovance.
- “Open-ness” will give way to capitalism. This started with the HP Helion announcement, which was expected, but then got interesting as RedHat announced new support guidelines for non-RedHat OpenStack environments.
Since then, we’ve seen a few more interesting moves that make me wonder if the Paris event will be the last time we see the broader OpenStack community come together.
- Mirantis expanded their efforts to deliver their own distribution, offer Openstack-as-a-Service and created a partnership with Oracle.
- Cisco continues to slowly drip details of their InterCloud products and services, with OpenStack being a central element.
- RedHat continues to expand its OpenStack “stack”, releasing the ManageIQ stack and continuing to acquihire talent. They appear to be keenly focused on Private Cloud environments.
- Smaller announcements from companies such as Piston Cloud and Bluebox are becoming more focused on Cloud Foundry / PaaS environments.
- MetaCloud continues to offer an interesting mix of business models and operational experience.
- Rackspace is working with Morgan Stanley to investigate its future options.
Attending an AWS event is a strange experience, especially if you’ve been attending technology events for many years and have gotten used to a certain pattern of announcements, demos, showfloors, etc. I’ve attending several AWS events in the past, primarily AWS re:Invent, but the AWS Summit in NYC seemed a little different this time.
First, the event is primarily attended by people that wouldn’t classify themselves as “IT Professionals”. It’s mostly people that would associate themselves with the “products” that a business makes or sells, and they leverage technology as a means of creating and delivering those products or services.
Second, the host (AWS) isn’t speaking to IT professionals and telling them about transformations and changes that are needed before they can get to the next stage in delivering IT. They focus on what is available now, to help their business do something now. And the context isn’t speeds and feeds, it’s business outcomes. How to get from ideas to execution.
Third, they have mastered the art of speaking in ways that ease the mind about the challenges and complexities of building applications and running technologies environments. And make no mistake, making technology work for a business is difficult, often very difficult. They speak in terms of pennies-per-hour and massive long-term savings, and “undifferentiated heavy lifting”. Note to IT departments, they are you talking about you, the purveyors of that “undifferentiated heavy lifting”. AWS is in the IT replacement business.
Finally, they don’t expose their org chart when discussing their offerings. It’s not the Storage division or the Compute division or Desktop division. They’ve figure out how to link together services, without mandating that they be bundled for pricing or renewals. And the services/products are all offered with public APIs, so it doesn’t initially limit the ecosystem from building adjacent capabilities around the core AWS services (more about this later). Continued »
There was quite a bit of buzz today with the announcement that Tesla Motors would release their patents to the world.The automaker, and it’s CEO (Elon Musk), that have become the envy of the automotive industry is giving away it’s most prized possessions? They are playing a technology game with Ford, Mercedes, Toyota and others, so why let them have the chance to catch up? Having grown up in Detroit, but spending the bulk of my professional career in technology, this is a fascinating turn of events and crossing of the streams. [Note: Because of the wording of this announcement, some are questioning if they will have any real applicable usage by outside companies.]
In today’s world, whether it’s automobiles or Cloud Computing, there are some massive platforms in the market. Competing against the largest platforms, or introducing new technology (or business models) can be extremely complex and costly. So how does a smaller company possibly compete against the industry giants?
One thing to do is to play by a different set of rules. In the case of Tesla Motors, they have developed the knowledge and experience to create an incredible set of products. But for them to scale, they would need to invest massive amount of capital to buildout the nationwide network of charging stations. And build service stations. And optimize their supply-chain. So instead of owning a vertical business model, they are choosing to let the market share in the opportunity of electric vehicles. They are sharing the costs and sharing the potential. In a game against competitors that are 10-100x as large, it may be the only way to remain as more than a small niche in the overall transportation market. Electric vehicles are a small market segment, at this time. It will be interesting to watch and see if the market helps it grow, establishing Tesla technology as the standard for any future vehicle.
But this approach doesn’t always work. For example, several years ago Rackspace decided that the future would be on-demand cloud computing, a shift from their traditional hosting business. But the industry leader, Amazon Web Services (AWS) was the 800 lb. gorilla and many years ahead of them. While Cloud Computing is still in it’s early stages, Rackspace decided that leveraging open-source was their best chance to compete. Instead of having to hire 100s of top-flight engineers to build their environments, they created and enlisted the OpenStack community. 100s of “free” engineering resources, creating Cloud Computing software that they could use within their own data centers. But several years into OpenStack, that strategy hasn’t closed the gap between them and AWS. Continued »
It’s the dog days of summer, so things are a little quiet in the Cloud Computing world. Spring trade-show season is done, school is out, people are taking vacations, and this one post is slightly off the topic of Cloud Computing. But in another 3-5 years we will just go back to calling it Computing or Technology, so I think this one will be OK.
Unfortunately, we had another week in IT and another week of people complaining about poor behavior in Silicon Valley . The so-called “Bro Culture”. And as always, it comes with the calls for sensitivity, and people hoping that their daughters won’t have to work in this industry. I agree with the former, but I find the latter short-sighted.
As the father of two daughters, it’s difficult to read about some of the stupidity. It’s not hard to make an argument that segments of the technology industry need to take a good, hard look in the mirror and figure out why this culture of moronic, fraternity-house driven behavior has become so common-place. But let me be clear – it’s just a small segment of the technology industry.
This is because the technology industry has become all-encompassing. Every company that begins, grows or survives over the next 5-10 years (and beyond) will fundamentally be a technology company. Regardless of industry, regardless of geography, all companies will be technology companies at their core. There’s a reason the terms “Internet of Things”and “Internet of Everything” are starting to take hold. So what does this have to do with ‘Bro’ culture? In a word, everything. If we take the failures of the ‘Bro’ culture and scare off women and girls from joining “the technology industry”, we will all suffer. They are the majority of the population. They are inherently creative and caring and add great insight and viewpoints to our teams and communities.
There’s a reasonable chance that the next President of the United States will be a woman. The number of women leading major corporations and organizations has never been higher. They are in positions that should inspire young women to reach for their goals and believe they can accomplish anything. But we might screw that up by amplifying the message to our daughters that the “technology industry” is a toxic place. Just as we’ve learned from history, the best way to stop oppression or ignorance is to keep pushing forward. Sticks and stones. We need to keep including technology in the conversations we have with our daughters, as well as teaching them how business models change with technology. We must teach them how to embrace the communities that move technology forward, even if it means turning a shoulder to the occasional stupid comment or inappropriate video. Encourage them to think big and act bigger. Give them the opportunity to solve our health problems, our environmental problems, our educational problems, and our financial problems.
Given that the majority of stories we hear about the ‘Bro’ culture happen around Silicon Valley, I continue to wonder when we’ll see smart, innovative wonder begin to move and cluster in other areas. Remove the frustrations and create the future without all the hassle. Or maybe they won’t have to if the Bros stop acting a fool and the rest of us encourage the girls to keep focusing on the positive contributions they are making.
If you’ve been around the Cloud Computing industry long enough, you know the joke about how it’s not a real Cloud Computing conference if Adrian Cockcroft (@adrianco; former architect at Netflix, now VC at Battery Ventures) isn’t giving a keynote. It’s a well deserved accolade given what has been built at Netflix, what the Netflix OSS team gives back to the community and what Adrian gives back. It’s a great example of one end of the spectrum – 100% on AWS, 100% open-source, small agile code that was designed up front to scale to the web, everything on GitHub, etc. etc.
But if you do a little bit of digging around other aspects of the web and cloud computing operations, you realize that it’s extremely rare to find other scenarios like that in the wild. For example, here’s a few scenarios:
- I spoke with Ed Bowman (@ebowman) from @GiltTech about how they design and run their “flash auction” site. It was a great discussion about how they have evolved over the past few years from monolithic code to micro-services, and giving back more to the open-source community. But he was clear that not everyone open-sources all their code; not all code is on GitHub; not all the technology they use is from open-source (some problems aren’t fixed, easily, using available open-source); they use a micro-service framework but aren’t using PaaS; they mentioned the word “ERP” (because, you know…supply chain is important when managing goods and suppliers)
- I spoke with Michael Ducy (@mfdii, Evangelist at Chef) about how he evolved his DevOps skills. He told me about the environment that runs at travel site Orbitz and how some of the applications that allow you to book plane flights still go through a mainframe. Yes, a mainframe, the original container before Docker became popular.
- I spoke with another large web-scale company recently about their storage infrastructure and migration to greater usage of OpenStack. Turns out that they use a mix of open-source code, small vendor code (open-source but not free) and large vendor products. And they mix and match for boot images, NAS, Block, performance tiers and Object/HDFS for Images/Hadoop/Analytics. Not the simple “all in one box” diagram we too often see in PPT. And none of it was part of the billions of AWS S3 objects reported each quarter, although they did manage billions of objects in their Private Cloud environment.
- Cloud Foundry co-creator Derek Collison (@derekcollison, now CEO at @apcera) recently wrote about how PaaS platforms, by themselves, are not enough for Enterprise customers. Some of this was obviously a way to highlight his new company, but the explanation was founded in the reality that we don’t yet like in a 100% DevOps-fuels PaaS-centric world – in fact, far from it.
This post is going to be a little bit off-topic (not Cloud Computing centric), but since this post, I’ve seen quite a bit of discussion by people trying to figure out some guidelines, or career guidance, in this new word of self-publishing, social media and other outlets for learning and sharing. It’s definitely not simple, since there no longer any defined lines between work and life, between media and non-media.
Earlier today, a friend started a thread on Facebook because they host a technical blog which allows ad placement by sponsors. He had been approached by a certain company and wanted some guidance on if he should allow that company to sponsor his blog. The central point was that there were some inherent conflicts of interest between the advertising company and this person (and his employer). After a bunch of feedback, advice and suggestions from friends, the issue was resolved. But one of the commenters asked if some of us that live in this new media world would discuss how we deal with the potential conflicts that can arise when you have a full-time job and also have a presence on external media sites (blogs, podcasts, etc.).
This is my experience. Other’s mileage will vary and I expect others will have different situations depending on their employers and how they handle “gray areas”.
For full disclosure, my employer details are here. In addition, I’ve co-hosted a podcast for almost 4 years, as well as written on several technology blogs. Before getting into any “guidance” to others, I’ve always found that it’s important to establish some person rules to guide how I manage the interaction between personal and professional. These are MY PERSONAL rules. Others will have different opinions. I’ve written about a few of these opinions previously (here, here, here) Continued »
[Dislosure: While my employer, EMC, is a majority stakeholder in VMware, I have no insight into VMware’s long-term strategic direction. That’s way above my pay grade. All information contained in this blog is based on publicly available information – sometimes you just got to know where to look.]
Evolution, transformation, disruption. Regardless of what segment of the IT industry you follow, these buzzwords are dominating the conversation. And a common thread is that all “legacy” (read: “existing”) vendors and technology will struggle with these transitions. But what happens when vendors actively invest in technology and expertise that run in parallel to those disruptions? Isn’t that the classic playbook from The Innovator’s Dilemma?
We all know that VMware took a bold step away from their traditional business when they launched the VMware vCloud Hybrid Service (vCHS), offering an alternative way for companies to consume IT resources from the cloud – instead of within their own data centers. They became a Cloud Service Provider, beginning to disrupt the ecosystem that had been built up around their hypervisor business. It allowed them to leverage their existing technology and installed base to expand into a different segment of the IT market. With vCHS, they not only offered on-demand IaaS services, but also Desktop-as-a-Service, DR-as-a-Service and many other services on the roadmap.
But what about the technologies that didn’t have VMware’s logo on them? Continued »
Software, software, software….
It’s hard to go anywhere in tech these days without someone highlighting the virtues of software. Software is eating the world. It’s a Software-Defined Economy. It’ll run in your Software-Defined Data Center.
But it feels like there is a gap between the things that developers are using to change the economy, and the tools that fall into the definition of “Software-Defined”. There are the tools of the Devs, and then the tools of the Ops crowd. In the past, the IT community often thought of them as isolated, but that thinking is beginning to change. Examples of “Infrastructure as Code” and “Operations at Scale” are beginning to become more visible and common.
Even the definition of a “developer” is beginning to change. In the past, developer only applied to the people writing the applications that we interacted with as business users. This now applies to infrastructure and operations teams as well. Think of it as the evolution of the SysAdmin, but across all the functional areas of infrastructure and operations.
But there is still opportunity to do better. Making it easier for all kinds of developers to be able to use these new software-defined tools and environments. To eliminate all the friction between them getting the software and making it useful; integrating it into their environments and making it part of their continuous application builds. Just making software free to download is not enough.
- Is the software available via GitHub?
- Are the APIs well documented?
- Does sample code exist across a broad range of languages and frameworks?
- Can a developer run the software locally?
- Can the software be up and running in minutes, using the native deployment tools of the developer?
- Is there an online community to answer questions for developers?
- Is there an online environment that allows the developers to validate that the software can integrate and scale beyond their local machine?
- Does the software creator actively participate in the community, both online and in real life?
Maybe you clicked on this link and thought that I was going to write about the OpenStack Marketplace that was launched during the OpenStack Summit in Atlanta. It’s a natural progression for the OpenStack community to drive awareness of applications and services. But that’s not the marketplace I observed in Atlanta last week.
btw – In case you missed OpenStack Summit, here are all the videos – lots of great technical content and discussions.
The marketplace I observed was the reality of the IT marketplace, with vendors beginning to make moves and announcements which show that OpenStack is no longer a dream about “interoperable open clouds”, but instead is just another set of tools, products and APIs that will vigorously attempt to compete for the hearts, minds and wallets of IT professionals, developers and systems integrators.
This isn’t to say that the OpenStack dream is fading. It was alive and well in keynotes which drew analogies to the Star Wars Rebel alliance, fighting against the Evil Empire and the Death Star. But diving deeper, we saw that there is still division amongst contributors and developers about what should really be considered “Core OpenStack”. Will developers still actively and passionately work on projects if they are not considered “core”? Will some vendors try and claim to be “more core” in their distributions or offerings than others? Continued »