In 2014, news about developing cloud applications using IBM Watson’s cognitive capabilities and mobile-first strategies were top traffic-getters on SearchCloudApplications. An article about developing Internet of Things (IoT) apps and a piece about enterprise architects’ cloud projects were runners up.
Looking at why these four stories attracted over 12,000 readers, I talked with our expert contributor, George Lawton, who wrote all of them. Together, we offered some footnotes to each story.
The year’s top story was “IBM’s Watson supercomputer gives developers access to cognitive cloud.” In it, Lawton describes how software developers are using IBM Watson to build customer-focused cloud-based applications. Essentially, Watson provides the ability to analyze data about customer behavior and suggest — or, even, predict — future behaviors. For example, Watson technology has been used by Fluid Inc.’s retail business customers to increase customer engagement and sales. Also, Welltok Inc. is building a Watson app that provides regular wellness activity guides and rewards for users’ healthy behavior.
IBM’s Watson Group is putting $100 million into fostering work by third-party software developers, one of those being Welltok, according an article by reporter Stephanie Neil about cognitive computing. Talking about that investment, Lawton told me that setting up a new Watson Group headquarters spurred “the single largest movement of IBM research personnel in its history,” he said. He predicts spurt of Watson-based product releases in 2015, particularly in vertical markets such as financial services, retail, healthcare and travel.
Mobile-first report takes second
High interest in SearchCloudApplications’ feature on mobile-first development of enterprise apps shows that “mobile is now a premiere consideration in the rollout of new services,” Lawton told me. Mobile-first design of applications is now a must, because people don’t have to use a computer to access information and make transactions.
The mobile-first trend has far-reaching impact. “It’s helping to redefine the traditional notion of service-oriented architectures to embrace a more flexible infrastructure based on much simpler APIs,” Lawton said. At the same time, the gap between native and hybrid development environments is starting to shrink, which promises to lower the bar in keeping up with the proliferation of iPhone, Android and now Windows devices.
Developers, take note of IoT
The intersection of cloud computing and the Internet of Things (IoT) was a buzzy topic at the 2014 Silicon Valley EclipseCon conference. Developers there posited that the cloud could enable quick tests on new IoT projects, according to SearchCloudApplications’ third most popular news story, which covered the IoT cloud discussion at EclipseCon. Cloud testing will speed development and innovation in IoT projects by reducing the number of failed projects traditionally associated with early-adopter rollouts. “Leveraging the cloud to quickly test out new ideas will allow businesses to weed out bad ideas with less risk,” Lawton said.
Watch SearchCloudApps in 2015 for regular, in-depth coverage of cloud-based IoT development. Meanwhile, catch up on IoT with articles on design issues in mobile and IoT development and how IoT technologies are impacting product development.
An enterprise architect’s cloud apps success
Everyone likes to learn by example, so it’s no surprise that a first-person account of cloud development projects was fourth on our news traffic tally. Exploring enterprise architects’ first cloud projects, George Lawton tapped the experiences of veteran software pros. Check it out to learn about how cloud helped in landing NASA’s Curiosity Rover and onboarding two companies’ sales teams to mobile and cloud apps.
If first-person articles appeal to you, you’ll find a bunch of them in our Change Agents profiles of software developers and architects.
That’s the news round-up for 2014. I can’t wait to see what tickles readers’ fancy in 2015.
Happy New Year!
Based on a list of the most popular tweets by SearchCloudApplications.com this year, twitter users were interested in a variety of cloud application topics, from integration to mobile backend as a service (MBaaS) to automation. Here are five of the most clicked on tweets and the articles they referenced.
The above tweet linked to a feature on how mobile developers view building and buying backends. The tweet was the most popular of 2014, and the link grossed 179 clicks. The quote in this tweet reflects the opinion that investing in a backend service is more cost-effective than building an application’s back end. Companies in certain industries, however, may want to avoid MBaaS for compliance reasons. Check out the story for more specifics from developers who have carefully considered if MBaaS is right for their companies.
When integration platform as a service (iPaaS) began to pop up in the cloud app world, there was some confusion over what the service provided customers. Some of that confusion remains because iPaaS is still nascent. When SearchCloudApplications.com shared our definition of the term, different tweets with a link to the article where clicked on several times and retweeted a handful of times. The definition is a good starting point for those who are unfamiliar with iPaaS, as well as developers in need of a refresher.
Automation is a tricky but appealing part of IT. For companies that are able to automate some of their processes, automation can save time and money. SearchCloudApplications.com’s third most clicked on tweet of 2014 was about how cloud computing company Strategic SaaS adopted automated migration software to upgrade the company’s operation, a good case study for other companies considering automation.
Integration appears for the second time on this list with the above tweet, which was the fourth most popular tweet by SearchCloudApplications.com this year. The tip linked to in this tweet provided readers with information on some common and useful tools for cloud app integration. Covering iPaaS and software as a service vendors, this tip reviews some new products that readers might find useful to their companies.
MBaaS joins integration as the reoccurring topics in the top five tweets of the year. This feature highlighted in the tweet above examined an MBaaS success story. It’s another good read for mobile developers, particularly those who are struggling with handling the back end of their applications.
Follow us on Twitter @SearchCloudApps if you’re interested in receiving tweets like those above on a regular basis.
Integration is one of the key issues that arises for companies considering or using the cloud. Cloud app integration is central to cloud computing because it enables different programs to share data, but it is difficult to do well.
Executive site editor Jan Stafford recently wrote about the mistakes made and strategy needed for dealing with cloud integration. Stafford’s blog post focuses on the highlights from interviews with two Gartner analysts, emphasizing the need for enterprise architects to be well-versed on integration.
If that’s you or you’re looking for more information on application integration and cloud integration, SearchCloudApplications.com has published several articles about integration in the last couple of months. Recent tips and features provide information on integration basics, tools and more.
Part of the difficulty of integration is that the need for it is so pervasive in the cloud world. Integration takes place in the following use cases: integration platform as a service (iPaaS) providers, cloud to cloud, cloud to integrator to cloud, or within a hybrid cloud.
IPaaS, one of the solutions to integration issues, also makes things more complicated. New iPaaS and other integration providers emerge every quarter. With so many integration tools to choose from, IT decision-makers need to invest time to assess the market. Recent tool reviews on SearchCloudApplications.com might be a good starting point for your research.
Integration is hard, but it isn’t impossible. If you’ve been running into issue after issue, don’t despair. Remember that other companies have had success with integration. Sometimes the best advice isn’t from an expert pontificating on a subject but from IT professionals who have toiled with the technology that makes integration possible.
For those who are doing a deep dive on the subject, check out this essential guide on cloud app integration with even more information on basics, tools, strategy and iPaaS. Once you’re done, check out our quiz on cloud integration solutions, and test your knowledge on the subject.
Today’s hybrid clouds don’t live up to the name, in Gartner analyst Eric Knipp’s opinion. Without application portability, hybrid clouds are just a collection of remote and in-house applications that have been tailored for each environment and loosely integrated.
“When I think of hybrid cloud, I’m thinking of a place where I can write an application and then deploy it to any hosting location without changing the application at all,” said Knipp, Gartner managing VP. In a true hybrid cloud, workloads can be easily moved back and forth between private and public clouds to facilitate deployment and efficient scaling. Using either policy or some flick of a switch, a developer could make that same application scale to many other places, which may span private, public or even multiple public providers.
Deploying a single application across many environments with no real limitations is a capability that doesn’t exist today, said Knipp, who is co-author of Gartner’s 2015 Planning Guide for Cloud Computing. “To get there, we have to be architecting portable cloud applications in a way that dimensionally can live up to this hybrid cloud fantasy that we have today,” he explained. “I think it’s going to exist, because I see some building block technologies that are maturing.”
Using a platform as a service (PaaS) framework, like Red Hat OpenShift or Cloud Foundry, is a first step toward such “real” hybrid clouds. PaaS greatly increases application developers’ productivity by outsourcing the “plumbing” required for software development. PaaS provides infrastructure provisioning, development tools and cloud testing so that developers can focus on building the business logic and other important features.
Some say that Docker is the best basic building block for the hybrid cloud, but Knipp doesn’t. Docker is an open source container program in which an application and its dependencies can be bundled. A container is where a program building block, or component, can be run. “Docker is a useful enabling technology, but doesn’t solve most portability challenges,” Knipp said. All Docker enables is embedding software into the Docker image that can be shared. “It doesn’t help you with the external dependencies, and that’s where the developer’s problem really lies.” Even before Docker, Knipp said, it wasn’t that hard to build an application, even as a .jar, that could be deployed across many different instances of Tomcat.
“Backing services is what was hard to solve before Docker and still remains hard to solve after Docker,” Knipp explained. All the components involved — the database, the message queues, the in-memory data grids, the analytics service, and so on – add tremendous complexity. It’s not just what’s in that application that’s difficult to handle, it’s all the backend services, Knipp said. PaaS helps by providing and automating many of those services.
Portability has to be the key non-functional requirement consideration for any new application that’s being built in the cloud. “Just because I can take my application and drop it someplace else doesn’t actually make it portable,” Knipp concluded. “For me, hybrid cloud will only be achieved when we have a much higher degree of application portability.”
Twenty-one percent of respondents to a survey by Gigaom Research said they use the cloud to develop enterprise applications. The technology research company recently published the results of three different surveys in a report by analyst George Crump called, “Shadow IT: data protection and cloud security.”
The low percentage of developers creating applications in the cloud may be due to some of the inherent issues of using cloud. The surveys polled software-application developers and other IT workers and decision makers on a variety of cloud practices and issues, including what their top cloud concerns are. Security, performance, learning cloud-related skills, cost and support were the highest ranked, with security well in the lead.
Incidentally, employees may pose the greatest security risk to cloud adopters. Employees commit more than 70% of unauthorized data access, whether accidentally or intentionally. Employees also knowingly use unauthorized cloud applications. Eighty-one percent said they use SaaS applications without IT approval.
Another key finding of the report was that companies use many cloud instances. Of the companies surveyed, 32% said they have more than 50 cloud machine instances in production. An additional 30% use one to ten clouds, and 23% use 11 to 50.
A recent report by Forrester Consulting confirmed this multi-cloud reality. About 83% of respondents struggle with compiling their disparate cloud services, according to the report, which was commissioned by Quincy, Mass.-based software company Infosys.
The report, “Simplify and innovate the way you consume cloud,” also highlighted user experience as a hurdle to working in the cloud. Between 60% and 70% of survey respondents said they are concerned/very concern about the following: the complexity of managing and governing hybrid cloud, that application performance metrics such as availability and speed will be negatively affected in the cloud, and that integration with other applications will be difficult.
When enterprises adopt cloud computing, many of their legacy methods of software integration are instantly obsolete. Hanging on to old integration methods is like trying to fit square pegs into round holes, according to Eric Knipp, Gartner Inc. managing VP. Integration is the biggest barrier to cloud deployment success and the primary driver of change and new opportunities in developers and enterprise architects’ jobs, he said.
Application integration has been a pain point for organizations a long time, Knipp said. Initial efforts focused on point-to-point integration, which usually resulted in fragile integration points that, when multiplied, were not robust. The integrations would break during software upgrades, causing long release cycles. Over time, some, but not all, enterprises remediated integrations using integration middleware, including enterprise services buses (ESBs) and APIs.
“Yet, when organizations adopt SaaS, I see the same point-to-point integrations happening,” Knipp said. “Haven’t we been here before? Don’t we know how this movie ends? It’s not good.”
Today, cloud integration must be a core competency in the utility belt of the modern application developer in an enterprise. “When you’re talking about the mainstream enterprise that is not in the business of writing software unless they have no choice, integration has to absolutely be the first thing that you focus on,” Knipp said.
Gartner Research Director Kyle Hilgendorf agreed. “I like to refer to integration as kind of a four-headed monster,” he said. “You’ve got network integration, data integration, identity integration and then application or services integration.” Knipp and Hilgendorf are co-authors, along with four other analysts, of Gartner’s recent 2015 Planning Guide for Cloud Computing.
To handle all four types of integration well, enterprise architects must ensure that those integration architectures are “pre-plumbed or pre-connected” prior to adoption of public cloud, Hilgendorf said.
In advance of adopting cloud, build a cloud-friendly enterprise architecture and integration strategy, Hilgendorf advised. “Think about how to bridge your networks between your data center and one or more cloud providers,” he said. “Think about how you will do single sign-on and identity and access management federation or synchronization.” Consider how to synchronize the business’ identities for authentication and authorization requests. “All that work and much more has to be done up front by the enterprise architect and architecture team,” he said.
The integration challenges of cloud adoption alone give architects and developers a once in a lifetime opportunity to retool their skillsets for a long-term, successful career, according to both analysts. With the right skills, they’ll be valued leaders as businesses transition from traditional application architectures, deployment methodologies and sourcing arrangements.
“It is more critical than ever for integration to be a core competency in the utility belt of the modern application developer in an enterprise,” Knipp said.
Denodo Express, a free data virtualization tool with a graphical user interface-based studio, is the latest product offered by Denodo Technologies, Inc. Denodo Express connects with and integrates on-premises, in the cloud, structured, unstructured and big data sources. These sources are then delivered and available to end users, as well as enterprise applications, dashboards, portals, Intranet, search and other tools.
“Denodo Express is designed for those data architects that are tired of being a prisoner to archaic data integration methods or are just generally frustrated at not being able to leverage the true value of their data,” said Suresh Chandrasekaran, senior VP of Denodo.
Denodo Express cuts down on the wait time developers often face when they want to integrate data. Along with integration of disparate sources, Denodo Express also performs abstraction; query optimization; caching; extract, transform and load batch scheduling; and data services publishing.
With this new product, Denodo, which is based in Palo Alto, Calif., seeks to eliminate the need for developers to search for and interpret data on their own. Instead, “Denodo Express [delivers it] to them in the format that they prefer, be that [structured query language] for [business intelligence] and reporting tools, Web services for Web and mobile applications, Web parts for SharePoint integration, etc.” said Chandrasekaran.
Denodo Express is free and available for download on the company’s website. The download gives users access to the product for an annual, renewable term. There are no time limits on using Denodo Express; however, the product is best used for smaller projects, such as personal or departmental projects. Once customers want to use Denodo’s data virtualization on an enterprise level, it is recommended that they upgrade to the Denodo Platform, which is not free. Customers interested in the expanded service should contact Denodo for pricing information.
Customers also have access to free educational support when they download Denodo Express. There are tutorials and videos from Denodo experts, as well as online community-based support. Further training courses are fee-based and available online and offline.
The product was released on September 29, 2014.
The refresh cycle, or application modernization boom, in human capital management (HCM) started a few years ago, but purchases and deployments took off last year, thanks to new capabilities in data and application consolidation, reporting and more, says Gartner Inc. analyst Chris Pane.
“Organizations are looking to go beyond the basics in HCM information systems,” says Pane. “They’re trying to consolidate the applications they have into a single data model, one single reporting view.” The one-view-for-all approach is easier to manage, secure and scale across international borders.
Pane is one of several experts in human capital management (HCM) systems my colleagues and I have interviewed lately for articles on deploying human resource applications in the cloud.
While most Fortune 1000 HCM upgrades have been designed for on-premise systems in recent years, cloud services’ scalability and consolidation opportunities are attractive, too. A good bit of the consolidation effort is taken out of the business’s hands in the cloud. In addition, adoption is growing due to greater sophistication in cloud feature functionality and increasing agility in delivering new functionality for geographically-dispersed organizations.
Pane projects growth in cloud HCM deployments because cloud technologies have matured. Also, wider corporate usage of cloud has quashed some businesses’ fears. “Don’t forget also that businesses have outsourced payroll for years already,” he says. “So, moving more of HCM to a third party and not sort of doing the process on-premise (sic) is culturally acceptable.”
HCM directors are becoming less concerned about cloud security, too. These days, most of the tried-and-trusted HCM providers have their own very secure data center facilities or use mega-cloud providers like AWS. “Just in terms of physical security there, cloud is arguably a lot stronger than what you would get in a conventional data center,” Pane says.
More stability is needed, however, before government and financial organizations, among others, put HCM in the cloud. Even mainstream businesses should take precautions, such as spreading their cloud instances across data centers in several geographies.
Pane offers three more tips on choosing new HCM apps:
• Make sure that you have a clean set of data to move to the new system for reporting purposes.
• Ask yourself if all the functions in the current system are still appropriate for today, a must considering the cost of feature deployment. It is not necessary to replicate everything in the old system within the new system, and doing so can complicate the migration.
• On the other hand, make sure that no functionality is lost when buying a new HCM system.
Get more tips on HCM and cloud adoption in the cloud in my article, Six Things to do before Deploying Cloud Apps. Then, get involved in the conversation, and tell us your best practices for cloud app deployment.
Gordon E. Moore, co-founder of Intel, noticed that over the course of tech history, compute power doubled every two years. Later coined as “Moore’s law,” his observation was meant to predict the general upward trend of processor speeds. Over the past few years, however, new content outlets — social media, in particular — have caused an explosion of unstructured data, a phenomenon that has bypassed Moore’s law by a landslide.
There is no single super-tool to tackle the growing generation of big data, according to Ben Butler, senior solutions marketing manager of big data at AWS. In his session at the AWS Summit in San Francisco, Butler advocated, instead, for a network of solutions — AWS solutions, to be specific — that leveraged the flexibility, capacity and cost effectiveness of the cloud.
Last week, Butler hosted another session at an AWS Summit in New York. His talk drilled down AWS solutions a bit further, offering specific use cases from different industries.
Big data has been used for fraud detection, click stream analysis and ad targeting, to name a few. One of the more exciting use cases is gene sequencing. This analysis of genetic variation can be used for disease research, personalized medicine and molecular testing. It is, in short, a tool that contributes to our understanding of disease and could be instrumental to the evolution of healthcare.
The sudden influx of big data has put pressure on on-premises systems that used to store, analyze and share data without much trouble, just a few years ago.
“DNA sequencing is scaling faster than Moore’s Law, so processing the sequence data is an increasingly significant barrier,” said Alex Dickinson, VP of strategic initiatives at Illumina, a genetic research company. Dickinson confirmed that the best solution for this processing bottleneck was cloud computing.
All of Illumina’s raw data streams from its sequencing instruments, over the Internet, to AWS, Dickinson explained. “There the data undergoes intensive processing to assemble final genomes from that raw data. It is then stored on AWS and made available to researchers for further analysis.” In other words, most of the big data lifecycle is processed on AWS.
Dickinson cited three reasons for selecting Amazon over other cloud providers. One, AWS has large instances that can handle big loads of raw data. Two, AWS has sites all over the globe. Three, AWS has competitive pricing.
Whether big data researchers choose AWS or not, the cloud is certainly the next frontier for processing massive datasets. In Illumina’s case, it is removing computational constraints and, by extension, generating more opportunities for scientific insight. As Dickinson put it, “the cloud enables raw instrument data to be transformed into disruptive healthcare discoveries.”
With over a billion users, Android has become the most popular Linux distribution in the consumer market, according to Ron Munitz, CTO and founder of Nubo, a remote Android Workspace solution. Now that enterprises are rushing to migrate their Windows or Linux-based deployments to the cloud, Munitz believes it makes sense to consider Android cloud apps as servers, in and of themselves. He presented this viewpoint at AnDevCon in Boston, in a session called, “Building Android for the Cloud”.
“If there is a migration from Linux to Android, and if there is a massive migration to the cloud, then it makes sense to combine all of them together and to expand Android to be a dominant cloud system on its own,” Munitz said. He believes the next step for Android is the make server side application ns, not only for users, but for organizations.
Munitz acknowledged many challenges that blocked progress in this direction. The primary drawback is latency, which would be introduced to applications running from Android’s cloud system. Android would also have to choose a remote display protocol (RDP) and, according to Munitz, there aren’t any RDPs that could handle Android well enough to satisfy users. After all, the user interface (UI) is the most important part of the mobile device, from the user’s perspective. And this is the part that would be subject to latency were its entire backend moved to the cloud.
That said, there are many reasons to entertain this concept of Android as a full-fledged cloud operating system or, as Munitz put it, “Cloudroid.” One reason is security, which has become a more pressing concern since the rise of BYOD. “Companies say you can have access to the organization’s data but that they need to verify that you will not steal data or, if you lose your phone, that it won’t be a risk.” Data held in Android cloud servers would be one way to protect the enterprise from this risk.
For the time being, Munitz’s position is largely abstract and speculative, but his premise is intriguing. In some regards, this seems to be the natural next step for Android. And, as Munitz put it, only a few years ago, Amazon was known as a book seller. Somehow, it has grown to become a dominant cloud provider. It seems like a much smaller leap to imagine Android doing the same.