Perhaps the most famous Big Data technology, Hadoop has gained a following over the years led by Web giants such as Yahoo and Facebook. As time goes on, Hadoop adoption continues to climb. Still, its complexity has made it difficult for smaller enterprises to jump on the bandwagon.
That might be changing. This week, multiple software companies introduced tools aimed at easier management, scalability and integration of Hadoop within the enterprise.
Pervasive Software Inc. rolled out Pervasive Data Integrator v10 – Hadoop Edition, designed to enable users to more easily transfer business data to and from Hadoop-based big data stores. The product addresses the challenging task of flowing non-Hadoop data into Hadoop, a framework often noted for its lack of visual data integration tooling.
Similarly, MapR Technologies Inc. released Version 2.0 of the MapR Distribution, a tool that provides increased monitoring, management, isolation and security for Hadoop. Some of its more notable features include central logging and multi-tenancy support, which both aim to enhance control and visibility of Hadoop data.
Also this week, cloud testing took the fore.
SOASTA announced its CloudTest Mobile platform, providing test automation for iOS, including iOS 6. CloudTest resides inside the app, an approach designed to allow developers to test apps as new mobile operating systems are released.
Also on the testing front, at Cloud Expo in New York, Parasoft Corp. showcased the latest release of Parasoft Virtualize, a service virtualization tool. The product aims to allow development and QA teams easier access to environments needed to test applications.
On another note, UShareSoft announced UForge App Store at the same expo. The platform is a collaborative, multi-cloud app store for enterprise IT applications. With its release, UShareSoft hopes to ease the delivery of software and application to the on-premise cloud. The spread of so-called app stores may betoken a trend of ‘consumerization’ of IT, as updates are shared using now-familiar Smart phone methods. -Stephanie Mann
At work today is a new breed of API. It relies on SOA, but has a new twist. The open or Web API movement has a capacity to dramatically change the status quo, altering the relationships of business leaders and developers, organizations and consumers. In a recent interview with SearchSOA.com, Alistair Farquharson talked about APIs, and discussed new trends in API management. Farquharson, CTO, SOA Software Inc., sees a sea-change a’ coming.
On the current state of APIs—and how they compare to old-fashioned SOA— Farquharson said:
I like the fact that APIs are simpler and more accessible. I like the fact that APIs are more community-oriented. A developer is far more attuned to a Facebook-like experience of collaboration than a UDDI registry. I like those kinds of trends around API management. I like the fact that discovery is completely revolutionized. I think the security mechanisms are simpler, and it remains to be seen how complicated things are going to be over time.
He added that new shifts in API management are shining a spotlight on developers:
I don’t think SOA was ever focused on the developer. API management has driven some focus toward the developer. The business likes this because the developer…is probably building some cool apps that are going to make them some money. It’s nice and neat if you look at it from that perspective.
Read more about our discussion with Farquharson here: Farquharson on API management: “Focus on business-developer relationship”. –Stephanie Mann
According to Gartner, a host of factors—ranging from cloud and social to big data and mobile technologies—are altering the EA landscape. As a result of those changes, enterprise architects may have more opportunity to deliver business value from EA than ever before. Analysts expanded on the notion this week in National Harbor, Md., at the Gartner Enterprise Architecture Summit 2012.
Ahead of the conferences, Gartner identified five categories of “deliverables” that it said will help EA practitioners do just that. Those types of deliverables must be: measurable, actionable, diagnostic, enabling and operational.
Respectively, these traits are said to measure the direct impact of EA on business; drive change and action; include models, requirements and analysis tools; collect information to provide input to diagnostic deliverables; and help define, communicate and run EA programs.
“Focusing on standard EA framework doesn’t work,” Brian Burke, a research vice president at Gartner, explained in a statement. “In the past EA practitioners focused on deliverables that were useful to enterprise architects but not valuable to senior management and/or did not respond to a specific business or IT need.”
Today, says Gartner, many organizations remain tied to traditional EA frameworks that no longer leverage the best opportunities to deliver business value. The research group sees a gap between the way companies pursue EA and the impact of EA on the business itself.
Gartner tells enterprise architects re-evaluate out-dated practices, instead shifting focus to efforts that empower business and IT leaders to make business outcome-driven decisions. – Stephanie Mann
Middleware integration developers seldom get accolades. Neither do plumbers. After all, you don’t think about the plumbing until it breaks. The same goes for middleware technology. Integration middleware doesn’t get respect, because it is buried so deeply below the surface of its end use applications. But it shouldn’t be that way, really. It is being used in some incredibly innovative ways.
That’s why it was refreshing to attend the recent FuseSource CamelOne 2012 conference in Boston. One after another of presenters discussed what they did with today’s integration essentials – ESBs, orchestrators, workflow engines and the like.
At CamelOne, CERN’s Felix Ehm showed how the world’s biggest physics research lab uses open source Active MQ messaging software to control and monitor a massive particle accelerator (see above). A General Dynamics Canada engineer, Mike Gingell, showed Agile integration successes using Camel, CXF, ActiveMQ and OSGi for troop tracking, Arctic surveillance and other defense uses. David Reiser and other Computer Science Corp. of America (CSC) software engineers described use of the Apache Camel integration framework to enable real-time data sharing of crucial FAA wind shear data. There was much more. Clearly, open source middleware is not just finding uses, it is finding mission-critical real-time systems uses.
This is serious stuff. But CamelOne was also fun. Cern’s Ehm, principal engineer for JMS infrastructure, admitted that, as a lad, he was so curious about what was inside that he would ”smash things with a hammer,” to see what was inside. Now he is using distributed systems to control the biggest beams as they smash the littlest particles. Ehm’s presentation was further enlivened by none other than Apache ActiveMQ Cofounder James Strachan who inadvertently leaned on an AV system touch screen wall module that activated some random disco music almost as loud as the original big bang.
It’s nice that Camel employs clever design patterns, and that ActiveMQ is adding useful manageability traits. But it is especially nice to find middleware being put to such innovative ends. The bottom line: Integration middleware is pretty cool, and useful too! – Jack Vaughan
Photo Courtesy: Cern
While the enterprise software business remains a good one, integration hardware appliances continue to grab headlines. With Oracle’s Exalogic and, now, IBM’s PureSystems, unveiled at Impact 2012, the integration hardware appliance product pipeline seems primed.
These machines are said to cope with complexity, one of the biggest hurdles to software integration today, by ”canning” known good integration configurations. As with a prefabricated house, there is room for customization, but the appliance may not meet the special needs of all integration developers.
Ease of integration is the basic raison d’etat behind IBM’s PureSystems box, shown above. Integration has become such a tangle, that there is little doubt some shops will consider the box as a way to cope. The path has been set for Big Blue shops by DataPower, the XML appliance that IBM acquired a number of years ago from start-up DataPower and took to market in a big way. For many IBM-oriented undertakings, ”DataPower” is almost synonymous with ”ESB.” Its utility was especially enhanced with the addition of object brokering and data caching capabilities.
If you’d like to see more of PureSystems and other doings at IBM Impact 2012 check out SearchSOA.com’s Impact 2012 in pictures slide show.
Agile development and composite applications are a hallmark of SOA these days, but they are not without their difficulties. The push to rapidly deploy composite apps complicates the life of the QA team, whose members must now create test beds to work with a mishmash of services.
Some of these services are complete and in operation, while others are under development. All of them, unfortunately, are usually undergoing versioning.
The open source community has created mock services architectures to deal with this symptom of SOA. Too, vendors have fielded tools to deal with the new paradigm. ITKO (now a CA company) Parasoft, GreenHat (now an IBM company) and Hewlett-Packard Co. now support simulation of services. These are often called “virtualized services” as well.
While there is a certain natural solidity to enterprise back-end systems, the Web, with its constant change, is influencing the need for virtualized testing.
“People need to have an e-commerce experience that is extremely dynamic. Expectations change almost every week,” said Kelly Emo, director, Applications Product Marketing, HP. “This places demand on the developer team, and potentially, on the scalability and elasticity of back-end services.”
Application owners help drive the use of services virtualization tools, she noted, saying, “They see the costs in waiting and the problems that arise with limited testing.”
HP entered the virtualized services fray about a year ago, and has recently updated its HP Service Virtualization offering with support for REST services, now found widely in cloud and Web APIs. Native support is also available with this release for IBM WebSphere MQ services, which has been seeing a lot of demand, she said.
Cloud computing, too, is a driver of the move to virtualized services testing, according to Emo.
SOA has been used for application transformation for several years – now SOA itself is undergoing a transformation. At IBM Impact 2012, IBM Application and Integration Middleware General Manager Marie Wieck went so far as to dub the transformation “SOA 3.0.” She was not alone among IBM leaders showing support for SOA services – old and new. Continued »
UPDATED – Long-time SOA player Progress Software disclosed plans today to divest important SOA and BPM holdings. In a prepared statement, the company said going forward it would focus on “core” OpenEdge product development and the new Application Platform-as-a-Service cloud computing market. It hopes to divest “non-core” business holdings and products including Actional SOA governance tools, Sonic and FuseSource ESBs, ObjectStore object databases, Savvion business modeling tools, and others by the middle to end of its FY 2013.
The move appears to be a return to its original roots, represented by its OpenEdge line. That operation is largely a channel business in which VARs and ISVs work with Progress platforms and tools to target specific vertical markets. That business, IT work formerly hosted in house, may be overtaken by cloud computing architectures, industry observers suggest.
In the early 2000s, Progress began to expand its software portfolio. It started a buying spree, eventually acquiring a series of best-of-breed software startups, including several SOA and XML specialists, with the intention to both enhance its OpenEdge line and sell point tools directly to enterprise software shops. The company included its Apama complex-event processing (CEP) products, which have found use in financial markets, as part of its core listing. In today’s announcement, the company said that FY 2011 revenue for core products was $361 million, while non-core products represented $172 million.
The future course for Progress Software had been under review by its board since at least shortly before its Progress Revolution user conference last fall. At that time CEO Rick Reidy announced he would be stepping down. Late last year, Jay Bhatt, who previously headed a division of Autodesk, took over as president and CEO at Progress Software.
“It looks like Progress is set to do a 180 degree turn, and revisit its past to try and reinvent its future,” BPM expert analyst Neil Ward-Dutton wrote in a blog entry.
Ward-Dutton, principal and co-founder at MW Advisors, also voiced concern, suggesting the pipelines for the divested products could “dry up very soon indeed, as prospects focus instead on potential choices with clear futures.”
Although Ward-Dutton has concern for the company, a former employee, Danny Goodall, a founder of the Lustratus Research Limited, voiced his optimism in a blog post.
“I am pleased that Progress has looked at its DNA, mapped that to what the market needs and has tried to structure a company that can thrive in the cloud,” said Goodall. “For too long Progress forgot its core values and differentiators and instead aimed to ape other vendors.”
“Progress watched competitors in the integration space build out broad SOA portfolios and felt it should do the same,” chides Goodall. This worked for Oracle (which Goodall credits for a high-powered sales operation) but not for Progress, in Goodall’s opinion. -Jack Vaughan (Includes reporting by Ryan Punzalan)
This week in Cannes, France, IT leaders gathered sea-side to discuss the current state—and future— of enterprise transformation. At The Open Group Conference, industry experts and entrepreneurs addressed the roles of enterprise architecture (EA) and IT in transforming the enterprise, with much of the conversation focusing on how to better achieve business objectives using EA and SOA. Continued »
Apps have crept into broader public consciousness in recent years thanks to mobile applications, and now APIs are getting wider attention. In fact, Java APIs stand as a very central part of the Oracle-Google Android trial that got underway this week in San Francisco. The legal wrangling comes at a time when APIs (Application Programming Interfaces) are increasingly seen as “open” and “public,” thanks in part to the strategies and successes of Facebook, Twitter and (none other than) Google APIs. Continued »