Adventures in Data Center Automation


April 17, 2008  9:58 PM

Performance and Availability Management vs. Analytics – Part 1 of ?



Posted by: Ryan Shopp
Alcatel-Lucent, Analytics, Apparent Networks, Application monitoring, BMC, Brix Networks, CA, cittio, Compuware, DCAB, eg innovations, Entuity, Firescope, Fluke Networks, Gomez, Groundwork, HP Software, Hyperic, IBM Tivoli, Indicative, InfoVista, Integrien, Keynote, Nagios, NetIQ, NetQoS, NetScout, Netuitive, Network Instruments, Network monitoring, nimsoft, OpenNMS, Opnet, Packet Design, Performance management, Quest Software, SolarWinds, Systems monitoring, Xangati, ZenOSS

I’ve had an opportunity to be briefed over the past couple months by a number of current Data Center Automation Blueprint’s Performance & Availability vendors (e.g., CITTIO, eG Innovations, InfoVista, Integrien, Nimsoft).  With that and some further research I think I’m ready to take another pass at this area of the blueprint.

First up, all these vendors use a variety of techniques to collect a variety of data from as many points of view as possible.

  • Their own server agents that collect data about systems, services, applications, databases, etc and then aggregate back to a centralized console
  • Agent-less centralized consoles that leverage infrastructure standard communications protocols (e.g., SNMP, RPC, ODBC, WMI, SSH, TCP, UDP, HTTP) to query or connect remotely to collect data from networks, systems, services, applications, databases, etc.
  • Passive traffic flow collectors (which can be an agents or appliance) that are either in-line with the traffic flows or receive an exact copy of all traffic flows traversing a network connection (e.g., switch port uplink) through hardware vendor capabilities (e.g., spanning)

These data collection points can be statistics about a specific IT infrastructure resource ; physical devices, virtual devices, physical connections, virtual connections or resources running on physical or virtual devices like services, processes, applications, databases, etc.

Or the data collection points can be traffic flows or end-to-end specifics including passive traffic flows, synthetic transactions or even as simple as a pinging from remote points.

Metrics that are captured, typically revolve around throughput, errors, utilization, latency, up/down status, etc. (there are way to many to mention here).

After saying all this, there is a list a mile long of vendors (a number already noted on the DCAB) that capture these predominately time-series oriented data points about performance, capacity, availability using any/all these methods or vantage points (I know, passive traffic flows are not time-series data but patterns/usage/performance etc can be determined from them).

So, with all that data, what most these vendors offer are two primary types of functionality; 1) a variety graphical reports and 2)metric thresholding capabilities that produce a list of outstanding issues/alerts/alarms/events/concerns (whatever you want to call them).

Ok, so why did I organize and point all this out. So I can draw a line around where most of the innovation from my perspective is occurring. The above is for the most part in my eyes a commodity these days. Most companies have had collection/reporting/thresholding capabilities spanning multiple technology silos since pretty close to the start of the enterprise networking. The reports continue to get fancier, the number of data sources a single product collects from continues to expand, etc.  Another sign of commoditization is related to the variety of economic business models offering these products; open source, managed service providers, internet distributed products, appliances deployment models and indirect sales forces, large enterprise direct sales force, completely flexible frameworks for service providers to basically “build their own,” etc.

For the most part where the majority of technical innovation is occurring these days is the next layer above this data collection, reporting and alerting. Now let me say this, yes…there is some great innovation still occurring in the data collection realm (e.g., Xangati offering real-time Netflow down to a user level, PacketDesign monitoring routing messages, NetQoS leveraging advanced TCP/IP theory to analyze where end-to-end bottlenecks are occurring). But, for the most part these new data sources are being used to augment or replace currently deployed data sources in an attempt to see things from either as many vantage points or the best vantage points to avoid surprises within their unique enterprise IT environment.

So where is the serious innovation coming from…stay tuned for part 2.

April 17, 2008  4:40 PM

links for 2008-04-17



Posted by: Ryan Shopp
DataCenter


April 16, 2008  4:43 PM

links for 2008-04-16



Posted by: Ryan Shopp
DataCenter


April 15, 2008  4:47 PM

links for 2008-04-15



Posted by: Ryan Shopp
DataCenter


April 14, 2008  9:45 PM

Mapping HP Software to the Data Center Automation Blueprint



Posted by: Ryan Shopp
Analytics, CMDB, DataCenter, DCAB, GridApp Systems, HP Software, Integrien, Netuitive

I had the chance to recently chat with an executive at HP to breakdown what pieces and parts ended up where post Peregrine, Mercury and Opsware acquisitions. Here is my attempted and mapping them to the Data Center Automation Blueprint.

  • Configuration & Change
    • for networks – Network Automation Software (formerly Opsware, formerly Rendition)
    • for servers – Server Automation Software (formerly Opsware)
    • for storage – Storage Essentials Software (formerly Appilog)
  • Resource Reconciliation
    • Universal CMDB software (formerly Mercury, formerly AppLogic)
  • Process Orchestration – Operations Orchestration Software (formerly Opsware, formerly iConclude)

The focus of our call was around the above areas…from here I’m trying to piece together by using the website and the knowledge that:

  • The Business Service Management group is where all the monitoring products reside; Mercury (excluding QA products) and original OpenView monitoring products. There still seems like a ton of overlap here…
  • The IT Service Management is where Peregrine and the original HP Service Desk products reside.

So that means for the other functional areas of the Data Center Automation Blueprint we have:

  • Analytics
    • HP Dashboard software & HP Business Service Level Management – each offers a unified user interface consolidating reports and statistics spanning multiple other product lines within Performance & Availability to IT Service Desks.
  • Performance & Availability
    • Products that are event/availability centric for the Data Center Infrastructure
      • HP Network Node Manager software – agent-less performance and availability software for networks
      • HP Operations Manager software – agent-based performance and availability software for servers/services/applications/databases.
      • HP Problem Isolation software – agent-less performance and availability software for servers/services/application/databases.
      • HP Process Monitor software & HP TransactionVision software – agent-based performance and availability software for services/applications/databases
    • Products that are trend/capacity centric for the Data Center Infrastructure
      • HP Performance Insight software – agent-less time series performance and capacity reporting software for networks that also consolidates data for reporting on servers/services/applications/databases
      • HP SiteScope software – agent-less performance and availability software for servers/services/applications/databases
      • HP Performance Manager software & HP GlancePlus software – agent-based time series performance & capacity statistics collected from servers/services/applications/databases.l
      • HP Real-User Monitor software – monitors applications/services/data traffic flows
  • Security & Prevention
    • HP WebInspect software – web application vulnerability scanning
      • **NOTE: In my eyes, this is more a security extension to the QA and Testing products from Mercury then part of a security & prevention software portfolio like that of Symantec, McAfee or EMC RSA.

So there we have it (i think). Now please correct me if I’m wrong, but one thing I didn’t see in the portfolio was anything that does proactive performance analytics like Integrien, Netuitive or ProactiveNet (acquired by BMC)? Besides that, from an outside perspective they merely have a very confusing Performance & Availability functional category (due to Mercury/OpenView overlap) that does seem to have all the pieces. So for HP Software, it’s just about executing and tying things together based on end-to-end use cases from their customers. One other area to keep an eye on is Configuration & Change for databases (from companies like GridApp). As more and more enteprises deploy the Server Automation Software, they may start wanting to get more detailed in the world of databases, if so that may be a build/buy decision point to consider in the future. One other thing based on what I’ve read is all these products are busy making sure they extend beyond physical systems support into the virtualized world.

I guess one outstanding thing to ponder is why shouldn’t HP also offer a comprehensive security & prevention offering to help them better compete against IBM? At some point many people assume/expect security and operations to converge, why not help drive that with a comprehensive security offering?


April 12, 2008  4:38 PM

links for 2008-04-12



Posted by: Ryan Shopp
DataCenter


April 11, 2008  4:47 PM

links for 2008-04-11



Posted by: Ryan Shopp
DataCenter
  • Over the last year Netuitive has experienced over 100 percent revenue growth, closed million-dollar deals with industry leaders in the financial services, retail, e-commerce and telecommunications industries, and surpassed its 200th customer milestone.
    (tags: analytics)
  • rumor mill with some justification. With BEA snapped up by Oracle and BMC very busy consuming BladeLogic, ReallOps, Emprisa etc that removes the two previous targets I discussed for Cisco. They need to strengthen their data center play – this could/woul
    (tags: acquisitions)


April 10, 2008  4:39 PM

links for 2008-04-10



Posted by: Ryan Shopp
DataCenter


April 9, 2008  4:46 PM

links for 2008-04-09



Posted by: Ryan Shopp
DataCenter


April 8, 2008  6:33 PM

links for 2008-04-08



Posted by: Ryan Shopp
DataCenter