Quest Software archives - Adventures in Data Center Automation

Adventures in Data Center Automation:

Quest Software

Apr 17 2008   9:58PM GMT

Performance and Availability Management vs. Analytics - Part 1 of ?



Posted by: Ryan Shopp
Network monitoring, Performance management, BMC, NetIQ, Alcatel-Lucent, NetScout, Analytics, CA, Systems monitoring, Application monitoring, SolarWinds, InfoVista, IBM Tivoli, HP Software, Quest Software, Netuitive, Integrien, NetQoS, Compuware, Fluke Networks, Network Instruments, Opnet, Entuity, Brix Networks, Keynote, Gomez, Xangati, Apparent Networks, Packet Design, Groundwork, Hyperic, Nagios, OpenNMS, ZenOSS, Firescope, Indicative, DCAB, eg innovations, cittio, nimsoft

I’ve had an opportunity to be briefed over the past couple months by a number of current Data Center Automation Blueprint’s Performance & Availability vendors (e.g., CITTIO, eG Innovations, InfoVista, Integrien, Nimsoft).  With that and some further research I think I’m ready to take another pass at this area of the blueprint.

First up, all these vendors use a variety of techniques to collect a variety of data from as many points of view as possible.

  • Their own server agents that collect data about systems, services, applications, databases, etc and then aggregate back to a centralized console
  • Agent-less centralized consoles that leverage infrastructure standard communications protocols (e.g., SNMP, RPC, ODBC, WMI, SSH, TCP, UDP, HTTP) to query or connect remotely to collect data from networks, systems, services, applications, databases, etc.
  • Passive traffic flow collectors (which can be an agents or appliance) that are either in-line with the traffic flows or receive an exact copy of all traffic flows traversing a network connection (e.g., switch port uplink) through hardware vendor capabilities (e.g., spanning)

These data collection points can be statistics about a specific IT infrastructure resource ; physical devices, virtual devices, physical connections, virtual connections or resources running on physical or virtual devices like services, processes, applications, databases, etc.

Or the data collection points can be traffic flows or end-to-end specifics including passive traffic flows, synthetic transactions or even as simple as a pinging from remote points.

Metrics that are captured, typically revolve around throughput, errors, utilization, latency, up/down status, etc. (there are way to many to mention here).

After saying all this, there is a list a mile long of vendors (a number already noted on the DCAB) that capture these predominately time-series oriented data points about performance, capacity, availability using any/all these methods or vantage points (I know, passive traffic flows are not time-series data but patterns/usage/performance etc can be determined from them).

So, with all that data, what most these vendors offer are two primary types of functionality; 1) a variety graphical reports and 2)metric thresholding capabilities that produce a list of outstanding issues/alerts/alarms/events/concerns (whatever you want to call them).

Ok, so why did I organize and point all this out. So I can draw a line around where most of the innovation from my perspective is occurring. The above is for the most part in my eyes a commodity these days. Most companies have had collection/reporting/thresholding capabilities spanning multiple technology silos since pretty close to the start of the enterprise networking. The reports continue to get fancier, the number of data sources a single product collects from continues to expand, etc.  Another sign of commoditization is related to the variety of economic business models offering these products; open source, managed service providers, internet distributed products, appliances deployment models and indirect sales forces, large enterprise direct sales force, completely flexible frameworks for service providers to basically “build their own,” etc.

For the most part where the majority of technical innovation is occurring these days is the next layer above this data collection, reporting and alerting. Now let me say this, yes…there is some great innovation still occurring in the data collection realm (e.g., Xangati offering real-time Netflow down to a user level, PacketDesign monitoring routing messages, NetQoS leveraging advanced TCP/IP theory to analyze where end-to-end bottlenecks are occurring). But, for the most part these new data sources are being used to augment or replace currently deployed data sources in an attempt to see things from either as many vantage points or the best vantage points to avoid surprises within their unique enterprise IT environment.

So where is the serious innovation coming from…stay tuned for part 2.

Jan 21 2008   1:43PM GMT

Quick Monday Summary of events from late last week/weekend



Posted by: Ryan Shopp
Symantec, BMC, NetIQ, NetScout, Quest Software, NetQoS, Compuware, Indicative

 Symantec to sell off Application Performance Monitoring group.  Looks like Precise Software is back and the Symantec Data Center group will focus in on the configuration and change management side of things.

BarcampESM took place over the weekend.  Here are some materials to take a look at.  BSM by Doug,  Discussions around open software and open standards, the desire for an “open agent” .  From this point forward keep track of things via the Open Management Consortium discussions.

Application Performance Management(APM) rolling review continues at InformationWeek - recently highlighted, ProactiveNet (recently acquired by BMC).  Previous reviews include Quest Software Foglight (Dec 2007), Network General (Nov 2007), Nimsoft Nimbus (Oct 2007), Compuware Vantage (Oct 2007), NetIQ AppManager (Sept 2007), NetQoS SuperAgent (Sept 2007)Indicative (Aug 2007).  As you can see this is a very congested space, pardon the pun, but it is sized to be over $2B in size by Forrester.

Now that we’ve run through the entire 6 functional areas of the Data Center Automation Blueprint we plant to discuss the impact of virtualization over the next couple posts.  Thanks in advance to those I’ve been talking with and their perspectives on this topic.


Dec 28 2007   11:31PM GMT

Digging into each of these 6 functional areas: Performance and Capacity



Posted by: Ryan Shopp
Network monitoring, Performance management, Symantec, BMC, EMC, NetIQ, Alcatel-Lucent, NetScout, DataCenter, CA, OSS, Systems monitoring, InfoVista, IBM Tivoli, HP Software, Quest Software, Netuitive, Integrien, NetQoS, Compuware, Fluke Networks, Network Instruments, Opnet, Entuity, Brix Networks, Keynote, Gomez, Xangati, Apparent Networks, Packet Design, Groundwork, Hyperic, Nagios, OpenNMS, ZenOSS, Zabbix

First things first, we have many of the same vendors from the Availability & Notification functional area of this Data Center Automation Blueprint in this category. Which probably begs the question, do we combine Availability & Notification with Performance & Capacity? I know in the OSS (not Open Source Software but telco-oriented Operational  Support Systems) model they do this and call it “Service Assurance”, another name could be Service Level Management as they two monitoring-centric functions are about ensuring service levels are met…or simply I call it Availability & Performance? I’ll come back to this at the end after I type up the players in this Performance & Capacity area:

But then, we have a slew of others that have been around for quite some time now…

And some innovative up-and-comers in some unique technology/approaches…

Real-Time Behavior/Pattern Analysis through Dynamic Thresholding

IP Traffic/Packet Flow Monitoring & Analysis

Open Source Software (OSS) vendors

Whew..that was more work then I expected to pull together and I’m not done yet…  Please throw into the comment who I’ve missed (I know there has to be a few).

The major challenge here is organizing and breaking down this functional area.  There are so many approaches to obtain performance metrics from/for the data center.  Some of the techniques and perspectives include;

  • passive vs. active
  • agent vs. agent-less
  • in-line appliance vs. out-of-band appliance (e.g., span a port)
  • proprietary vs. leverage infrastructure mgmt. capabilities (e.g., Cisco Netflow)
  • outside the data center looking in vs. inside the data center itself.
  • Reactive troubleshooting vs. Proactive Predictive

I’m going to need to have a part two (and maybe more) for this functional category breaking down the pro’s and con’s of various approaches.  Which vendors do what, etc.  I also need to revisit that question from the top of do we combine this into a single “availability & performance” functional category???  For now, this first pass will have to do…


Dec 24 2007   5:52PM GMT

So let’s start to dig into each of these 6 functional areas: Availability and Notification



Posted by: Ryan Shopp
BMC, EMC, NetIQ, DataCenter, CA, IBM Tivoli, HP Software, Quest Software

So it’s time to start refining the Data Center Automation Blueprint. One way I hope to do that is through these next 6 blog posts (one for each functional DCA category) that will:

1) create list of vendors I know about that have some capabilities for the data center in the specified functional area

2) during this first pass attempting I also hope to breakdown each function by some major capabilities.

*NOTE: Help me out if I miss some vendors, miss some products within vendor product lines etc. Again, the focus is for current/future complex data center so I won’t be including tools like Ipswitch What’s Up Gold or products that are on their way out (end-0f-life) by vendor (e.g., NetView).

Event consolidation & root cause analysis

A new product segment that has materialized that for now I’m going to go place here is log management where you maintain historical event/message/alert logs and then have historical reporting and applying advanced indexing and searching technology to quickly find the “needle in the haystack” problems. It also has application beyond operational availability management of the data center within the security space for compliance management.

Next up will be the current Data Center Automation Functional Area of Performance and Capacity.


Dec 7 2007   6:52PM GMT

Data Center Virtualization Automation/Management is becoming very, very congested



Posted by: Ryan Shopp
Microsoft Windows, Symantec, Virtualization, BMC, DataCenter, InfoVista, IBM Tivoli, HP Software, Quest Software, BladeLogic, Stratavia, Cassatt, PlateSpin, Veeam, Vizioncore, Netuitive

I just saw this snippet from the 451 consulting group and WOW!  In December 2006 they were covering 6 players in the Virtualization Management arena, now their are over 60!

I have some reading to do it seems.  I don’t have the $$$ to pay for the 170 page report but will take the time to go review the website and read articles about many of these vendors then report back what I learn here on this blog.  Reading through the below list I recognize a number of them…but some are names i’ve never even heard of to this point.  My quick notes are mentioned next to the company name…kind of like the word association game “what is the first thing you think of when I say…”

The companies listed by the report that have a virtualization management play include;

3Leaf Systems - who?
Acronis - who?
Akorri - who?
Availigent - who?
Avocent - the ones who acquired LANdesk
BladeLogic - major player in DCA systems/application automation
Blue Lane Technologies - virtual patching appliance
BMC Software - one of the big 4 has something, not sure how deep or what
CA - one of the big 4 has something, not sure how deep or what
Cassatt - virtualization pure play with “green” positioning
Catbird - who?
CiRBA - monitoring product to help with cserver onsolidation efforts
Cisco Systems - big guy with their ambitious Data Center 3.0 initiative
Citrix Systems - acquired XenSource post VMware IPO
CohesiveFT - who?
CollabNet - who?
Configuresoft - big but still growing systems & security mgmt player
Desktone - who?
DeviceVM - who?
Egenera - who?
eG Innovations - who?
Embotics - who?
Enigmatec - who?
Enomaly - who?
FastScale - who?
Hewlett-Packard - major player/move with Opsware acquisition
Hyperic - who?
IBM - one of the big 4 has something, not sure how deep or what
illumita - who?
InfoVista - not sure what they have in virtualization, maybe a performance monitoring for some virtual servers?
InovaWave - who?
Leostream - who?
Marathon Technologies - who?
Mendocino Software - who?
Microsoft - guerilla, who will have an impact in this space!
Netuitive - automated performance threshold monitoring, i assume they must do this for virtual servers to be included here.
Network Appliance - not sure
Nimsoft - application monitoring, been on my todo list to read more on them.
Novell - big guy, has some play here - not sure what
Onaro - who?
Pano Logic - who?
PlateSpin - known virtualization automation player i’ve talked about previously
Platform Computing - who?
Quest Software - database, application monitoring
Qumranet - who?
Red Hat - linux
Reflex Security - who?
RingCube - who?
Scalent Systems - known virtualization player with recent major OEM announcements
ScienceLogic - who?
SteelEye Technology - who?
Stratavia - Run Book Automation
Surgient - austin company, not sure what they have these days…need to look
SWsoft and Parallels - Macintosh ability to run Windows
Sychron - who?
Sun Microsystems - solaris and grid computing initiatives
Symantec - security and storage with some systems products they’ve acquired
ToutVirtual - who?
Univa UD - who?
Veeam Software - known virtualization player i’ve previously talked about
Virtual Iron - heard of them…haven’t looked at them yet though
Virtugo Software - who?
Vizioncore - known virtualization player i’ve previously talked about
VMLogix - heard of them…haven’t look at them yet though
VMware - if you don’t know this name you must dead, or atleast not into technology or the stock market
XDS - who?
Xsigo - who?

Bottom line, I have a ton of reading to do!!!  I’ll start with the smaller guys and work my way up.  If you have any perspectives or insights please don’t hesitate to leave them in the comments section.


Dec 3 2007   11:41PM GMT

Availability Management, so what’s been going on here?



Posted by: Ryan Shopp
Microsoft Windows, Symantec, BMC, EMC, DataCenter, CA, IBM Tivoli, HP Software, Quest Software, Netuitive, Integrien

As mentioned in my November 2007 round-up, I haven’t given any love to automation products watching for outages, faults or other availability of the infrastructure oriented events.

Part of the reason for this oversight is these days most data centers are locked into a product from the “big 4″ vendors; BMC (Performance, formerly Patrol), CA (formerly Aprisma), HP (NNM, Operations), IBM (NetView, formerly Micromuse) or the “upcoming 5″ vendors EMC, Oracle, Microsoft, Quest Software and Symantec due to their overall IT infrastructure architecture and strategy.

But their are other innovative players in town to consider for replacement or complimenting these bigger guys. Self-learning technologies are being advanced by companies like Netuitive and Integrien. These technologies are focused on monitoring real-time events and then leveraging mathematical algorithms to estimate baselines and set thresholds in an attempt to accurately predict system and service level degradation.


Oct 31 2007   8:12PM GMT

Activities in Application, System & Network Performance Monitoring



Posted by: Ryan Shopp
Networking, Network monitoring, Performance management, Microsoft Windows, Symantec, BMC, EMC, DataCenter, CA, Systems monitoring, Application monitoring, SolarWinds, InfoVista, Accellent, IBM Tivoli, HP Software, Quest Software

Big item to post about right out of the gate!  We all are familiar with the “Performance Management” sector within the Data Center.  Quick couple sentence summary.  Software that automates the collection and identification of potential performance bottlenecks within the data center.  Performance bottlenecks meaning real-time delays, conditions that are affecting productivity or analytics that leverages historical collected data that can help predict a potential performance concern before it happens.

Now there are a TON of large players in this space which we will review in more details in upcoming posts (e.g., BMC, CA, HP, IBM, EMC, Symantec, Quest Software, Microsoft) but today I want to hit on a couple vendors you should consider if you’re tired of working with your current vendor (most likely one of the big names above).

InfoVista is one of the last pure-play companies that provide solutions for automating Data Center Performance Management/Monitoring.  Yesterday, they finally announced a move (after years of OEM’ing various product) to round out their solution on the application performance management perspective.  I’ve talked to a number of large global enterprise/telecom customers who speak the gospel about the quality and capabilities of their products.  They’ve been known in the past for their network and systems centric capabilities but with the acquisition of Accellent they now own the application monitoring technology.  Now, let’s be clear - their solution is designed for large, large Enteprises and/or Telecommunication companies.  If your not looking to do a major global deployment spanning a large data centers and/or vast numbers of remote offices this solution may be overkill for you.   If that is the case I would recommend you taking a look at another company.

Solarwinds is making some major investments in their offerings.  If your a small, medium business or wishing to manage a portion (specific group/organization) within a larger enterprise then take a look at their Orion product line.  You get a major bang for your buck (many times 75% of the functionality you use from one of the big guys at a price point most likely less then your annual maintenance contract).  The other beautiful thing is you can download and evaluate the product in all is glory without ever talking to a single sales person.  Also, they have a very active community behind their products including a great blog, Geek Speak by my friend Josh Stephens, that provides very useful insights and perspective on leveraging their products.