Blog - Application Performance Management


Complete Application Performance Management Is More Than Just Checking the Boxes PDF Print
Written by Bojan Simic   
August 03, 2011

On July 6th, Compuware announced that it acquired dynaTrace Software for $256 million in cash. dynaTrace provides solutions for tracing and capturing application transactions, code level application diagnostics and real-user experience monitoring (RUM). This company has particular strengths in monitoring Java applications and its products are used in both pre-production and production.

Analyzing drivers behind this acquisition uncovers some of the larger trends in the APM market and brings to light new requirements for creating competitive advantages in this space.

Compuware's position prior to the acquisition

Prior to the acquisition, Compuware's APM portfolio consisted of the Vantage product line and Gomez products acquired in October of 2009. The Gomez acquisition enabled Compuware to offer arguably the broadest range of application performance management capabilities in the market. These capabilities include both synthetic and real user monitoring, monitoring from both inside and outside of the corporate firewall, network, database, server and application component monitoring, as well as monitoring last mile, cloud and mobile performance. Additionally, Compuware had an aggressive agenda for integrating Gomez and Vantage products and the company was able to follow through on this plan and allow their customers to leverage the capabilities of both of these technologies in an integrated way.

It looks like Compuware was in good shape when competing in the APM market prior to this acquisition. So why did they feel like they needed to spend $256 million on purchasing a company with $26 million in TTM in revenues?

Completeness vs. effectiveness of APM product portfolios

Competitive positioning of many APM vendors have been largely focused on the completeness of their product portfolios and making sure that they have all of the major boxes checked. User experience management, transaction monitoring, monitoring application components or parts of the delivery infrastructure are just some of the areas that vendors are looking to cover when trying to position themselves as complete APM solutions. However, the fact that Compuware had user experience monitoring, transaction and Java monitoring boxes checked and still decided to spend more than half a billion dollars on acquiring Gomez and dynaTrace, user experience monitoring and transaction tracing providers, is proof that gaining true competitive advantage in the APM market is becoming a more complex task.

Preliminary findings of TRAC's APM survey show that end-user organizations are evaluating APM solutions predominantly based on effectiveness in their specific use cases and specific pain points that they are trying to address. Even though organizations see the value in managing multiple aspects of application performance management through an integrated solution, what matters to them more than the completeness of APM portfolios are capabilities that vendors are providing within each of these segments. Also, solutions that are focusing on varied individual segments of APM are based on different underlining technologies and approaches for collecting the data, which in many cases determines their effectiveness in different usage scenarios. Based on that, user experience monitoring solutions can be segmented into 2-3 separate sub-markets and the same goes for transaction monitoring products. The dynaTrace acquisition enables Compuware to add strong capabilities in the areas of the APM that the company was not focusing on, such as pre-production monitoring. More importantly, the acquisition allows Compuware to strengthen its offerings in areas that were included in the company's pre-acquisition portfolio, such as transaction tracing, deep dive monitoring and RUM. Even though the acquisition expands the array of capabilities that will allow the company to be more effective in a broader range of APM use cases, the real story of the acquisition, from a technology perspective, is that it allows Compuware to gain new strengths across different functional segments of APM.

The best way to describe the APM vendor landscape is as a set of different micro landscapes that are being defined by the types of applications and technology environments that organizations are looking to manage or blind spots that they are trying to close. The acquisition enables Compuware to significantly increase the number of usage scenarios where their solutions are able to effectively address application performance challenges.

Impact on competitors

This move can impact other APM vendors both short and long term. Short term, it can be expected that many vendors will try to take advantage of the fact that Compuware just acquired a technology that significantly overlaps with their Vantage technology and go after current Vantage customers. The same day the acquisition was made public, Compuware announced that their Vantage Analyzer product is being replaced and, due to end-user concerns about the support that Compuware will be providing for Vantage products going forward, this strategy could result in new customer wins for some vendors.

Long term, this acquisition could have a more significant impact on the APM market and cause additional consolidation and, more importantly, a shift in how requirements for effective application performance management markets are defined. Some of the other traditional leaders in the APM market that have all of the major boxes checked when it comes to completeness of their product portfolios may also find that they need to take a good look into each of these boxes and see if their capabilities are really well aligned with the key requirements for managing today's complex application environments. Those vendors that come to the same conclusion as Compuware did, after evaluating their portfolios, will be facing a "build or buy" quandary which, given how fast the requirements of this market are changing and what technology backgrounds their solutions are, should not be a tough dilemma. The real question is: How many of the vendors who are left in this market can be good acquisition targets? Even though new vendors are constantly entering this market, the list of acquisition targets that can help create true competitive advantages across a broad range of deployment scenarios is still fairly short.

 

 
Application Inspection Triggers: New Approach for Making Application Performance Data Relevant PDF Print
Written by Jeffrey Hill   
May 26, 2011

TRAC's article from October, 2010, "BI Becoming the Key Enabler for IT Performance Management" talked about how the complexity of managing IT performance is driving the need for new analytics and reporting capabilities for IT management solutions. These capabilities are especially important when it comes to monitoring network and application performance – a deeper and wider view of the application infrastructure is vital as companies add more complex and dynamic IT services. Many organizations that use several APM solutions at the same time report that they still do not have enough visibility into application performance and, as a result, struggle with troubleshooting and repairing performance issues. The relevance of application performance data largely depends on how well they fit an organization's particular use case and thus the metrics collected "out of the box" by APM solutions may not fit the problems that they are trying to solve.

ExtraHop Networks recently announced version 3.5 of their Application Delivery Assurance system, a key part of which is a technology called Application Inspection Triggers. This capability allows organizations to define metrics to be captured at network speeds through the use of scripts that are customized to solve a particular problem. These metrics can be uniquely tailored to meet the specific needs of each organization or IT department with custom alerts and reports suited to the metrics being collected. The granularity of the collection process can be as fine as required to isolate problems, even down to collecting information about individual users, files or program statements.

What makes this announcement even more interesting is the core technology that ExtraHop uses to monitor network and application performance. ExtraHop's solutions are an interesting combination of capabilities for both network and application performance monitoring – the company provides appliances for passive monitoring of network traffic, but is different than traditional network visibility tools as it provides increased visibility into application performance, as well as the ability to monitor the impact of different infrastructure elements, such as storage or database, on application performance. The depth of information that ExtraHop's appliances capture and the fact that this information is captured in real-time make Application Inspection Triggers even more effective because of the flexibility of the metrics that organization are able to capture.

From an industry standpoint, there is no shortage of vendors that monitor application performance, but the real question is what capabilities really make the difference between seeing wider and deeper into the application infrastructure and having the ability to solve performance problems. In addition to ExtraHop, other vendors are realizing that what really makes the difference in performance management is how the data that is collected is being processed and presented to IT decision makers. A good example of a company that understands the value of making data relevant is SL Corporation, whose RTView product enables organizations to get more out of the data collected by their APM tools by aggregating it and providing an additional level of analysis and reporting. Another example is Prelert, who provides a solution that leverages data collected by other APM tools and applies a self-learning technology to improve the ability to troubleshoot and repair application performance issues.

The well-controlled and monitored application infrastructure that existed ten years ago has been replaced by a dynamic and sometimes unpredictable mixture of local servers, virtualized applications and the cloud. In order to be able to effectively manage these types of environments, organizations need to be able to do more than just monitor packets, servers or application components and ensure that performance data that is being delivered to IT staff is truly relevant. One of the key value propositions of business intelligence - the ability to deliver the right information to the right people at the right time -- is becoming a key differentiator for APM vendors and ExtraHop's recent announcement is a significant step in that direction.

 

 
Demystifying The Application Performance Market Calls for... An Application PDF Print
Written by Bojan Simic   
March 09, 2011

TRAC's recent article "Application Performance Management - The Journey of a Technology Label" talked about how diluted the APM space has became and that it is getting more difficult for end-user organizations to distinguish between vendors' marketing messaging and the true value that these solutions can deliver. Sometimes, we would get vendor requests for a call to discuss their latest customer win, selection process that an end-user organization went though and a type of IT environment that they are managing. The most impressive part about some of these calls is not necessarily how the vendor won that deal, but how some vendors they were competing against even got to be considered in that type of usage scenario.

Recently, we had two application monitoring vendors referring to the same competitor as a company that is "having more success against us than ever before" and "gets involved in some of our deals, but we very rarely see them win". On the other hand, when talking with end-users about the same product, the feedback that we get can range anywhere from them raving about the product to complaining about all of the "blind spots" that it leaves. So, is the solution that this vendor provides good or bad? It is actually very good when used for addressing problems that it was designed to address.

The application performance monitoring market has been growing very fast and some vendors are trying to grow their presence by going after nearly any environment that lacks visibility into application performance. This typically results in them sometimes getting invited to the table in usage scenarios where they have very little chance of winning, while it makes it more difficult for companies that could actually add value in those environments to fight through marketing noise and even be considered. The reality is that even though there are a lot of vendors that play in this space, due to new market dynamics, "shortlists" of vendors that can be truly effective in certain usage scenarios are sometimes very short.

To shed light on this issue, we have been interviewing end-user organizations and trying to find out what they really care about when evaluating technology vendors. The findings came down to three key areas: 1) fit for their IT environment; 2) problems that they are trying to solve; 3) product attributes that they are looking for. We also found significant differences between preferences of different job roles and companies that fall into different categories based on the size of the organization and the industry sector that they compete in. The list of individual criteria that impacts their selection processes was fairly long and SOME of them are listed below.

Table_for_APM_article

Our goal was to publish a study that would help end-user organizations make the correct decisions about selecting solutions for monitoring application performance that would be the best fit for their needs. However, the variety of their goals, selection criteria, types of IT environments and company profiles created a challenge of coming up with recommendations that would be truly relevant and actionable and not just a superficial overview of the market.

We realized that the complexity of the application performance space calls for a new report format and the idea for it came straight from our research. Many organizations are reporting that a Web browser is becoming the center of their IT performance efforts, as technology initiatives such as SaaS, IaaS and PaaS are changing how computing resources are being used and information is delivered to business users. As a result, we built a Web application for publishing the research findings that will allow end-user organizations to access information they really care about in a more interactive fashion.

With all due respect to good old PDF, there is too much complexity in the application performance monitoring market to fit research findings in a "one size fits all" publishing format and still make them actionable and relevant for different profiles of end-users. We have been advocating that information only has value if it is actionable and relevant so now it is time for us to "walk the walk".

If you are an end-user of IT performance technologies, we are interested in hearing your thoughts about the new report format before it gets published. TRAC will be hosting a series of demo presentations of the new report format and If you are interested in attending, please send a note to

 

 
Application Performance Management – The Journey of a Technology Label PDF Print
Written by Bojan Simic   
November 29, 2010

Industry analysts tend to classify vendors into technology "buckets" and create "labels" for each of them, as that makes it easier to compare products, capture key trends and provide context around problems that these products are addressing. This method also resonates with some technology marketers, as it allows them to partially benefit from promotions that other vendors and media are conducting around a label of a technology bucket their product was put into.

The term "application performance management" (APM) has been one of the hottest technology "labels" over the last few years. Performance of enterprise applications impacts nearly all of the key business goals, and it shouldn't come as a surprise that technology solutions for managing performance of these applications has been very high on IT agendas. With that said, it should be even less of a surprise that technology vendors, who are involved in managing the delivery of applications to business users in any way, realized this opportunity and started calling themselves "APM vendors". However, every "hot" industry term has an expiration date attached to it and sometimes it doesn't take long for a company to go from being one of the biggest promoters of an industry term to getting to the point where it doesn't even want to be associated with it.

Back in 2008, there were more than 50 technology vendors that used the term APM to position products that they provide and that number is now down to less than 30. So, had these 20+ companies gone out of business or completely changed their product portfolios? No, but they had realized that the term APM got diluted and that it is in their best interest to separate themselves from technologies that address the same problem as they do, only from a different perspective.

Emergence of new categories

Being thrown into the same technology bucket with companies that are addressing a similar problem from a different perspective could be a major challenge for many technology companies. Organizations that are in this position typically have two options: 1) wait until the market matures to the point when it becomes obvious that their solution is significantly different than other products in the same "bucket", or 2) coin a new term to describe a category in which their product belongs, promote the heck out of it and hope that it will become an industry accepted term. It took a combination of these two approaches to somewhat change the boundaries of the APM "bucket". That resulted in more market awareness about the differences between two groups of products that are also addressing challenges of managing application performance, but doing it from different perspectives: end-user experience monitoring and business transaction management (BTM).

The increased interest of end-user organizations in having visibility into how their applications are performing, not only from the perspective of their IT departments but from the perspective of business users, resulted in more market awareness about the role that end-user experience monitoring solutions are playing in managing application performance. The market matured enough to become more aware of the fact that different flavors of technologies for monitoring the quality of end-user experience, such as those provided by Aternity, Knoa Software, Coradiant or AlertSite, do not compete against, but complement vendors such as OPNET, OpTier or Quest's Foglight.

On the other side, vendors that specialize in managing application performance from a business transaction perspective also found a way to raise awareness about the differences between their solutions and many other APM products. This resulted in an increased adoption of the term BTM when describing capabilities of these solutions. These solutions are taking a different approach when addressing issues with application performance, as compared to some other APM vendors, and enable organizations to monitor the performance of applications across an entire transaction flow. Some of the vendors that fall in this group include OpTier, Nastel, INETCO, Correlsense, Precise Software, dynaTrace and AmberPoint (acquired by Oracle).

Read more...
 
Keynote Systems Partners with dynaTrace and OPNET; A Step Toward True End-to-End Visibility Into Application Performance? PDF Print
Written by Bojan Simic   
September 15, 2010

Today, Keynote Systems and dynaTrace announced a strategic partnership that would allow end-users to leverage these two solutions in an integrated fashion. This is the second strategic partnership that Keynote has created in this space over the last two months, as they formed a similar type of relationship with OPNET Technologies that was announced on July 22. These partnerships might be confusing to some, as it might seem that these three companies are essentially doing the same thing: to monitor the performance of business-critical applications. However, while Keynote is specializing in monitoring the quality of end-user experience and performance testing for Web applications from the outside of the corporate firewall, OPNET and dynaTrace provide solutions for monitoring application performance across enterprise infrastructure inside of the firewall.

The general perception of solutions for end-user experience monitoring, such as the one that Keynote is providing, is that they are very effective in identifying when business users are experiencing problems with application performance, but they are not as effective in drilling down into parts of the application delivery chain to isolate and resolve the root cause of the problem. On the other hand, tools for monitoring the performance of internal infrastructure, such as OPNET or dynaTrace, are able to monitor the transaction flow of applications across the network and into the data center, and provide a deeper dive into how applications are performing, what is causing performance problems and how they can be prevented and resolved. TRAC’s recent report “10 Things to Consider When Evaluating End-User Monitoring Solutions” revealed that the ability to integrate tools for monitoring the quality of end-user experience with tools for monitoring enterprise infrastructure is one of the key aspects of having full visibility into application performance. With that said, there is a clear value that end-user organizations can experience when products that include robust capabilities for application performance management (such as OPNET and dynaTrace) get integrated with one of the leading solutions for end-user experience monitoring from outside of the firewall (Keynote).

However, in order to evaluate a true significance of these partnerships, they should be analyzed in the context of some of the key dynamics in this market.

Read more...
 
2010 IT Performance Management End-User Survey: Background, Drivers and Key Takeaways PDF Print
Written by Bojan Simic   
August 08, 2010

In October of 2009, when we launched TRAC Research, we based our approach for covering IT performance management technologies on two advises that we were given by end-users:

  • Don’t evaluate products by throwing them into technology buckets, but talk about what these products can do in specific usage scenarios
  • Distinguish impactful from “cool” technologies, meaning discover what are the measurable business benefits from deploying a technology solution, not how “hot” the technology is

      We thought that the best approach for doing this would be to launch an end-user survey and ask folks that are using this technology what their experiences are. This is when things started to get really messy. Before we even formulated the questions, we conducted close to 150 interviews with end-users, executives of technology vendors, prominent writers and some true thought leaders in this space to make sure that the questions are spot on to what they care about. Just to clarify, none of us are rookies in this space and for me, this is the 18th survey of this type that I’ve created. Although, this time, launching the survey was more “interesting” than usual.

      Read more...
       
      10 IT Performance Management Companies Likely to Be Acquired in 2010 – Part 2 PDF Print
      Written by Bojan Simic   
      May 25, 2010

      One of the emerging trends in IT performance management is that the proliferation of SaaS and cloud computing technologies are changing how organizations go about using and managing IT services. These trends are adding a new dimension to service level and performance monitoring and organizations are increasingly expecting a similar level of flexibility from their management tools as they are getting from their SaaS and cloud deployments. This also opens up new opportunities for management vendors to differentiate themselves from the competition and increase their presence in new markets by acquiring technologies that are well positioned to address new management challenges.


      Our recent article highlighted two technology companies that are likely acquisition targets based on their technology, alignment with key market trends and the ability of their solutions to fill in technology and go-to-market gaps that larger vendors currently have. In part two of this series, we are covering two additional companies that meet the same criteria.

      Again, this listing is not based on any inside information.

      Read more...
       
      IT Tools That Talk to Each Other Make Performance Data More Actionable PDF Print
      Written by Bojan Simic   
      February 09, 2010

      One of the key questions in IT performance management is: Does an improved ability to collect more performance data generally lead to an improved performance of IT services? The answer is: No, not necessarily. Actually, a number of end-user organizations that I have spoken with reported that their ability to prevent and resolve performance issues deteriorated after they invested in additional monitoring tools. As new challenges of managing application performance “jump out”, organizations tend to deploy new point solutions that are addressing each of these problems. This does allow them to collect more information about these specific problems, but it doesn’t necessarily allow them to have  better control of the overall IT performance.

      Managing application performance is one of the key IT initiatives for end-users, but there is not a single class of technology or solution provider that can address every single issue of managing the performance of business-critical applications. Some major IT management vendors are investing significant resources in acquiring companies to enhance their product offering and enable them to tackle more performance challenges. However, the capabilities needed for end-to-end management of IT performance are rapidly changing and companies that are looking to provide capabilities for addressing each of the major IT management challenges are likely to keep playing “catch-up”. End-user requirements are changing at a pace that is faster than product development cycles or times needed for acquisitions to be initiated, agreed on and completed. So, are organizations that are looking to access all relevant IT performance data through a single platform are out of luck?

      Read more...
       
      How PowerPoint Fell in Love with “Aligning IT with Business” PDF Print
      Written by Bojan Simic   
      January 26, 2010

      Once in a while, IT management vendors pick up a theme that their customers are very interested in; they start building their marketing messaging around it, write white papers about it, and have it all over their websites. Before you know it, what originally was a legitimate request from end-user organizations for addressing challenges that they have, it becomes a marketing term that is very difficult to define for end-users. “Aligning IT with business” is becoming a very good example of that.

      The fact is, the majority of end-user organizations are still struggling to come up with a set of metrics that would help them understand how their IT initiatives are contributing to their business goals. These organizations are allocating a significant part of their enterprise budgets to their IT initiatives and they need to figure out:

      • How their past investments in IT are contributing to their bottom line
      • What criteria they should be using when evaluating the value of new technology investments
      • How to prioritize their current IT management initiatives

      So the need to align IT is a true pain point for end-user organizations and they are willing to invest in technology that will help them with that. But what technology is the best fit?

      Read more...
       
      How End-User Monitoring “Graduated” from APM PDF Print
      Written by Bojan Simic   
      December 07, 2009

      Over the last 2-3 years, the term “Application Performance Management” (APM) became an integral part of marketing messaging for more than 70 technology vendors. Even though solutions provided by all of these vendors are helping to improve the speed and availability of business-critical applications, these vendors are providing solutions that are significantly different. These solutions could range anywhere from network performance monitoring to application acceleration, Web management and even managed/carrier services.

      However, the APM as a general concept has become relatively easy for decision makers of end-user organizations to digest, as it hits all key pain points that IT organizations are dealing with. As a result, multiple vendors were more than happy to jump on this bandwagon and position themselves as players in this space.

      Other than the language in their press releases and marketing collateral, these vendors really have nothing else in common. Technology wise, how similar are the offerings of F5, NetQoS, Keynote Systems and OpTier? They are not similar at all.

      Read more...