On April 4th, 2011, SmartBear Software enhanced its traditional focus on application testing and QA by acquiring AlertSite, a developer of application web performance monitoring and management tools. SmartBear's products emphasize the importance of managing the entire application lifecycle from code review to application profiling and automated testing for QA. By way of contrast, AlertSite is focused on synthetic monitoring and testing of web site performance. The product lines of both companies are complementary and together form a suite of applications that monitor and manage applications from inception to deployment and actual use.

This is a good move for SmartBear for several reasons. To begin, both companies have sizeable communities of users: SmartBear has a development and QA community of more than 100,000 users, while AlertSite's DejaClick has had more than 250,000 downloads, providing an opportunity to cross-sell and up-sell across both communities. While AlertSite's approach for monitoring Web performance has been resonating well with their customers, the company lacked resources to truly challenge companies that have been leaders in this space such as Gomez and Keynote Systems. Through this acquisition, AlertSite gains additional marketing muscle and research and development resources.

However, when you take a closer look into the product portfolios and strategies of these vendors, it becomes apparent that some of the key dynamics in the application management market are influencing this acquisition.

 --  The concept of a lifecycle of application performance management has been present in the market for some time and has been accepted mostly by vendors who provide solutions for application testing in pre-production. Vendors are becoming increasingly aware of the importance of providing solutions which identify how the lifecycle of application management affects both end-user experience and business goals.

This acquisition gives SmartBear opportunities that go well beyond extending their current community and creating new channels for AlertSite's products. SmartBear now has an opportunity to capitalize on market trends that call for a more user-centric approach throughout the entire lifecycle of application management. Taking advantage of these trends will require tighter integration with AlertSite's product portfolio, as well as building product capabilities that enhance their appeal to companies that are adopting a DevOps methodology.

Web performance has become critical to conducting business – nothing discourages customers or potential customers faster than poor website performance. However, TRAC's recent research shows that issues with the quality of end-user experience for websites occur 10 times more frequently than website outages. For that reason, organizations report losing twice as much revenue due to issues with end-user experience as they do for issues with site availability, proof that end-user experience should be at the core of application performance management initiatives. Including user experience in the entire lifecycle of application management should lead to better customer retention and increased revenue.

TRAC's recent article "Application Performance Management - The Journey of a Technology Label" talked about how diluted the APM space has became and that it is getting more difficult for end-user organizations to distinguish between vendors' marketing messaging and the true value that these solutions can deliver. Sometimes, we would get vendor requests for a call to discuss their latest customer win, selection process that an end-user organization went though and a type of IT environment that they are managing. The most impressive part about some of these calls is not necessarily how the vendor won that deal, but how some vendors they were competing against even got to be considered in that type of usage scenario.

Recently, we had two application monitoring vendors referring to the same competitor as a company that is "having more success against us than ever before" and "gets involved in some of our deals, but we very rarely see them win". On the other hand, when talking with end-users about the same product, the feedback that we get can range anywhere from them raving about the product to complaining about all of the "blind spots" that it leaves. So, is the solution that this vendor provides good or bad? It is actually very good when used for addressing problems that it was designed to address.

The application performance monitoring market has been growing very fast and some vendors are trying to grow their presence by going after nearly any environment that lacks visibility into application performance. This typically results in them sometimes getting invited to the table in usage scenarios where they have very little chance of winning, while it makes it more difficult for companies that could actually add value in those environments to fight through marketing noise and even be considered. The reality is that even though there are a lot of vendors that play in this space, due to new market dynamics, "shortlists" of vendors that can be truly effective in certain usage scenarios are sometimes very short.

To shed light on this issue, we have been interviewing end-user organizations and trying to find out what they really care about when evaluating technology vendors. The findings came down to three key areas: 1) fit for their IT environment; 2) problems that they are trying to solve; 3) product attributes that they are looking for. We also found significant differences between preferences of different job roles and companies that fall into different categories based on the size of the organization and the industry sector that they compete in. The list of individual criteria that impacts their selection processes was fairly long and SOME of them are listed below.

Our goal was to publish a study that would help end-user organizations make the correct decisions about selecting solutions for monitoring application performance that would be the best fit for their needs. However, the variety of their goals, selection criteria, types of IT environments and company profiles created a challenge of coming up with recommendations that would be truly relevant and actionable and not just a superficial overview of the market.

We realized that the complexity of the application performance space calls for a new report format and the idea for it came straight from our research. Many organizations are reporting that a Web browser is becoming the center of their IT performance efforts, as technology initiatives such as SaaS, IaaS and PaaS are changing how computing resources are being used and information is delivered to business users. As a result, we built a Web application for publishing the research findings that will allow end-user organizations to access information they really care about in a more interactive fashion.

With all due respect to good old PDF, there is too much complexity in the application performance monitoring market to fit research findings in a "one size fits all" publishing format and still make them actionable and relevant for different profiles of end-users. We have been advocating that information only has value if it is actionable and relevant so now it is time for us to "walk the walk".

If you are an end-user of IT performance technologies, we are interested in hearing your thoughts about the new report format before it gets published. TRAC will be hosting a series of demo presentations of the new report format and If you are interested in attending, please send a note to

Industry analysts tend to classify vendors into technology "buckets" and create "labels" for each of them, as that makes it easier to compare products, capture key trends and provide context around problems that these products are addressing. This method also resonates with some technology marketers, as it allows them to partially benefit from promotions that other vendors and media are conducting around a label of a technology bucket their product was put into.

The term "application performance management" (APM) has been one of the hottest technology "labels" over the last few years. Performance of enterprise applications impacts nearly all of the key business goals, and it shouldn't come as a surprise that technology solutions for managing performance of these applications has been very high on IT agendas. With that said, it should be even less of a surprise that technology vendors, who are involved in managing the delivery of applications to business users in any way, realized this opportunity and started calling themselves "APM vendors". However, every "hot" industry term has an expiration date attached to it and sometimes it doesn't take long for a company to go from being one of the biggest promoters of an industry term to getting to the point where it doesn't even want to be associated with it.

Back in 2008, there were more than 50 technology vendors that used the term APM to position products that they provide and that number is now down to less than 30. So, had these 20+ companies gone out of business or completely changed their product portfolios? No, but they had realized that the term APM got diluted and that it is in their best interest to separate themselves from technologies that address the same problem as they do, only from a different perspective.

Emergence of new categories

Being thrown into the same technology bucket with companies that are addressing a similar problem from a different perspective could be a major challenge for many technology companies. Organizations that are in this position typically have two options: 1) wait until the market matures to the point when it becomes obvious that their solution is significantly different than other products in the same "bucket", or 2) coin a new term to describe a category in which their product belongs, promote the heck out of it and hope that it will become an industry accepted term. It took a combination of these two approaches to somewhat change the boundaries of the APM "bucket". That resulted in more market awareness about the differences between two groups of products that are also addressing challenges of managing application performance, but doing it from different perspectives: end-user experience monitoring and business transaction management (BTM).

The increased interest of end-user organizations in having visibility into how their applications are performing, not only from the perspective of their IT departments but from the perspective of business users, resulted in more market awareness about the role that end-user experience monitoring solutions are playing in managing application performance. The market matured enough to become more aware of the fact that different flavors of technologies for monitoring the quality of end-user experience, such as those provided by Aternity, Knoa Software, Coradiant or AlertSite, do not compete against, but complement vendors such as OPNET, OpTier or Quest's Foglight.

On the other side, vendors that specialize in managing application performance from a business transaction perspective also found a way to raise awareness about the differences between their solutions and many other APM products. This resulted in an increased adoption of the term BTM when describing capabilities of these solutions. These solutions are taking a different approach when addressing issues with application performance, as compared to some other APM vendors, and enable organizations to monitor the performance of applications across an entire transaction flow. Some of the vendors that fall in this group include OpTier, Nastel, INETCO, Correlsense, Precise Software, dynaTrace and AmberPoint (acquired by Oracle).

Today, Keynote Systems and dynaTrace announced a strategic partnership that would allow end-users to leverage these two solutions in an integrated fashion. This is the second strategic partnership that Keynote has created in this space over the last two months, as they formed a similar type of relationship with OPNET Technologies that was announced on July 22. These partnerships might be confusing to some, as it might seem that these three companies are essentially doing the same thing: to monitor the performance of business-critical applications. However, while Keynote is specializing in monitoring the quality of end-user experience and performance testing for Web applications from the outside of the corporate firewall, OPNET and dynaTrace provide solutions for monitoring application performance across enterprise infrastructure inside of the firewall.

The general perception of solutions for end-user experience monitoring, such as the one that Keynote is providing, is that they are very effective in identifying when business users are experiencing problems with application performance, but they are not as effective in drilling down into parts of the application delivery chain to isolate and resolve the root cause of the problem. On the other hand, tools for monitoring the performance of internal infrastructure, such as OPNET or dynaTrace, are able to monitor the transaction flow of applications across the network and into the data center, and provide a deeper dive into how applications are performing, what is causing performance problems and how they can be prevented and resolved. TRAC’s recent report “10 Things to Consider When Evaluating End-User Monitoring Solutions” revealed that the ability to integrate tools for monitoring the quality of end-user experience with tools for monitoring enterprise infrastructure is one of the key aspects of having full visibility into application performance. With that said, there is a clear value that end-user organizations can experience when products that include robust capabilities for application performance management (such as OPNET and dynaTrace) get integrated with one of the leading solutions for end-user experience monitoring from outside of the firewall (Keynote).

However, in order to evaluate a true significance of these partnerships, they should be analyzed in the context of some of the key dynamics in this market.

Over the last 2-3 years, the term “Application Performance Management” (APM) became an integral part of marketing messaging for more than 70 technology vendors. Even though solutions provided by all of these vendors are helping to improve the speed and availability of business-critical applications, these vendors are providing solutions that are significantly different. These solutions could range anywhere from network performance monitoring to application acceleration, Web management and even managed/carrier services.

However, the APM as a general concept has become relatively easy for decision makers of end-user organizations to digest, as it hits all key pain points that IT organizations are dealing with. As a result, multiple vendors were more than happy to jump on this bandwagon and position themselves as players in this space.

Other than the language in their press releases and marketing collateral, these vendors really have nothing else in common. Technology wise, how similar are the offerings of F5, NetQoS, Keynote Systems and OpTier? They are not similar at all.