Web Performance Management Technology

DynaTrace AJAX Edition

2010-08-25T13:44:00.000-07:00

Whats a web KPI? Simply put, web Key Performance Indicators are measurements that tell you how you are doing against your objectives. The old saying "You can't improve what you can't measure" is more applicable than ever when doing business on the web. Website performance has increasingly become the "Secret Sauce" of doing business on the web, and as many of the Alpha Geeks have stated, speed should always be product feature #1.

At Velocity 2010 in San Jose, DynaTrace launched DynaTrace AJAX edition. This is a great tool for tracking website performance KPI's. DynaTrace has a great article on recommended web performance KPI's and a demo of the AJAX edition tool.

DynaTrace AJAX Edition

Velocity 2010 - Fast By Default

2010-06-30T05:23:00.000-07:00

Velocity 2010 is a wrap. In case you are not familiar with Velocity, this was its 3rd year. This conference brings the best minds and technology together in the web operations and performance management space and was totally sold out. Sponsors included the likes of Google, Gomez, Keynote, Yahoo, DynDNS, Strangeloop and Facebook.

Why should you care about a 1 second or even 500 Millisecond latency?

Because your competitors do!

Speed Matters! There is no more debate, no more theorizing, no more question. Speed effects your bottom line.

The Velocity Conference is all about speed and what can be done to squeeze out every ounce of speed for the end user.

From the Velocity web site:
Topics and Themes for Velocity 2010

Velocity attendees are a unique tribe of disaster gurus, special ops professionals, software developers, academics, sysadmins, developers, engineers, and more. They're the hidden heroes that keep the trains running on time, the people you call at 3 in the morning when your site is down. They're the most skilled at repeatedly rising to the challenge of finding answers to complex problems and are always on the leading edge of emerging technologies and solutions.

Velocity gives attendees access to speakers and the in-depth, technical content that will move the dial furthest for web ops and development professionals most responsible for the health of their company's IT infrastructure. Topics and themes we're focusing on in 2010 include:

Mobile Web Peformance
Multiple Data Center Management
Network Latency
Cloud Computing
Scalable Video and Social Gaming
HTML5
Configuration Management
Webcaching and Memecaching
Green Architecture
Metrics

Source: Velocity 2010 http://en.oreilly.com/velocity2010

What is Universal Mind ?

2010-06-16T16:31:00.000-07:00

Click here to view in full size on youTube.

http://www.universalmind.com/

Introducing Google Caffeine (now Kaffein) UNOFFICIALLY launched

2010-05-05T16:50:00.000-07:00

Matt Cutts (Google) blogged about Caffeine in Nov 2009, and it appears that google has been integrating the release of Caffeine (now Kaffein) gradually.

Starting on about April 1st, depending on your location on the planet, you may have seen some changes to your ranking.

Think your website speed doesn't matter? One of the new ranking factors with the rollout of Kaffein is speed. Kaffein incorporates a new speed ranking algorithm, and although google claims that this new factor only effects 1% or less of all search results, given that all other ranking factors are equal, your website speed will rank you above or below your competitors. Its a fact that bounce rates are higher amongst slower sites, and google factors this in as a less desirable search result. Cutts offers an explanation of speed based ranking and debunks a few misconceptions on his April 9 blog entry. "speeding up your website isn’t just something that can affect your search rankings–it’s a fantastic idea for your users".

Still don't think your site speed is that big of a deal? Lets talk about pay-per-click Ad-Words. I am getting reports from customers, that with the rollout of Kaffein, ad-words are costing more, and the additional cost is directly related to page speed. I have yet to verify this, but several marketing departments concur.

Google also seems to be ranking results and ads based on IP address geo-coding, meaning that relevancy now relates to your actual geographic location, or at least where google THINKS you are.

If you want to compare Kaffein results against the old google, check out http://www.comparecaffeine.com/ . Ranking differences seem to be fluctuating, indicating that google may still be tweaking the new algorithm.

Tools - "Site Performance" and "Page Speed" by Google

2010-03-03T09:14:00.000-08:00

Similar to Yahoo ySlow, Google labs provides "Page Speed" in their "Labs" section of "Site Performance" webmaster tools.

"Site Performance" trends and analyzes your site page performance while "Page Speed" evaluates performance from the client point of view and makes recommendations on how to improve the end user performance experience. These are extremely useful tools for tracking and improving your end user performance related experience.

http://code.google.com/speed/page-speed/

Gomez 2 Minute Explainer

2010-02-03T07:02:00.000-08:00

Gomez is the leader in Web Performance Monitoring. This 2 minute explainer lends great insight into their approach, and the importance of managing the web delivery chain.
http://www.gomez.com/resources/video-library/web-performance-monitoring-two-minute-explainer/

$$ Load Time is Money $$

2010-01-11T09:09:00.000-08:00

How much is your page load time costing you ? Gomez (Compuware) just launched a calculation tool. Plug in your numbers and see. http://www.compuware.com/fastcalc/

Fast or Furious?

2010-01-05T06:29:00.000-08:00

We made it past the holidays. Some on-line retailer's "got it" and some did not. Were your customers FAST or FURIOUS ?

Are you getting a failing grade ?

2009-12-10T06:58:00.000-08:00

One clear Google philosophy is that "form" never comes before function, and that FAST is king over nearly all other UI design requirements. If you want to grade your site performance and optimization levels quickly and easily, just load up the Yahoo "YSlow" add-on to Firebug in Firefox and you can now go around grading any site you like. It make's great suggestions for optimizing, or for which of your web developers to fire.

To quote the master performance expert Steve Souders

THE PERFORMANCE GOLDEN RULE: 80%-90% of the end-user response time is spent on the front-end. Start there.

Below I have compared both the Microsoft homepage and the google homepage. Notice that Microsoft nearly flunks out entirely when it comes to optimization. Its worth noting though, that when I ran the same test against the Microsoft Bing homepage, it got an "A".

In Search of... A better, faster, stronger Web

2009-11-20T09:43:00.000-08:00

This is a great presentation by Marissa Mayer (Google) on optimizing for speed, and evaluating how your users respond to different user experience experiments.

The Google search business generates $10 billion/year. In 1999, Google indexed 30 million pages. Today they index over 300 billion pages, and their concern about optimizing speed and the end user experience is more important than ever.

'Tis the season for..... Load Testing

2009-11-16T07:16:00.000-08:00

Holiday retail madness is coming at us fast. Is your site ready? Over the years I have load tested hundreds of sites for capacity planning and deployment readiness. Below are my top 10 tips for success in accurately measuring performance of your site.

Start off testing a single server, not the farm/cluster. Originate the load from the same network switch to remove all possible network latency. I prefer Silk Performer for this.
Test the application pages first. No assets, no images, no CSS, no .JS includes. Typically page generation by the application server bottlenecks long before the web server and static content. When doing this, hits/sec should equal pages/sec.
Initially make each test transaction a new user. This will aggressively show you what impact your session persistence has on server memory growth.
Test site content and order processing pages individually at first, then combine the tests. Order processing pages will always be more process intensive than site content that is most often cached by the app server, CDN, or on the client. Testing individually and then combined will show you how they impact each others page performance and define how you optimize going forward.
Stress test by eliminating simulated "Think Time". In early testing you need to focus on levels of concurrency, not total users on the site. Concurrency translates directly to maximum pages/sec, transactions/sec, and data throughput.
Under load/stress pay close attention to 3rd party resources (database). Understand what is responsible for increasing page generation response times. Allowed concurrency can be tuned on the app server to manage memory growth, CPU utilization, and 3rd party resource saturation. Request queuing is not bad and needs to be used to optimize and throttle request threading rather than letting unlimited requests eventually crush the server.
Endurance test. Test with high concurrency/load for 8 to 12 hours. Small memory leaks not previously seen will be found here. This is your stability certification.
Re-test with all page assets loading. Hits/sec will no longer equal pages/sec, note changes to CPU levels and page response times with all assets loading. Use these results to make client and CDN caching decisions.
Increase load and re-test with all servers in the farm/cluster. Pay special attention to what happens to the performance of 3rd party resources (database) now with all web servers under heavy load.
Test in the wild. Get outside the firewall/DMZ and test with Gomez Reality Load. Gomez Reality Load can send MASSIVE amounts real load from the internet to your site allowing you to fully test all components and hosts in your site and report performance on each host and asset. Your site pages and assets might run as expected under load, but will your 3rd party hosts? CDN providers, advertisers, page analytics plug-ins? At this point, take the opportunity to test your fail-over scenarios. Don't take anyone's "Word" for it. Fail-over strategies are like data backups. If you have not actually tested them in the wild, they don't work.

This is a very compressed top 10 with a lot of missing detail. If you would like to know more, feel free to contact me.

Do Small Changes in Performance Really Matter?

2009-11-11T06:42:00.000-08:00

The Velocity 2009 "Web Performance and Operations" conference took place in San Jose this year on June 22. Attending the conference were developers, engineers, and managers from companies of all sizes, focusing on web performance. So, do even the smallest changes in performance matter? Lets have a look at what some of the big players had to say.

Microsoft (Bing) found that 2 additional seconds in response time reduced the number of searches per user by 1.8% and decreased revenue per user by 4.3%.
Google found that a 400 millisecond delay resulted in 0.59% fewer searches per user and that even after the delay was removed, these users still had 0.21% fewer searches, indicating that a slower user experience affects long term behavior.
Shopzilla conducted a year-long performance redesign reducing response times by 5 seconds (from ~7 seconds to ~2 seconds) resulting in a 25% increase in page views, a 7-12% increase in revenue, and a 50% reduction in hardware.

Source: Steve Souders @Velocity Conference 2009
http://radar.oreilly.com/2009/07/velocity-making-your-site-fast.html

Brand Reputation. Who's Watching ?

2009-11-10T06:19:00.000-08:00

Assuming that brand reputation is important, every company must maintain some level of brand reputation management.   Although this might be the least concern of your IT operations manager and your developers, I guarantee its near and dear to the heart of your business owners, C level executives, and shareholders.

So who is watching? Who's keeping score ?     Gomez is!
I'll eventually do a complete Gomez breakdown, but for now you should know that Gomez Benchmarking is keeping score.   The old saying goes "You can't improve what you can't measure".   You might not be measuring, but somebody else surely is.

According to a report by the Aberdeen Group entitled “The Performance of Web Applications — Customers Are Won or Lost in One Second” one second delays in response time significantly impact top business goals.

One second delays can reduce:

page views by 11%
conversions by 7%
customer satisfaction by 16%

Who knows, maybe nobody will care that last quarter on-line sales were down by 2%, and that you ended up being the worst performer on this list. Still think you don't need a Performance Management Strategy ?

Do you have a Web Performance Management Strategy ?

2009-11-09T10:43:00.000-08:00

I have worked with internet technologies since long before the WWW gained household adoption. I've watched the internet and its usage evolve from VT100 emulation, WAIS, MUDS, and Gopher to the WWW as we all know it today. In 1994 the first online retailers appeared, and today this retail B2C market is responsible for $225 billion in revenue in the United States alone for 2009.

As with everything that changes or evolves, many themes stay the same. One constant challenge through this evolutionary time line has been developing and managing a better "end user" experience for website visitors. This topic can be broken into two categories. One category addresses the DESIGN of the actual user interface that provides the navigation and features of the end user experience. The other category addresses the PERFORMANCE experience, or in other words, how fast and reliable the end user experience is.

While working for Universal Mind Inc, and previously for Allaire and Macromedia. I have conducted hundreds of performance related engagements on web applications and retail sites ranging from performance and stability tuning to capacity planning and load testing. While both design and performance are critical to the end user experience, and ultimately translate into revenue for eCommerce and iBusiness stakeholders, I'll be focusing on performance management strategies and technology, because not even the coolest or most intuitive rich featured web applications will retain customers or sell products if the site is unreliable or painfully slow. Further more, speed (response time) is directly related to revenue conversion, capture and/or loss. Because your site was performing great today doesn't mean it was performing great yesterday, or last week, and it certainly doesn't mean it will perform well tomorrow, on Black Friday, or on Cyber Monday. Even a 1 second difference in the user experience can be connected to revenue.

You might have technical tools that measure performance points along your network layers, and you might have user analytics to tell you what parts of the site your users visit most, but if you are responsible for a business critical web application and don't have a comprehensive performance management strategy that provides meaningful visibility, trending, and instrumentation into site, page, and service level performance, your visibility into the end user experience, capacity planning, and associated revenue gain or loss is severely limited.

I'll address these concepts here in my blog, topic by topic. Enjoy!