July 19, 2008   Sign In |  About ebizQ |  Contact Us |  Join ebizQ Gold Club
Business Performance and Optimization Syndicate This
Print this article    Email this article    Talk Back!    Write to Editor
The Danger of Placebo Metrics
02/14/2006
By John Stelzer, Director of Industry Development, Sterling Commerce

When I was fairly young, my father taught me a lesson that has proven valuable in business to this day. Although I was years away from driving age, I started to show an initial curiosity about cars. Recognizing my new interest, my dad took me with him to the local garage to pick up the family car after a tune-up.

ADVERTISEMENT
Our Popular Webinars
BPM for Financial Services
Roundtable Discussion: Open Source Market Update
Event-Driven SOA: The Best Practice of Advanced Architecture Teams
Evolving Security Architectures and SOA for Better Business Collaboration
Getting Started with BPM
More Webinars

I remember being shocked by the $25 bill for the service. [On my meager 25-cents-a-week allowance, this seemed like an expenditure that would require a lifetime of saving to be able to afford.] When I commented on the “mammoth” tab, my dad pointed out that the tune-up was essentially free because the money he would save from improved gas mileage would more than cover the cost of the service.

He explained that before the service, we were getting about 16 miles per gallon, and that it typically improved to 21 miles per gallon after a tune-up. Gasoline was selling at the exorbitant price of 29 cents per gallon in those days. [Yes, there really was a time when you could buy gasoline for only 29 cents a gallon; and yes, I’m old enough to remember it; and no, it wasn’t as far back as the old hand-cranked models, either!] My father went on to explain that given the number of miles we would likely drive before the next tune-up, we would save much more than the $25 we had just spent for the tune-up.

In those days, we drove the car about 10,000 miles a year. At 21 miles to the gallon, that required roughly 476 gallons of gas. At 16 miles per gallon, it would have required 625 gallons. The difference (149 gallons) would cost $43.21 at 29 cents a gallon. This was clearly more than the $25 he had just paid for the tune-up.

This marked the beginning of my understanding of several important concepts. First, I was going to have to earn a lot more than 25 cents a week if I was ever going to own my own car—even if tune-ups did eventually pay for themselves! Second, if you’re going to understand the impact of a change, you’ve got to take the appropriate measurements before and after the change. And third, if you measure the wrong things—even if you do it before and after the change—you won’t know the actual impact of the change.

These last two realizations are even more important today—now that organizations are pinning such high hopes on the likelihood of various forms of integration, automation, and collaboration producing significant business improvements. More than ever, when attempting to determine the business impact of one information technology initiative or another, there comes a point when organizations need to decide what they should measure to track success. All too often, those trying to calculate the cost/benefit of their process improvement initiative latch onto some statistic that measures something, but not something that matters…hence the name “placebo metrics.”

Page 1

More Top Stories
Federated Event Systems: The Event Web Gold Club Protected
Web 2.0: Coming Soon to an Enterprise Application Near You Gold Club Protected
Simplifying the Complex Gold Club Protected
Application Management: Consider the End User Gold Club Protected
A Look Back at 2007: Cutting Complexity Out of the Agile Organization Gold Club Protected
The Integration-Centric Business Process Management Suite Gold Club Protected
More Top Stories
Related News
Can SaaS, Open Source, and Appliances Save Search?
ASG's New Business Service Platform Solutions for Performance Management
IONA and Chariot Solutions Fuse with FUSE
More News
Subscribe to our Newsletters
ebizQ Weekly Gold Club Update
Live Webinar Updates
Updates from ebizQ Partners
ebizQ SOA Update
ebizQ BPM Update
ebizQ Security Update
ebizQ BI Update
ebizQ Open Source Software Update
Virtual Show Newsletter
ebizQ Web 2.0 and the Enterprise
Your E-mail Address:
Getting Started with BPM
Date: Jul 29, 2008
Time: 12:00 PM ET
(16:00 GMT)

REGISTER TODAY!
Evolving Security Architectures and SOA for Better Business Collaboration
Date: Aug 06, 2008
Time: 12:00 PM ET
(16:00 GMT)

REGISTER TODAY!
Archived Webinars | Upcoming Webinars
  ZapThink Report: Filling in the Pieces of the Service Lifecycle Puzzle - Mercury's Comprehensive Approach to the Service Lifecycle

As companies roll out their SOA offerings, they quickly realize that to achieve the benefits promised by SOA, they must manage and govern the...Learn More

ebizQ also recommends
 Optimal Service-Parts Management: Part One
 The Geek Gap: Do Suits Care?
 Collaboration and Social Media <i>Taking Stock of Today's Experiences and Tomorrow's Opportunities</i>
 BPM Done Right
 Mitigate Risk with Security Assessments
More White Papers

Marketing Solutions | Feedback | About ebizQ | Unsubscribe | Privacy Policy | Site Map

Live Chat