When it comes to data, the days of equal rights are over.



The traditional thinking around business intelligence and analytics is that every piece of data must undergo thorough transformation and cleansing before entering the data warehouse. Today, this line of thinking has changed.

As BI tools have become increasingly available to all employees for many purposes, the rigid data transformation processes of the past have become overkill for some analyses. The concept of "just-in-time" data allows for the use of native data in a growing number of circumstances. Adopting this more flexible approach to BI can help organizations achieve broader adoption and faster results from their systems.

Let's start by taking a closer look at how companies have approached BI in the past.

The notion of ETL

Extract, transform and load (ETL) and data-quality processes have been used for years to bring disparate data together into a consistent format that supports end-user dashboards and analysis. The transformation aspect of ETL involves reformatting of the data, cleansing to remove duplicate copies and inconsistencies and integration on a common platform. This requires a significant amount of time from skilled developers and establishment of daily processing requirements so that reporting systems are up-to-date the next day. ETL is required for many types of analyses, but it's expensive and creates delays for all users, perhaps unnecessarily.

Some limitations of ETL include:

  • BI for the few: To support these additional processes, BI has traditionally been owned and controlled by IT workers who oversaw the sourcing of data and creation of reports, and/or by a handful of analysts whose full-time jobs were to prepare reports for management. This means that most employees don't benefit from better decision-making because they can't easily access data or create their own reports. Companies then wonder why they don't have a stronger ROI from their BI systems.

  • Volumes of data, slow analysis: Many organizations possess a total data volume in the hundreds of terabytes, and even approaching the petabyte mark. Yet it can take analysts hours, or even days depending on the backlog of requests, to deliver useful reports. These days, that's too slow for many competitive industries.

  • As Chuck Schweiger, business analyst with retailer Timbuk2, recently remarked in a case study: "Our [enterprise resource planning] system has a wealth of data, but there really was no easy way to get that data out and interact with it. Moreover, our prior reporting and analytics process was so full of handoffs that it was not a workable solution for today's on-demand, flexible, global business environment." Timbuk2 took a Software-as-a-Service BI approach to overcome this barrier.

  • Lost data, lost opportunities: Time and budget may not be available to transform all data, and ETL tools have a tendency to transform data beyond analytic needs. In other words, the actionable qualities observed in the data's original state may be lost as it becomes sanitized and rationalized for a higher-level database.

-1-

1  2  

   Next Page

Explore Our Topics

  • EDITOR'S BRIEFING
ebizQ editorial highlights and updates, compiled by Site Editor Anne Stuart
  • Today's trends: BPM suites are more popular than ever, according to recent BPTrends research. ebizQ Site Editor Anne Stuart shares highlights from the report.
  • Agility e-zine: Don't miss the second issue of ebizQ's new Business Agility Insights e-zine for updates on two key BPM standards and expert advice on decision management.
  • Burning question: How useful is BPM for addressing compliance issues? Join the discussion on the ebizQ Forum.
  • ebizQ editorial: Browse our collection of independent editorial content, including articles, tips, Q & As, podcasts, guest columns, book excerpts and more.
  • Want to contribute to ebizQ? Read our editorial guidelines,then contact Site Editor Anne Stuart (astuart@techtarget.com).
  • Virtual Conferences
  • Webinars
  • Roundtables

BPM in Action

March 10, 2011

The sixth annual BPM in Action 2011 Virtual Conference will explore cutting-edge market developments in BPM and describe how to leverage them for improved business operation and performance. More

View All Virtual Conferences

Best Practices in Moving Processes to the Clouds

Date:Apr 07, 2010
Time:13:00 PM ET- (17:00 GMT)

REGISTER TODAY!

How Can the Cloud Fit Into Your Applications Strategy?

Date:Apr 07, 2010
Time:12:00 PM ET- (16:00 GMT)

REGISTER TODAY!
View All Roundtables
  • Research Library
  • Podcasts
  • News

Joe McKendrick: Part II of II: Designing Evolve-ability into SOA and IT Systems

In part two of Joe McKendrick's recent podcast with Miko Matsumura, chief strategist for Software AG, they talk about how SOA and IT systems need to change and grow and adapt with the organization around it.

Listen Now

Phil Wainewright: Helping Brands Engage with Social Media

Phil Wainewright interviews David Vap, VP of products at RightNow Technologies, and finds out how sharing best practices can help businesses understand how best to engage with online communities.

Listen Now

Peter Schooff: Making Every IT Dollar Result in a Desired Business Outcome: Scott Hebner of IBM Rati

Scott Hebner, Vice President of Marketing and Strategy for IBM Rational, discusses a topic on the top of every company's mind today: getting the most from IT investments.

Listen Now

Jessica Ann Mola: Where Will BI Fit In? Lyndsay Wise Explains

In BI, this tough economy and the increasing role of Web 2.0 and MDM are certainly topics on people's minds today. WiseAnalytics' Lyndsay Wise addresses each of them in this informative podcast.

Listen Now

Dennis Byron: Talking with...Deepak Singh of BPM Provider Adeptia

Deepak Singh, President and CTO of Adeptia, joins ebizQ's Dennis Byron in a podcast that gets its hand around the trend of industry-specific BPM.

Listen Now
More Podcasts
  • Most Popular
  • Quick Guide
  • Most Discussed

Quick Guide: What is BPM?

Learn More

Quick Guide: What is Event Processing?

Smart event processing can help your company run smarter and faster. This comprehensive guide helps you research the basics of complex event processing (CEP) and learn how to get started on the right foot with your CEP project using EDA, RFID, SOA, SCADA and other relevant technologies. Learn More

Quick Guide: What is Enterprise 2.0?

A lot of people are talking about Enterprise 2.0 as being the business application of Web 2.0 technology. However, there's still some debate on exactly what this technology entails, how it applies to today's business models, and which components bring true value. Some use the term Enterprise 2.0 exclusively to describe the use of social networking technologies in the enterprise, while others use it to describe a web economy platform, or the technological framework behind such a platform. Still others say that Enterprise 2.0 is all of these things. Learn More


E-Zine: BPM Quarterly

This new publication from our sister site SearchSOA.com explores workflow, business activity monitoring (BAM) and complex event processing (CEP) issues.

Featured Bloggers

Peter Schooff's Latest Blog Posts:

Read Peter Schooff's Blog
Michael Poulin's Latest Blog Posts:

Read Michael Poulin's Blog
Scott Cleveland's Latest Blog Posts:

Read Scott Cleveland's Blog
Janne J. Korhonen's Latest Blog Posts:

Read Janne J. Korhonen's Blog
Adrian Grigoriu's Latest Blog Posts:

Read Adrian Grigoriu's Blog
Steven Minsky's Latest Blog Posts:

Read Steven Minsky's Blog
Anne Stuart's Latest Blog Posts:

Read Anne Stuart's Blog

View All ebizQ Bloggers