We use cookies and other similar technologies (Cookies) to enhance your experience and to provide you with relevant content and ads. By using our website, you are agreeing to the use of Cookies. You can change your settings at any time. Cookie Policy.

James Taylor's Decision Management

James Taylor

ETL and Decisioning

Vote 0 Votes

I was talking with an analyst about possible uses of business rules and other decisioning technology and an example came up where a customer was using ETL (Extract Transform Load) technology and business rules. The particular customer is using an ETL product to data cleanse all incoming transactions from over 50 supplying systems and is then applying a business rules engine as a ‘routing engine’ for transactions. The complexity of the business rules goes way beyond what the ETL tool could offer on data transformation, hence the mixed ETL-BRE implementation. A particularly important aspect was the manageability of the rules as they expect to implement up to 150,000 accounting rules! The ETL handles the standardization of the data and the mapping into a Generic Object to which the rules are applied. The resulting object(s) are then picked up by the ETL tool and loaded in the General Ledger and data warehouse.

So when might you want to combine ETL technology with decisioning technology:

  • When you have a very large number of transformation rules such that rule management, not transformation, is the biggest issue
  • When you want to have the same rules run in transformation processes and other business processes
  • When you want to have business experts not technical ones maintain some of the rules
  • When you want to use analytics, especially predictive analytics, as part of your transformation process

ETL tools do a great job of transformation most of the time. When they run out of steam, think about business rules.

Sorry for the low rate of posting - been a quiet week in terms of things to blog about.

1 Comment

Extract, transform, load and manage data from single environment through best etl tools / software which provides rapid improvement in data warehousing process.

James Taylor blogs about decision-management technologies such as predictive analytics and business rules, discussing how they deliver agility, improve business processes and bring intelligent automation to SOA.

James Taylor

James Taylor blogs on decision management for ebizQ, and is an independent consultant on decision management, predictive analytics, business rules, and related topics.

Sponsored Links



 Subscribe to this blog by RSS
Subscribe by email:

Recently Commented On

Recent Webinars

    Monthly Archives