Forrester Warns Data Explosion Is Increasing the Compliance Gap

08/20/2008

According to a new report by analysts Forrester Research, businesses are exposing themselves to increasing operational risk and costs because of inadequate database archiving strategies.



ebizQ received the following:

Archive store specialists Clearpace say that this adds to an increasing body of evidence that shows it is critical that IT managers place the same priority on the long term retention and retrieval of structured data, as they do on managing email and document archives.

Report highlights include:

  • 50% annual growth is reported in online transactional data and repositories


  • 27% of enterprises surveyed have 50 or more terabyte production databases


  • 64% of enterprises surveyed have over half of their databases on costly tier 1 storage


  • 20% of data centre infrastructure spend is to support data growth



In the report, Noel Yuhanna, Principal Analyst Forrester Research says "Database archiving often fails to get the attention it needs compared to other critical activities related to production databases and data warehouses." He continues, highlighting the compliance pressures now being faced, "An archival system becomes critical when you need to access archived information in response to a legal summons, customer service issue, security investigation or technical issue. The value of archiving grows considerably as it becomes easier to access the archived data."

John Bantleman, CEO of Clearpace, who commissioned the research, said, "With legal demands for access growing conventional approaches to database archiving are increasingly being found lacking. They focus on lifting and shifting inactive data from production databases to improve application performance, without considering how to optimize the way archived data is stored. Get your archiving right and you reduce storage costs and guarantee, simple, future-proofed access. Get it wrong and at worst you could face prison."

Clearpace's view is supported by Forrester Research's report, "Why Database Archiving Should Be Part of Your DBMS Strategy.", which highlights the viewpoint that archiving approaches need to advance from simply considering how to select and move data into an archive to encompass specialised archive repositories that ensure data integrity, security and availability.

The independent researchers questioned 150 senior IT executives evenly split across the US and UK. The responses indicate that the volume of enterprise data is growing at 50% per annum, driven by a new-generation of applications together with a strong demand to retain data for business analytics and trend analysis. 75% of the survey respondents state that they are now managing 10 or more databases of at least 1 terabyte. This growth is causing serious performance and storage challenges.

Typically 85% of production data is comprised of inactive records. With 64% of respondents saying that their enterprises have over half of their databases residing on expensive tier one storage solutions, the costs of holding inactive data in this environment are significant and unnecessary.

Understanding this, many enterprises are identifying and moving inactive data from the production database into traditional archives such as tape storage, XML files or another database on lower tier storage. With each of these types of archive, little or no emphasis is placed on maintaining long term integrity or usability of the archived data. Data retrieval times for data stored offsite on tape for example are typically measured in days, if not several weeks. Furthermore the costs of dedicating developer resource to rebuild systems and data structures can outweigh the value that was supposed to be safeguarded by purging the production database. In contrast, shifting data to an archive RDBMS adds complexity and requires resources similar to production databases for ongoing support - hence it rarely fully achieves the desired cost savings.

According to Forrester's survey, the top two drivers of archiving strategies were regulatory compliance and business requirements. With national and supranational government regulations requiring enterprises to store specific information such as call records for several years, and increasing business demands for access to historical information, it is easy to see why.

"IT managers need to achieve a balance between the compliance demands for retention and the business demand for economical storage and retrieval. Current database management system technology is optimised for transactional processing, data warehouses are optimised for analytics but both fail to adequately address archiving needs. Worse still the lines between archive stores and backup, which have very different drivers and requirements, are all too often blurred." says John Bantleman. He continues, "Forrester's research clearly illustrates the need for the new generation of archive stores. These deliver both massive reductions in storage footprints, through data compression, together with the security, immutability and point-in-time query capability that enables quick, simple and unimpeachable fulfilment of regulatory obligations."

  • ebizQ Update
  • Contribute

Please pardon our appearance while we work out the remaining kinks of our new site. If you happen to find a bug, please let us know at support@ebizq.net

ebizQ is very interested in what you have to say. To contribute an article, an opinion, or to become a blogger, please contact Peter Schooff.

  • Virtual Conferences
  • Webinars
  • Roundtables

SOA In Action

Nov 19, 2008

This conference will teach business leaders what to expect, and what to avoid, to make their SOA journey a success. SOA is a long journey, not a single project, and distributed architectures are inherently complex. Success requires new ways of working, creating more efficient cross organization processes, adopting new tools, and building new skills.Register

View All Virtual Conferences

Create a Center of Excellence in SOA Governance


Date: Dec 02, 2008

Time: 12:00 PM ET- (17:00 GMT)

REGISTER TODAY!

Next-Generation BI


Date: Dec 03, 2008

Time: 12:00 PM ET- (17:00 GMT)

REGISTER TODAY!
View All Webinars

Create a Center of Excellence in SOA Governance


Date:Dec 02, 2008

Time:12:00 PM ET- (17:00 GMT)

REGISTER TODAY!

Next-Generation BI


Date:Dec 03, 2008

Time:12:00 PM ET- (17:00 GMT)

REGISTER TODAY!
View All Roundtables
  • White Papers
  • Podcasts
  • Blogs

Dennis Byron: Revisiting Bill Miller of XAware, Open Source Data Integration Software

Almost a year after their first chat, XAware founder and CTO Bill Miller gives Dennis Byron an update on what's going on this year at XAware and how that "open source thing" is working out.

Listen Now

The Acceleration of SOA: iTKO Explains

Listen to Peter Schooff's podcast with Jason English, VP of Corporate Marketing for iTKO, where they offer a quick preview of ebizQ's upcoming SOA in Action Virtual Conference on Nov. 19.

Listen Now

Heading Off SOA Disillusionment With Progress

David Bressler provides Progress Software's customers and field teams with the expertise and experience to deliver SOA. In this podcast, Bressler gives an excellent introduction to ebizQ's Nov. 19 SOA in Action Virtual Conference, where he'll be a featured speaker.

Listen Now

Dennis Byron: VP of IONA/Progress Larry Alston on Functionality in OSS

Hear Larry Alston's unique perspective on the open source development model and how IONA is adopting a "functionality rules" open-source-as-a-tactic theme now that Iona is part of Progress.

Listen Now

Mike Rothman: Understanding Web 2.0 Attacks

In this podcast, Rothman flies solo and rants about Web 2.0 attack vectors, providing a primer on the types of attacks you're likely to see from social networks. Rothman also gives himself the "free association" treatment, discussing topics like Facebook and the impact of Web 2.0 on PCI.rnrnListen to or download the 11:39 minute podcast below:

Listen Now
  • Most Read
  • Most Discussed
  • Quick Guide

Building The Instantly Responsive Enterprise

Integrating BPM and CEP gives you intelligent business processes that can react to rapidly changing business conditions with continuous visibility. Learn More

Enterprise Linkage: New Change Management

Insurers need to think about creating "true linkage," which means linking business strategy to process to IT investments and thereby setting the foundation for true change. Learn More

The Invisible Hand of BI

To be effective, business intelligence technology must work behind the scenes to deliver relevant information when, where, and how it's needed. Learn More

Quick Guide: What is Enterprise 2.0?

A lot of people are talking about Enterprise 2.0 as being the business application of Web 2.0 technology. However, there's still some debate on exactly what this technology entails, how it applies to today's business models, and which components bring true value. Some use the term Enterprise 2.0 exclusively to describe the use of social networking technologies in the enterprise, while others use it to describe a web economy platform, or the technological framework behind such a platform. Still others say that Enterprise 2.0 is all of these things. Learn More

Quick Guide: What is BPM?

Learn More

Quick Guide: What is Event Processing?

Smart event processing can help your company run smarter and faster. This comprehensive guide helps you research the basics of complex event processing (CEP) and learn how to get started on the right foot with your CEP project using EDA, RFID, SOA, SCADA and other relevant technologies. Learn More

Product Spotlight

As you may know, technology is only part of an overall SOA governance solution. It is sometimes difficult to ensure visibility into all SOA assets and their relationships, end-to-end governance throughout the lifecycle of SOA assets, and analytics to help ensure organizations are reaping the rewards of their SOA investments. Download this spotlight report to review a solution to governing your SOA.

The Forrester Wave: Business Process Management for Document Processes

Read this Forrester report to see how vendors stack up regarding business process management. Forrester evaluated eight business process management suite (BPMS) suppliers best suited and most experienced for document-intensive processes across approximately 150 criteria. Download this paper to find out which BPM tools are right for your business.

Community Managers

Peter Schooff

Peter Schooff is Managing Editor at ebizQ. Peter is also a popular blogger in the IT Security space, where he keeps an eye on security trends critical to protecting applications and locking down identities.

Read Peter Schooff's Blog
Peter Schooff's Features:
Read More »

Phil Wainewright

A preeminent authority on emerging trends in business automation, Phil Wainewright is Community Manager for Leveraging the Connected Web. This community covers Enterprise 2.0, Mashups, Cloud, SaaS, Web Content and Social Networking, among other topics.

Read Phil Wainewright's Blog
Phil Wainewright's Features:
Read More »

Joe McKendrick

Author and consultant Joe McKendrick is Community Manager for Enabling Business Agility and Reuse . This community focuses on SOA, EDA/CEP, ESB, Open Source, Event Processing, Web Services, Application and Web Servers, and Legacy Integration, among other topics.

Read Joe McKendrick's Blog
Joe McKendrick's Features:
Read More »

Dennis Byron

Dennis Byron brings three decades as a top analyst to his role as Community Manager for Improving Business Processes. This community encompasses Business Process Management (BPM), Process Modeling, Process Analysis, and Business Alert Monitoring (BAM), among other topics.

Read Dennis Byron's Blog
Dennis Byron's Features:
Read More »

Ronan Bradley

Financial services expert Ronan Bradley is Community Manager for Financial Services covering banking and capital markets.

Read Ronan Bradley's Blog
Ronan Bradley's Features:
Read More »

David A. Kelly

With twenty years on the cutting edge of enterprise infrastructure, David A. Kelly is Community Manager for Governing the Infrastructure. This category includes IT governance, SOA governance, and compliance, risk management, ITIL, business service management, registries and more.

Read David A. Kelly's Blog
David A. Kelly's Features:
Read More »

View All Community Managers