We use cookies and other similar technologies (Cookies) to enhance your experience and to provide you with relevant content and ads. By using our website, you are agreeing to the use of Cookies. You can change your settings at any time. Cookie Policy.

Untitled Document As the amount and types of data that constitute an organization's information increases exponentially, it becomes more difficult to manage and protect that data. Data deduplication technology, which is maturing in the backup space and emerging in nearline and primary storage solutions, is becoming a necessity for any organization managing large amounts of data. But why is data deduplication so critical? Simple: it has the potential to change the economics of data management and data protection solutions by greatly reducing the costs of storing and transferring data.

An IT manager drawn to the promise of deduplication will want to know how data deduplication delivers disruptive benefits, how it compares to other reduction technologies, what its limitations are and what customers must know when deploying deduplication solutions.

Deduplication compared to other data reduction technologies

First-generation data reduction technologies such as data compression and file single instancing have been available for some time and have been widely adopted. Although these technologies can reduce data footprint and transfer costs, these gains are modest, usually in the range of 2-8X.

The goal of most compression schemes is to reduce the footprint of a single file by removing redundancies and efficiently encoding the results. Little is done to address duplicate or versioned files. Emerging application-aware compression technologies can deliver significantly improved reduction rates for narrow classes of data, but often with significant performance penalties and little or no improvement handling cross-file redundancies.

The goal of file single instance storage (SIS) technologies is to reduce the data footprints of a repository by eliminating redundant files and replacing them with references. But file level SIS does little to reduce the footprint of a single file and doesn't handle sub-file redundancies. Block level SIS technologies improve reduction ratios by eliminating duplicate fixed length blocks across files in a repository, but results are still limited. File level changes that affect data alignment (e.g. byte insertions) typically defeat fixed block schemes. Related, redundant data in dissimilar files are rarely suitably block aligned, further limiting block level SIS technologies, making them a poor choice for versioned environments.


1  2  3  4  5  

   Next Page

Explore Our Topics

  • Virtual Conferences
  • Webinars
  • Roundtables

BPM in Action

March 10, 2011

The sixth annual BPM in Action 2011 Virtual Conference will explore cutting-edge market developments in BPM and describe how to leverage them for improved business operation and performance. More

View All Virtual Conferences

Smart Case Management: Why It's So Smart.

Date:Nov 05, 2009
Time:12:00 PM ET- (17:00 GMT)


Date:Oct 29, 2009
Time:15:00 PM ET- (19:00 GMT)

View All Roundtables
  • Research Library
  • Podcasts
  • News

Joe McKendrick: Part II of II: Designing Evolve-ability into SOA and IT Systems

In part two of Joe McKendrick's recent podcast with Miko Matsumura, chief strategist for Software AG, they talk about how SOA and IT systems need to change and grow and adapt with the organization around it.

Listen Now

Phil Wainewright: Helping Brands Engage with Social Media

Phil Wainewright interviews David Vap, VP of products at RightNow Technologies, and finds out how sharing best practices can help businesses understand how best to engage with online communities.

Listen Now

Peter Schooff: Making Every IT Dollar Result in a Desired Business Outcome: Scott Hebner of IBM Rati

Scott Hebner, Vice President of Marketing and Strategy for IBM Rational, discusses a topic on the top of every company's mind today: getting the most from IT investments.

Listen Now

Jessica Ann Mola: Where Will BI Fit In? Lyndsay Wise Explains

In BI, this tough economy and the increasing role of Web 2.0 and MDM are certainly topics on people's minds today. WiseAnalytics' Lyndsay Wise addresses each of them in this informative podcast.

Listen Now

Dennis Byron: Talking with...Deepak Singh of BPM Provider Adeptia

Deepak Singh, President and CTO of Adeptia, joins ebizQ's Dennis Byron in a podcast that gets its hand around the trend of industry-specific BPM.

Listen Now
More Podcasts
  • Most Popular
  • Quick Guide
  • Most Discussed

Quick Guide: What is BPM?

Learn More

Quick Guide: What is Event Processing?

Smart event processing can help your company run smarter and faster. This comprehensive guide helps you research the basics of complex event processing (CEP) and learn how to get started on the right foot with your CEP project using EDA, RFID, SOA, SCADA and other relevant technologies. Learn More

Quick Guide: What is Enterprise 2.0?

A lot of people are talking about Enterprise 2.0 as being the business application of Web 2.0 technology. However, there's still some debate on exactly what this technology entails, how it applies to today's business models, and which components bring true value. Some use the term Enterprise 2.0 exclusively to describe the use of social networking technologies in the enterprise, while others use it to describe a web economy platform, or the technological framework behind such a platform. Still others say that Enterprise 2.0 is all of these things. Learn More