The Deduplication Swindle?
Go back to 2009 and NetApp announced it was about to buy the rising star of Deduplication market Data Domain. The announcement was premature and EMC eventually pulled the rug from under their feet and ended up winning a hard fought battle consuming Data Domain into their Data Protection offering.
No doubt it has been a smart move for EMC, the battle was hard fought for a reason, Deduplication endorsed the EMC mantra of no tape and from published information it seems that Data Domain is a successful and growing revenue stream.
So if there is a swindle, where is it? Based on nothing more than anecdotal conversations with users of various deduplication technology, we see the problem tied up in the dark art of deduplication sizing.
When you look at the raw $ per raw disk capacity that is paid for a deduplication the price is huge. Of course if you understand deduplication its not about buying raw capacity its about compression ratios as they apply to backups.
The promise of deduplication is to store months or years worth of backup jobs on disk with ratios as high as 70:1.
However the truth is that it seems no one can ever say with any accuracy how the ratios will actually pan out and THAT is the issue. The high cost of a deduplication appliance is usually justified by showing savings over long periods such as five years. Experts “size” your requirements using methods that do not seem to be shared or open and come back with a capacity you will need that will house your backup data for the next 3 years or 5 years.
However, at Data&Storage Asean we have come across numerous IT managers that have made a deduplication investment based on this somewhat “mystical” projection only to find that the 5 years capacity they though they bought turned out to run out of space after a much shorter period.
It seems that the deduplication vendors are selling a future that cannot be substantiated, but once you invest in deduplication it is difficult to break out. If capacity runs out earlier than you had been led to believe your only option is to buy more deduplicated capacity or let more tape creep back into your backup processes.
Note, we have not done any objective study into this claim and we cannot prove that any specific deduplication vendor is “over promising” when they sell the technology. The suggestion that it may be happening is only based on anecdotal conversations. So if any of the de-duplication vendors can give us a different perspective we will be very happy to review and potentially publish it. Likewise if you are an IT manager that has experienced implementing deduplication and would like to share that experience (good or bad), please do contact us.
Contributor – Data&Storage Asean