Chunking Algorithm for Data Deduplication in cloud Storage. Data Deduplication is technique to remove redundant data from incoming data stream. Deduplication has four stages, namely 1]Chunking 2]Fingerprinting 3]Indexing and 4]Writing. I am working on chunking algorithm.
Chunking is use process to chunk the incoming data into small chunks. There are many algorithm available for chunking, namely AE, TTTD, MAXP, Rabin etc.
My aim is to develop a efficient chunking algorithm.
I have uploaded some algorithm papers , go through it. I am working on AE algorithm see attach document for more information. I want this project in C++/C language.
Go through this link where the code for AE and TTTD algorithm is given, [url removed, login to view] but i am unable to run it.
If you have any suggestion or query please message me.