Skip to content
forked from fomy/destor

An experimental platform for chunk-level data deduplication. Key words: DDFS, Sparse Index, Extreme Binning, SiLo, Sample Index, BLC; CBR, CFL, CAP, HAR; ASM, OPT; GC, Cumulus

Notifications You must be signed in to change notification settings

zhangchunzhong/destor

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

General Information

Porting Destor form C (https://github.com/fomy/destor) to rust.

Destor is a platform for data deduplication evaluation.

Features

  1. Container-based storage;
  2. Chunk-level pipeline;
  3. Fixed-sized chunking, Content-Defined Chunking (CDC) and an approximate file-level deduplication;
  4. A variety of fingerprint indexes, including DDFS, Extreme Binning, Sparse Index, SiLo, etc.
  5. A variety of rewriting algorithms, including CFL, CBR, CAP, HAR etc.
  6. A variety of restore algorithms, including LRU, optimal replacement algorithm, rolling forward assembly.

Related papers

see doc/README.md

Environment

Linux Mint 20

Build

Follow the steps in page https://is.gd/c_rust

INSTALL

#install openssl
sudo apt-get install -y libssl-dev
#install glib-2.0
sudo apt-get install -y libglib2.0-dev
#install rust
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh

Running

see doc/README.md

Configuration

see doc/README.md

Author

Julian Zhang Email : zczxyz at 126.com

About

An experimental platform for chunk-level data deduplication. Key words: DDFS, Sparse Index, Extreme Binning, SiLo, Sample Index, BLC; CBR, CFL, CAP, HAR; ASM, OPT; GC, Cumulus

Resources

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C 90.8%
  • Shell 7.0%
  • Other 2.2%