DAN

Deduplication ANalyzer

Data Collector

collector: go through the trace and build the chunk, file, region, and container databases

refs_distrbution_exporter: go through the chunk/region/container database and print all reference numbers

refs_classifier.py: classify chunk/region/container according to reference numbers

refs_locality_exporter: go through the trace and output all reference numbers in logical or physical locality

refs_locality_correlation_calc.py: with the output of locality_sequence, calc the correlation coefficient of reference number
refs_locality_distance_analyzer.py: with the output of locality_sequence, calc the correlation coefficient of reference number

chunk_refs_distance_analyzer: go through the chunk database and calc the distance between chunk references
chunk_size_analyzer: go through the chunk database and calc the chunk size distribution, with different reference numbers

file_size_analyzer: go through the chunk and file database to get file size distribution
file_type_analyzer: go through the chunk and file database to get the fractions of popular file types
file_refs_source_analyzer: go through the chunk database and analyze the relationship between reference and file

Name		Name	Last commit message	Last commit date
Latest commit History 223 Commits
LICENSE		LICENSE
Makefile		Makefile
README.md		README.md
chunk_refs_distance_analyzer.c		chunk_refs_distance_analyzer.c
chunk_size_analyzer.c		chunk_size_analyzer.c
collector.c		collector.c
collision_detector.c		collision_detector.c
data.c		data.c
data.h		data.h
file_distinct_check.py		file_distinct_check.py
file_exporter.c		file_exporter.c
file_identical_check.py		file_identical_check.py
file_intra_redundacy_check.py		file_intra_redundacy_check.py
file_refs_source_analyzer.c		file_refs_source_analyzer.c
file_similar_check.py		file_similar_check.py
file_size_analyzer.c		file_size_analyzer.c
file_type_analyzer.c		file_type_analyzer.c
fslayout_generator.c		fslayout_generator.c
libhashfile.c		libhashfile.c
libhashfile.h		libhashfile.h
refs_classifier.py		refs_classifier.py
refs_distribution_exporter.c		refs_distribution_exporter.c
refs_locality_correlation_calc.py		refs_locality_correlation_calc.py
refs_locality_distance_analyzer.py		refs_locality_distance_analyzer.py
refs_locality_exporter.c		refs_locality_exporter.c
refs_locality_segment_analyzer.py		refs_locality_segment_analyzer.py
simd_exporter.c		simd_exporter.c
simd_reverse_exporter.c		simd_reverse_exporter.c
store.c		store.c
store.h		store.h