Skip to content

swatisinghi/qubole

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 

Repository files navigation

A file system is used to store the data that is entered. A master index is used to store the unique id that is returned as a result of the put operation against the file name, file data check sum and number of references to the file.

The checksum and the references is used to implement the de-duplication and the lazy deletion of the files in the background, as a result of which only one copy of data is stored in the file system until all the references to the file are deleted, and all the ids corresponding to a given data point to the same file stored in the file system.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages