v0.1.4

What's Changed

• Fix calling async from sync inside async runtime by @seanses in #170
• Make CasObject serde::Serializable by @znation in #172
• Removed unused parts of the remote shard interface. by @hoytak in #175
• Adding request_id to logs from CAS requests by @jgodlew in #173
• Shard query resilient to shard file deletion by @seanses in #174
• only store compressed chunk if the compressed chunk is smaller by @assafvayner in #177
• Consolidate local client testing code into local_client.rs by @hoytak in #178
• Rename data processing class names to reflect functionality by @hoytak in #176
• Fix cas chunk header validation bug by @seanses in #181
• Use KL divergence on bg4 groups to choose compression scheme by @hoytak in #179
• Clean up global dedup query API by @hoytak in #180
• Xorb Format Upgrade by @hoytak in #182
• Fix validating v0 xorb bug by @seanses in #184
• Fix parsing v0 xorb again by @seanses in #185
• Validate the unpacked chunk offsets by @seanses in #186
• Add back repo_type for compat by @seanses in #187
• Adds support cache dir config via env variable by @rajatarya in #188
• Releasing version 0.1.4 by @rajatarya in #191

New Contributors

• @znation made their first contribution in #172

Full Changelog: v0.1.3...v0.1.4

v0.1.3

What's Changed

• Profiler by @hoytak in #143
• feat: client telemetry by @port8080 in #121
• missing files from previous push by @port8080 in #145
• in-memory MDBShardFile cache. by @hoytak in #144
• Download benchmark results: set concurrent range gets to 8 by @assafvayner in #146
• Reduce memory usage by @seanses in #148
• Compress models better by @seanses in #130
• Remove small file passthrough by @ylow in #149
• Fix ubuntu aarch64 build by @seanses in #152
• Added base64 util to DataHash by @hoytak in #153
• Move Threadpool class to separate module by @hoytak in #151
• Separation of shard and cache directories by endpoint. by @hoytak in #154
• chunk cache change hash to checksum by @assafvayner in #156
• Fixing clippy issues present in upgraded rust version by @hoytak in #155
• check max chunk nums by @assafvayner in #158
• Simplify shard manager by @hoytak in #157
• Fragmentation Prevention by @ylow in #147
• Avoid uploading empty xorbs. by @hoytak in #161
• Caching system for shard file manager by @hoytak in #159
• Get repo_type from caller by @seanses in #160
• Up the chunk deduplication size. by @hoytak in #163
• Migration utility by @seanses in #150
• cache gets verifies crc checksum on stored cache items by @assafvayner in #164
• Wrap cache reader in BufReader for speed. by @hoytak in #166
• Expose a convenient function to migrate files in repo scanner by @seanses in #167
• singleflight remove explicit threadpool by @assafvayner in #169
• hfxet 0.1.3 by @assafvayner in #171

New Contributors

• @ylow made their first contribution in #149

Full Changelog: v0.1.2...v0.1.3

v0.1.2

What's Changed

• disable client telemetry by default by @assafvayner in #142

Full Changelog: v0.1.1...v0.1.2

v0.1.1

What's Changed

• Deadlock fix. by @hoytak in #140
• Update Cargo.toml to version 0.1.1 by @rajatarya in #141

Full Changelog: v0.1.0...v0.1.1

v0.1.0

What's Changed

• Only load the shard chunk dedup tables for the upload path by @hoytak in #129
• Drop xet_error. by @hoytak in #134
• Drop on shard_file_manager issues warning in debug mode instead of error. by @hoytak in #128
• Added CoC, contribution guide, and updated readme by @rajatarya in #133
• CI & Release GH Action updates by @rajatarya in #135
• Update release.yml, fix GH publish by @rajatarya in #136
• GitHub release + PyPi publishing by @rajatarya in #137
• Update release.yml by @rajatarya in #138
• Update release.yml by @rajatarya in #139

Full Changelog: v20241218-00-dedup-upload-ctrlc...v0.1.0

v20241218-00: Dedup fixes, Upload Progress Bar, CTRL+C cancellation

What's Changed

• Universal Build WHL instructions by @rajatarya in #116
• remove x86 as a linux target by @jgodlew in #117
• remove vendored feature from x86_64 by @jgodlew in #118
• Parallelize xorb upload by @seanses in #98
• add BatchQueryReconstructionRequest by @assafvayner in #123
• upload progress bar work by @assafvayner in #120
• Update threadpool by @hoytak in #122
• Skip register shard that are already registered by @seanses in #127
• Python CTRL-C cancellation by @hoytak in #119

Full Changelog: v20241211-00-throughput-ux...v20241218-00-dedup-upload-ctrlc