Refactor recompress_chunk() API

This patch will improve performance of recompress_chunk() API by identifying only affected segments which needs to be recompressed. All unaffected segments are never decompressed. If affected compressed segments exceeds a certain limit we fallback to legacy way of recompressing, where we decompres all compressed segments and recompress them. Fixes #392
timescale · Sep 3, 2023 · d373115 · d373115
1 parent c6a9308
commit d373115
Show file tree

Hide file tree

Showing 14 changed files with 3,387 additions and 628 deletions.
diff --git a/.unreleased/feature_5867 b/.unreleased/feature_5867
@@ -0,0 +1 @@
+Implements: #5867 Refactor recompress_chunk() API
diff --git a/tsl/src/compression/CMakeLists.txt b/tsl/src/compression/CMakeLists.txt
@@ -7,5 +7,6 @@ set(SOURCES
     ${CMAKE_CURRENT_SOURCE_DIR}/deltadelta.c
     ${CMAKE_CURRENT_SOURCE_DIR}/dictionary.c
     ${CMAKE_CURRENT_SOURCE_DIR}/gorilla.c
+    ${CMAKE_CURRENT_SOURCE_DIR}/recompression.c
     ${CMAKE_CURRENT_SOURCE_DIR}/segment_meta.c)
 target_sources(${TSL_LIBRARY_NAME} PRIVATE ${SOURCES})
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		Implements: #5867 Refactor recompress_chunk() API