From 0094a618f60afc2588c0e252a583c468e9b40a53 Mon Sep 17 00:00:00 2001 From: Lezek123 Date: Tue, 26 Nov 2024 09:46:22 +0100 Subject: [PATCH] Update changelog --- storage-node/CHANGELOG.md | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/storage-node/CHANGELOG.md b/storage-node/CHANGELOG.md index da23df9c92..a3cf96681f 100644 --- a/storage-node/CHANGELOG.md +++ b/storage-node/CHANGELOG.md @@ -1,6 +1,12 @@ ### 4.3.0 -- Adds `archive` mode / command, which allows downloading, compressing and uploading all data objects to an external S3 bucket that can be used as a backup. +- **New feature:** `archive` mode / command, which allows downloading, compressing and uploading all data objects to an external S3 bucket that can be used as a backup. +- **Optimizations:** The way data objects / data object ids are queried and processed during sync and cleanup has been optimized: + - `DataObjectDetailsLoader` and `DataObjectIdsLoader` were implemented. They allow loading data objects / data object ids in batches using a connection query and avoid fetching redundant data from the GraphQL server. + - Sync and cleanup services now process tasks in batches of `10_000` to avoid overflowing the memory. + - Synchronous operations like `sort` or `filter` on larger arrays of data objects have been optimized (for example, by replacing `.filter(Array.includes(...))` with `.filter(Set.has(...))`) +- Improved logging during cleanup + ### 4.2.0