Release 2.13.0: Release branch #6342
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dist_move_chunk is now version specific. However, only the generic version was declared as a solo test. This PR adjusts the the test declaration.
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## 2.13.x #6342 +/- ##
==========================================
+ Coverage 86.99% 87.02% +0.02%
==========================================
Files 249 249
Lines 57983 57989 +6
Branches 12917 12917
==========================================
+ Hits 50444 50465 +21
+ Misses 5144 5116 -28
- Partials 2395 2408 +13 ☔ View full report in Codecov by Sentry. |
One test query of the parallel test did not contain an ORDER BY. Therefore, the test result was not deterministic. This patch adds the missing ORDER BY.
Change compression policy to use segmentwise recompression when possible to increase performance. Segmentwise recompression decompresses rows into memory, thus reducing IO load when recompressing, making it much faster for bigger chunks.
If a hypertable uses a non-default tablespace for its primary or unique constraints with additional DEFERRABLE or INITIALLY DEFERRED characteristics then any chunk creation will fail with syntax error. We now set the tablespace via a separate command for such constraints for the chunks. Fixes timescale#6338
If we reuse the compressor to recompress multiple sets of tuples, internal state gets left behind from the previous run which can contain invalid data. Resetting the compressor first iteration field between runs fixes this.
This release contains performance improvements, an improved hypertable DDL API and bug fixes since the 2.12.2 release. We recommend that you upgrade at the next available opportunity. In addition, it includes these noteworthy features: * Full PostgreSQL 16 support for all existing features * Vectorized aggregation execution for sum() * Track chunk creation time used in retention/compression policies **Deprecation notice: Multi-node support** TimescaleDB 2.13 is the last version that will include multi-node support. Multi-node support in 2.13 is available for PostgreSQL 13, 14 and 15. Learn more about it [here](docs/MultiNodeDeprecation.md). If you want to migrate from multi-node TimescaleDB to single-node TimescaleDB read the [migration documentation](https://docs.timescale.com/migrate/latest/multi-node-to-timescale-service/). **PostgreSQL 13 deprecation announcement** We will continue supporting PostgreSQL 13 until April 2024. Sooner to that time, we will announce the specific version of TimescaleDB in which PostgreSQL 13 support will not be included going forward. **Starting from TimescaleDB 2.13.0** * No Amazon Machine Images (AMI) are published. If you previously used AMI, please use another [installation method](https://docs.timescale.com/self-hosted/latest/install/) * Continuous Aggregates are materialized only (non-realtime) by default **Features** * timescale#5575 Add chunk-wise sorted paths for compressed chunks * timescale#5761 Simplify hypertable DDL API * timescale#5890 Reduce WAL activity by freezing compressed tuples immediately * timescale#6050 Vectorized aggregation execution for sum() * timescale#6062 Add metadata for chunk creation time * timescale#6077 Make Continous Aggregates materialized only (non-realtime) by default * timescale#6177 Change show_chunks/drop_chunks using chunk creation time * timescale#6178 Show batches/tuples decompressed during DML operations in EXPLAIN output * timescale#6185 Keep track of catalog version * timescale#6227 Use creation time in retention/compression policy * timescale#6307 Add SQL function cagg_validate_query **Bugfixes** * timescale#6188 Add GUC for setting background worker log level * timescale#6222 Allow enabling compression on hypertable with unique expression index * timescale#6240 Check if worker registration succeeded * timescale#6254 Fix exception detail passing in compression_policy_execute * timescale#6264 Fix missing bms_del_member result assignment * timescale#6275 Fix negative bitmapset member not allowed in compression * timescale#6280 Potential data loss when compressing a table with a partial index that matches compression order. * timescale#6289 Add support for startup chunk exclusion with aggs * timescale#6290 Repair relacl on upgrade * timescale#6297 Fix segfault when creating a cagg using a NULL width in time bucket function * timescale#6305 Make timescaledb_functions.makeaclitem strict * timescale#6332 Fix typmod and collation for segmentby columns * timescale#6339 Fix tablespace with constraints * timescale#6343 Enable segmentwise recompression in compression policy **Thanks** * @fetchezar for reporting an issue with compression policy error messages * @jflambert for reporting the background worker log level issue * @torazem for reporting an issue with compression and large oids * @fetchezar for reporting an issue in the compression policy * @lyp-bobi for reporting an issue with tablespace with constraints * @pdipesh02 for contributing to the implementation of the metadata for chunk creation time, the generalized hypertable API, and show_chunks/drop_chunks using chunk creation time * @lkshminarayanan for all his work on PG16 support
|
@svenklemm, @erimatnor: please review this pull request.
|
svenklemm
approved these changes
Nov 27, 2023
fabriziomello
approved these changes
Nov 28, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
2539ea2 Release 2.13.0
fb32fe8 Reset compressor between recompression runs
d896a9e Fix non-default tablespaces with constraints
34d72aa Use segmentwise recompression in compress policy
e9a4f30 Make parallel test deterministic
7dc5317 Ensure dist_move_chunk is executed as solo test
7c9099f Enable MN test for PG 15 in CI
7b0dda6 Add support for chunk exclusion with partial aggs
d1c8cb0 Fix segmentby typmod and collation of compressed chunks
d17b582 Revert "Restart scheduler on error"
747f4e2 Refactor compression filter handling
3c860cc Don't disable batch sorted merge plan with enable_sort GUC
e3c4596 Optimize compress_chunk index behaviour
a3aec8c Add helper functions for arrays
485383a Bugfix: adjust "wholerow" ROWID_VAR in the chunks' targetlist
586b4e9 Use test-specific temporary roles
4481725 Use creation time in retention/compression policy
e5840e3 Use bulk heap insert API for decompression
5f8c9e2 Fix dist_compression test
115078a Fix size function tests on MN
0254abd Remove useless table lock
49121ae Bump PG versions used in CI
ecb4c21 Fix solo test for dist_util
b917eed Fix sanitizer output log directory
0892d90 Move issue to Done column when closed
3e08d21 Add SQL function cagg_validate_query
483ddcd Make _timescaledb_functions.makeaclitem strict
1d7a7e4 Fix the PG16 test references
06e9fa0 Read and decompress columns lazily
d0021d5 Fix segfault creating cagg with NULL bucket width
b423d14 Adjust restore points test for PG 16
f231021 Repair relacl on extension upgrade
418f5c5 Stabilize CI by excluding debug messages
ff88de9 Determine data type of vector agg at plan stage
e90280a Add support for startup chunk exclusion with aggs
1b3f4a7 PG16: Fix ignored workflow for Windows on CI
d602be4 PG16: Fix flaky test
9d4ffc9 PG16: Enable Windows on CI
e1331c6 Improve diagnostics for cagg trigger errors
6bca947 Fix ABI check on PG 16
6e79687 Fix CI configuration for PG 16
56a708b PG16: Enable SQLSmith on CI
e93b5fa PG16: Fix join recursion
c34fd0b Do not use partial indexes for compression
2422f51 Add debug messages to job scheduler
9b7cb83 Simplified aggregation type detection logic
68e39a3 PG16: Fix telemetry tests without OpenSSL
18bcf16 Use last package Postgres version on Windows
393cc68 Simplify compress_chunk calls in tests
f6bd108 Fix compression for tables with large oids
fbc1fbb PG16: Enable CI
b4bb3a0 PG16: Fix transparent decompression output tests
187b124 Fix wrong use of Const instead of Datum
c58a640 PG16: Fix join recursion
dbb8ce5 Store hypertable RelOptInfo in CompressionInfo
61f2606 Evaluate stable expressions in vectorized filters at run time
7f4f23b Add Coccinelle rules - bitmap set operations
7f25cd9 Fix missing result assignment for bms_del_member
844807a Change show_chunks/drop_chunks using creation time
22b556d Fix exception detail passing in compression_policy_execute
48f4296 Support for segment_by filters on vector aggs
bc5e39d Vectorize the comparison operators for Date type
a094f17 Vectorized aggregation execution for sum()
4048900 Adjust dist_util test output
98623ea Check if worker registration succeeded
0aefc07 Pass RowDecompressor by reference in build_scankeys
c9ca6f5 Add OpenSSF badge to readme
4678f66 PG16: Fix ordered append output test
3c3bdb3 Remove invalid memcpy
29fe401 PG16: Refactored ownercheck functions
e30967f PG16: Handle new vacuum option ONLY_DATABASE_STATS
0435267 Add CAgg related issues to project
aa81f17 Further reduce sqlsmith loops in nightly runs
f3b3e55 Add sorted paths for compressed chunks
d01d950 Use "dylib" uniformly on MacOSX
f8b8bef Adjust relation size in MN test results
50578e4 Fix partialize_finalize test output
53e9747 Fix flaky upgrade test
d614f44 PG16: Removed ignore feature from pg_regress
8767de6 Reduce WAL activity by freezing tuples immediately
dc91938 PG16: Fix JOIN behaviour
7b7722e Fix index inserts during decompression
7797c41 Install PG15 in homebrew test
--
Disable-check: force-changelog-file
Disable-check: commit-count