Code

Explicitly log relation extension#140

Code

Open

antons-antons wants to merge 117 commits intoREL_14_STABLE_neonneondatabase/postgres:REL_14_STABLE_neonfrom antons_log_page_extensionneondatabase/postgres:antons_log_page_extensionCopy head branch name to clipboard

+16,733-215

Commits

Commits on Feb 9, 2022

• [smgr_api] [community] smgr_api.patch

  Show description for 6c5225e
  lubennikovaav

  committed
  6c5225e

  Copy full SHA for 6c5225e

• [contrib/zenith] contrib_zenith.patch

  Show description for 4dc7b76
  lubennikovaav

  committed
  4dc7b76

  Copy full SHA for 4dc7b76

• [walredo] zenith_wal_redo.patch

  Show description for 7448697
  lubennikovaav

  committed
  7448697

  Copy full SHA for 7448697

• lastWrittenPageLSN.patch

  Show description for 4783dfc
  lubennikovaav

  committed
  4783dfc

  Copy full SHA for 4783dfc

• Fix GetPage requests right after replaying CREATE DATABASE

  Show description for 0fd9474
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  0fd9474

  Copy full SHA for 0fd9474

• handle_eviction_of_non_wal_logged_pages.patch

  Show description for c178d58
  lubennikovaav

  committed
  c178d58

  Copy full SHA for c178d58

• [walproposer] wal_proposer.patch

  Show description for 3ee8149
  lubennikovaav

  committed
  3ee8149

  Copy full SHA for 3ee8149

• persist_unlogged_tables.patch

  Show description for 782eacf
  lubennikovaav

  committed
  782eacf

  Copy full SHA for 782eacf

• fix_pg_table_size.patch

  Show description for 31a077b
  lubennikovaav

  committed
  31a077b

  Copy full SHA for 31a077b

• [walredo] fix_gin_redo.patch

  Show description for 917462d
  lubennikovaav

  committed
  917462d

  Copy full SHA for 917462d

• [walredo] fix_brin_redo.patch

  Show description for 7276b7f
  lubennikovaav

  committed
  7276b7f

  Copy full SHA for 7276b7f

• speculative_records_workaround.patch

  lubennikovaav

  committed
  6d7bafb

  Copy full SHA for 6d7bafb

• wallog_t_ctid.patch

  lubennikovaav

  committed
  87b826f

  Copy full SHA for 87b826f

• vacuumlazy_debug_stub.patch

  lubennikovaav

  committed
  9f457bf

  Copy full SHA for 9f457bf

• [test] zenith_test_evict.patch

  lubennikovaav

  committed
  ac7bd68

  Copy full SHA for ac7bd68

• fix_sequence_wallogging.patch

  lubennikovaav

  committed
  74ae59f

  Copy full SHA for 74ae59f

• Bring back change that got lost in refactoring. silence ReadBuffer_common error. TODO: add a comment, why this is fine for zenith.

  lubennikovaav

  committed
  e27aaea

  Copy full SHA for e27aaea

• [contrib/zenith] [refer #225] if insert WAL position points at the end of WAL page header, then return it back to the page origin

  

  knizhnik

  authored and

  lubennikovaav

  committed
  6ac8b6e

  Copy full SHA for 6ac8b6e

• [walproposer] Create replication slot for walproposer to avoid loose of WAL at compute node

  Show description for 8360d74
  

  knizhnik

  authored and

  lubennikovaav

  committed
  8360d74

  Copy full SHA for 8360d74

• [walproposer] Skip absent WAL segment removed by pg_resetwal

  lubennikovaav

  committed
  b9e24d1

  Copy full SHA for b9e24d1

• [walproposer] Fix breaking out of WalProposerPoll and WaitEventSetWait inside.

  Show description for 232d876
  

  arssher

  authored and

  lubennikovaav

  committed
  232d876

  Copy full SHA for 232d876

• [walproposer] Make it possible to start postgres without reading checkpoint from WAL

  Show description for 45e9074
  

  knizhnik

  authored and

  lubennikovaav

  committed
  45e9074

  Copy full SHA for 45e9074

• [walproposer] Simplify WL_LATCH_SET testing in the walproposer

  

  ololobus

  authored and

  lubennikovaav

  committed
  5085205

  Copy full SHA for 5085205

• [walredo] Add basic support for Seccomp BPF mode

  Show description for 1f5c11d
  

  funbringer

  authored and

  lubennikovaav

  committed
  1f5c11d

  Copy full SHA for 1f5c11d

• [smgr_api] [contrib/zenith] 1. Do not call mdinit from smgrinit() because it cause memory leak in wal-redo-postgres

  Show description for fb8c2a1
  

  knizhnik

  authored and

  lubennikovaav

  committed
  fb8c2a1

  Copy full SHA for fb8c2a1

• [walproposer] [contrib/zenith] support zenith_tenant

  Show description for 15becb6
  

  LizardWizzard

  authored and

  lubennikovaav

  committed
  15becb6

  Copy full SHA for 15becb6

• [walproposer] Remove graceful termination of COPY during walproposer recovery.

  Show description for 87797bb
  

  arssher

  authored and

  lubennikovaav

  committed
  87797bb

  Copy full SHA for 87797bb

• [walproposer] [contrib/zenith] [refer #395] Do no align sart replication position in wal_proppser to segment boundary

  

  knizhnik

  authored and

  lubennikovaav

  committed
  4319a6f

  Copy full SHA for 4319a6f

• [test] Add contrib/zenith_test_utils with helpers for testing and debugging.

  Show description for 48fc26e
  lubennikovaav

  committed
  48fc26e

  Copy full SHA for 48fc26e

• [walproposer] Change condition for triggering recovery

  

  knizhnik

  authored and

  lubennikovaav

  committed
  9dedb55

  Copy full SHA for 9dedb55

• [contrib/zenith] Use authentication token passed as environment variable in connections

  Show description for eae6cb8
  

  LizardWizzard

  authored and

  lubennikovaav

  committed
  eae6cb8

  Copy full SHA for eae6cb8

• [contrib/zenith] Fix race condition while WAL-logging page, leading to CRC errors.

  Show description for 4c15b7c
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  4c15b7c

  Copy full SHA for 4c15b7c

• [walproposer] Rework walkeeper protocol to use libpq (#60)

  Show description for 209d0c0
  

  sharnoff

  authored and

  lubennikovaav

  committed
  209d0c0

  Copy full SHA for 209d0c0

• Build zenithdb/compute-node:latest in CI (neondatabase/cloud#125)

  

  ololobus

  authored and

  lubennikovaav

  committed
  743848e

  Copy full SHA for 743848e

• zenith_regression_tests.patch

  Show description for 657c3ed
  lubennikovaav

  committed
  657c3ed

  Copy full SHA for 657c3ed

• Add test function to flush the shared buffer cache.

  

  hlinnaka

  authored and

  lubennikovaav

  committed
  9310468

  Copy full SHA for 9310468

• Basic safekeeper refactoring and bug fixing.

  Show description for a4359e6
  

  arssher

  authored and

  lubennikovaav

  committed
  a4359e6

  Copy full SHA for a4359e6

• Rename VCL to epochStartLsn and restart_lsn to truncate_lsn.

  Show description for 3287dbb
  

  arssher

  authored and

  lubennikovaav

  committed
  3287dbb

  Copy full SHA for 3287dbb

• [refer #27] Implement shared relsize cache to improve zenith performance.

  Show description for 09a8680
  

  knizhnik

  authored and

  lubennikovaav

  committed
  09a8680

  Copy full SHA for 09a8680

• Cleanup walproposer changes from #60

  Show description for 82d969e
  

  sharnoff

  authored and

  lubennikovaav

  committed
  82d969e

  Copy full SHA for 82d969e

• pass tenant id in connection string to safekeeper

  

  LizardWizzard

  authored and

  lubennikovaav

  committed
  7d06d8f

  Copy full SHA for 7d06d8f

• Ask pageserver only with LSN's aligned on record boundary.

  Show description for 6a45e63
  

  kelvich

  authored and

  lubennikovaav

  committed
  6a45e63

  Copy full SHA for 6a45e63

• [refer #506] Correctly initialize all fields of WAL page header for first WAL record of started compute node

  

  knizhnik

  authored and

  lubennikovaav

  committed
  ffa97f0

  Copy full SHA for ffa97f0

• Add --sync-safekeepers starting standalone walproposer to sync safekeepers (#439).

  Show description for 3600cce
  

  knizhnik

  authored and

  lubennikovaav

  committed
  3600cce

  Copy full SHA for 3600cce

• Update Dockerfile

  

  ololobus

  authored and

  lubennikovaav

  committed
  7e3d867

  Copy full SHA for 7e3d867

• Fix compiler warnings in walproposer.c

  

  ololobus

  authored and

  lubennikovaav

  committed
  b661532

  Copy full SHA for b661532

• Always advance truncateLsn to commitLsn, keeping it on record boundary.

  Show description for cc87ff1
  

  arssher

  authored and

  lubennikovaav

  committed
  cc87ff1

  Copy full SHA for cc87ff1

• Minor logging editing.

  

  arssher

  authored and

  lubennikovaav

  committed
  43dcc39

  Copy full SHA for 43dcc39

• Fix walproposer starting streaming point.

  Show description for 40c109b
  

  arssher

  authored and

  lubennikovaav

  committed
  40c109b

  Copy full SHA for 40c109b

• Mark all recovery messages as received by the donor.

  Show description for 3e79e7b
  

  arssher

  authored and

  lubennikovaav

  committed
  3e79e7b

  Copy full SHA for 3e79e7b

• Don't FATAL in walproposer when EOF arrives in SS_IDLE state.

  

  arssher

  authored and

  lubennikovaav

  committed
  2750bac

  Copy full SHA for 2750bac

• Optimize walproposer starting streaming point.

  Show description for 153d0f6
  

  arssher

  authored and

  lubennikovaav

  committed
  153d0f6

  Copy full SHA for 153d0f6

• Silence a compiler warning.

  Show description for 7648f05
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  7648f05

  Copy full SHA for 7648f05

• Remove unused functions for reading non-rel pages.

  Show description for afaad8f
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  afaad8f

  Copy full SHA for afaad8f

• Misc cleanup in the code that communicates with the page server.

  Show description for ae5ee63
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  ae5ee63

  Copy full SHA for ae5ee63

• Improve the protocol between Postgres and page server.

  Show description for bf4c0cb
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  bf4c0cb

  Copy full SHA for bf4c0cb

• Silence compiler warning when building without --enable-seccomp

  

  hlinnaka

  authored and

  lubennikovaav

  committed
  3dc6bfb

  Copy full SHA for 3dc6bfb

• Run 'pgindent' on zenith-specific code in contrib/zenith and in walproposer.c

  

  hlinnaka

  authored and

  lubennikovaav

  committed
  75dc8ea

  Copy full SHA for 75dc8ea

• Silence compiler warning

  Show description for 316ff47
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  316ff47

  Copy full SHA for 316ff47

• Fix a badly worded comment

  

  hlinnaka

  authored and

  lubennikovaav

  committed
  2ea36fd

  Copy full SHA for 2ea36fd

• Simplify a2e929e by storing starting point in walkeeper itself.

  

  arssher

  authored and

  lubennikovaav

  committed
  fd61df8

  Copy full SHA for fd61df8

• Catch walkeeper ErrorResponse in PQgetCopyData

  Show description for 484ac78
  

  sharnoff

  authored and

  lubennikovaav

  committed
  484ac78

  Copy full SHA for 484ac78

• Use buffered I/O for reading commands from stdin.

  Show description for 5edfd25
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  5edfd25

  Copy full SHA for 5edfd25

• Replace fread() with plain read() and a hand-written buffer.

  Show description for 139a5b6
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  139a5b6

  Copy full SHA for 139a5b6

• Store unlogged tables locally, and replace PD_WAL_LOGGED.

  Show description for c4bd89e
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  c4bd89e

  Copy full SHA for c4bd89e

• Fix queue cleanup in proposer (#93)

  Show description for 7a6caaa
  

  2 peopleauthored and

  lubennikovaav

  committed
  7a6caaa

  Copy full SHA for 7a6caaa

• Support read-only nodes

  Show description for f38fd05
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  f38fd05

  Copy full SHA for f38fd05

• Remove a drop of syncSafekeepers complexity.

  

  arssher

  authored and

  lubennikovaav

  committed
  3642beb

  Copy full SHA for 3642beb

• Fix compiler warning.

  Show description for 4744ed7
  

  arssher

  authored and

  lubennikovaav

  committed
  4744ed7

  Copy full SHA for 4744ed7

• Implement backpressure for compute node to avoid WAL overflow

  

  knizhnik

  authored and

  lubennikovaav

  committed
  b9e8a5c

  Copy full SHA for b9e8a5c

• Initialize FSM/VM pages through buffer cache

  Show description for c7ce764
  

  ololobus

  authored and

  lubennikovaav

  committed
  c7ce764

  Copy full SHA for c7ce764

• Turn off back pressure by default

  

  ololobus

  authored and

  lubennikovaav

  committed
  6e5f8d6

  Copy full SHA for 6e5f8d6

• ShutdownConnection instead of ResetConnection in more places.

  Show description for d6cb3fa
  

  arssher

  authored and

  lubennikovaav

  committed
  d6cb3fa

  Copy full SHA for d6cb3fa

• Handle partial writes to stdout in WAL redo process.

  

  hlinnaka

  authored and

  lubennikovaav

  committed
  bcbf12c

  Copy full SHA for bcbf12c

• Handle keepalives while receiving WAL in recovery.

  Show description for a3e992f
  

  arssher

  authored and

  lubennikovaav

  committed
  a3e992f

  Copy full SHA for a3e992f

• Fix truncateLsn update (#101)

  Show description for 1bb6aa9
  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  1bb6aa9

  Copy full SHA for 1bb6aa9

• [walproposer] Get rid of SAB_Error after rebase

  Show description for b2e8da8
  

  ololobus

  authored and

  lubennikovaav

  committed
  b2e8da8

  Copy full SHA for b2e8da8

• Add term history to safekeepers.

  Show description for d4e813b
  

  arssher

  authored and

  lubennikovaav

  committed
  d4e813b

  Copy full SHA for d4e813b

• Clarify the meaning of StandbyReply LSNs used for backpressure

  lubennikovaav

  committed
  7fb4e66

  Copy full SHA for 7fb4e66

• Use max_replication_apply_lag instead of max_replication_write_lag.

  Show description for 3e0c8a3
  lubennikovaav

  committed
  3e0c8a3

  Copy full SHA for 3e0c8a3

• Forward pageserver connection string to safekeeper

  Show description for 2c00fed
  

  LizardWizzard

  authored and

  lubennikovaav

  committed
  2c00fed

  Copy full SHA for 2c00fed

• Move backpressure throttling to ProcessInterrupts()

  lubennikovaav

  committed
  9e50f21

  Copy full SHA for 9e50f21

• Stop building docker images in this repo.

  Show description for 41e38c0
  

  kelvich

  authored and

  lubennikovaav

  committed
  41e38c0

  Copy full SHA for 41e38c0

• [walproposer] Async WAL append (#105)

  Show description for 9bbc511
  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  9bbc511

  Copy full SHA for 9bbc511

• Fix walsender to work with zenith style standbyReply that sends non-zero flushLsn.

  Show description for 9ba395f
  lubennikovaav

  committed
  9ba395f

  Copy full SHA for 9ba395f

• Do not copy the obsolete apply_conf binary into Docker image

  

  ololobus

  authored and

  lubennikovaav

  committed
  6d88bd2

  Copy full SHA for 6d88bd2

• Reorder walproposer code in a more natural order (#112)

  Show description for 39d07f0
  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  39d07f0

  Copy full SHA for 39d07f0

• Simplify walproposer code (#114)

  Show description for 326dbd7
  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  326dbd7

  Copy full SHA for 326dbd7

• Don't change propTerm after quorum is acquired (#107)

  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  85b65e4

  Copy full SHA for 85b65e4

• walproposer renames (#116)

  Show description for 8e82eae
  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  8e82eae

  Copy full SHA for 8e82eae

• Report back-pressure trottling status of backend

  

  knizhnik

  authored and

  lubennikovaav

  committed
  cb04c36

  Copy full SHA for cb04c36

• Add max_replication_write_lag

  

  knizhnik

  authored and

  lubennikovaav

  committed
  808848d

  Copy full SHA for 808848d

• Do not throttle wal sender

  

  knizhnik

  authored and

  lubennikovaav

  committed
  27f713e

  Copy full SHA for 27f713e

• Do no throttle wal sender

  

  knizhnik

  authored and

  lubennikovaav

  committed
  8f9af18

  Copy full SHA for 8f9af18

• Don't track acks in walproposer (#119)

  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  c2e8404

  Copy full SHA for c2e8404

• Silence excessively noisy logging from walproposer.

  Show description for c68dc1f
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  c68dc1f

  Copy full SHA for c68dc1f

• Extend replication protocol with ZenithFeedback message.

  Show description for 8916e66
  lubennikovaav

  committed
  8916e66

  Copy full SHA for 8916e66

• Allow to join empty safekeeper to existing cluster (#123)

  

  petuhovskiy

  authored and

  lubennikovaav

  committed
  e7322f1

  Copy full SHA for e7322f1

• Use local relation cache for smgr_exists

  Show description for 0df3071
  

  knizhnik

  authored and

  lubennikovaav

  committed
  0df3071

  Copy full SHA for 0df3071

• Reduce walproposer logging after ca5e7be.

  

  arssher

  authored and

  lubennikovaav

  committed
  a5db530

  Copy full SHA for a5db530

• Implement cluster size quota for zenith compute node.

  Show description for c0845f9
  lubennikovaav

  committed
  c0845f9

  Copy full SHA for c0845f9

• Revert "Use local relation cache for smgr_exists"

  Show description for 14aaa50
  

  arssher

  authored and

  lubennikovaav

  committed
  14aaa50

  Copy full SHA for 14aaa50

• Change the unit of cluster size limit GUC to MB, and other fixes.

  Show description for 952a94e
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  952a94e

  Copy full SHA for 952a94e

• Improve error handling while connecting to page server.

  Show description for d881913
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  d881913

  Copy full SHA for d881913

• Make getpage requests interruptible.

  Show description for 580c034
  

  hlinnaka

  authored and

  lubennikovaav

  committed
  580c034

  Copy full SHA for 580c034

Commits on Feb 10, 2022

• Fix memory leak of messages received from safekeepers.

  Show description for e056fb6
  hlinnaka

  committed
  e056fb6

  Copy full SHA for e056fb6

Commits on Feb 11, 2022

• Initialize pgxactoff for walproposer

  Show description for 8524105
  knizhnik

  committed
  8524105

  Copy full SHA for 8524105

Commits on Feb 14, 2022

• Fix compilation warning after 8524105.

  arssher

  committed
  7b5ee1c

  Copy full SHA for 7b5ee1c

• Fix more compiler warnings.

  arssher

  committed
  d914790

  Copy full SHA for d914790

Commits on Feb 16, 2022

• Remove dead code in handling ZenithFeedback part of an AppendResponse.

  Show description for b426ffe
  hlinnaka

  committed
  b426ffe

  Copy full SHA for b426ffe

• Prevent recursive call of XLogBeginInsert

  Show description for ecbcefb
  knizhnik

  committed
  ecbcefb

  Copy full SHA for ecbcefb

• Update src/backend/access/gin/ginfast.c

  Show description for d455371
  

  knizhnik

  and

  hlinnaka

  committed
  d455371

  Copy full SHA for d455371

Commits on Feb 18, 2022

• Expose reading a relation page at a specific LSN (#131)

  Show description for 2c2b362
  antons-antons

  authored
  2c2b362

  Copy full SHA for 2c2b362

Commits on Feb 22, 2022

• Add backpressure_lsns() function. Fix zenith feedback processing

  lubennikovaav

  committed
  a3709cc

  Copy full SHA for a3709cc

Commits on Feb 23, 2022

• Fix zenith_test_utils linkage on macOS

  Show description for 1872ba6
  kelvich

  committed
  1872ba6

  Copy full SHA for 1872ba6

Commits on Feb 24, 2022

• Add warning fr unrecgonized GUCs with zenith prefix

  Show description for 31dc24a
  

  knizhnik

  authored and

  lubennikovaav

  committed
  31dc24a

  Copy full SHA for 31dc24a

Commits on Mar 3, 2022

• WIP: Explicitly log relation extension

  Show description for efa733e
  antons-antons

  committed
  efa733e

  Copy full SHA for efa733e