Code

LogPoller support for MaxLogsKept#1338

Code

Closed

reductionista wants to merge 55 commits intoccip-developsmartcontractkit/ccip:ccip-developfrom max-logs-kept-testssmartcontractkit/ccip:max-logs-kept-testsCopy head branch name to clipboard

+1,106-446

Commits

Commits on Oct 12, 2024

• Manually merged in from chainlink repo:

  Show description for 9f9148a
  reductionista

  committed
  9f9148a

• Manually merge in FilteredLogs receive []Expression from upstream

  Show description for 990662d
  reductionista

  committed
  990662d

• use tx in insertLogsWithinTx

  reductionista

  committed
  c738f58

• Add id column as PRIMARY KEY for evm.logs & evm.log_poller_blocks

  Show description for f2152f3
  reductionista

  committed
  f2152f3

• Clean up db indexes

  Show description for c4192c3
  reductionista

  committed
  c4192c3

• Fix 2 unrelated bugs I noticed

  reductionista

  committed
  bac89ac

• Update ExpiredLogs query

  reductionista

  committed
  de696bb

• Update test for fromBlock >= :block_number

  Show description for 9f4b268
  reductionista

  committed
  9f4b268

• Increase staggering of initial pruning runs

  reductionista

  committed
  5a9eb23

• Decrease retention periods for CCIP events, for testing

  reductionista

  committed
  741579f

• Fix bug in merged commit from develop

  Show description for 54f9ea4
  reductionista

  committed
  54f9ea4

• restore retention periods

  reductionista

  committed
  bb7ca3b

• Set LogPrunePageSize = 2001

  reductionista

  committed
  44ccdc9

• merge whitespace differences from chainlink repo

  reductionista

  committed
  388ca20

• sync from chainlink repo

  reductionista

  committed
  6bb5f2a

• Update DeleteBlocksBefore query to use block_number index instead of LIMIT

  reductionista

  committed
  dcf3ad6

• Merge unknown changes to tests from chainlink repo

  reductionista

  committed
  ab32e1a

• Changes in orm_test.go from "Split off SelectUnmatchedLogs from DeleteExpiredLogs"

  reductionista

  committed
  27fe6c6

• Rename LogIds & some changes to orm_test.go from chainlink repo

  reductionista

  committed
  b06ea6c

• Fix UnmatchedLogs query

  reductionista

  committed
  428e7f8

• Reduce 20x to 5x for testing

  reductionista

  committed
  9c4e902

• LogKeepBlocksDepth = 1000

  reductionista

  committed
  3ff0e21

• Add debugging : TODO Remove!

  reductionista

  committed
  b993451

• Fix event_bindings merge issue

  reductionista

  committed
  012345f

• Add helper function for tickers

  reductionista

  committed
  b9648b0

• Stagger initial unmatched logs prune

  reductionista

  committed
  23b6617

• Reorganize sql migration script, adding comments to clarify

  Show description for 5e18824
  reductionista

  committed
  5e18824

• add WHERE evm_chain_id and handle sql.ErrNoRows

  reductionista

  committed
  de81d71

• Add PruneExcessLogs for MaxLogsKept

  reductionista

  committed
  385f2bb

• Update contract_transmitter.go for MaxLogsKept

  reductionista

  committed
  8dbb78c

• Set MaxLogsKept to 1

  Show description for 3970897
  reductionista

  committed
  3970897

• Fix unreachable code

  reductionista

  committed
  3ba99f1

• Update branch

  reductionista

  committed
  e73e343

• Add temporary indexes for comparing sizes

  reductionista

  committed
  9206356

• Set MaxLogPageSize to 0, to test performance with no LIMIT in query

  reductionista

  committed
  bf980bb

• Re-use block-range paging from DeleteBlocksBefore for SelectExcessLogs

  reductionista

  committed
  14cad9e

• Add test for ExecPagedQuery

  reductionista

  committed
  b121498

• Change LogPollerPageSize from 0 to 2000

  reductionista

  committed
  e1bc72c

• Add block_number >= lower

  reductionista

  committed
  826a2a1

• Use ExecPagedQuery for SelectUnmatchedLogIDs

  reductionista

  committed
  c0e4678

• Update tests

  reductionista

  committed
  cbb4ef6

• Fix golint errors

  reductionista

  committed
  94ef8ac

• Reduce LogPollerPrunePageSize 2000 -> 1000

  reductionista

  committed
  4547055

• Merge in test for multichain issue hotfix

  reductionista

  committed
  eaaf877

• Improve logging

  reductionista

  committed
  8d61e38

• Add test for SelectExcessLogIDs

  Show description for ef5716e
  reductionista

  committed
  ef5716e

• Change sql comments to go comments

  reductionista

  committed
  01c1a2f

• Only activate count-based log pruning when needed

  reductionista

  committed
  523effb

• Fix setting of countBasedPruningActive flag

  reductionista

  committed
  56f2163

• Refactor ExecPagedQuery into method of generic type RangedQuery[T]

  reductionista

  committed
  4eb72ec

• sql.ErrRows fix

  reductionista

  committed
  a83c3cb

• Address remaining PR comments

  Show description for a7b9328
  reductionista

  committed
  a7b9328

• NoOfTokensWithDynamicPrice = 0

  reductionista

  committed
  2500099

• Lower LogPrunePageSize from 1000 to 700

  reductionista

  committed
  1dc3d7d

• MaxLogsKept=0

  reductionista

  committed
  4494f58