Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fix: Fix the resuming of MongoDB change streams in log-based replication mode #31

Draft
wants to merge 43 commits into
base: main
Choose a base branch
from
Draft

fix: Fix the resuming of MongoDB change streams in log-based replication mode #31

wants to merge 43 commits into from

Commits on Nov 17, 2023

  1. Start scaffolding things to test change stream handling more specific… 

    …ally
    @menzenski
    menzenski committed Nov 17, 2023
    Configuration menu
    Copy the full SHA
    a0280ce View commit details
    Browse the repository at this point in the history

Commits on Nov 24, 2023

  1. some more refactoring, start adding resume strategy setting and tests

    @menzenski
    menzenski committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    6ea1f0c View commit details
    Browse the repository at this point in the history

  2. more tests, start splitting up the giant method

    @menzenski
    menzenski committed Nov 24, 2023
    Configuration menu
    Copy the full SHA
    8d61b87 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2024

  1. add mypy to precommit checks

    @menzenski
    menzenski committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    4f0b291 View commit details
    Browse the repository at this point in the history

  2. add debugging logging config file

    @menzenski
    menzenski committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    48e9610 View commit details
    Browse the repository at this point in the history

  3. update sdk version

    @menzenski
    menzenski committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    d3aacb9 View commit details
    Browse the repository at this point in the history

  4. did this fix it?

    @menzenski
    menzenski committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    154b62e View commit details
    Browse the repository at this point in the history

  5. delete logging config

    @menzenski
    menzenski committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    fa6ad4c View commit details
    Browse the repository at this point in the history

  6. delete mongodb testing things, they didn't work with change streams

    @menzenski
    menzenski committed Feb 15, 2024
    Configuration menu
    Copy the full SHA
    32f6a2a View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2024

  1. remove start at operation time

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    2f9c015 View commit details
    Browse the repository at this point in the history

  2. rm seed utils

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    650ec30 View commit details
    Browse the repository at this point in the history

  3. bump version

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    c4335e5 View commit details
    Browse the repository at this point in the history

  4. remove backports cached property if we're on 3.8+ now

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    b0e253a View commit details
    Browse the repository at this point in the history

  5. Fix change stream handling in MongoDB log-based replication mode

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    cf875b8 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'change-stream-improvements' of github.com:menzenski/tap… 

    …-mongodb into change-stream-improvements
    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    aaf7dd7 View commit details
    Browse the repository at this point in the history

  7. remove loguru, not used

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    2a3c032 View commit details
    Browse the repository at this point in the history

  8. rm seed command

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    8fac23a View commit details
    Browse the repository at this point in the history

  9. test with python 3.12

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    96d6811 View commit details
    Browse the repository at this point in the history

  10. more python version updates

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    83fa85e View commit details
    Browse the repository at this point in the history

  11. rm generic reference to re.match

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    f2ac545 View commit details
    Browse the repository at this point in the history

  12. rm conftest

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    b1f293b View commit details
    Browse the repository at this point in the history

  13. more strategy cleanup

    @menzenski
    menzenski committed Feb 16, 2024
    Configuration menu
    Copy the full SHA
    0648fff View commit details
    Browse the repository at this point in the history

Commits on Feb 19, 2024

  1. add remaining change event fields

    @menzenski
    menzenski committed Feb 19, 2024
    Configuration menu
    Copy the full SHA
    2451443 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. Update streams.py 

    Co-authored-by: Edgar Ramírez Mondragón <[email protected]>
    @menzenski @edgarrmondragon
    menzenski and edgarrmondragon authored Feb 20, 2024
    Configuration menu
    Copy the full SHA
    316daa4 View commit details
    Browse the repository at this point in the history

  2. add a whole bunch of mongo-replica-set-in-docker experiments

    @menzenski
    menzenski committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    794c2da View commit details
    Browse the repository at this point in the history

  3. let's see if that gets a mongodb replica set stood up in github actions

    @menzenski
    menzenski committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    d7a6250 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'change-stream-improvements' of github.com:menzenski/tap… 

    …-mongodb into change-stream-improvements
    @menzenski
    menzenski committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    a030376 View commit details
    Browse the repository at this point in the history

  5. quote version numbers

    @menzenski
    menzenski committed Feb 20, 2024
    Configuration menu
    Copy the full SHA
    9ec4ba4 View commit details
    Browse the repository at this point in the history

Commits on Feb 21, 2024

  1. support 3.12 patch versions

    @menzenski
    menzenski committed Feb 21, 2024
    Configuration menu
    Copy the full SHA
    9f3d774 View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2024

  1. don't always throw an exception

    @menzenski
    menzenski committed Feb 23, 2024
    Configuration menu
    Copy the full SHA
    a1b8257 View commit details
    Browse the repository at this point in the history

Commits on Apr 23, 2024

  1. re-lock plugins

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    43272cd View commit details
    Browse the repository at this point in the history

  2. re-lock poetry dependencies, update local python version

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4ff5b89 View commit details
    Browse the repository at this point in the history

  3. first pass at tests that use testcontainers-mongodb

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    4310b48 View commit details
    Browse the repository at this point in the history

  4. Lint and docstrings

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    a85f1dd View commit details
    Browse the repository at this point in the history

  5. add a real test case of the tap in incremental mode

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    981523d View commit details
    Browse the repository at this point in the history

  6. rm that block

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    1952c29 View commit details
    Browse the repository at this point in the history

  7. make integration_tests a package so we can import from it

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    b161e20 View commit details
    Browse the repository at this point in the history

  8. try getting replica set to work

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    f481319 View commit details
    Browse the repository at this point in the history

  9. rm replica-set attempts, didn't work

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    25f69ba View commit details
    Browse the repository at this point in the history

  10. use loguru for all logging because I understand it

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    d42a173 View commit details
    Browse the repository at this point in the history

  11. various lint and typing fixes

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    0207c76 View commit details
    Browse the repository at this point in the history

  12. add collection name to log messages and more explicitly handle the du… 

    …mmy record scenario
    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    95a88b3 View commit details
    Browse the repository at this point in the history

  13. set metadata on a dummy record

    @menzenski
    menzenski committed Apr 23, 2024
    Configuration menu
    Copy the full SHA
    909078d View commit details
    Browse the repository at this point in the history