Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initial implementation of a custom persistence layer #73029

Draft
wants to merge 26 commits into
base: canary
Choose a base branch
from
Draft

Initial implementation of a custom persistence layer #73029

wants to merge 26 commits into from
+2,572 −31

Commits on Nov 22, 2024

  1. Initial implementation of a custom persistence layer

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2cb9085 View commit details
    Browse the repository at this point in the history

  2. generic key

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    208c48c View commit details
    Browse the repository at this point in the history

  3. bugfixes

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    bee7543 View commit details
    Browse the repository at this point in the history

  4. integrate turbo-persistence into the backend

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    d16143e View commit details
    Browse the repository at this point in the history

  5. fixup

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    73ebb2f View commit details
    Browse the repository at this point in the history

  6. smaller value blocks

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2327234 View commit details
    Browse the repository at this point in the history

  7. put verification check behind feature flag

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    9098882 View commit details
    Browse the repository at this point in the history

  8. change block count and index block block indicies to 2 bytes

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    6f3efe6 View commit details
    Browse the repository at this point in the history

  9. WIP: log hit miss

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    4ea02bd View commit details
    Browse the repository at this point in the history

  10. Revert "WIP: log hit miss" 

    This reverts commit 17ea86f39a7448b5ae47009ec3456a87143cf18e.
    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    b596080 View commit details
    Browse the repository at this point in the history

  11. use 2 bytes block index in key blocks

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    4078fa1 View commit details
    Browse the repository at this point in the history

  12. add medium sized values that are placed in a separate value block

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    b4ad44e View commit details
    Browse the repository at this point in the history

  13. adjust block sizes and small value size field

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    c1c481f View commit details
    Browse the repository at this point in the history

  14. prehashing

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    fd74635 View commit details
    Browse the repository at this point in the history

  15. more test cases

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    1e68c8b View commit details
    Browse the repository at this point in the history

  16. add strict checks

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    38b8aff View commit details
    Browse the repository at this point in the history

  17. fixup verify_sst_content

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    2a2e71a View commit details
    Browse the repository at this point in the history

  18. support large keys

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    c387ed7 View commit details
    Browse the repository at this point in the history

  19. add stats

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    1f45e56 View commit details
    Browse the repository at this point in the history

  20. reorder test cases

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    c8e83a6 View commit details
    Browse the repository at this point in the history

  21. print stats on shutdown

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    0e3c56f View commit details
    Browse the repository at this point in the history

  22. add separate index block cache, cache all aqmfs

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    8f5adb8 View commit details
    Browse the repository at this point in the history

  23. smaller blocks

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    d94f8f5 View commit details
    Browse the repository at this point in the history

  24. avoid caching medium values

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    15c7963 View commit details
    Browse the repository at this point in the history

  25. increase SST file size, parellel finishing

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    3be2cb0 View commit details
    Browse the repository at this point in the history

  26. more stats

    @sokra
    sokra committed Nov 22, 2024
    Configuration menu
    Copy the full SHA
    f8aa31a View commit details
    Browse the repository at this point in the history