Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: implement core logic in SDK #2

Merged
merged 7 commits into from
Nov 8, 2024
Merged

feat: implement core logic in SDK #2

merged 7 commits into from
Nov 8, 2024

Conversation

pnadolny13
Copy link
Contributor

This uses all the standard SDK patterns which unlocks default backoff retry logic, pagination, state, sorting to enable resumable bookmarks. Additionally this implements partitioning in the general ledger details stream to process one module time at a time and store state per module to improve long running backfill jobs.

TODO:

  • Does not include audit history streams yet
  • Refactoring out the sage SDK logic to reduce duplicate logic

@pnadolny13 pnadolny13 merged commit a684183 into main Nov 8, 2024
2 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant