New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Transition from redis to sqlite #24

Closed

RakuJa opened this issue Oct 27, 2023 · 1 comment

Assignees

Labels

Owner

RakuJa commented Oct 27, 2023

Redis was used for four main reasons:

Ease of use in python
Original bestiary was only a key: value store, it did not require filtering at first
Fly instance allows only 220mb of RAM for the basic tier, python would eat up 180-200mb, leaving no ram space for any db. Now that we (we=Rust) optimized the structure and use only 80mb, we have space for a sqlite db.
Possibility of different shards in different locations, reconciliation, etc..

This will improve latency (local db), remove ugly sanitation code when converting from json array to array of strings.

RakuJa added the enhancement label

RakuJa self-assigned this

Owner Author

RakuJa commented Nov 16, 2023

closed by PR #28
Transitioned smoothly, without regressions

RakuJa closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment