Figure out a datastore

[di]

Currently this loads all files into memory, and does some rudimentary in-process caching of files.

Ideally this would be replaced with something that would perform slightly better, without having to hold all of PyPI in memory forever. Something like redis with a 24 hour timeout.

Any potential solution should probably not store files on disk.

[miketheman]

Might also be interesting to look at sqlite as a persistent volume datastore - it can scale pretty well.

Here's how these folks did it on k8s: https://www.getharvest.com/blog/running-sqlite-on-kubernetes-surprisingly-not-bad