[discussion] DB data rotation/partitioning

[mimir-d]

Issue by xaionaro
Friday Oct 09, 2020 at 09:54 GMT
Originally opened as https://github.com/facebookincubator/contest/issues/149

---

This is a follow-up task of discussion: https://github.com/facebookincubator/contest/pull/148

(feel free to edit the issue)

---

Problem

Currently we just have a database where we store the whole history of anything ever happened. So longer we use ConTest, more data is stored and those tables. And the problem is that in long term any migration/backup/whatever of the DB might take too much time. IMO, it makes sense to consider ways to rotate/archive data or partition it.

Action required

So I'm asking to share your thoughts about the problem and possible solutions, including data rotation/archivation and data partitioning. We need to decide what and how we will do about the problem.