[Production checks] Gdrive GC

[lasryaric]

Adding production checks for Gdrive.

Deployment steps:

Add the following 3 env vars to front:

CORE_DATABASE_URI_RO
FRONT_DATABASE_URI_RO
CONNECTORS_DATABASE_URI_RO 

• Deploy front
• Start the cron based workflow:

./front/production_check> npx tsx ./admin/cli.ts start

Check if the workflow is properly running on Temporal Cloud.

Setup Datadog Alerts

• One alerts that triggers if the log Production check failed is emitted
• One alerts that trigger if the log Done running all checks is not trigger within a 90 minutes time frame.

[spolu]

We also need CORE_DATABASE_URI and CONNECTORS_DATABASE_URI to be added to front so that we have access to all SQL moving forward

[lasryaric]

We also need CORE_DATABASE_URI and CONNECTORS_DATABASE_URI to be added to front so that we have access to all SQL moving forward

You mean on top of the RO version?

CORE_DATABASE_URI_RO
FRONT_DATABASE_URI_RO
CONNECTORS_DATABASE_URI_RO 

[spolu]

The code is hard to read TBH

Let's make things simple. Separate in two checks one for Slack one for Gdrive

For GDrive let's stick with the migration flow that is easy to understand.

Take all connector file ids and create a hash (that's fine that holds in memory)

Then take all core document_id and check them.

No chunking, it's easier to understand and can be read more easily

The fact that you try to do both at the same time makes it hard to understand and read. We need DEAD simple here otherwise we'll not maintain it.