feat: better visibility

[talboren]

close #2806

• Trace and spans in processing
• Prometheus metrics for processing
• SQLAlchemy 2
• Psycopg 3
• Opt-outs in different ETL process
• Performance imporvements
• Caching for some parts

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
keep	⬜️ Ignored (Inspect)	Visit Preview		Dec 15, 2024 0:10am

[codecov]

Codecov Report

Attention: Patch coverage is 58.14815% with 226 lines in your changes missing coverage. Please review.

Project coverage is 43.98%. Comparing base (aa11b5d) to head (4d4029b).
Report is 13 commits behind head on main.

Files with missing lines	Patch %	Lines
keep/api/tasks/process_event_task.py	61.90%	56 Missing ⚠️
keep/api/core/db.py	50.00%	54 Missing ⚠️
tests/test_deduplications.py	13.79%	50 Missing ⚠️
keep/api/api.py	70.37%	24 Missing ⚠️
keep/api/routes/alerts.py	71.42%	10 Missing ⚠️
tests/test_enrichments.py	10.00%	9 Missing ⚠️
keep/api/alert_deduplicator/alert_deduplicator.py	58.82%	7 Missing ⚠️
keep/api/bl/enrichments_bl.py	60.00%	6 Missing ⚠️
keep/api/routes/metrics.py	63.63%	4 Missing ⚠️
tests/conftest.py	81.25%	3 Missing ⚠️
... and 3 more

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #2775      +/-   ##
==========================================
- Coverage   44.05%   43.98%   -0.08%     
==========================================
  Files         158      164       +6     
  Lines       15076    15676     +600     
==========================================
+ Hits         6642     6895     +253     
- Misses       8434     8781     +347     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[shahargl]

lgtm