Skip to content

Latest commit

 

History

History
16 lines (12 loc) · 790 Bytes

2024-06-06-api-disruption.md

File metadata and controls

16 lines (12 loc) · 790 Bytes

api.foundries.io disruption

We were experiencing a disruption on our resources:

  • api.foundries.io was failing to serve certain requests with 500 error
  • app.foundries.io was showing 500 error on some pages

The issue was investigated and fixed.

Timeline of Events

  • 18:05 UTC - We deployed a new version of api.foundries.io containing a bug in our instrumentation (logging) code. This caused the API to respond with 500 error to some requests, prior to handling those requests. As a result, some pages on app.foundries.io were also showing 500 error.
  • 18:40 UTC - A problem was noticed in our cloud logs and investigation started.
  • 19:01 UTC - A fix was prepared, verified, and merged.
  • 19:19 UTC - A fix deployed to our servers; system is back to normal.