[osc-fr1] Database node is mis-behaving

» View Event Details | Created Mon, 02 Oct 2023 10:24:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Mon, 02 Oct 2023 11:10:00 +0000

Update

All databases have been restarted. We are running post incident checks.

Posted: Mon, 02 Oct 2023 10:50:00 +0000

Update

Databases are currently restarting on the impacted node.

Posted: Mon, 02 Oct 2023 10:43:00 +0000

Update

The impacted node has been restarted. Databases will start restarting on this node.

Posted: Mon, 02 Oct 2023 10:40:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Mon, 02 Oct 2023 10:24:00 +0000

[All Regions] Trouble reaching applications

» View Event Details | Created Wed, 04 Oct 2023 09:59:00 +0000

Post-Mortem

A post-mortem on this incident is available. It explains why the platform was partially unavailable for a few minutes on the osc-secnum-fr1 region. If you have any questions, don’t hesitate to contact our support team. https://doc.scalingo.com/security/postmortems/spm-2023-001

Posted: Mon, 23 Oct 2023 13:14:00 +0000

Resolved

Cloudflare indicates that a fix has been deployed, the situation appears to be stable, we are still following closely the situation.

Posted: Wed, 04 Oct 2023 12:47:00 +0000

Investigating

An incident is currently in progress on Cloudflare side, affecting DNS resolution. You may experience trouble reaching your applications hosted on Scalingo if you use the 1.1.1.1 address for DNS resolution. Cloudflare has opened an incident on its status page: https://www.cloudflarestatus.com

Posted: Wed, 04 Oct 2023 09:59:00 +0000

[osc-fr1] Database node is mis-behaving

» View Event Details | Created Thu, 05 Oct 2023 23:16:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Fri, 06 Oct 2023 00:02:00 +0000

Update

All databases have been restarted. We are running post incident checks.

Posted: Thu, 05 Oct 2023 23:56:00 +0000

Update

The impacted node has been restarted. Databases will start restarting on this node.

Posted: Thu, 05 Oct 2023 23:43:00 +0000

Investigating

One of our databases hosting node is misbehaving. Our team has been alerted.

Posted: Thu, 05 Oct 2023 23:16:00 +0000

[All Regions] Elevated errors rate on authorization

» View Event Details | Created Tue, 17 Oct 2023 10:08:00 +0000

Resolved

The issue has been traced back to a regression that has been added to our API. We rolled back the impacted deployment. Service is back to normal.

Posted: Tue, 17 Oct 2023 10:30:00 +0000

Update

A probable source has been found. A patch is being progressively deployed.

Posted: Tue, 17 Oct 2023 10:29:00 +0000

Investigating

We detect an elevated error rates on our API. Some requests are finishing with an access denied where the access is legitim.

Our engineers are taking a look at the issue.

Posted: Tue, 17 Oct 2023 10:08:00 +0000

[osc-fr1] A database node is mis-behaving

» View Event Details | Created Tue, 17 Oct 2023 11:30:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Tue, 17 Oct 2023 11:49:00 +0000

Update

The impacted node has been restarted. Databases will start restarting on this node.

Posted: Tue, 17 Oct 2023 11:43:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Tue, 17 Oct 2023 11:30:00 +0000

[osc-fr1] A database node is mis-behaving

» View Event Details | Created Sat, 21 Oct 2023 00:42:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Sat, 21 Oct 2023 03:07:00 +0000

Update

The impacted node has been restarted. Databasesare restarting on this node.

Posted: Sat, 21 Oct 2023 00:47:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Sat, 21 Oct 2023 00:42:00 +0000