[osc-fr1] A database node is mis-behaving

» View Event Details | Created Fri, 03 Nov 2023 08:17:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Fri, 03 Nov 2023 09:46:00 +0000

Update

Most of the databases have been restarted at this point, but there are still 6 unstarted instances, which we are currently working on.

Posted: Fri, 03 Nov 2023 08:43:00 +0000

Update

The affected node has been restarted and the databases hosted on it are being rebooted.

Posted: Fri, 03 Nov 2023 08:42:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Fri, 03 Nov 2023 08:17:00 +0000

[global] Some deployments are failing

» View Event Details | Created Mon, 06 Nov 2023 09:38:00 +0000

Update

If your deployment is still failing with the following error:

E: The repository 'http://apt.postgresql.org/pub/repos/apt bionic-pgdg Release' no longer has a Release file.

You will need to reset your deployment cache (https://doc.scalingo.com/platform/deployment/cache) and retry.

Posted: Mon, 06 Nov 2023 11:03:00 +0000

Resolved

The fix has been released on both regions.

Posted: Mon, 06 Nov 2023 10:27:00 +0000

Update

The fix has been validated. It is currently being released in both osc-fr1 and osc-secnum-fr1 regions.

Posted: Mon, 06 Nov 2023 10:22:00 +0000

Update

The source of the issue has been found. A patch is being written.

Posted: Mon, 06 Nov 2023 09:42:00 +0000

Investigating

Deployments using the apt-buildpack with the scalingo-20 stack are currently failing on both regions.

Posted: Mon, 06 Nov 2023 09:38:00 +0000

[osc-fr1] A database hosting node is misbehaving

» View Event Details | Created Mon, 06 Nov 2023 17:15:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Mon, 06 Nov 2023 18:06:00 +0000

Update

Most of the databases have been restarted at this point, but there are still 2 unstarted instances, which we are currently working on.

Posted: Mon, 06 Nov 2023 18:01:00 +0000

Update

The databases on the impacted are currently restarting.

Posted: Mon, 06 Nov 2023 17:46:00 +0000

Update

The incident has been traced back to an hardware issue. We are continuing to investigate.

Posted: Mon, 06 Nov 2023 17:32:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Mon, 06 Nov 2023 17:15:00 +0000

[osc-fr1] Database node is mis-behaving

» View Event Details | Created Sat, 11 Nov 2023 03:17:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Sat, 11 Nov 2023 04:09:00 +0000

Update

All databases have been restarted. We are running post incident checks.

Posted: Sat, 11 Nov 2023 03:54:00 +0000

Update

The impacted node has been restarted. Databases are currently restarting on the impacted node.

Posted: Sat, 11 Nov 2023 03:40:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Sat, 11 Nov 2023 03:17:00 +0000

[osc-secnum-fr1] API High Error Rate

» View Event Details | Created Tue, 14 Nov 2023 11:05:00 +0000

Resolved

The situation is stable now. The incident is now resolved.

Posted: Tue, 14 Nov 2023 20:00:00 +0000

Update

Deployments are working again on the osc-secnum-fr1 region.

Posted: Tue, 14 Nov 2023 11:21:00 +0000

Investigating

Some operations on the platform are currently not possible due to an incident on our provider's Object Storage.

This only impacts the osc-secnum-fr1 region on the following actions:

• Deployments
• Scale (/auto Scale)
• Restarts
• Logs Archives

Posted: Tue, 14 Nov 2023 11:05:00 +0000

[osc-fr1] Database node is mis-behaving

» View Event Details | Created Tue, 14 Nov 2023 15:07:00 +0000

Resolved

All databases have been restarted. If you still have issues, please contact our support.

Posted: Tue, 14 Nov 2023 15:30:00 +0000

Update

The node has been restarted, the databases are being rebooted.

Posted: Tue, 14 Nov 2023 15:29:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted. We are going to reboot the affected node. This will cause a service interruption for databases using a "starter" plan hosted on this node. Databases using a business plan will not be affected.

Posted: Tue, 14 Nov 2023 15:07:00 +0000

[osc-secnum-fr1] Incident affecting PostgreSQL databases

» View Event Details | Created Tue, 14 Nov 2023 16:36:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please don't hesitate to contact our support.

Posted: Tue, 14 Nov 2023 16:58:00 +0000

Investigating

An incident is in progress on an internal component, affecting PostgreSQL databases hosted on the osc-secnum-fr1 region. Investigations are in progress.

Posted: Tue, 14 Nov 2023 16:36:00 +0000

[Maintenance - osc-fr1] Expected impact on hosted databases

» View Event Details | Created Wed, 22 Nov 2023 19:00:00 +0000

Resolved

All databases are back online, the operation is now complete. If you are still experiencing issue please contact the support.

Posted: Wed, 22 Nov 2023 20:04:00 +0000

Update

The maintenance has ended with success on the third node. We are running post maintenance checks.

Posted: Wed, 22 Nov 2023 20:00:00 +0000

Update

Databases are restarting on the third node.

Posted: Wed, 22 Nov 2023 19:48:00 +0000

Update

The maintenance has ended with success on the second node. The maintenance will start on the third node.

Posted: Wed, 22 Nov 2023 19:39:00 +0000

Update

The maintenance has ended with success on the first node. The maintenance will start on the second node.

Posted: Wed, 22 Nov 2023 19:19:00 +0000

Update

Databases are restarting on the second node.

Posted: Wed, 22 Nov 2023 19:30:00 +0000

Update

The maintenance is starting on the first database node.

Posted: Wed, 22 Nov 2023 19:01:00 +0000

Scheduled

A maintenance operation is planned on 3 database nodes on Wednesday November 22nd from 8pm to 11pm (CET). An e-mail has been sent to the owners and collaborators of the databases that will be impacted. If you haven't received any e-mails, you won't be affected by the operation.

As a reminder:

• For databases using a Business plan: no impact is expected.
• For databases using a Starter plan: a service interruption is expected. We estimate this interruption will last less than one hour.

You will be able to follow the progress of the operation on our status page.

Posted: Wed, 22 Nov 2023 19:00:00 +0000

[osc-secnum-fr1] Database node is mis-behaving

» View Event Details | Created Mon, 27 Nov 2023 00:16:00 +0000

Resolved

All checks are now green on our side. If you still have issues, please contact our support.

Posted: Mon, 27 Nov 2023 00:24:00 +0000

Update

The impacted node has been restarted. All databases have been restarted. We are running post incident checks.

Posted: Mon, 27 Nov 2023 00:23:00 +0000

Investigating

One of our database instance node is misbehaving. Our team has been alerted.

Posted: Mon, 27 Nov 2023 00:16:00 +0000