HTTP 5xx errors have been resolved.

Upgrades have been completed for the evening.

Unfortunately there are items that could not be actioned during this upgrade and are scheduled to the next available window.

It appears that a configuration point was missed.
Node srv4 was drawing substantially more errors than the rest of the nodes and has been taken offline.

In addition, Puma concurrency and max_threads tuning is still in process.

mstdn.ca appears to be more stable, however until errors are completely solved this incident will remain open.

We recognize the ongoing 500 errors being a challenge to use mstdn.ca. We're working as quickly as we can to identify the root cause of the issue.

More information will be shared here as it becomes available. Thank you for your patience.