The issue has been identified and resolved. A buggy query heavily loaded the system for approximately 16 minutes. During this time, queries were queued and data display slowed. When the query in question was identified the task was killed. Shortly after, services returned to normal. This affected reads from the system, as well as alerts. Customer collection was not affected, and there was no data loss.
Posted over 1 year ago. Sep 06, 2017 - 23:47 UTC
After restarting the database cluster, things are back to a normal state. We're continuing to monitor the status closely, and investigating the root cause.
Posted over 1 year ago. Sep 06, 2017 - 23:20 UTC
We're looking into an increased number of errors and timeouts when accessing our database.