21:23 UTC | 14:23 PT
We're happy to report the issues causing a performance degradation in POD 13 have been resolved. If you have any issues, please reach out to us.
21:02 UTC | 14:02 PT
We’re seeing improvements and recovery on Pod 13. We’ll continue to monitor the situation.
20:33 UTC | 13:33 PT
We're seeing a reoccurrence of performance issues on POD 13. Our Operations team is continuing to investigate the cause.
20:06 UTC | 13:06 PT
There was a brief outage affecting all products on POD 13. Services are working normally now. We're monitoring the situation.
This issue was a reoccurrence of the incident that occurred on June 5 . During this incident, customers on Pod 13 were unable to bulk update tickets. Bulk deletes caused a backup when trying to delete the same record multiple times. Our DBA team executed query killers to stop the slow queries and performance returned to normal. The offending code that caused the incident has been identified and a fix has been deployed to address the defect so that the issue does not happen again.
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.