09:59 UTC | 01:59 PT
We are happy to let you know that the incident affecting customers on pod 3 is now solved.
09:27 UTC | 01:27 PT
We're seeing improvements on POD3 and are continuing to work to stabilise services.
08:58 UTC | 00:58 PT
Our Operations team are working to mitigate the cause of issues impacting POD3 accounts. Thank you for your patience.
08:42 UTC | 00:42 PT
We are investigating issues affecting POD3 accounts. More information to come! Thank you for your patience!
This is a reoccurrence of the Support, Talk, Help Center Outage in Pod 3 incident from the previous week. Root cause analysis is still ongoing, however initial findings are showing a collision of services when the datastore is backed up and copied between different servers causing the load balancers to flap. Stopping a portion of the datastore backups caused the services to stabilize, resolving the issue. To prevent another recurrence of this issue, a change has been made to move the EU datastore backups to non EU business hours.
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.