13:59 UTC | 06:59 PT
Access issues for Pod 5, 6, & 9 customers are now resolved.
13:54 UTC | 06:54 PT
We are investigating access issues to accounts on Pod 5, 6, & 9. We will provide further info shortly.
This incident occurred when rolling back a change that was deployed in response to a recent service incident (Performance Issues Pod 4). In the event that occurred on 2016-09-27, a network vendor circuit was disabled as a precautionary measure while the vendor was experiencing a large outage at the time. We received word that the issue had been resolved, and so prepared to re-enable the circuit. Upon re-enabling the circuit, we discovered packet loss leading to a resurgence of performance issues on Pod 4. The change was rolled back. and we have opened another ticket with the network vendor for investigation.
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.