04:54 UTC | 21:54 PT
We are happy to report that the issues affecting Views on Pod 6 have been resolved.
04:37 UTC | 21:37 PT
We’re seeing improvements on issues affecting Views for some customers on POD 6. Will continue to monitor.
04:11 UTC | 21:11 PT
We are currently investigating an issue of Views not displaying correctly for a few customers on POD 6
A voice failover and influx of voice traffic on pod 6 caused views to not update correctly in a cluster on pod 6 due to database replication lag. This in turn caused an issue with the mysql replication client not able to publish events in a timely manner downstream. In the notifications service, push notifications were dropped or delivered significant delays. While one of the slaves recovered on its own, we had to restart and recover the other slave then bring it back into rotation. In order to prevent this from happening again in the future we will send current voice queue activity to db slaves instead of master.
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.