Service Incident - December 8th, 2017 - Intermittent search errors, Pod 11

SUMMARY

09:01 UTC | 01:01 PT
We are happy to report that the search issue affecting some customers on pod 11 is resolved

08:43 UTC | 00:43 PT
We are currently experiencing reports of search issues impacting some Pod 11 customers.

POST-MORTEM
During this incident, customers experienced intermittent errors for operations relying on the search platform. The team found that the Elastic Search service was not running on one of the nodes on Pod 11, causing Search to work sometimes and return errors other times. The team manually restarted the downed node, restoring Search services back to normal. To help prevent recurrence of this issue, the team is investigating improving error codes on unhealthy nodes, as well as implementing an auto-start function on downed Elastic Search nodes.

FOR MORE INFORMATION

For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.