09:07 UTC | 02:07 PT
We are happy to report that the bulk updating issues in Pod 3 are now resolved.
08:43 UTC | 01:43 PT
We are seeing improvements in bulk updates on Pod 3. We are monitoring closely.
08:19 UTC | 01:19 PT
We are currently investigating reports of slow bulk updates for our customers on Pod 3.
A customer was running a bulk import of a large batch of users and caused the queue on one of the work servers to become overloaded. This prevented other customers' jobs from being executed in a timely manner. To resolve the issue, we contacted the customer and asked them to interrupt and postpone their bulk import to off-peak hours.
To avoid this from happening in future we'll be increasing the capacity of the work servers, as well as the possibility of adding rate limiting to bulk user imports.
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.