07:17 UTC | 00:17 PT
All known issues with Bulk updates have now been resolved.
06:08 UTC | 23:08 PT
We are receiving reports that bulk ticket updates are not working for some customers. We are investigating.
An error in the deployment commands for an update to the archive code resulted in an unnoticed failure of the intended software on Pods 6 and 9. Coordinated with this release was the cleanup of tables in the database that continued to have a false dependency since the software update failed. This mismatch eventually led to a backup of all Resque batch jobs on these Pods, causing bulk ticket updates/merges to fail as well as halting the processing of outbound mail, stats, and channels.
Once the issue was identified, an updated deployment was rolled out, resolving the issue. To mitigate future occurrences, we're implementing better post-deployment check scripts on our deploy tool.
FOR MORE INFORMATION
For current system status information about your Zendesk, check out our system status page. During an incident, you can also receive status updates by following @ZendeskOps on Twitter. The summary of our post-mortem investigation is usually posted here a few days after the incident has ended. If you have additional questions about this incident, please log a ticket with us.