Summary
On September 14, 2022, Autodesk experienced a service disruption that impacted customers using BIM 360 Docs between 11:05 AM PDT and 7:30 PM PDT.
Impacted Services
- Customers using BIM 360 Docs experienced slowness with model upload and translation.
Root Cause
- New nodes being launched for Notifications service were unable to service any traffic, resulting in errors and slowness. This was a result of updating the image used for new nodes at run time with a Java security update, causing the Java service application to become unstable. Customer impact was a delay for some of the models uploaded into BIM 360 Docs to be translated into other file formats.
- Images from which the Notification service nodes are created were configured to install security patches at runtime.
Autodesk Actions
Autodesk has completed a post-incident analysis of the event and identified actions to be taken. These include the following:
- Prevent new nodes from being spun up during security updates.
- Updated the image for new nodes to prevent security patches from being installed at runtime when new nodes for Notification service come up.
Thank you for your patience and understanding.