Upchain

Incident Report for Autodesk Health Dashboard

Postmortem

AUTODESK EVENT ANALYSIS
Incident Number: #COE-INC110463

Incident Date: July 15, 2024

Summary
On July 15, 2024, between 5:00 PM PDT and July 16, 2024, at 1:42 AM PDT, Autodesk customers could not log into the Live environment in Upchain.

Impacted Services

  • Upchain customers using the Live environment were unable to log into the application and therefore were blocked from using product.

Root Cause

  • The issue was caused by a feature flag enablement where a client ID was missing. To resolve the issue the feature flag was disabled.

Autodesk Actions
Autodesk has completed a post-incident analysis of the event and identified actions to be taken. These include the following:

  • Schedule feature flag enablement when staff is available to validate the production deployment and perform a rollback if required.
  • Improve SSM variable validation to detect empty spaces and to trim leading and trailing space.

Thank you for your patience and understanding

Posted Sep 25, 2024 - 14:35 PDT

Resolved

On July 15, 2024 at 05:00 PM PDT, Autodesk identified an issue where customers were unable to login to Upchain. Once the issue was resolved on July 15, 2024 at 11:42 PM PDT, Upchain returned to normal operation. This is a retroactive notification as this issue did not display on the Autodesk Health Dashboard at that time. Thank you for your patience and understanding.
Posted Jul 26, 2024 - 02:40 PDT
This incident affected: Upchain.