Dagster UI down for multiple users

Incident Report for Dagster Cloud

Postmortem

In addition to structured event logs that appear in the Dagster UI, Dagster supports raw compute logs to capture STDERR and STDOUT.

During the affected window, a fault in our compute log download process resulted in timeouts and diminished responsiveness of our web servers.

We mitigated the issue by temporarily disabling compute log downloads before adjusting compute log behavior so that the conditions that led to the failure are no longer possible. Log functionality has since been fully restored. We've also adjusted our incident process to ensure status pages are posted more quickly in the future.

Please reach out if you have additional questions. Thank you for your patience.

Posted Mar 07, 2025 - 21:34 UTC

Resolved

The Dagster+ UI is restored. Agents, runs, and automations are not affected. We will continue to work to restore STDOUT and STDERR in the UI during US business hours. In the meantime, compute logs will continue to upload but will not be accessible via the UI.

[UPDATE 1:10 pm EST] STDERR and STDOUT are available again in the UI for all users.

Posted Feb 27, 2025 - 11:29 UTC

Monitoring

We have rolled out a fix and are monitoring service restoration. The Dagster+ UI is available again. STDERR and STDOUT tabs on runs are temporarily disabled.

Posted Feb 27, 2025 - 10:52 UTC

Update

We have rolled out a fix and are monitoring service restoration. The Dagster+ UI is available again. STDERR and STDOUT tabs on runs are temporarily disabled.

Posted Feb 27, 2025 - 10:51 UTC

Update

We are continuing to investigate this issue.

Posted Feb 27, 2025 - 10:25 UTC

Investigating

We've received reports from multiple users having trouble accessing the Dagster Cloud UI. Our engineering team is currently investigating.

Posted Feb 27, 2025 - 09:27 UTC

This incident affected: Dagster Cloud UI.