This incident has been fully resolved and inbound call connection rates have returned to normal.

As of ~2:15 we are no longer seeing increased instability from the ST API. Our team is assessing final impact, but it appears there was minimal impact to calls over this period.

Issue is reported to be resolved and health indicators look good. We're seeing calls get handled appropriately.

Campaign nodes recovered successfully

This incident has been resolved. All systems are operating normally

Fix was landed at 12PM and errors are back to zero.

We've deployed fixes to restore functionality to the dashboard. Root cause was a security improvement that temporarily impaired functionality in the dashboard. We have deployed fixes that restore functionality while preserving security.

Systems have been showing normal for days, marking resolved.

A change was published to tighten controls in certain parts of our compute environment. This change inadvertently halted post-call processing and scheduled job processing via a third party integration vendor. The issue was noticed within 15 minutes, and the change was reverted. The team is evaluating a better approach to address the change in question. Engineering reprocessed any halted / paused jobs.

We've verified that the upstream provider is now fully operational.

Processing should have gone to normal as of afternoon 4/15

Our error monitors have subsided and the provider has marked their incident complete.