Incident Report: CVaaS Service Disruption - September 8, 2025
On September 8, 2025, CloudVision as-a-Service experienced a service disruption, lasting from 8 minutes in our UK region (cv-prod-uk-1) to 25 minutes in a US region (us-central1-a). During this time, users were unable to establish new connections, and transient connection errors occurred for those with existing connections.
We do not expect any data loss, as device state streaming was coalesced and resumed after the disruption. This incident was not caused by a security breach, intrusion, or other malicious activity.
Root Cause
An internal certificate expired within our trust chain, causing a disruption. The certificate was not properly monitored in our system, which notifies and automatically renews certificates, leading to its expiration.
Our Response
Our team was alerted to similar service disruptions across various global regions, and a status page incident was posted because the issue was not transient and was unrelated to our service provider. The disruption was triaged, the root cause identified, and mitigations implemented within 20 minutes. Corrective actions were taken simultaneously over the next approximately 35 minutes. The incident was closed after an assessment of all regions was completed, and services were restored.
We understand that an outage of this nature is unacceptable and apologize to all affected CloudVision as-a-Service users impacted by this incident. We are committed to implementing changes identified during our internal investigation to prevent this type of failure from happening again.
Thank you for using CloudVision as-a-Service.