CVaaS Status

High Device Streaming Latency experienced on the Platform

Update - Device streaming latency and data ingestion are still steady. We are still monitoring the platform. The next update will be provided if the situation changes.
Jun 28, 2026 - 11:24 UTC

Monitoring - We have seen steady stabilization since June 27th, 17:00 UTC, and brief ingestion latencies ( < 5m ) being resolved with mitigations since June 28th, 02:00 UTC. Device streaming latency and data ingestion are holding steady at this time.

We are continuing to monitor the service region cv-prod-us-central1-b.
Jun 28, 2026 - 05:52 UTC

Update - We are continuing to improve the stability of the platform. At this time we are seeing steady stabilization since June 27th, 17:00 UTC.

Our team is observing the various mitigations in place currently prior to transitioning to monitoring phase.
Jun 28, 2026 - 04:03 UTC

Update - We are continuing to improve the stability of the platform.

We have made significant progress since the start of this incident. We have seen steady stabilization since June 27th, 17:00 UTC, with platform ingest rates and streaming latency demonstrating consistent periods of stability.

At this time, our team is focusing on mitigating brief periods ( < 5m ) of ingestion spikes. We are working on resolving this aspect before fully transitioning to the monitoring phase.

Thank you for your continued patience.
Jun 28, 2026 - 00:53 UTC

Update - We are continuing to stabilize the platform. We will post updates every 3 hours to reduce spam.
Jun 27, 2026 - 21:32 UTC

Update - We are continuing to stabilize the platform. We will post updates every 3 hours to reduce spam.
Jun 27, 2026 - 18:32 UTC

Update - We are continuing to stabilize the platform. We will post updates every 3 hours to reduce spam.
Jun 27, 2026 - 15:46 UTC

Update - We are continuing to stabilize the platform. We will post updates every 3 hours to reduce spam.
Jun 27, 2026 - 12:41 UTC

Update - We are continuing to stabilize the platform. We will post updates every 3 hours to reduce spam.
Jun 27, 2026 - 09:39 UTC

Update - We are continuing to stabilize the platform. We will post updates every 3 hours to reduce spam.
Jun 27, 2026 - 06:37 UTC

Update - Our team is continuing to respond to this incident. At this time, some devices may see intermittent streaming latency increases, and potentially erroneous "Device Stopped Streaming" events, but not at broad scale. We expect this to impact about < 1 % of our devices currently for cv-prod-us-central1-b.

We are continuing to stabilize the platform.
Jun 27, 2026 - 05:06 UTC

Update - We are continuing to stabilize the platform.
Jun 27, 2026 - 01:58 UTC

Update - We are continuing to stabilize the platform.
Jun 27, 2026 - 00:35 UTC

Update - We are continuing to stabilize the platform.
Jun 26, 2026 - 22:51 UTC

Update - We are continuing to stabilize the platform.
Jun 26, 2026 - 21:33 UTC

Update - We are continuing to stablize the platform.
Jun 26, 2026 - 20:27 UTC

Identified - Currently, lag has resolved and our publish latencies are stable - however we are seeing elevated error increase, which we are investigating.
Jun 26, 2026 - 19:09 UTC

Monitoring - We have fully recovered from the ingestion lag. We are continuing to monitor.
Jun 26, 2026 - 18:42 UTC

Update - Our Publish latency for P90 and P95 have stabilized. We are continuing with recovery.
Jun 26, 2026 - 18:34 UTC

Identified - We are actively investigating as well as working on recovery.
Jun 26, 2026 - 18:10 UTC

Investigating - We are experiencing high device streaming latency on this affected cluster.

Some impact may be user visible, such as:
- A delay in processing streamed device data. Some events such as "Device stopped streaming" or "Streaming Latency Breached Threshold" may fire as a result of this. In this case, the device updates are behind schedule and will be processed with some delay during the impact window.
- There may be some stale data, or sporadic timeouts viewing parts of the UI.
- Some provisioning features may be delayed or timeout due to the high latency.

We are currently investigating the issue and working on mitigation. Thank you for your patience.
Jun 26, 2026 - 17:27 UTC

us-central1-a Operational

Core Platform Operational