2023-11-16 - AMER - Delay in Visibility Logs

This incident has been resolved and the service is operating normally at this time. Again, we apologize for any impact this may have had on you or your customers.

Log ingestion for Firebox logs service is operating normally at this time and we're monitoring to ensure system stability. We'll post our next update in 30min, if not sooner.

Recovery process for Log Ingestion is still in place, some delays are still expected. We will post an update in 2 hours if not sooner. We apologize any inconvenience this event may have caused.

Log ingestion for Firebox logs service keeps returning to nominal values, some delays are still expected. We will post an update in 2 hours if not sooner. We apologize any inconvenience this event may have caused. Thank you for your patience.

Metrics of the Log ingestion for Firebox logs service continue returning to normal, some delays are still expected. Please check back at 2023-11-17 15:00 UTC for updates. We apologize for the impact this event may have caused. Thank you for your patience.

Log ingestion for Firebox logs service keeps catching up. Please check back at 2023-11-17 13:00 UTC for updates. We apologize for the impact this event may have caused. Thank you for your patience.

Log ingestion for Firebox logs service is still catching up. Please check back at 2023-11-17 11:00 UTC for updates. We apologize for the impact this event has caused. Thanks for your patience

The log ingestion for Firebox logs service continues to catchup. Please check back at 2023-11-17 09:00 UTC for updates. We apologize for the impact this event has caused. Thanks for your patience

Log ingestion is delayed by about 6.5 hours. We estimate that it'll take 5 hours for the recovery to be completed. Please check back for updates at 2023-11-17 07:00 UTC. We apologize for the impact this event has caused and thank you for your patience.

The log ingestion service continues to catchup. Please check back at 2023-11-17 01:00 UTC for updates. Thanks for your patience.

Our log ingestion service is recovering. However, we are still experiencing delays in log ingestion for Firebox logs and are still investigating the initial cause of the issue. We apologize for the impact this event has caused and will post our next update in 2 hours, if not sooner.

We were alerted to delays in log processing for Firebox logs and have taken steps to address the problem. However, we are still investigating the initial cause of the delay. The system is working to catch up on the delay. We'll post our next update in 60 minutes, if not sooner.