One place to monitor all your cloud vendors. Get instant alerts when an outage is detected.
Panther services have fully recovered from the regional AWS outage in us-east-1, and all systems are now operating normally.
During the incident, some customers experienced intermittent authentication errors and delays in data ingestion, enrichment, detection processing, and alert generation. All impacted components have since stabilized, and ingestion pipelines have caught up. No further action is required from customers.
Panther services experienced temporary degradation due to a regional AWS outage in us-east-1, and have now returned to normal operation. During the incident, some users saw intermittent authentication errors and delays in data ingestion, enrichment, detection processing, and alert generation. Events are being queued, and will continue to process downstream as services stabilize. However, it may take some time for ingestion pipelines to fully catch up.
Here is the current summary of how each Panther component was impacted and is actively being remediated:
Data ingestion and Enrichment:
- HTTP Sources: If you received 5xx errors when attempting to send data to a Panther HTTP source, please send the data again, as it was not properly ingested nor stored in a queue.
- Data is currently being recovered from the Dead-Letter Queue (DLQ). We expect the data to continue flowing in over the next 24 hours as failed jobs are requeued.
Detections:
- Detection processing may be delayed. Panther is in the process of requeuing all events that had issues being run through associated detections.
Alerting:
- Alerts were generated as detections were processed, which could have been delayed.
- Delivery of alerts to destinations may have been delayed.
- If a destination itself was down, Panther retried a number of times to deliver the alert, then marked delivery as failed in the Console and generated a System Error.
You can review AWS’s incident details on the AWS Service Health Dashboard: https://health.aws.amazon.com/health/status
We’ll continue to post updates here as we confirm full recovery and return to normal operation.
Thank you for your patience while we monitor and validate system stability.
AWS is continuing to experience service disruptions in the us-east-1 region, which may still cause errors or delays when accessing or using Panther.
We’ve confirmed that data ingestion and alert processing are not impacted; events are being queued, and will continue to process downstream as services stabilize. However, it may take some time for ingestion pipelines to fully catch up.
You can follow AWS’s progress directly on their Service Health Dashboard: https://health.aws.amazon.com/health/status
We’ll continue to post updates here as we confirm full recovery and return to normal operation.
Thank you for your patience while we monitor and validate system stability.
With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.
Start free trialNo credit card required · Cancel anytime · 4522 services available
Integrations with