Outage in InEvent

Slow web socket connection

Resolved Minor
September 13, 2021 - Started over 2 years ago - Lasted 7 months
Official incident page

Need to monitor InEvent outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including InEvent, and never miss an outage again.
Start Free Trial

Outage Details

We are currently seeing a slow scalability response from the InEvent Firebase socket group. We are currently investigating the issue with Google Firebase team.
Latest Updates ( sorted recent to last )
MONITORING over 2 years ago - at 09/13/2021 05:07PM

The team has concluded the implementation of all temporary solutions on the platform.
This includes creating a timeout option on slow connecting sockets and also disabled Redis as a single connection.
The web socket chat will remain with limited chat support on the firebase instance until we add support for per instance local connection, which should happen next week.
The Redis cache team will be implementing a new permanent solution end of this week, Friday at the latest.

IDENTIFIED over 2 years ago - at 09/13/2021 03:45PM

We currently fixed an autoscaling Redis instance that was not able to redirect the load to a separate system. Redis is used by InEvent to quickly balance its write operations instead of relying only on a traditional SQL database.

The following components are still affected:
Firebase Web Sockets, which covers the live chat on the Virtual Lobby.

IDENTIFIED over 2 years ago - at 09/13/2021 02:55PM

We have identified the slowness from the Firebase product.
We are deploying an alternative with the Native websockets, under Company > Tools.
We are currently deploying a fix for UI improvements on the Firebase UI console while Firebase is not responsive.
Chat may be offline while the fix is being applied, but video and streaming should work normally.

INVESTIGATING over 2 years ago - at 09/13/2021 02:48PM

We are currently seeing a slow scalability response from the InEvent Firebase socket group. We are currently investigating the issue with Google Firebase team.

Start monitoring InEvent and all your cloud vendors in minutes

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3153 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime