Gamma Outage History

Cisco Webex experienced DNS record issues that caused intermittent inbound call failures on iOS devices using the Horizon with Webex Mobile APP, while outbound calls and Android devices remained unaffected. Cisco engineers identified and resolved the DNS problems within their network. The service was restored after monitoring confirmed successful call delivery, with the incident lasting approximately 30 hours.

BT Openreach experienced a network issue affecting 0292 numbers (South Wales area) that had been ported from their service, with additional reports of 01443 numbers also being impacted. The issue caused service disruptions for these ported numbers over approximately 49 hours while BT's switch team worked to resolve what they classified as a major network incident. BT Openreach confirmed resolution on the morning of May 21st, with affected numbers returning to normal service, though users were asked to report any remaining issues to the service desk.

Gamma's mobile data service experienced issues where users reported data was either unavailable or capped, affecting the mobile network for 3.7 hours. The technology partner (3UK) identified and corrected an issue with a specific network cluster. Normal data service was restored after the cluster issue was resolved.

A fire in a neighboring building caused the Amsterdam data center to be taken offline as a precaution, resulting in a power failure that affected Webex Contact Center services and call recording access in Control Hub. All services automatically failed over to redundant infrastructure in London with no interruption to live calling or other core functions, though users temporarily lost the ability to access call recordings through Control Hub. The call recording service was fully restored over the weekend with no data loss, and all systems returned to normal operation.

The Gamma Portal experienced performance issues that impacted order management and fault management functionality. The service disruption lasted 5.7 hours and affected general network operations. Engineering teams resolved the issue and implemented monitoring to prevent further impacts before closing the incident.

Gamma's Ethernet service experienced a complete outage lasting 9.1 hours due to issues with PXC core network switches, which caused LDP sessions to fail and prevented L2 circuits from establishing. The incident affected the general network infrastructure and was resolved through collaboration between multiple engineering teams, hardware supplier support, and core switch reboots. Services were restored and monitored for stability, with the incident remaining open for additional monitoring to ensure no further issues arose.

A faulty FPC card caused a service impact to Ethernet connectivity between Gamma and TalkTalk networks. TalkTalk engineers replaced the defective card with a spare unit that had been delivered to the site. Services were restored after the card replacement was completed, with the incident lasting 3.9 hours.

The Gamma portal experienced access issues that prevented users from loading email content and accessing voice platform portals including Horizon, Inbound, and STCM. Engineering teams performed restorative actions including server reboots and application layer fixes to resolve the connectivity problems. The service was restored after 25.2 hours with continued monitoring to ensure stability.

Cisco WxCC experienced degraded performance affecting customers in the US, Canada, ANZ, and UK regions, with UK users also reporting issues despite the initial scope being limited to other regions. The incident impacted general network functionality and lasted 24 hours. The team worked with Cisco to provide logs and resolve the performance issues.