Outage in Georgia Tech IT

GTED gtAccountEntitlements have been accidentally removed and need to be restored

Resolved Minor
October 15, 2024 - Started 2 months ago - Lasted 14 days

Need to monitor Georgia Tech IT outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including Georgia Tech IT, and never miss an outage again.
Start Free Trial

Outage Details

Between 9:30-9:45 today, a grouper patch in Test overwrote production entitlement value from across GTED, which affected the access of some user accounts. Support is currently restoring those entitlements from backup and are performing an emergency change to temporarily turn off provisioning and processing until the issue has been addressed to prevent further accounts from being affected
Components affected
Georgia Tech IT Identity
Latest Updates ( sorted recent to last )
2 months ago - at 10/15/2024 04:18PM

Between 9:30-9:45 today, a grouper patch in Test overwrote production entitlement value from across GTED, which affected the access of some user accounts. Support is currently restoring those entitlements from backup and are performing an emergency change to temporarily turn off provisioning and processing until the issue has been addressed to prevent further accounts from being affected

2 months ago - at 10/15/2024 05:25PM

Between 9:30-9:45 today, a grouper patch in Test overwrote production entitlement value from across GTED, which affected the access of some user accounts. Support is currently restoring those entitlements from backup and are performing an emergency change to temporarily turn off provisioning and processing until the issue has been addressed to prevent further accounts from being affected

2 months ago - at 10/15/2024 07:41PM

The OIT team currently tasked with fixing this problem with the GT account access services has identified the issue and is still in the process of restoring full access to user accounts.

2 months ago - at 10/16/2024 12:13AM

All student and employee accounts should now be restored. OIT is moving onto restoring other accounts that lost their entitlements earlier this morning on 10/15/2024.

2 months ago - at 10/17/2024 05:54PM

As of 11:30am on Thursday 10/17, GRS has been fully refreshed, inspected, and re-enabled. This indicates that the recovery of GTED and GRS from Tuesday is largely complete. However, Grouper updates are still delayed as the Identity Management(IAM) team continues to verify the read-only behavior and ensure they can test the components requiring further testing without risking production data.

2 months ago - at 10/18/2024 11:13PM

OIT is still working through this issue and is now entering the final stages of our fix implementation. We will send another update when further information is available

2 months ago - at 10/21/2024 03:55PM

The Grouper system is still undergoing updates, with ongoing efforts to verify its accuracy before it can be fully re-enabled.
The IAM team is addressing persistent entitlements issues by implementing workarounds for provisioning problems and ensuring accurate group memberships. Efforts are also focused on strengthening the test system for new software testing. The team aims to have workarounds in place by the end of tomorrow and is targeting a permanent fix by the end of the week.

Start monitoring all your vendors in just 5 minutes

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 3278 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook

Setup in 5 minutes or less

How much time you'll save your team, by having the outages information close to them?

14-day free trial · No credit card required · Cancel anytime