Outage in FAS Research Computing

holylabs - over quota message or previously deleted files showing up

Minor
June 06, 2025 - Started 15 days ago

Need to monitor FAS Research Computing outages?
Stay on top of outages with IsDown. Monitor the official status pages of all your vendors, SaaS, and tools, including FAS Research Computing, and never miss an outage again.
Start Free Trial

Outage Details

During the downtime holylabs was migrated to our new Vast filesystem. During this migration data was synced from from the old system to the new and then a final sync was done at powerup while the systems were not available for use by end users.We have since found an issue for some labs that will present itself in one of two ways (or both, for some):1 - You are able to use your holylabs lab directory but you notice files that were previously deleted2- You cannot use your holylabs lab directory because of over quota errorsOur storage team is working to resolve this issue by temporarily suspending quotas on holylabs to prevent over-quota errors and also to remove the data that should not have remained after the final sync(s) so as to get lab directories back below quota.This work has already begun but will may take several days to complete. Updates will be posted here.
Latest Updates ( sorted recent to last )
IDENTIFIED 15 days ago - at 06/06/2025 03:50PM

During the downtime holylabs was migrated to our new Vast filesystem. During this migration data was synced from from the old system to the new and then a final sync was done at powerup while the systems were not available for use by end users.We have since found an issue for some labs that will present itself in one of two ways (or both, for some):1 - You are able to use your holylabs lab directory but you notice files that were previously deleted2- You cannot use your holylabs lab directory because of over quota errorsOur storage team is working to resolve this issue by temporarily suspending quotas on holylabs to prevent over-quota errors and also to remove the data that should not have remained after the final sync(s) so as to get lab directories back below quota.This work has already begun but will may take several days to complete. Updates will be posted here.

Latest FAS Research Computing outages

Coldfront service disruption - about 18 hours ago

Be the First to Know When Vendors Go Down

With IsDown, you can monitor all your critical services' official status pages from one centralized dashboard and receive instant alerts the moment an outage is detected. Say goodbye to constantly checking multiple sites for updates and stay ahead of outages with IsDown.

Start free trial

No credit card required · Cancel anytime · 4400 services available

Integrations with Slack Microsoft Teams Google Chat Datadog PagerDuty Zapier Discord Webhook