Outages
-
Data Depot Filesystem issue: Scheduling Resumed
An internal portion of the Data Depot filesystem is currently offline, as a result, all scheduling has been paused until this issue is resolved. Impact to you Attempts to read files that are on the affected storage may result in error messages Our IT...
-
Gilbreth Remains Unavailable – Update Expected by 10:00 AM
The scheduled Math Data Center maintenance is complete. The Gilbreth cluster remains unavailable as we continue post‑maintenance work. The next update will be provided by 10:00 AM tomorrow (Friday), or sooner if available. We appreciate your patience...
-
Unscheduled Data Depot Service Outage
RCAC’s Data Depot storage system is currently unavailable. Our team is actively investigating and working to restore service as quickly as possible. We will provide updates as the situation develops and once service is fully restored. We appreciate y...
-
Globus access to Depot degraded; slow Depot logins and Depot access on clusters
Users of Data Depot on RCAC clusters are currently experiencing degraded performance, and some Globus transfers to and from Depot are failing or running slowly. In addition, some users may see slow Globus logins or be temporarily unable to log in to...
-
The storage system for Geddes started experiencing issues overnight. Any deployments using the geddes-standard-multinode storage class will experience issues accessing data. Engineers are currently investigating.
-
Gilbreth Scheduling paused due to Scratch filesystem issue
We’re currently addressing an issue with the Scratch filesystem on Gilbreth, and job scheduling has been temporarily paused while we work on a fix. Our team is actively investigating and will post updates as soon as more information is available or 4...
-
Unscheduled Cluster & Data Depot Outage
Data Depot and clusters began experiencing issues around 8:00AM EST. Engineers are currently diagnosing the issue and are working to identify a fix. Job scheduling has been paused while this issue is being addressed. We will provide an update by 2:00...
-
The Weber cluster began experiencing issues around 8:00 AM EST. Engineers are currently diagnosing the issue and are working to identify a fix. The cluster is unreachable at this time. No ETA is currently available for return to service We will provi...
-
The gilbreth cluster began experiencing issues around 9:00 AM EST. Engineers are currently working on a solution and expect for return to service by 11:30 AM EST.
-
The Data Depot storage system began experiencing issues starting around 4:30pm EDT today. Engineers are currently diagnosing the issue and are working to identify a fix. Job scheduling has been paused while this issue is being addressed. We will prov...
-
The Geddes cluster began experiencing issues with its storage system around 4 AM this morning. Some users may be experiencing no space left on device errors or other storage related errors on their deployments. Engineers are currently diagnosing the...
-
Edit: The Data Depot file system has returned to full service and scheduling has resumed on all clusters. The Data Depot storage system began experience issues starting around 9am EDT this morning. Engineers are currently diagnosing the issue and ar...
-
Edit: Data Depot functionality has been restored. The Data Depot file system began experiencing issues with writes around 2:30pm EDT. The data migration process currently ongoing from Data Depot 2 to Data Depot 3 ran into an unexpected problem. Engi...
-
Problem For New User/Projects On Anvil
Anvil is experiencing a problem with new user and allocation propagation. Our engineers are working on the fix, and will keep this updated. The problem has been fixed at 5 pm.
-
The Gautschi cluster began experiencing issues with cooling around 2:00pm EST. Engineers are currently diagnosing the issue and are working to identify a fix. Job scheduling has been paused while this issue is being addressed. No ETA at this time. We...
-
Today, RCAC user management systems sent incorrect email messages to many faculty partners and their resource managers. Please ignore any recent email about expirations or removals. You may verify who has access to your resources through our site www...
-
Power outage after thunderstorm
A power outage affected our datacenters at approx 3:15pm. It appears cluster services are restored, however access and authentication may be slowed while we work to get other core infrastructure back online. OoD and desktop of Negishi and gilbreth ma...
-
Unscheduled Weber Login Interruption
The Weber cluster began experiencing issues with logins around 10:00am EDT. Engineers are currently diagnosing the issue and are working to identify a fix. We will provide an update by 2:00pm EDT.
-
Beginning at 10:00 AM EST on June 10th, the Anvil cluster experience a brief network interruption to fix an issue related to network connectivity. We are continuing to work on it and expected return to service is 11:00 AM EST the end of the day. Upda...
-
Beginning at 19:00 EST, the Anvil cluster will experience a brief network interruption to fix an issue related to network connectivity. Expected return to service is 19:30 EST.