Scratch system failure on Rice, Snyder, Hammer
*** Update ***
As of 7:00 pm, the problem on the scratch system has been corrected, and scheduling has resumed on all three affected clusters - Rice, Snyder, and Hammer.
Update
Storage engineers are working with the system vendor to evaluate a proposed fix for the problem.
We will update the status again no later than 9:00pm tonight.
Original Message
The scratch file system serving the Rice, Snyder, and Hammer clusters has stopped allowing users to write new data to it.
Scheduling on those clusters has been paused, so new jobs will not be started. Currently running jobs may fail if they try to write data into the scratch system.
Engineers are currently working on this problem, and we will update the status of the system no later than 6:00 pm today.