Unscheduled scratch outage on Rice, Hammer, and Snyder
The scratch filesystem serving Hammer, Rice, and Snyder has been restored to normal operations, and all queues have been re-enabled.
The scratch filesystem serving Hammer, Rice, and Snyder is partially unavailable.
Both currently running jobs and attempts to access files on their scratch which happen to be on a specific internal disk array will currently block, as well as commands such as quota and df. Any jobs whose files are served by other portions of the scratch filesystem will be unaffected.
As a precaution, job scheduling on Hammer, Rice, and Snyder has been paused while storage engineers address the issue.