Rice scheduling temporarily stoppedUPDATE: June 13, 2019 5:31pm
We have identified and eliminated the source of potential instability with Rice scratch. As of 5:31pm, job queues on the Rice cluster have been enabled and job scheduling has resumed. We will continue to monitor the filesystem to ensure stable operations.
We apologize for the disruption of service. Please report any issues to firstname.lastname@example.org.
ORIGINAL: June 13, 2019 12:26pm
The Rice cluster is currently experiencing a vendor bug in its scratch filesystem. To prevent filesystem instability, job scheduling has been paused while engineers are diagnosing the issue. Currently running jobs will not be affected (only starting of new ones will).
We will provide an update by 5 PM today.