Hansen: unscheduled outage to Lustre scratch
The error condition on the Lustre filesystem has been cleared, and Hansen is back in production and accepting new jobs.
Jobs already running should have resumed at the point where they were blocked waiting when the Lustre error occurred.
This afternoon (December 6, 2011) the LustreC scratch filesystem serving the Hansen cluster has suffered a multiple disk failure. As a result, scheduling has been stopped on Hansen.
This issue has been escalated to the storage vendor. We currently have no estimate for when LustreC will return to service.