Unscheduled Scheduling Outage on Hansen
Job scheduling on Hansen has returned to normal. This concludes the outage.
Original Message:
Hansen is not currently scheduling any new jobs.
A filesystem used for a specific project serving Hansen became unavailable on Hansen around 5:00am. This caused the cluster to begin offlining all nodes and not scheduling any new jobs.
We are investigating the issue and are bringing back all the nodes with or without this filesystem as soon as possible so unrelated work may continue.