Unscheduled Fortress outage
Link to update at November 8, 2023 8:19am EST UPDATE:
The disk cache continues to drain and there is now enough space for most activities to succeed. Fortress is back in production.
Link to update at November 7, 2023 3:09pm EST UPDATE:
Library issues are mostly resolved and it is picking up the backlog of tape requests. The disk cache is still 99% full, so some stages may still fail. We will continue to monitor the system and provide an update tomorrow.
Link to original posting ORIGINAL:
Fortress began experiencing issues with its tape library around 5:00PM. Engineers are currently diagnosing the issue and are working to identify a fix. Vendor support has been contacted and diagnostics have been uploaded.
During this time tape accesses may be slow or fail. Also, due to problem, the disk cache used to hold larger files is very full, so you may get out of space errors while trying to write large files.
We will provide an update by noon November 7, 2023.