Carter
-
Carter Cluster Decommission Early Notice
Thank you for partnering with ITaP in the community cluster program. Carter has been running for more than 4.5 years now and will be decommissioned on April 30, 2017. This timeline coincides with the five-year warranty of the machine. Our current tim...
-
As a reminder, Carter will be shut down and decommissioned on Sunday April 30, 2017. ALL DATA in /scratch/carter WILL NOT BE RETRIEVABLE after April 30, 2017. See below for options on how to move any data you wish to keep from Carter's scratch space...
-
Emergency Carter Cluster Maintenance
Update: Owner queues on Carter have been restarted. While Carter is currently deemed stable, performance is still impacted. Engineers are closely monitoring the situation and will take corrective action if necessary. Update: At this time, only Carter...
-
Partial scratch outages on Rice, Snyder, Carter, Scholar and Hammer
The scratch filesystems serving Carter, Hammer, Rice, Scholar, and Snyder started behaving abnormally this morning. This may have affected some jobs, and anyone using one of the login nodes for these clusters may have had sessions freeze or seen dela...
-
Emergency Security Patching of RCAC Clusters
Due to a recent security vulnerability, the Carter, Halstead, Hammer, Radon, Rice, Scholar, and Snyder clusters will have their operating system upgraded to a newer version during February 2, 2017 5:00pm - March 2, 2017 5:00pm EST. Unlike other cl...
-
Clusters to switch to hierarchical modules
Carter, Conte, Hammer, Hathi, Rice, Scholar, and Snyder have been converted to hierarchical modules. All front-ends have been converted, and nodes will update over the next couple of hours. Running jobs will not be impacted by this change. If you hav...
-
The maintenance for Carter cluster was cancelled and will be rescheduled at a later date. The cluster has remained in service. Original Notice The Carter cluster will be unavailable beginning at Tuesday, January 10th, 2017 at 8:00am EST, for emergen...
-
The old Carter scratch filesystem (Warp) will be retired and shut down in three weeks' time. To access this filesystem and ensure you have any files or data you need transferred, please refer to the Carter Scratch Transfer Tool news posting on this...
-
The Carter Cluster was returned to production at 10:45pm on November 7. We apologize for this extended outage. Update: November 7, 2016 6:01pm Work on reinstalling the Carter nodes continues. All other systems have returned normal operations. We...
-
Security vulnerability patch impacts debugging
Due to a recently found vulnerability in the Linux Kernel (known as the Dirty-COW vulnerability), an emergency patch has been applied on the cluster nodes. This patch is necessary to avoid exploitation of the vulnerability. Unfortunately, the patch i...
-
Measures taken within the first two hours of this problem seem to have resolved the issue. Original Message: A portion of the systems serving the Research Data Depot have suffered a failure. Some systems using Depot have been affected, particularly...
-
Unscheduled Scratch Outage on Carter
UPDATE As of about 6:30 pm, the new scratch system was brought back online, and scheduling has been restarted on Carter. Original Message The new scratch filesystem serving Carter that was just activated on Tuesday night is currently unavailable. Bot...
-
On September 27th, 2016, the Carter cluster scratch filesystem, which had been suffering from numerous issues, was replaced by an entirely new system. Unfortunately, in order to put the new system into place quickly, it was not possible to copy over...
-
Home Filesystem Maintenance - All Clusters
Conte has been returned to normal operations as well now. This concludes the home directory maintenance on all systems. Update: September 27, 2016 11:55pm All systems other than Conte have been successfully returned to normal operations with the ne...
-
Software stack changes and upgrades
During the Home Filesystem Maintenance - All Clusters maintenance on September 27th, several upgrades and changes will be made to the software stack on the clusters. Changes will include updates to the default version of the Intel compiler and associ...
-
We are seeing some issues with the systems in the warp-scratch set of hosts. You may encounter an error with your home directory and/or a message about permissions upon login. Even if you see this, you may find the system is still able to access bo...
-
Unscheduled scratch outage on Carter
UPDATE: ITaP engineers have implemented a temporary solution so that work may continue on Carter until the scheduled upcoming maintenance window on Tuesday. Any jobs running which were using the scratch space have been stopped in order to allow for t...
-
Degraded performance of several systems
We have seen a significant wave of these events this morning, September 21. For the most part, this wave seems to have been linked to a storage problem that has been resolved. However, we are implementing new monitoring and response procedures toda...
-
Engineering Computing Network (ECN) will be performing scheduled maintenance this weekend on several ECN server resulting in their unavailability for a short time. Some ECN services will be affected, including several software license servers for ITa...
-
Carter and Scholar are back online for use as of 6:25am, though they will be operating with many nodes still offline. Staff will be working through Wednesday to steadily increase the number of nodes available. This concludes the POD cluster mainten...