New Halstead Scratch Storage
Link to update at May 15, 2018 4:58pm EDT UPDATE:
After the maintenance on May 14-15, 2018, scratch locations are defined as follows:
- $CLUSTER_SCRATCH (new scratch space, e.g. /scratch/halstead/m/myusername)
- $CLUSTER_SCRATCH_NEW (new scratch space, e.g. /scratch/halstead/m/myusername)
- $CLUSTER_SCRATCH_OLD (old scratch space, e.g. /scratch/halstead-old/m/myusername)
As mentioned earlier, there has been no automatic transfer from old to new scratch filesystem, so your $CLUSTER_SCRATCH may appear empty. Please copy any necessary files from $CLUSTER_SCRATCH_OLD by hand by June 15th, 2018.
Please note that SMB/CIFS mounts (from scratch.halstead.rcac.purdue.edu and scratch.halsteadgpu.rcac.purdue.edu) are only serving new scratch filesystem. To copy files between old and new scratches, use cp or rsync commands in your terminal session, or a GUI file manager inside a Thinlinc remote desktop session. Finally, both scratches are available on the purdue#halstead Globus endpoint (click the "Up one folder" arrow to navigate to the old scratch).
Link to original posting ORIGINAL:
The Halstead and HalsteadGPU scratch storage will be moving to a new storage system over Thursday, April 12, 2018. There will not be any automatic transfer of files from your old scratch space to your new scratch space. You will find there are two new environment variables to assist you in a smooth transition to this new space:
- $CLUSTER_SCRATCH_NEW (new scratch space)
- $CLUSTER_SCRATCH_OLD (old/existing scratch space)
The new scratch space ($CLUSTER_SCRATCH_NEW) is already available on all Halstead and HalsteadGPU submission front-ends and compute nodes. During the maintenance on %enddate%, the $CLUSTER_SCRATCH variable will switch from matching $CLUSTER_SCRATCH_OLD to matching $CLUSTER_SCRATCH_NEW.
The old scratch space will remain available for one additional month as the $CLUSTER_SCRATCH_OLD variable. However, this scratch space will be removed from Halstead and HalsteadGPU at that point and all files remaining there will be permanently deleted. The $CLUSTER_SCRATCH_NEW and _OLD variables will also be removed at that time.
Please be sure to copy any files you need from the old path to the new path. All files not transferred by June 15th, 2018 will be lost.