Copying files from Purdue IT research computing home directory to Gilbreth
The Gilbreth home directory and its contents are specific to the Gilbreth cluster, and are not available on other RCAC machines. For people having access to other Community Clusters and Gilbreth, there is no automatic copying or synchronization between main and Gilbreth home directories. At your discretion, you can manually copy all or parts of your main research computing home to Gilbreth using one of the methods described below.
Please note that copying may fail if the size of your research computing home directory is larger than the Gilbreth one's quota. Please check usage and limits before proceeding!
Link to section 'Complete copy' of 'Copying files from Purdue IT research computing home directory to Gilbreth' Complete copy
For your convenience, a custom tool copy-rcac-home is provided to simplify at-will duplication of your main research computing home directory into Gilbreth. The tool performs a complete 1-to-1 copy using rsync -auH (with exception of a narrow subset of system-specific service files).
To use the tool, simply type copy-rcac-home in a terminal window on a Gilbreth front-end or compute node:
$ copy-rcac-home
This script will copy entire contents of your main RCAC
home directory into your Gilbreth cluster's $HOME.
Note: copying may fail if the size of your RCAC home directory
is larger than your quota on the Gilbreth one (25GB).
BEFORE PROCEEDING, please run 'myquota' command on another
cluster to see your usage there and judge whether it would fit!
Would you like to proceed? [Y/n]:
At this stage answering yes will proceed with copying, or you can respond with a no (or Ctrl-C) to cancel. See copy-rcac-home --help for more details on the tool.
Link to section 'Partial copy' of 'Copying files from Purdue IT research computing home directory to Gilbreth' Partial copy
Desired parts (or whole) of your research computing home directories can be copied to Gilbreth via any of the home directories' supported transfer methods, such as SCP, SFTP, rsync, or Globus.
-
Example: recursive copying of a subdirectory from RCAC home directory into Gilbreth home using
scp.(if you are on Gilbreth, use other cluster name for the remote part) $ scp -pr myothercluster.rcac.purdue.edu:somedirectory/ ~/ (if you are on another cluster, use Gilbreth for the remote part) $ scp -pr somedirectory/ myusername@gilbreth.rcac.purdue.edu:~/ -
Example: copying using Globus.
Search collections for "Purdue Research Computing - Home Directories" and "Purdue Gilbreth Cluster - Home" endpoints, respectively, then transfer desired files and/or directories as usual.