Copying files from Purdue IT research computing home directory to Scholar
The Scholar home directory and its contents are specific to the Scholar cluster, and are not available on other RCAC machines. For people having access to other Community Clusters and Scholar, there is no automatic copying or synchronization between main and Scholar home directories. At your discretion, you can manually copy all or parts of your main research computing home to Scholar using one of the methods described below.
Please note that copying may fail if the size of your research computing home directory is larger than the Scholar one's quota. Please check usage and limits before proceeding!
Link to section 'Complete copy' of 'Copying files from Purdue IT research computing home directory to Scholar' Complete copy
For your convenience, a custom tool copy-rcac-home is provided to simplify at-will duplication of your main research computing home directory into Scholar. The tool performs a complete 1-to-1 copy using rsync -auH (with exception of a narrow subset of system-specific service files).
To use the tool, simply type copy-rcac-home in a terminal window on a Scholar front-end or compute node:
$ copy-rcac-home
This script will copy entire contents of your main RCAC
home directory into your Scholar cluster's $HOME.
Note: copying may fail if the size of your RCAC home directory
is larger than your quota on the Scholar one (25GB).
BEFORE PROCEEDING, please run 'myquota' command on another
cluster to see your usage there and judge whether it would fit!
Would you like to proceed? [Y/n]:
At this stage answering yes will proceed with copying, or you can respond with a no (or Ctrl-C) to cancel. See copy-rcac-home --help for more details on the tool.
Link to section 'Partial copy' of 'Copying files from Purdue IT research computing home directory to Scholar' Partial copy
Desired parts (or whole) of your research computing home directories can be copied to Scholar via any of the home directories' supported transfer methods, such as SCP, SFTP, rsync, or Globus.
-
Example: recursive copying of a subdirectory from RCAC home directory into Scholar home using
scp.(if you are on Scholar, use other cluster name for the remote part) $ scp -pr myothercluster.rcac.purdue.edu:somedirectory/ ~/ (if you are on another cluster, use Scholar for the remote part) $ scp -pr somedirectory/ myusername@scholar.rcac.purdue.edu:~/ -
Example: copying using Globus.
Search collections for "Purdue Research Computing - Home Directories" and "Purdue Scholar Cluster - Home" endpoints, respectively, then transfer desired files and/or directories as usual.