What Is Globus Online?
Globus Online allows researchers everywhere to have access to a fast, powerful file transfer service that’s easy to use. Simply submit a transfer request and walk away — no need to babysit your job or worry about coming back to a failed request. Globus Online manages file transfers for you: monitoring performance, retrying failures, auto-tuning, recovering from faults automatically when possible, and reporting status. Globus also allows you to quickly and efficiently share data with collaborators around the globe even if they are not a part of ND.
Setting Up Globus Online
For instructions on setting up Globus Online, view our Setting Up Globus Online wiki page.
Transferring Files to/from CRC
Note: The instructions below are for transferring files between your personal computer and the CRC systems. If you want to transfer files from the CRC systems to someone without a ND/CRC account (i.e. at another university), please see the Sharing Files section below.
After Globus Connect Personal has been installed on your system, you will be able to transfer files through the Globus Online interface. Login to Globus Online if you have not already. Once logged in, you should be on the Transfer Files interface. If you are not, you can click "File Manager" towards the top left. Example below:
Click on the Collection field where it says "Start here..." This will bring up a menu from which you can choose recent collections, bookmarks, and collections you have created. To transfer files from your own computer, select the "Your Collections" tab. Here you will see the collection(s) you have created.
- Select the collection you created while setting up Globus Connect Personal. Make sure the Globus Connect Personal program is currently running on your system, otherwise there will be an error.
- Navigate to the other Collection field. Here you will enter the name of the CRC's Collection: ND Center for Research Computing. If it is your first time connecting to the Collection, you may be required to authenticate with your ND credentials.
- Once successfully connected to the CRC Collection, a large list of directories will appear. Find your scratch365 directory, (you must have scratch space to use Globus) which will be the folder with your user-name. Double-click it to see the contents, this is where transferred files will be stored on the CRC endpoint.
Select and Transfer File(s)
Both Endpoint windows display the files that are in the current path specified in the Path field. In order to transfer a file, navigate to the directory where you want to transfer your file to, then on the other Endpoint navigate to the directory of the file you want to transfer.
- Select the file by clicking on it, and click on the corresponding Start at the bottom of the Endpoint to transfer the file to the indicated Endpoint. If you want to check on the status of any transfers, click the "Activity" tab on the left Menu.
You will be given a notification if your transfer was submitted successfully. You will then receive an e-mail once the transfer is complete, which will indicate whether the transfer was successful or not.
Note: At this time, Globus Online has no intention of supporting AFS authentication. So, in order to transfer files using Globus Online, you are REQUIRED to have /scratch365 space allocated to you at the CRC. To request a /scratch365 space, please e-mail CRCSupport@nd.edu. If you need the files in your AFS directory, you can move them to your AFS space after the files have been transferred to your /scratch365 directory.
With GlobusPlus, users can now share large datasets (or large files) with anyone who has a free Globus Online account (even if they don't have a ND/CRC account). In order to share files with Globus users at other universities and institutions, you need to set up a new shared endpoint. If you haven't already, make sure you set up your own Globus Account as described above. Please note that this also requires having /scratch365 space. If you do not have /scratch365 space yet, please e-mail CRCSupport@nd.edu with your request.
1. Authenticate with Globus and select the CRC endpoint in the Collections Field. (Click here for a more detailed description)
- Click "Start Here..."
- Type ND Center for Research Computing and select the CRC in the drop-down menu.
- Authenticate with CAS if necessary.
2. Navigate to the directory you'd like to share within your /scratch365 space. Highlight it with the mouse.
- Click "Share" towards the right of the collection viewer.
- Enter a display name, this is what the collaborator will see as the title of the collection.
- If desired, enter a description. This is not required.
- Click Next to setup Permissions.
3. Setup permissions to those who'd you like to share to.
- Towards the top right, click "Add Permissions - Share With"
- You can customize the sharing path if you'd like, or leave it as "/".
- Enter the email address of who you'd like to share with. Click ADD directly to the right of the email field.
- Fill out the rest of the fields if desired.
- Click Add Permission on the bottom once finished. If the box titled "Send Email" is checked, the collaborator will receive an email from Globus with a link to get to the shared directory.
- From here, the collaborator can either download the data using the Connect Personal, or to another endpoint (another university etc).
Globus has a more detailed guide here.