File Transfer Using Globus

Overview

Globus is a fast, reliable, and secure file transfer service for moving large amounts of data between a pair of "Globus endpoints" (i.e. computers).  It has both web-based and command line interfaces.  Using Globus is faster than using sftp or scp for both on and off-campus file transfers and usually it can automatically restart from the middle of an interrupted transfer.

Dartmouth's main Globus endpoint is named "dartmouth#dtn".  DTN is for "data transfer node".  The DTN has been tuned to do fast file transfers using Dartmouth's high speed research network.  You can access your DartFS storage directly from the DTN using Globus.  If you would like to see another system configured as a Globus endpoint, please email Research.Computing@dartmouth.edu to have it added.  You can also create endpoints yourself on laptops, workstations, etc. by using Globus Connect Personal.

Requirements

  • To use the Dartmouth DTN, email Research.Computing@dartmouth.edu and ask to have your NetID enabled.
  • To transfer files into/out of your laptop or desktop, you need Globus Connect Personal installed on your computer.
  • To transfer files into/out of DartFS, you need a Research Computing account.  You probably already have one but if not, you can request one at rcweb.dartmouth.edu/accounts.  This is just to access DartFS and has nothing really to do with Globus.
  • To use Globus’s command line interface, you need a SSH client on your machine.

Use the Web Interface to Transfer Files

This basically consists of four steps.

  1. Login to the Globus portal (with your NetID).
  2. Activate a first endpoint (dartmouth#dtn also uses your NetID).
  3. Activate a destination endpoint (typically this is a separate username/password).
  4. Initiate a transfer between the two endpoints.

Here is an example showing how to move a file of folder from your DartFS home directory to another location using the DTN.

Go to https://globus.org and click the Log In button.  From there, select Dartmouth College in the drop down list, click the Continue button as shown below.

Use your NetID to login. You will see the File Manager window as shown below:

Click in the Collection field and start to type 'dartmouth'

Select the Dartmouth Data Transfer Node as shown in this figure below:

 

 

 

 

 

 

 

 

 

 

and then enter your netid and password for dtn.dartmouth.edu as shown here:

After you login, you will see a list of the files in your DartFS home directory as show below:

Select the directory or files that you want to transfer. Click on the collection field at the top right of the File Manager window to enter the destination endpoint. You will need to have an account on another computer that is a Globus endpoint.  After you have logged into the second endpoint and selected the directory where you want to transfer the files, click the Start button at the bottom of the window.

You can view the status of your transfer by clicking on the Activity link on the left hand side of the window. You will receive an email when the transfer has been completed.

Transfers that will last for more than 24 hours.

The default credential lifetime when a Globus user authenticates to access an endpoint is 24 hours. To minimize how often you need to authenticate, you can extend the credential lifetime up to 720 hours (30 days). In the web interface when you are prompted to authenticate, click the advanced link and enter an amount up to 720 for the credential lifetime as shown below.

You DartFS credential is good for up to 30 days.

File Sharing

You can also share folders (directories) with other Globus users. You can only share folders not individual files. Here is the Globus web page that explains how to to share folders.

Details

Article ID: 64131
Created
Tue 10/9/18 11:52 AM
Modified
Thu 6/6/19 10:21 AM