Pull data from a Globus endpoint to DartFS

Overview

This document outlines the steps to pull data from an external Globus endpoint using the Globus Connect Personal client. Dartmouth College does not have a Globus endpoint that allows collaborators to pull data from us.

Install the Globus command line client in your DartFS home

# Connect to andes or another HPC node
$ ssh YOUR_NETID@andes

# Download the Globus Connect Personal client
$ wget https://downloads.globus.org/globus-connect-personal/linux/stable/globusconnectpersonal-latest.tgz

# Exact the downloaded zip file and then delete it
$ tar zxvf globusconnectpersonal-latest.tgz
$ rm -f globusconnectpersonal-latest.tgz

# Enter the extracted directory
$ cd globusconnectpersonal-3.2.2

Authorize the client to act as a Globus endpoint on your behalf

Steps

  • In the terminal, run "./globusconnectpersonal -setup --no-gui"
  • Select and copy the long URL provided at the end of the output
  • Switch to a web browse and point it to the copied URL
  • On the first screen, click "Continue" to login in with Dartmouth's SSOUploaded Image (Thumbnail)
  • If prompted, complete the Dartmouth SSO process
  • On the next screen, click "Allow" to authorize Globus to work on your behalfUploaded Image (Thumbnail)
  • On the last screen, select and copy the auth code providedUploaded Image (Thumbnail)
  • Back in the terminal, paste the auth code and press enter
[d92495j@andes globusconnectpersonal-3.2.2]$ ./globusconnectpersonal -setup --no-gui
Globus Connect Personal needs you to log in to continue the setup process.

We will display a login URL. Copy it into any browser and log in to get a
single-use code. Return to this command with the code to continue setup.

Login here:
-----
https://auth.globus.org/v2/oauth2/authorize?client_id=4d6448ae-8ca0-40e4-aaa9-8ec8e8320621&redirect_uri=https%3A%2F%2Fauth.globus.org%2Fv2%2Fweb%2Fauth-code&scope=openid+profile+urn%3Aglobus%3Aauth%3Ascope%3Aauth.globus.org%3Aview_identity_set+urn%3Aglobus%3Aauth%3Ascope%3Atransfer.api.globus.org%3Agcp_install&state=_default&response_type=code&code_challenge=MBqFAL6PUlCSh0u67QC6AgXq99XUCUkgEp3gk6g8Zmo&code_challenge_method=S256&access_type=online&prefill_named_grant=andes.dartmouth.edu
-----
Enter the auth code: 3JkoBPeTeSn5psxE4ab1eaf2PVcaOH

== starting endpoint setup

Input a value for the Endpoint Name: andes.dartmouth.edu
registered new endpoint, id: 3ca4b538-385e-11ee-87b9-4dfadf03ac7e
setup completed successfully

Commands to use the Globus personal endpoint

# Start the endpoint listener
$ ./globusconnectpersonal -start &

# Stop the endpoint listener
$ ./globusconnectpersonal -stop

# Check the status
$ ./globusconnectpersonal -status

Use the endpoint to pull data

This is all done through the web browser as follow; 

Click in the Collection field and start to type the endpoint you want to pull data from.

Select the endpoint as shown in the example below and enter the username and password if required.

Uploaded Image (Thumbnail)

After you login, you will see a list of the files in the selected collection's directory as show below:

Uploaded Image (Thumbnail)Select the directory or files that you want to transfer. Click on the collection field at the top right of the File Manager window to enter the endpoint you created as the destination endpoint. Select the directory where you want to transfer the files to and click the Start button.

You can view the status of your transfer by clicking on the Activity link on the left hand side of the window. You will receive an email when the transfer has been completed.

Details

Article ID: 153617
Created
Fri 8/11/23 1:49 PM
Modified
Wed 9/6/23 8:29 PM