• Introduction
  • Support
  • Glossary
  • License
  • Acknowledgement
  • Git Version Control
    • Git Basics
    • Git and Atom: GitLab
    • Git and Atom: GitHub
    • Git in the Command Line
    • Git Scenarios
  • Learning Linux
    • Learning Linux Commands
    • Essential Commands
      • Script: Backup
      • Script: Seconds
    • Managing Files
      • Script: Create Files
    • File Permissions
    • Working with Processes
    • Services
    • System Configuration
    • Environment Customization
    • Communication Protocols
    • Task Manager (crontab, at)
    • Bash Scripting
    • Command Line Shortcuts
  • Using the HPC
    • Overview
      • Hardware
      • Storage
      • Software
    • Prerequisites
    • Request an Allocation
    • Access your Allocation
    • Execute a Job
      • Working with C++
      • Working with Fortran
      • Working with Python
      • Working with Makefiles
      • More Job Details
    • Managing Jobs
    • Modules
      • CVMFS Modules
    • Compilers
    • Workflows
      • Crystal Workflow
  • Xsede Resources
    • IU/TACC Atmosphere on Jetstream
    • Using Jetstream Virtual Machines
  • Data Transfer and Storage
    • Moving Data
      • Graphical Client SFTP
    • Globus Data Transfer Tool
      • Globus Endpoints
      • Globus Transfers & More
      • Globus Command Line Interface
  • Tools
    • Docker Containers
    • Singularity Containers
Powered by GitBook
On this page
  1. Data Transfer and Storage

Moving Data

PreviousUsing Jetstream Virtual MachinesNextGraphical Client SFTP

Last updated 6 years ago

CCLA Data Transfer Nodes (DTNs) allow for speedy movement of large data sets into and out of the network. There are several transfer tool/protocol options to choose from to fit your needs.

  1. has a web interface or command line tools that you can use to transfer data between your personal endpoints or securely share access to your data. This is the preferred method of transfer for the CCLA.

  2. Secure copy (scp) via the command line to and from storage locations, including local computers.

     scp username@remote-host1.edu:/path/to/directory/example.txt username@remote-host2.edu:/path/to/directory/

  3. Secure (or SSH) file transfer protocol (SFTP) can be used to transfer files between two remote storage locations (similar to scp) but also allows the user to list directories and see content. You can use SFTP as long as you have SSH access to that host.

     sftp username@remote_hostname_or_IP

  4. will allow you to use a graphical user interface with drag-and-drop capabilities. CCLA maintains documentation for CyberDuck and WinSCP.

    For Linux users, there is no clear recommendation for SFTP clients. No one free client supports all of CCLA storage services and behaves consistently. However, supports all of CCLA services and typically behaves predictably on Linux systems. See for a how-to guide using CloudExplorer and Scality.

  5. or (supports s3) are other command line utilities that may suit your data transfer needs. At this time, CCLA does not offer support for these tools.

Globus
Graphical clients (SFTP)
Cloud Explorer
here
rsync
rclone