HTC Computing Guides

Below is a list of guides for some of the most common tasks our users need to carry out as they begin and continue to use the HTC resources at the CHTC.

User Expectations

HTC Documentation

Basics and Policies

HTC System Transition to a New Linux Version (CentOS Stream 9) HTC System Overview Using CHTC's HTC Submit Nodes Connect to CHTC Transfer Files between CHTC and your Computer Automate CHTC Log In Transfer Files Between CHTC and ResearchDrive Use Globus to Transfer Files to and from CHTC Access a Private GitHub Repository Remotely Check Disk Quota and Usage

Job Submission

Learn About Your Jobs Using condor_q Practice: Submit HTC Jobs using HTCondor Submitting Multiple Jobs Using HTCondor Workflows with HTCondor's DAGMan Submitting Multiple Jobs in Different Directories

Handling Data in Jobs

Transfer Small Input and Output Transfer Large Input Files Via Squid Use Large Input and Output Files Via Staging

Software Solutions

Compile Software in an Interactive Job Running Matlab Jobs Run Python Jobs Use Conda Environments to Run Python Jobs Run R Jobs Run Java Jobs Run Julia Jobs Use Software Installed in a Docker Container Build a Docker Container Image Use Licensed Software Use Apptainer Containers Building an Apptainer Container Advanced Apptainer Example - SUMO

Special Use Cases

Use GPUs Run Machine Learning Jobs Scale Beyond Local HTC Capacity Checkpointing Jobs Submit High Memory Jobs Use Software Available in Modules Use Custom Linux Versions in CHTC

Troubleshooting

Windows / Linux Incompatibility Explore and Test Docker Containers