HTCondor is a an open-source framework for high throughput computing developed at the University of Wisconsin—Madison. It’s an incredibly useful and versatile tool that I rely on heavily in my everyday work. However, I’ve found when the number of jobs becomes large (especially when there are interrelated jobs), actually making the job submission files can become a pain.

This prompted me to make PyCondor (Python HTCondor), a tool that helps build and submit HTCondor jobs in a straight-forward manner with minimal hassle.

With just a couple lines of code, you can get build and submit an HTCondor submission file!

import pycondor

# Setting up a PyCondor Job
job = pycondor.Job('examplejob', 'script.py')
# Write all necessary submit files and submit job to Condor
job.build_submit()

Here are some useful links related to the project: