2. Introduction to HTCondor

2.1. What is HTCondor?

HTCondor is a software that creates a High-Throughput Computing environment. Such an environment can deliver a high capacity of computing power over a larger period of time. HTCondor can manage a dedicated cluster of computers, but its true power comes from the ability to effectively harness non-dedicated, preexisting resources under distributed ownership.

Like other batch systems, HTCondor provides a job queuing mechanism, scheduling policy, priority scheme, resource monitoring, and resource management. Users submit their jobs into a HTCondor queue. HTCondor then chooses when and where to run the jobs, and monitors the job through to its completion

More information available at:

2.2. Why do we use HTCondor?

HTCondor can help us solve or improve the following issues.

  • Fair sharing of the resources

    • We want everyone to have fair and easy access to the resources available. HTCondor takes various factors into account to calculate a priority for each user.

  • Less idle resources

    • We want our resources to be utilized to their full extent, if possible. HTCondor can help us know of idle resources, and keep a steady flow of jobs for them to run.

  • Flexibility in the running environment

    • We want to customize the running environment of our jobs to our specifications. Faster than IT would respond. HTCondor can run containerized jobs, with Docker.

  • Abstraction layer

    • Allows you to be less concerned with the underlying hardware/tech. Just give me the resources!!