Loading…
Back To Schedule
Thursday, November 21 • 3:20pm - 3:55pm
Serving HTC Users in Kubernetes by Leveraging HTCondor - Igor Sfiligoi, University of California San Diego

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Feedback form is now closed.
High Throughput Computing (HTC), sometimes also called batch computing, has long been and still is the major workhorse for most R&D organizations. Typical workloads include parameter sweeps, Monte Carlo simulations and partitionable dataset processing. Kubernetes by itself is not very well suited for such workloads, which are submitted by hundreds of concurrent users and rely on the execution of thousands, or even millions of small tasks. This presentation will provide an overview of how HTCondor, a prominent HTC system, can be used to effectively and efficiently manage such workloads. The author has been running such a system on a Kubernetes cluster operated out of the University of California San Diego, and will share his experience and issues he encountered during that time.
Speakers
avatar for Igor Sfiligoi

Igor Sfiligoi

Lead Scientific Software Developer and Researcher, University of California San Diego
Igor has been active in distributed computing for over 20 years. He has started in real-time systems, moved to local clusters, worked with leadership HPC systems, but spent most of his career in computing spanning continents. For about 10 years, he has been working on one such world-wide... Read More →

kubecon19 htcondor v2 pdf
Thursday November 21, 2019 3:20pm - 3:55pm PST
Room 6E - San Diego Convention Center Upper Level
  Application + Development