DLR Portal
Home|Sitemap|Kontakt|Barrierefreiheit Impressum und Nutzungsbedingungen Datenschutz Cookies & Tracking |English
Sie sind hier: Home:Aktuelles:Veranstaltungen:PyHPC 2011:Abstracts
Erweiterte Suche
Aktuelles
Veranstaltungen
VESTEC Online-Abschlussworkshop 2022
TiGL Workshop 2018
PyHPC 2011
CPACS/RCE2012
PyHPC 2012
PyHPC 2013
IPAW 2014
SECESA 2014
PyHPC 2014
PyHPC 2015
PyHPC 2016
PyHPC 2017
PyHPC 2018
Archiv
Institut
Abteilungen
Themen
Projekte
Software
Veröffentlichungen
Karriere
Abstracts
Zurück
Drucken

Work Queue + Python: A Framework For Scalable Scientific Ensemble Applications

Peter Bui, Dinesh Rajan, Badi Abdul-Wahid, Jesus Izaguirre and Douglas Thain



Even with the increase in the number and variety of computer resources available to research scientists today, it is still challenging to construct scalable distributed applications. To address this issue, we developed Work Queue, a flexible master/worker framework for building large scale scientific ensemble applications that span many machines including clusters, grids, and clouds. In this paper, we describe Work Queue and then present the Python-WorkQueue module, which enables scientists to take advantage of our Work Queue framework while using the Python programming language. To demonstrate the module's flexibility and power, we examine two distributed scientific applications, RepExWQ and Folding@work. Both of these programs were written using Python-WorkQueue and manifest the Work Queue framework's ability to scale not only to hundreds of workers, but to also enable scientists to take advantage of multiple distributed computing resources simultaneously.


PyHPC2011
Call for Papers
Program
Abstracts
Program Committee
Downloads
PyHPC2011-Program (0,2 MB)
PyHPC2011-CfP (0,33 MB)
Links
SC11
Workshop Python for High Performance and Scientific Computing (SC11)
Submission page (EasyChair)
Birds of a Feather Python for High Performance Computing (SC11)
Facebook event page
Twitter @PyHPC2011
Copyright © 2022 Deutsches Zentrum für Luft- und Raumfahrt e.V. (DLR). Alle Rechte vorbehalten.