Workflow Engines: Synergy between Collaborations and Project


(Richard Dubois) #1

Workflow Engines: DESC and the LSST Project have a mutual interest in workflow engines for running pipelines, both DM stack and science, at scale - but they have different needs regarding the computing architectures they need to run on. We’d like to discuss workflow engine strategy, and explore the possibilities of using the same tools. DESC is already running large production runs, and so the Project may be able to learn from this. Submitted with @cwalter and @drphilmarshall