DM Status Report for June 2022

The DM monthly status report covering June 1-30, 2022 activities has been posted to DocuShare, collection-8803. For convenience, the High-level Summary is pasted below. Direct link to the full report: https://docushare.lsstcorp.org/docushare/dsweb/Get/Document-40804/_DM%20Monthly%20Progress%20Report%20-202206.pdf

High-level Summary

Community Interactions, Meetings and Workshops

DMSSTVF2F was held June 6 ahead of DMLTvF2F was held June 7-9 as usual a range of technical topics were discussed - this was the first leadership meeting with sessions open to all DM members.

Several DM people attended AAS where Robert Lupton delivered the Heineman prize lecture.

The 2022 DM Bootcamp for new Science Pipelines team members and contributors was held with up to 68 attendees. Videos of the tutorials are available for future reference.

Technical Progress

Data Preview 0.2 had an early release to existing delegates on June 27th, completing a major integration activity requiring coordination between the Science Pipelines, Middleware, Execution, Verification & Validation, Qserv, Science Platform and Community Engagement Teams. While part of the pre-Ops programme, a number of construction systems had their first production-scale use and thus offered both an opportunity to retire some milestones as well as to lower risk for the Construction project.

A paper describing the Middleware (DMTN-229) was submitted to SPIE and to arXiv. Use of GitHub Actions for checking software was standardized across all DM packages.

The capability to generate HIPS trees from high-resolution, healpix-projected coadds with native Rubin code was demonstrated and used by the operations project to produce the images that are viewable in the Portal for DP0.2. ScarletDeblendTask now outputs a single storage container that allows users to access both the scarlet models and flux re-distributed model while using an order of magnitude less storage space. The tasks to perform image differencing were refactored to improve maintainability and enable new features. The Heliolinc algorithm was extended to allow fitting orbits of interstellar objects. DMTN-226 on alert filtering was published.

A number of VO-compliant image services were released to production as part of Data Preview DP0.2. Scale testing was performed to ensure the doubling of the delegates associated with DP0.2 would go smoothly (it did).

NCSA continue to help getting data to SLAC, creating large tar files helped expedite the file transfers. Support continues for BPS and personal HTCondor running via Slurm cluster at SLAC is now running simple jobs.