The DM monthly status report covering March 2021 activities has been posted to DocuShare, collection-8803. For convenience, the High-level Summary is pasted below. Direct link to the full report: DocuShare Authorization Error
Community Interactions, Meetings and Workshops
The second virtual photo-z forum was held with the science community to solicit input from the community on defining the criteria to be used to evaluate photo-z estimators in the DRP catalog.
DM supported the Rubin quarterly review on March 2.
DMPM gave a Rubin big data talk at the joint DOE/NSF workshop “Optimizing the use of connectomic data to drive data science and scientific discovery” on March 31
Technical Progress
DMTN-176 outlining the butler client/server architecture was completed.
The faro package for the computation of science performance metrics was released into lsst_distrib. Faro now runs as a regular part of the daily and weekly builds of the science pipelines.
Precursor datasets are now being processed using Gen3 in Continuous Integration (CI), having Joint_cal converted was the last hurdle for this. The Gen3 pipeline will be run on the three-tract Hyper Suprime-Cam precursor dataset with both Gen2 and Gen3 middleware in the coming months, comparing output data products, and patching the pipelines in order to achieve scientific parity.
CentOS 8 was removed as a supported platform of DM due to the scheduled termination of support for it at the end of 2021. The new Heliolinc2 algorithm for fitting orbits for solar system objects was improved and now achieves >95% completeness. A template generation for difference imaging stage was added to the default DRP pipeline. A user provisioning service was implemented to address security concerns about elevated privileges being briefly active in DM containers.
The replicated telemetry system (EFD) is now available at the LSST Data Facility for project staff. Shared Gen3 dataset repos are now available for use by all project members on the development cluster at NCSA
The queries in the Qserv scale testing suite were rewritten to execute against the synthetic KPM50 test catalog, and the first rounds of these queries were executed at NCSA from the new “Kraken” parallel scale testing harness.
Data transfers from Summit to NCSA through Gen3 ingestion continue to be monitored.
The LSSTCam Camera Control System (CCS) servers were delivered and provisioned at the summit.