DM Monthly Status Report for December 2018

The DM monthly status report covering December activities has been posted to DocuShare, collection-1645. For convenience, the High-level Summary is pasted below. Direct link to full report (pdf):

High-level Summary

Community Interactions, Meetings and Workshops

DM Subsystem Scientist Leanne Guy presented on the topic of an “Overview and Current Status of Science Verification Plans with ComCam and the LSST Camera” to the science collaborations in conjunction with the LSST Commissioning Lead.

DM Project Manager Wil O’Mullane and LSST Data Facility T/CAM Margaret Gelman have started taking place in regular meetings planning for the LSST operations era chaired by Robert Blum, Acting Director of LSST Operations.

DM organized and supported a successful workshop to plan the work required to be completed prior to shipping the Auxiliary Telescope spectrograph to Chile.

The DM System Science Team initiated three studies designed to illuminate various questions around prompt data processing.

Twenty-five members of the Data Management subsystem attended ITIL Foundations training sessions organized by the LSST Data Facility at NCSA.

Technical Progress

The Portal Aspect of the LSST Science Platform now has a TAP search interface. This enables the user to browse available tables and their columns submit an ADQL query and view the results. This has been used to process queries generated in a Jupyter notebook, through the CADC TAP service, a intermediate Presto distributed query language intermediate layer, and forward them to Qserv for processing.

A WebDAV server package to access the LSST Science Platform’s User File Workspace was selected and tested. Namespace-based quotas in the notebook environment were also implemented.

The SQuaRE team integrated verification metrics being generated by the prototype Data Release Production pipeline (through the validate_drp) pipeline with the upgraded (“Chronograf-based”) SQuaSH front end. They also developed a mechanism for simulating SAL telemetry which will be used in testing DM’s implementation of the EFD.

The Science Pipelines groups made a number of advances, including incorporating templates which have been corrected for differential chromatic refraction into regular integration testing of the Alert Production pipeline and integration a mitigation for the brighter-fatter effect with the LSST codebase. In addition, the group held a “hackathon” to convert the Pipelines documentation to the latest DM standards, and and deployed a prototype version of a metrics management task as described in DMTN-098.

Work on the core network on the summit was completed. Communications equipment was installed, configured and is ready for servers to be connected, servers were configured for networking and general IT services.

1 Like