DM Monthly Status Report for October 2017

The DM monthly status report covering October activities has been posted in Docushare, Collection-5185. For your convenience, the High-level Summary is pasted below. Direct link to full report (pdf): http://ls.st/int.

High-level Summary
During this month the named DM “points of contact” were rolled-out to the various science collaborations. We also unveiled a “Data QA” section on the community.lsst.org site. This provides a forum in which members of the DM Subsystem Science Team will respond to questions from scientists about the details of LSST data products. Within the Subsystem Science Team, work started on a proposal to simplify LSST’s solar system data products (while delivering equivalent capabilities to the end user).

A priority for DM as we move forward will be to undertake a series of internal reviews of important components of the system. This effort got underway with a successfully design review of the Header Service.

The Data Butler Working Group continued this month, with substantial design and prototyping work being undertaken on the new, “third generation” I/O abstraction layer. This work will be presented to the DM Leadership Team during the early November face-to-face meeting.

Version 14.0 of the LSST Science Pipelines was publicly released and is now available from the pipelines.lsst.io site. This new version provides a range of new and upgraded capabilities, which are described in the extensive notes that accompany the release.

Moving beyond the 14.0 release, the Pipelines group delivered a detailed description of the algorithm which is being proposed to deliver template images which are corrected for differential chromatic refraction and an early implementation of the source association system within the end-to-end alert production test system. The new deblending algorithm was presented to various science collaborations and external workshops, collecting valuable feedback.

HyperSQL table data support has been added to the Firefly server making it possible to use standard SQL for table data manipulation.
We supported the Pathfinder Early integration Activity “Next Visit” milestone and workshop (hosted by NCSA).

Work on Summit Network progressed. Power cable trays and cables were installed in the Computer Room, and we updated the design with seismic bracing of supports for the raised floor.

Delays in the provisioning of the upgraded PDAC Qserv head node, and additional evolving hardware and GPFS/NFS instabilities within the PDAC are creating schedule pressure that could put some upcoming end-of-cycle deliverables at risk.

Several team members attended the ADASS meeting in Santiago, Chile and some stayed for the subsequent IVOA Interoperability Meeting. This included a very productive “birds of a feather” session on science platforms, which was an extension of the earlier discussions involving NOAO, STScI and LSST. We conducted discussions on VOTable data representation, hierarchical image representation, authenticated service listings in VO registries, and the applicability of other software and VO standards to LSST at both ADASS the IVOA meeting.

In staffing news, Mario Jurić has formally stepped down as DM Subsystem Scientist and transitioned to his new role as DM System Science Team Coordinator. We have carried out telephone interviews with several candidates to replace Mario as the Subsystem Scientist, and will move to face to face interviews next month for three of them. We have also interviewed candidates for the DM Release Manager/Engineer and expect to make an offer next month.