DM Monthly Status Report for November 2017

The DM monthly status report covering November activities has been posted in Docushare, Collection-5185. For your convenience, the High-level Summary is pasted below. Direct link to full report (pdf):

High-level Summary

This month marked the end of the Fall 2017 development cycle for DM. During Fall 2017, more than 100 individual epics were completed by the DM team. Many of the key conclusions and the resultant milestones are described in detail below.

Three candidates for the position of DM Subsystem Scientist were interviewed during November. Discussion among the selection committee will extend into next month.

The DM System Science Team delivered a technical note (DMTN-065) reporting on the requirements and plans for processing LSST Special Programs data. The concerns raised have been entered into 14 separate JIRA issues for further analysis by the engineering team.

The Butler Working Group presented initial conclusions to the DM Leadership Team meeting at the start of November, and then spent the rest of the month preparing use cases, requirements and a straw-man design for formal delivery. These will be reviewed next month. At the same time, the Lossy Compression Working Group produced a preliminary report; further work in this WG is ongoing.

The Systems Engineering and Data Facility teams worked to refine the definition of milestones and align delivery dates across Early Integration activities and for internal use within DM.

A number of major improvements were made to the Science Pipelines codebase. Highlights include substantial upgrades to the astrometric matcher, refinements to the algorithm used to reject artefacts when building coadds, and integration of the “Synpipe” synthetic object injection system with the DM Stack. The Science Pipelines groups also focused on delivering functionality for the major LDM-503 (“level 2”) milestones due at the end of the month. In addition, the SQuaRE team delivered upgrades to the validate_drp package for tracking key performance metrics (KPMs) and to the continuous integration (CI) system that is used to run it.

The Science User Interface team enhanced the Firefly tool to display HiPS (Hierarchical Progressive Survey) data. The Data Access team completed in-place, partitioned, synthesis of Object catalog at 30%-DR1 density within one of the Qserv test clusters at CC-IN2P3. This will be used for gathering Qserv KPMs. In addition, they worked with the Data Facility team to load WISE data in preparation for the LDM-503-1 milestone.

At the Data Facility, the expanded Level 1 Services test & Integration system, and testing of Level 1 system software commenced.

The Summit Computer Room mechanical floor, drop ceiling, and 18” copper cable trays were installed. The AURA Dense Wave Division Multiplex (DWDM) equipment was installed in La Serena and on Cerro Pachon. The REUNA DWDM equipment was installed in Santiago and La Serena. The cross-connects (connecting REUNA to LAN/FIU 100 Gbps Ring) were installed in the L3 facility in Santiago. A Request for Proposal was submitted by FIU to select the optical vendor to provide the DWDM solution to be used by LSST on the Spectrum link.