The DM monthly status report covering August activities has been posted to DocuShare, Collection-6145. For your convenience, the High-level Summary is pasted below. Direct link to full report (pdf): http://ls.st/nrv.
High-level Summary
DM started August by participating in the successful Joint Status Review, and then continued it with the LSST2018 Project and Community Workshop (PCW). Highlights from among many fruitful breakouts and discussions at the PCW included a Stack Club session (a 50+ person interactive demonstration of the LSST Science Platform Jupyter Notebook component on the Kubernetes service at NCSA) as well as a keynote address by the DM Subsystem Scientist and a “Data Management 101” presentation introducing the subsystem to the wider project by the Deputy Subsystem Scientist.
The SQuaRE team released an early version of their “nbreport” tool, demonstrating the ability to use Jupyter notebooks as the basis of end-of-night (and other) reports as described in SQR-026.
The Data Access & Database team switched the Qserv system to a new SQL parser, resolving long standing query coverage bugs in the process. The DAX web services are now being deployed under Kubernetes (instead of bare containers) on the PDAC . A prototype middleware framework was stood up at NCSA for ongoing incremental “Generation 3” middleware development efforts.
The Science User Interface was upgraded to provide a MOC overlay on HiPS and FITS images, enabling users to visualize the observation coverage of a particular project or mission.
The Alert Production pipeline was upgraded to make it possible to use templates which have been corrected for the effects of differential chromatic refraction. Meanwhile, a proof-of-concept implementation of a more scalable and manageable “mini-broker” alert distribution hub has been delivered.
The Data Release system was upgraded with a new “constrained” photometric model for the Jointcal calibration system, which has demonstrated compelling results on precursor datasets, and with the inclusion of the new “Scarlet” deblender in the LSST Software Stack. The LSST implementation of the Forward Global Calibration Method was also demonstrated running at-scale on data precursor datasets.
The Networking team completed initial configuration of the core network and spine failover testing In the Summit Computer Room. The network is now configured and connected to the DWDM . We continue preparations for a CY18 100 gigabits/second demonstration in conjunction with Supercomputing 2018. Data Transfer Nodes are in place in Miami and being deployed in La Serena and Champaign. The team confirmed access to links from SCInet from Dallas–Chicago.
DM participated in the OCS Integration of Spectrograph Image Creation Components cross-subsystem integration activity in Tucson.
A number of significant technical reports were published or updated during this month. Highlights include:
- DMTN-080, describing the “warp comparison” algorithm for rejecting artifacts during coadd construction;
- DMTN-082, describing a mechanism for exposing data from the Engineering Facilities Database to the Science Platform;
- DMTN-092, describing interfaces with the Alert Production pipeline.