The DM Monthly status report covering February activities has been posted in Docushare, Collection-6145. For your convenience, the High-level Summary is pasted below. Direct link to full report (pdf): http://ls.st/p2e.
High-level Summary:
The DESC (Dark Energy Science Collaboration) meeting at SLAC during the week of February 5 was attended by several DM team members. This was a useful opportunity to keep in touch with DESC, to gather potential requirements, and to understand where experiments may be mutually beneficial.
Leanne Guy, the incoming DM Subsystem Scientist, spent the week of 26 February at the University of Washington, where she discussed DM software, plans and processes with members of the DM System Science Team, the Alert Production Team, and DM Project Management.
This month saw a lot of documentation activity, with revisions to the DM product list in LDM-294, the system architecture in LDM-148, the data access use cases in LDM-592, and DM contributions to the LSST overview paper. A paper describing the new deblender, Scarlet, which is being developed for LSST was submitted for publication. Work continued on the data access and broker policy documents. This work can be tracked using the DM documentation landing page at www.lsst.io.
DM’s adoption of Kubernetes-based systems continued, with the first phase of the Kubernetes commons being installed at the Data Facility and made available to a limited set of designated cross-team developers for initial testing. The SUIT team experimented with the most effective way to deploy Firefly and other SUIT services in a Kubernetes environment.
A number of enhancements were made to data access sevices. The catalog web service, dbserv, was rewritten: the new version provides a selection of enhanced capabilities and better VO-compatibility. Qserv master/shard-server flow control was upgraded to improve performance in high load conditions. Finally, Metaserv (V1) was deployed in the Prototype Data Access Centre (PDAC) with cleaned up SDSS metadata.
Work is now well underway in the Science Pipelines groups to prototype technologies for the LSST mini-broker, with a particular focus on alert filtering. This ties into updates to the prototype alert production pipeline.
QA was a continued focus this month. The QA tools that have been in development for the last few months were successfully used to address real data validation challenges at scale. Planning for further QA activities has been a major topic of discussion this month, and will be a key part of next month’s Joint Technical Meeting.
The Data Facility deployed a prototype consolidated database system running Oracle., This will initially be used to support upcoming AuxTel milestones. The development of test systems for LSST-specific infrastructure at the Data Facility continued. We demonstrated we can fetch Spectrograph Image Data from the DAQ, integrate the image data with header metadata from the DM Header Service (DMHS), and produce FITS files.
Completed preparations in the Summit Computer Room to start installing the ummit Network equipment. The technical description document “Network Architecture and Operations Model for LSST use of ESnet” was completed and distributed to stakeholders.