The DM monthly status report covering November activities has been posted to DocuShare, collection-14954. For convenience, the High-level Summary is pasted below. Direct link to the full report: Monthly Report
High-level Summary
Community Interactions, Meetings and Workshops
After the successful CCR1 DM supported the AMCR meeting and visit to Chile Nov 5-7. DM also hosted a ComCam On-Sky Hack Week at Princeton Nov 18-22, focusing on using the first processed rotationally-dithered data to start commissioning the science pipelines
DM attended ADASS Jenness delivering a poster on SIAv2 and McCormick a talk on Felis.
We understand that the NASA SphereX has adopted Phalanx, our infrastructure underlying the Rubin Science Platform, as well as key Rubin Science Platform services, for its (internal) Science Team’s data access and analysis environment. While not directly related to Rubin Construction, the continued adoption of Rubin Data Management software, even prior to the start of the survey, gives us confidence that while there are of course challenges ahead, our engineering is judged to be sound and pertinent by our peers.
Technical Progress
We continued working on P1a verification and starting P1b verification using ComCam data.
A new machine-learning model for reliability classification of difference image sources was deployed, which greatly reduced classification runtime. A single frame Solar System association pipeline was written for Prompt Processing, which successfully associated known Solar System objects in ComCam images even when templates for image differencing were not available.
DM has made progress on science pipeline commissioning using the rotationally-dithered multiband images from ComCam to minimize the algorithmic contribution to science quality metrics revealing the capability of the as built Rubin system. These data comprised early data release production outputs which provided, for example, the first templates for the first alerts Nov 19th, new defect masks, refined configs for PSF modeling, amp-to-amp background matching, and artifact rejection.
New version of the OODS with S3 support has been successfully tested, and is ready for deployment at the summit.
LSSTCam network has been successfully moved to the pixel zone, improving transfer times to SLAC using the IPSec link.
Several Kafka problems were solved from the perspective of DevOps. Testing is still underway.