The DM monthly status report covering November has been posted in Docushare, Collection-4640. For your convenience I am pasting high-level summary and project status below. Direct link to the full report (pdf): http://ls.st/q89.
#High-level Summary
The Fall 2016 DM development cycle and the planning of the Sprint 2017 cycle has been completed. Work on converting the stack from SWIG to pybind11 continued. Significant progress was made in improving the Prototype Data Access Center. Completed study of tools for simulating PSF. New version of QC harness was deployed. Design for AST-backed coordinate system was finished. Laid grounds for work on new Footprint implementation. Significant progress was made with replan; descoping and final prioritization is expected to spill into beginning of 2017.
#Project Status
Selected technical accomplishments:
- The Architecture Team updated the Data Products Definition Document (LSE-163) and synchronized it with the DM System Requirements (LSE-61) in addition to contributing to an updated Commissioning Plan (LSE-79). The team coordinated deployment of the Prototype Data Access Center and began preparing for its expansion. A team member helped review the Telescope & Site Assembly, Integration, and Verification plan.
- The AP Team
- Began looking into failure modes of single epoch reference matching
- Helped to finish off the Python 3 porting effort
- Finished the design of the AST powered coordinate transform system
- Implemented a tool to build alerts with the expected content
- The DRP Team
- Completed DMTN-020, the Project Management Guide produced by the Project Management Working Group.
- Completed a comparative study of tools for simulating PSFs and “donuts” for use in PSF modelling.
- Delivered a PSF-matched coaddition system appropriate for scientific use.
- The SUIT Team has successfully deployed a version of PDAC at NCSA. It supports the basic search and display of the catalogs and images.
- The DAX Team completed catalog and image ingest of the SDSS Stripe 82 dataset into the PDAC at NCSA, and completed configuration of the PDAC backend services. Support and bug fixes were supplied to SUIT as needed.
- The Net&BS Team has completed 85% of the work on phase 1 of the Summits - Gatehouse fibre installation. Cobra/Telefonica completed work on the first leg from the gate to the fork without any safety incidents. The next 2 legs of work are to dig the holes for the additional posts, plant the posts and then string the cable from the fork to the summits. The contractor completed cleaning the roads on legs 2 and 3.
- During the Super Computing 2016, Net&BS team members from AmLight, and network engineers from Academic Network of Sao Paulo (ANSP), State University of Sao Paulo (UNESP) and California Institute of Technology leverage the AmLight-ExP network to demonstrate the new 200G capacity installed between South America and the U.S. A total of 176Gbps of aggregated traffic was seen between Sao Paulo, Miami and Salt Lake City, Utah, where the Super Computing 2016 was hosted, and demonstrated a sustained flow rate of ~85Gbps, with peaks of 97Gbps, generated using FDT software. This demonstration paves the way for future large file transfers from LSST to the US.
- The NCSA Team
- Participated in the LSST Operations Planning Workshop.
- Attended Supercomputing 2016 conference to gain insight on technology trends for planning LSST physical infrastructure.
- Drafted a 400+ line WBS for the DM-wide replan (in progress), following a three-layer business architecture for IT facilities, with detailed breakdown of major software and service construction areas.
- Completed initial prototype components that exercise complete Camera-to-distributor Level 1 messaging services.
- Defined the first three phases of incremental deployment of Batch Production Services and completed overall documentation of Batch Production Service software component interaction that is being used as the basis for implementing NCSA’s elements.
- The SQuaRE Team
- Released a new feature to SQuaSH allowing points on the metrics regression dashboard to be traced back to the code changes involved
- Submitted LDM-493, Data Management Documentation Architecture to TCT
- Is now producing qserv dev Docker containers automatically off the weekly engineering release
- Deployed a basic status monitoring service