PZ Commissioning Team meeting summaries

Science Photometric Redshifts
#1

This topic thread is for meeting summaries of the “Photo-z Commissioning Team”. Members of this team are working with the Rubin Observatory commissioning effort under an MOU (see SITCOMTN-010 for more information).

As described in the Forum topic “Rubin Commissioning and the Photo-z Validation Cooperative”, this is the team that will take the lead on guiding implementation and performing early science validation for the shortlisted PZ estimators with the unreleased commissioning data, which will help the science community make use of Data Previews 1 and 2 during the Photo-z Validation Cooperative phase of the “Roadmap to Photo-z for the LSST Object Catalog”.

The team wants to keep any interested parties in the broader science community informed of their ongoing work, so updates will periodically be posted here in the Rubin Community Forum.

#2

Tue Nov 8, 2022

Attending: Melissa Graham, Markus Rau, John Franklin Crenshaw, Julia Gschwend, Nacho Sevilla, Sam Schmidt, Alex Malz, Bryce Kalmbach, Shahab Joudaki, Eric Charles, Drew Oldag

Discussion

  1. Round table of introductions

  2. Review the PZ Commissioning Team MOU

  3. Timeline for commissioning and data previews

  4. Review of the PZ Roadmap and Letters of Recommendation
    a. Discussed potentially adding FlexZBoost, for which an LoR was not submitted.
    b. Discussed how the team may need to prioritize RAIL-compatible codes.

  5. PZ Server, Julia Gschwend
    a. Currently in development at LineA, it is a community resource for photo-z validation.
    b. The team is invited to have user accounts and test the tutorials.

#3

Tue Nov 29

Attending: Julia Gschwend, Nacho Sevilla, Alex Malz, Drew Oldag, Melissa DeLucchi, Anja von der Linden, Sam Schmidt, Bryce Kalmbach, John Franklin Crenshaw, Eric Gawiser, Melissa Graham

Discussion:

  1. SIT-COM Science Units: The PZ Commissioning team is part of the SIT-COM Science Unit “Galaxy photometry and photometric redshifts”, co-led by Dan Taranu and Melissa Graham.

  2. Data Preview 0: The first steps for PZ Commissioning team will be to test use of RAIL and the PZ Server from the Rubin Science Platform (RSP) deployed at the Interim Data Facility (IDF; Google Cloud), with the DP0.2 data set. To get started, the relevant DP0.2 tutorial notebooks are numbers 1, 2, and 4a/b.

Initial action items were volunteered by a few team members and the next meeting will be a longer (2h) co-working session in Jan 2023.

#4

Wed Jan 18

Attending: Melissa Graham, Drew Oldag, Julia Gschwend, John Franklin Crenshaw, Alex Malz, Sam Schmidt, Shahab Joudaki, Brant Robertson, Markus Rau

Discussion

  1. Mock training sets and PZ Server: A new notebook has been added to the photoz folder in the delegate-contributions-dp02 repo demonstrating how to create a mock training set from DP0.2 data, and then made an initial attempt to upload this to the PZ Server. We discussed the process and options for such uploads to the PZ Server.

  2. Running PZ estimators at scale: Options for running scalability tests, evaluating outcomes, and potential problems we might encounter were discussed. Current implementations with RAIL and qp, and how LINCC might best contribute, were also discussed. General agreement on working together with experimentation and benchmarking.

Markus, Alex, and Drew and Sam (and perhaps others) were going to tag up later to discuss practical places to start as well as scope of testing.

#5

Tue Apr 11

Attending: Melissa Graham, Sam Schmidt, Drew Oldag, Nacho Sevilla, Melissa Delucchi, Olivia Lynn, Julia Gschwend, Brant Robertson, John Franklin Crenshaw, Alex Malz, Bryce Kalmbach

Discussion

  1. Potential 2023 LSST Photo-z Virtual Symposia: we might host a two half-day sessions (e.g., June/November) with a focus on promoting software interoperability for the various LSST PZ-related efforts ongoing within in-kind contributions and Science Collaborations. Melissa G. and Eric C. will take the lead on organizing. Stay tuned for an announcement.

  2. PZ Server & RAIL: Julia G. reported on updates to the LIneA PZ Server related to user uploads, libraries, and tutorials. Updates to the training set maker are currently under construction. Julia G. also reported on progress with ingesting the DP0.2 Object catalog and RAIL runs (FlexZBoost estimate) at LIneA’s clusters. Bug fixes and run-time scalability were discussed. Several action items for co-work between LIneA, RAIL, and LINCC were identified.

#6

Wed Mar 13, Fri Mar 22 2024

Discussion

Ops Rehearsal #3 will make simulated ComCam data available to the Commissioning team members in early April.

We discussed how to use Ops Rehearsal #3 as an opportunity to stand up and test an end-to-end process for creating photo-z estimates. With only gri filters, we don’t expect to be able to robustly evaluate any resulting photo-z, but the focus would be on implementation. We discussed various aspects of the computational resources, results storage, and results sharing within the Commissioning team.

Development continues on various photo-z related software packages such as RAIL and the PZ Server. We discussed what would be appropriate / useful to include in activities related to Ops Rehearsal #3. We also discussed writing a SITCom Tech Note to describe progress made based on Ops Rehearsal #3. The SITCom-TN would become publicly available (but the simulated ComCam data would not be).

#7

Abridged discussion topics from team meetings over the past few months.

Wed Apr 10

  • onboarding to commissioning resources
  • use of operations rehearsal 3 data
  • status updates from RAIL team, path forward

Wed May 8

  • RAIL workflow
  • LePhare implementation into RAIL
  • Rubin/Roman simulations
  • applying PZ estimators to DP0.2
  • different types of flux estimates and their use in PZ

Wed Jun 5

  • congratulations RAIL team on the release
  • operations rehearsal 4 is coming up
  • updates from PZ Server team on development

Wed Jul 10

  • most people at DESC meeting or on vacation
  • updates from commissioning
  • PZ Server updates