I am using LSST pipelines version v24_0_0 on RSP. I am attempting to run the following pipetask processing command, which was previously successful with v23_0_1:
DATAQUERY="exposure.observation_type='science' AND detector!=2 AND detector!=61"
OUTPUT=DECam/runs/v01
LOGFILE=$LOGDIR/step1-v01.log; \
date | tee $LOGFILE; \
pipetask --long-log run --register-dataset-types -j 4 \
-b $REPO --instrument lsst.obs.decam.DarkEnergyCamera \
-i $INPUT \
-o $OUTPUT \
-C calibrate:config/processCcd_grz_config.py \
-C transformPreSourceTable:config/transformPreSourceTable_config.py \
-c calibrate:deblend.maxFootprintArea=3000 \
-c characterizeImage:psfIterations=1 \
-c characterizeImage:measurePsf.psfDeterminer.name="psfex" \
-c calibrate:astrometry.matcher.maxRefObjects=3000 \
-c isr:doFringe=False \
-p $DRP_PIPE_DIR/pipelines/DECam/DRP-Merian.yaml#step1 \
-d "instrument='DECam' AND $DATAQUERY" \
2>&1 | tee -a $LOGFILE; \
date | tee -a $LOGFILE
This fails early on with an error about:
lsst.pex.config.config.FieldValidationError: RegistryField âmeasurePsf.psfDeterminerâ failed validation: Unknown key âpsfexâ in Registry/ConfigChoiceField
I have attached the full log file.
I looked at the v24_0_0 docs and it appears to me that âpsfexâ is still listed as a valid option there:
How do I select psfex for measurePsf.psfDeterminer in v24_0_0? Or is psfex no longer an option in v24_0_0?
This may not be related, but Iâm also noticing that on the front page of the v24_0_0 docs, thereâs a sentence that says:
This documentation covers version v23_0_0. Learn whatâs new. You can also find documentation for other versions.
Is the âv23_0_0â listed there accurate? If the docs are not updated for the release Iâm actually using then maybe that could explain whatâs going on.
This version has not formally been released yet so the documentation does not point to it by default. v24 will be released soon and then things will become a bit more self consistent and issues with the version number in the docs will be cleaned up. We are also working on v25 as well (which is based on w_2022_48). The release notes are still a work in progress and have not yet been merged to a release branch.
As I mentioned in another thread, you are doing detailed enough work that you should really be using a modern weekly release. w_2022_48 is a good place to start.
Thanks. I think that I did try guessing that before posting this topic. I just tried it again and got a similar (but not identical) error traceback when using measurePsf.psfDeterminer as compared to using measurePsf.psfDeterminer.name in the command. Without .name, the traceback starts with:
lsst.daf.butler.cli.utils ERROR: Caught an exception, details are in traceback:
Traceback (most recent call last):
File "/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-4.0.5/Linux64/pex_config/gc75b51116a+846e1f9efd/python/lsst/pex/config/configChoiceField.py", line 281, in __getitem__
value = self._dict[k]
KeyError: 'psfex'
Iâve attached the two launch scripts and corresponding log files in case the details could be helpful (for this test I tried only generating the QuantumGraph).
I will also aim to re-try this in w_2022_48 soon. Maybe that will end up running just fine.
