Getting started tutorial part 5 problems

Support
#1

Hello,

I have problem while running:pipetask run --register-dataset-types
-b $RC2_SUBSET_DIR/SMALL_HSC/butler.yaml
-i u/$USER/source_calibration,u/$USER/gbdes,u/$USER/fgcm
-o u/$USER/warps
-p $DRP_PIPE_DIR/pipelines/HSC/DRP-RC2_subset.yaml#makeWarp
-d “skymap = ‘hsc_rings_v1’ AND tract = 9813 AND patch in (38, 39, 40, 41)”

I get following raceback:
Traceback (most recent call last):
File “/home/venil/lsstsw/stack/lsst-scipipe-9.0.0/Linux64/ctrl_mpexec/gf3af793bb1+a78a79140c/python/lsst/ctrl/mpexec/cli/cmd/commands.py”, line 221, in run
pipeline = script.build(**kwargs, show=show)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/venil/lsstsw/stack/lsst-scipipe-9.0.0/Linux64/ctrl_mpexec/gf3af793bb1+a78a79140c/python/lsst/ctrl/mpexec/cli/script/build.py”, line 115, in build
pipeline = f.makePipeline(args)
^^^^^^^^^^^^^^^^^^^^
File “/home/venil/lsstsw/stack/lsst-scipipe-9.0.0/Linux64/ctrl_mpexec/gf3af793bb1+a78a79140c/python/lsst/ctrl/mpexec/cmdLineFwk.py”, line 586, in makePipeline
pipeline = Pipeline.from_uri(args.pipeline)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/venil/lsstsw/stack/lsst-scipipe-9.0.0/Linux64/pipe_base/g4e4daad928+5ce4365957/python/lsst/pipe/base/pipeline.py”, line 335, in from_uri
pipeline = pipeline.subsetFromLabels(label_specifier)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/venil/lsstsw/stack/lsst-scipipe-9.0.0/Linux64/pipe_base/g4e4daad928+5ce4365957/python/lsst/pipe/base/pipeline.py”, line 403, in subsetFromLabels
return Pipeline.fromIR(self._pipelineIR.subset_from_labels(labelSet, subsetCtrl))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File “/home/venil/lsstsw/stack/lsst-scipipe-9.0.0/Linux64/pipe_base/g4e4daad928+5ce4365957/python/lsst/pipe/base/pipelineIR.py”, line 960, in subset_from_labels
raise ValueError(
ValueError: Not all supplied labels (specified or named subsets) are in the pipeline definition, extra labels: {‘makeWarp’}
Can anyone help me to find cause of the problem please.

Thank you.

#2

As I noted previously, the tutorial that you are trying is tied to the v27 release. There are no promises that it will work at all for a current weekly since rapid changes are occurring during commissioning.

#3

So, can I at least assume that my installation of the pipeline works correctly, since achieving that was one of my goals while going through the tutorial?

#4

With an lsstsw install the easiest thing for you to convince yourself that everything is fine is to do:

$ rebuild lsst_distrib lsst_ci ci_hsc_gen3 ci_imsim ci_cpp_gen3

which will run all our continuous integration tests (and take a few hours). rebuild lsst_distrib working is a pretty good indication that everything is fine because it does run tests (whereas lsstinstall won’t run tests when it does a binary install).
One downside of rebuild is that we don’t guarantee that it will be in a working state at any given moment because people can be merging tickets from multiple branches so you can be unlucky.

1 Like