When running the following code line:
pipetask run -b /project/gmegias/aos/lsst_stack/perturbations/test/phosimData -i refcats,LSSTComCam/raw/all,LSSTComCam/calib --instrument lsst.obs.lsst.LsstComCam --register-dataset-types --output-run ts_phosim_9006001 -p comcamPipeline.yaml -d “exposure IN (4021123106001, 4021123106002)” -j 2
In RSP notebook i get the following error:
[Errno 2] No such file or directory: ‘pipetask run -b /project/gmegias/aos/lsst_stack/perturbations/test/phosimData -i refcats,LSSTComCam/raw/all,LSSTComCam/calib --instrument lsst.obs.lsst.LsstComCam --register-dataset-types --output-run ts_phosim_9006001 -p comcamPipeline.yaml -d “exposure IN (4021123106001, 4021123106002)” -j 2’
However, if I run it from the LSP terminal the response is a different one:
ctrl.mpexec.cmdLineFwk INFO: QuantumGraph contains 22 quanta for 3 tasks, graph ID: ‘1629306899.3660324-8663’
conda.common.io INFO: overtaking stderr and stdout
conda.common.io INFO: stderr and stdout yielding back
isr INFO: Converting exposure to floating point values.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 8, exposure: 4021123106002, …} took 6.913 seconds
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 5, exposure: 4021123106002, …} took 7.022 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 1 quanta successfully, 0 failed and 21 remain out of total 22 quanta.
ctrl.mpexec.mpGraphExecutor INFO: Executed 2 quanta successfully, 0 failed and 20 remain out of total 22 quanta.
INFO: Loading reference objects from region bounded by [0.14611101, 0.38344077], [-0.37143930, -0.13810829] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [0.00000000, 360.00000000], [-0.37144007, -0.13811062] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [359.67667034, 359.91400010], [-0.37143930, -0.13810829] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [0.14611085, 0.38344026], [-0.13672181, 0.09661078] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [0.00000000, 360.00000000], [-0.13672209, 0.09661098] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [359.67667084, 359.91400026], [-0.13672181, 0.09661078] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [0.14611068, 0.38343976], [0.09799794, 0.33132828] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [0.00000000, 360.00000000], [0.09799959, 0.33132896] RA Dec
INFO: Loaded 1 reference objects
INFO: Loading reference objects from region bounded by [359.67667135, 359.91400043], [0.09799794, 0.33132828] RA Dec
INFO: Loaded 1 reference objects
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘generateDonutCatalogOnlineTask’ on quantum {instrument: ‘LSSTComCam’} took 0.309 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 3 quanta successfully, 0 failed and 19 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 8} failed
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
Process task-18:
Traceback (most recent call last):
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 315, in _bootstrap
self.run()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 108, in run
self._target(*self._args, **self._kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 128, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.mpGraphExecutor ERROR: Task <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 8}> failed; processing will continue for remaining tasks.
ctrl.mpexec.mpGraphExecutor INFO: Executed 3 quanta successfully, 1 failed and 18 remain out of total 22 quanta.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 5} failed
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
Process task-13:
Traceback (most recent call last):
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 315, in _bootstrap
self.run()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 108, in run
self._target(*self._args, **self._kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 128, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.mpGraphExecutor ERROR: Task <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 5}> failed; processing will continue for remaining tasks.
ctrl.mpexec.mpGraphExecutor INFO: Executed 3 quanta successfully, 2 failed and 17 remain out of total 22 quanta.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
isr INFO: Converting exposure to floating point values.
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 7, exposure: 4021123106001, …} took 4.728 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 4 quanta successfully, 2 failed and 16 remain out of total 22 quanta.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 7} failed
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 4, exposure: 4021123106002, …} took 4.714 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 5 quanta successfully, 2 failed and 15 remain out of total 22 quanta.
Process task-21:
Traceback (most recent call last):
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 315, in _bootstrap
self.run()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 108, in run
self._target(*self._args, **self._kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 128, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.mpGraphExecutor ERROR: Task <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 7}> failed; processing will continue for remaining tasks.
ctrl.mpexec.mpGraphExecutor INFO: Executed 5 quanta successfully, 3 failed and 14 remain out of total 22 quanta.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 1, exposure: 4021123106001, …} took 4.238 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 6 quanta successfully, 3 failed and 13 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 1} failed
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 3, exposure: 4021123106002, …} took 6.181 seconds
Process task-20:
Traceback (most recent call last):
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 315, in _bootstrap
self.run()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 108, in run
self._target(*self._args, **self._kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 128, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.mpGraphExecutor INFO: Executed 7 quanta successfully, 3 failed and 12 remain out of total 22 quanta.
ctrl.mpexec.mpGraphExecutor ERROR: Task <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 1}> failed; processing will continue for remaining tasks.
ctrl.mpexec.mpGraphExecutor INFO: Executed 7 quanta successfully, 4 failed and 11 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 3} failed
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
Process task-19:
Traceback (most recent call last):
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 315, in _bootstrap
self.run()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 108, in run
self._target(*self._args, **self._kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 128, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.mpGraphExecutor ERROR: Task <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 3}> failed; processing will continue for remaining tasks.
ctrl.mpexec.mpGraphExecutor INFO: Executed 7 quanta successfully, 5 failed and 10 remain out of total 22 quanta.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Converting exposure to floating point values.
isr INFO: Applying gain correction instead of flat.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 6, exposure: 4021123106002, …} took 4.954 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 8 quanta successfully, 5 failed and 9 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 0, exposure: 4021123106001, …} took 5.731 seconds
isr INFO: Converting exposure to floating point values.
ctrl.mpexec.mpGraphExecutor INFO: Executed 9 quanta successfully, 5 failed and 8 remain out of total 22 quanta.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor ERROR: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 0} failed
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 2, exposure: 4021123106001, …} took 5.402 seconds
Process task-14:
Traceback (most recent call last):
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 315, in _bootstrap
self.run()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/multiprocessing/process.py”, line 108, in run
self._target(*self._args, **self._kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 128, in _executeJob
quantumExecutor.execute(taskDef, quantum, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 173, in execute
self.runQuantum(task, quantum, taskDef, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/singleQuantumExecutor.py”, line 439, in runQuantum
task.runQuantum(butlerQC, inputRefs, outputRefs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/pipe_base/22.0.1-20-g5ce7af2+ff3b2f8649/python/lsst/pipe/base/pipelineTask.py”, line 155, in runQuantum
outputs = self.run(**inputs)
File “/project/gmegias/aos/lsst_stack/ts_wep/python/lsst/ts/wep/task/EstimateZernikesFamTask.py”, line 134, in run
focusZ1 = exposures[1].getMetadata()[“FOCUSZ”]
IndexError: list index out of range
ctrl.mpexec.mpGraphExecutor INFO: Executed 10 quanta successfully, 5 failed and 7 remain out of total 22 quanta.
ctrl.mpexec.mpGraphExecutor ERROR: Task <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 0}> failed; processing will continue for remaining tasks.
ctrl.mpexec.mpGraphExecutor INFO: Executed 10 quanta successfully, 6 failed and 6 remain out of total 22 quanta.
isr INFO: Converting exposure to floating point values.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 6, exposure: 4021123106001, …} took 4.436 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 11 quanta successfully, 6 failed and 5 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 4, exposure: 4021123106001, …} took 6.367 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 12 quanta successfully, 6 failed and 4 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 6} took 25.437 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 13 quanta successfully, 6 failed and 3 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 4} took 24.939 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 14 quanta successfully, 6 failed and 2 remain out of total 22 quanta.
isr INFO: Converting exposure to floating point values.
isr INFO: Assembling CCD from amplifiers.
isr INFO: Widening saturation trails.
isr INFO: Applying gain correction instead of flat.
isr WARNING: No rough magnitude zero point defined for filter g_01.
isr INFO: Setting rough magnitude zero point for filter g_01: 30.940228
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘isr’ on quantum {instrument: ‘LSSTComCam’, detector: 2, exposure: 4021123106002, …} took 4.964 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 15 quanta successfully, 6 failed and 1 remain out of total 22 quanta.
ctrl.mpexec.singleQuantumExecutor INFO: Execution of task ‘estimateZernikesFamTask’ on quantum {instrument: ‘LSSTComCam’, detector: 2} took 24.095 seconds
ctrl.mpexec.mpGraphExecutor INFO: Executed 16 quanta successfully, 6 failed and 0 remain out of total 22 quanta.
ctrl.mpexec.mpGraphExecutor ERROR: Failed jobs:
ctrl.mpexec.mpGraphExecutor ERROR: - FAILED: <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 8}>
ctrl.mpexec.mpGraphExecutor ERROR: - FAILED: <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 5}>
ctrl.mpexec.mpGraphExecutor ERROR: - FAILED: <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 7}>
ctrl.mpexec.mpGraphExecutor ERROR: - FAILED: <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 1}>
ctrl.mpexec.mpGraphExecutor ERROR: - FAILED: <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 3}>
ctrl.mpexec.mpGraphExecutor ERROR: - FAILED: <TaskDef(EstimateZernikesFamTask, label=estimateZernikesFamTask) dataId={instrument: ‘LSSTComCam’, detector: 0}>
Traceback (most recent call last):
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/bin/pipetask”, line 29, in
sys.exit(main())
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/cli/pipetask.py”, line 45, in main
return cli()
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/site-packages/click/core.py”, line 829, in call
return self.main(*args, **kwargs)
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/site-packages/click/core.py”, line 782, in main
rv = self.invoke(ctx)
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/site-packages/click/core.py”, line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/site-packages/click/core.py”, line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/site-packages/click/core.py”, line 610, in invoke
return callback(*args, **kwargs)
File “/opt/lsst/software/stack/conda/miniconda3-py38_4.9.2/envs/lsst-scipipe-0.6.0/lib/python3.8/site-packages/click/decorators.py”, line 21, in new_func
return f(get_current_context(), *args, **kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/cli/cmd/commands.py”, line 103, in run
script.run(qgraphObj=qgraph, **kwargs)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/cli/script/run.py”, line 171, in run
f.runPipeline(qgraphObj, taskFactory, args)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/cmdLineFwk.py”, line 669, in runPipeline
executor.execute(graph, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 299, in execute
self._executeQuantaMP(graph, butler)
File “/opt/lsst/software/stack/stack/miniconda3-py38_4.9.2-0.6.0/Linux64/ctrl_mpexec/22.0.1-14-g3316c66+9f7b2bc49a/python/lsst/ctrl/mpexec/mpGraphExecutor.py”, line 479, in _executeQuantaMP
raise MPGraphExecutorError(“One or more tasks failed or timed out during execution.”)
lsst.ctrl.mpexec.mpGraphExecutor.MPGraphExecutorError: One or more tasks failed or timed out during execution.
I don’t understand what’s wrong in the notebook nor what’s going on the terminal. Any help will be appreciate it!