‘divide by zero’ RuntimeWarning of constructFlat.py in hscPipe v7.5


(Ying-Tung Chen) #1

Although the process of constructFlat.py finished without error, I got a lot ‘divide by zero’ RuntimeWarning messages from the flat process by hscPipe 7.5. I am not sure what is the cause. Maybe they’re coming from ccd=9?

It seems that all flat files are ready in --rerun directory, but the output files in --rerun never been moved/copied to --calib directory, i.e. no file exists in --calib directory after the process of constructFlat.py. So, I can’t continue the following process using singleFrameDriver.py for the 2019 data. Is there a solution for this case?

This is the log with RuntimeWarning:

4198 INFO 2019-06-11T05:46:42.926+0800 flat: Writing {‘ccd’: 110, ‘filter’: ‘HSC-G’, ‘calibDate’: ‘2019-04-04’} on subaru15.asiaa.sinica.edu.tw:4198
4196 INFO 2019-06-11T05:47:03.128+0800 flat.combination: Detector 111 has 82.087409% pixels vignetted
4196 INFO 2019-06-11T05:47:08.184+0800 flat: Writing {‘ccd’: 111, ‘filter’: ‘HSC-G’, ‘calibDate’: ‘2019-04-04’} on subaru15.asiaa.sinica.edu.tw:4196
/opt/hscPipe7/stack/miniconda3-4.5.12-1172c30/Linux64/ip_isr/7.1-hsc/python/lsst/ip/isr/isrTask.py:2069: RuntimeWarning: invalid value encountered in true_divide
flatness = (skyLevels[good] - skyMedian) / skyMedian
/opt/hscPipe7/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_drivers/7.5-hsc/python/lsst/pipe/drivers/constructCalibs.py:145: RuntimeWarning: divide by zero encountered in double_scalars
combined *= finalScale / background
/opt/hscPipe7/python/miniconda3-4.5.12/envs/lsst-scipipe-1172c30/lib/python3.7/site-packages/numpy/core/fromnumeric.py:3118: RuntimeWarning: Mean of empty slice.
out=out, **kwargs)
/opt/hscPipe7/python/miniconda3-4.5.12/envs/lsst-scipipe-1172c30/lib/python3.7/site-packages/numpy/core/_methods.py:85: RuntimeWarning: invalid value encountered in true_divide
ret = ret.dtype.type(ret / rcount)
/opt/hscPipe7/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_drivers/7.5-hsc/python/lsst/pipe/drivers/constructCalibs.py:1076: RuntimeWarning: divide by zero encountered in log
bgMatrix = np.log(bgMatrix)
/opt/hscPipe7/stack/miniconda3-4.5.12-1172c30/Linux64/pipe_drivers/7.5-hsc/python/lsst/pipe/drivers/constructCalibs.py:1083: UserWarning: Warning: converting a masked element to nan.
compScales = np.array([(bgMatrix[i1, :] - expScales).mean() for i1 in range(numCcds)])
/opt/hscPipe7/stack/miniconda3-4.5.12-1172c30/Linux64/ip_isr/7.1-hsc/python/lsst/ip/isr/isrTask.py:2069: RuntimeWarning: invalid value encountered in true_divide
flatness = (skyLevels[good] - skyMedian) / skyMedian
/opt/hscPipe7/stack/miniconda3-4.5.12-1172c30/Linux64/ip_isr/7.1-hsc/python/lsst/ip/isr/isrTask.py:2069: RuntimeWarning: invalid value encountered in true_divide
flatness = (skyLevels[good] - skyMedian) / skyMedian


(Paul Price) #2

This is all completely normal. Use ingestCalibs.py to ingest the created calibs into the calib repo.


(Ying-Tung Chen) #3

I see. I proceeded to run singleFrameDriver.py, but terminated by EXIT CODE: 139 and Segmentation fault. I will report that in another report.