Lsstinstall not correctly installing v27_0_0

Support
#1

Hi,
I need to install v27_0_0 on an HPC system. I have previously been able to install this version, but now the installation seems incomplete.

The minimal code for the error is:

source v27_0_0/loadLSST.sh
setup lsst_distrib
python -c "from lsst.pipe.tasks.warpAndPsfMatch import WarpAndPsfMatchTask"

Which outputs:

  File "<string>", line 1, in <module>
  File "/rds/project/rds-rPTGgs6He74/lsst_stack/v27_0_0/conda/envs/lsst-scipipe-8.0.0/share/eups/Linux64/pipe_tasks/gc07e1c2157+a98bf949bb/python/lsst/pipe/tasks/warpAndPsfMatch.py", line 29, in <module>
    from lsst.ip.diffim import ModelPsfMatchTask
  File "/rds/project/rds-rPTGgs6He74/lsst_stack/v27_0_0/conda/envs/lsst-scipipe-8.0.0/share/eups/Linux64/ip_diffim/g1470d8bcf6+cbe83ee85a/python/lsst/ip/diffim/__init__.py", line 25, in <module>
    from .diffimLib import *
  File "/rds/project/rds-rPTGgs6He74/lsst_stack/v27_0_0/conda/envs/lsst-scipipe-8.0.0/share/eups/Linux64/ip_diffim/g1470d8bcf6+cbe83ee85a/python/lsst/ip/diffim/diffimLib.py", line 25, in <module>
    from .detail import *
  File "/rds/project/rds-rPTGgs6He74/lsst_stack/v27_0_0/conda/envs/lsst-scipipe-8.0.0/share/eups/Linux64/ip_diffim/g1470d8bcf6+cbe83ee85a/python/lsst/ip/diffim/detail/__init__.py", line 22, in <module>
    from .._ipdiffimLib import *
ImportError: libboost_timer.so.1.82.0: cannot open shared object file: No such file or directory

I have v28_0_0 and v28_0_1 installed (and also maintain weeklies on the same system) with no issues.

Looking in the v27_0_0/conda/pkgs and v27_0_0/conda/envs/lsst-scipipe-8.0.0/lib folders it seems much of the libboost* files and folders are missing compared to the respective v28_0_0 folders.

Given these versions of the science pipeline seems to all use the same version of libboost, I am considering copying from v28_0_0 to v27_0_0, although this feels very hacky. Also, this may just be the first error I come across with the environment, and fixing it might just lead me to the next missing package.

Is there a better solution to making sure libboost is installed?

Thanks

#2

Update: I’ve copied over the libboost files from v28_0_0 to v27_0_0.
The minimal example no longer produces an error and pipecheck runs with no errors.
But it still doesn’t feel right!

#3

Thanks for the report. We can take a look at rubin-env 8 – older rubin-envs will tend to start failing unless exact pinning is used and we try to keep things working when we see failures. The key recommendation though is to use lsstinstall with the -X option since this will install the exact conda environment that we used to build the release. This is particularly relevant for older releases where we aren’t expecting people to be trying to install significant other conda packages on top. Did you use -X?

See Install with lsstinstall and eups distrib — LSST Science Pipelines

1 Like
#4

Hi Tim,
I didn’t use -X - I have now, and can confirm v27_0_0 installs and runs the reproducer successfully.
I have now modified my install scripts to use -X for older versions and -T for the latest version.
Thanks!