Hi (new to the project, and to the forum, first post )
I’m having issues installing the LSST Science Pipeline, following the installation guide, v25.0.1. I have run this on the RCS CSD3 facility and my local machine running Ubuntu on WSL2. I’m stuck at the eups distrib install -t v25_0_1 lsst_distrib step. Both fail at the same point, so I’m assuming it’s not a system-specific issue, although the exact contents of the error message differ.
The failure comes from the sconsUtils build (see below for the tail of the build logs), and can be recreated with eups distrib install -t v25_0_1 sconsUtils.
On CSD3, I see a segmentation fault and + exit -4.
On my local machine I see a bit more potentially useful info as error messages from pytest (pytest: error: unrecognized arguments: --flake8) and scons make it to the build log. I’ve done a bit of digging on pytest: error: unrecognized arguments: --flake8: flake8 is installed in the Python environment, but it seems the syntax in pytest setup.cfg has changed between versions. Notably, the current pytest setup.cfg on github differs from the v25.0.1 tagged version.
Hopefully someone who understands the build environment or is more familiar with pytest will be able to shed some light on this.
In the mean time - is there an option to build without downloading? I can’t see one in eups distrib install -h. That way I could try building with an edited setup.cfg.
You can’t use old releases with new conda environment.
Did you install the conda environment with curl -OL https://raw.githubusercontent.com/lsst/lsst/25.0.1/scripts/newinstall.sh ? That should get you an older rubin-env (it will be shown in the prompt). v25 uses pytest-flake8 as part of the build but newer releases do not and we removed that package from the conda environment.
Yes, I used curl -OL https://raw.githubusercontent.com/lsst/lsst/25.0.1/scripts/newinstall.sh as per the installation instructions. So the versions matched up.
Thanks to Matthias Wittgen, the tags have been fixed, and you should now get the proper version of rubin-env (5.0.1) when doing a curl -LO https://raw.githubusercontent.com/lsst/lsst/25.0.1/scripts/newinstall.sh
(You can also try using lsstinstall, which will be the supported installation mechanism going forward.)
Hi all, happy to report installation with lsstinstall was successful on both my laptop (Ubuntu on WSL2) and the HPC service I’m using (which runs RHEL).
I’ve marked @ktl 's reply as the solution, however please note his final comment in parenthesis is the solution - lsstinstall is the supported installation mechanism - and that I didn’t get the newinstall.sh installation system to work.
Hm. I think we’ve seen C++ compiler failures like that due to running out of memory. But that should apply equally for lsstinstall as newinstall. Is it possible that something else was consuming memory at the time?
Oh, there’s one more factor that would explain this. lsstinstall will try to use pre-compiled binary packages wherever possible. newinstall is a bit finicky and often falls back to source packages and compilation even when this isn’t necessary.
Oh, there’s one more factor that would explain this. lsstinstall will try to use pre-compiled binary packages wherever possible. newinstall is a bit finicky and often falls back to source packages and compilation even when this isn’t necessary.
This seems more likely (than the memory suggestion) considering I had issues on two different systems with newinstall, and both work with lsstinstall.
)