Hi,
In discussions with @rbiswas & @danielsf concerning sncosmo and the 12_0 release, it has been suggested we move back to astropy 1.1.1 rather than use the installed 1.2.1. We currently have a conda installation of 12_0. Can I merely do a “conda remove” on astropy and reinstall it via conda using the default (not the LSST) channel? Looking back at our older w.2016.20 install, I see astropy=1.1.1=np110py27_0.
I’m more than happy to start over if that’s the best course of action.
Thanks,
Heather
Is this because of a problem with sncosmos or a problem with Astropy?
I think others are in a better position to answer that @timj… from what I understand there is potentially a compatibility problem with sims_utils and astropy 1.2.1.
@timj I have a suspicion that astropy 1.2.1 breaks sim_utils – I am waiting on a test build to validate this theory.
I will look into exactly why sims_utils brakes with astropy 1.2.1 this afternoon. I will post my findings here.
It is related to sims_utils, although @danielsf will determine exactly what is the problem.
However, I’m curious that you are having a problem with it at all – the conda installation specifies astropy 1.1.2 (a compatible version), rather than installing astropy 1.2. Did you upgrade astropy after conda installing lsst_sims?
@ljones I didn’t upgrade anything and followed the directions:
https://pipelines.lsst.io/install/conda.html
Actually just to make sure, I repeated the procedure and here is the full log, where if you scroll down a bit, you’ll see:
astropy: 1.2.1-np111py27_0
I also note that astropy-helpers doesn’t seem to match the major/minor version of astropy:
astropy-helpers: 1.1.1-0
My understanding is that their versioning convention is to follow astropy’s at least in the major/minor numbering.
Did I make an error?
conda install lsst-distrib lsst-sims
Fetching package metadata: …
Solving package specifications: …
Warning: 2 possible package resolutions (only showing differing packages):
[u’setuptools-git-1.1-0.tar.bz2’],
[u’setuptools-git-1.1-py27_0.tar.bz2’],
Package plan for installation in environment /home/heather/.conda/envs/lsstNew:
The following packages will be downloaded:
package | build
---------------------------|-----------------
libgcc-5.2.0 | 0 1.1 MB
libgfortran-3.0.0 | 1 281 KB
libsodium-1.0.10 | 0 1.2 MB
mkl-11.3.3 | 0 122.1 MB
nomkl-1.0 | 0 402 B
libpng-1.6.22 | 0 214 KB
swig-3.0.2 | 0 1.9 MB
zeromq-4.1.4 | 0 4.1 MB
alabaster-0.7.8 | py27_0 18 KB
backports-1.0 | py27_0 1 KB
cython-0.24 | py27_0 5.3 MB
decorator-4.0.10 | py27_0 12 KB
docutils-0.12 | py27_2 637 KB
eups-2.0.2 | 0 403 KB
freetype-2.5.5 | 1 2.5 MB
functools32-3.2.3.2 | py27_0 15 KB
imagesize-0.7.1 | py27_0 3 KB
markupsafe-0.23 | py27_2 31 KB
mistune-0.7.2 | py27_0 570 KB
numpy-1.11.1 | py27_0 6.2 MB
path.py-8.2.1 | py27_0 45 KB
ptyprocess-0.5.1 | py27_0 19 KB
py-1.4.31 | py27_0 123 KB
pygments-2.1.3 | py27_0 1.2 MB
pyparsing-2.1.4 | py27_0 70 KB
pytz-2016.4 | py27_0 178 KB
pyyaml-3.11 | py27_4 297 KB
pyzmq-15.2.0 | py27_1 705 KB
setuptools-git-1.1 | 0 16 KB
simplegeneric-0.8.1 | py27_1 7 KB
snowballstemmer-1.2.1 | py27_0 73 KB
sphinx_rtd_theme-0.1.9 | py27_0 628 KB
sqlalchemy-1.0.13 | py27_0 1.3 MB
astropy-1.2.1 | np111py27_0 8.4 MB
babel-2.3.3 | py27_0 4.9 MB
configparser-3.5.0b2 | py27_1 30 KB
cycler-0.10.0 | py27_0 11 KB
fontconfig-2.11.1 | 6 405 KB
get_terminal_size-1.0.0 | py27_0 4 KB
jinja2-2.8 | py27_1 264 KB
jsonschema-2.5.1 | py27_0 55 KB
lsst-apr-1.5.2 | 0 472 KB
lsst-cfitsio-3360.4 | 0 3.4 MB
lsst-doxygen-1.8.5.1 | 0 2.9 MB
lsst-eigen-3.2.5.1 | 0 454 KB
lsst-fftw-3.3.4.2 | 0 1.7 MB
lsst-freetds-0.91.112.2 | 0 3.9 MB
lsst-gsl-1.16.3 | 0 6.9 MB
lsst-mariadb-0.10.1.11.2 | 0 141.7 MB
lsst-mariadbclient-0.10.1.11.3| 0 37.2 MB
lsst-minuit2-5.34.14 | 0 7.7 MB
lsst-mpich-3.2 | 0 5.2 MB
lsst-pyephem-3.7.5.1.1 | 0 915 KB
lsst-python-d2to1-0.2.12.1 | 0 44 KB
lsst-python-eups-configs-0.0.4| 0 7 KB
lsst-sims-data-0.12.0 | 0 27.9 MB
lsst-sims-sed-library-0.12.0| 0 816.4 MB
lsst-sims-skybrightness-data-0.12.0| 0 943.4 MB
lsst-swig-eups-configs-3.0.2.1| 0 7 KB
lsst-throughputs-0.12.0 | 0 9.6 MB
lsst-xpa-2.1.15.3 | 0 568 KB
numexpr-2.6.0 | np111py27_0 351 KB
pathlib2-2.1.0 | py27_0 26 KB
pexpect-4.0.1 | py27_0 63 KB
pytest-2.9.2 | py27_0 239 KB
python-dateutil-2.5.3 | py27_0 236 KB
scipy-0.17.1 | np111py27_1 30.1 MB
ssl_match_hostname-3.4.0.2 | py27_1 6 KB
traitlets-4.2.1 | py27_0 108 KB
entrypoints-0.2.2 | py27_0 6 KB
jupyter_core-4.1.0 | py27_0 51 KB
lsst-activemqcpp-3.9.0.2.post3| 0 65.9 MB
lsst-apr-util-1.5.4 | 0 672 KB
lsst-astropy-eups-configs-0.0.1.2| 0 7 KB
lsst-boost-1.60.post1 | 0 16.5 MB
lsst-mpi-0.0.1.post1 | 0 16 KB
lsst-mysqlpython-1.2.3.2.post2| 0 103 KB
lsst-numpy-eups-configs-0.0.2.post1| 0 8 KB
lsst-pykg-config-1.2.0.post6| 0 33 KB
lsst-pymssql-2.1.1.post4 | 0 1.0 MB
lsst-python-psutil-4.1.0.post1| 0 231 KB
lsst-pyyaml-eups-configs-3.11.1.post1| 0 5 KB
lsst-scons-2.5.0.1 | 0 743 KB
lsst-sqlalchemy-eups-configs-1.0.8.3.post1| 0 5 KB
lsst-stsci-distutils-0.3.7.1| 0 41 KB
lsst-wcslib-5.13.1 | 0 3.3 MB
pandas-0.18.1 | np111py27_0 13.0 MB
pickleshare-0.7.2 | py27_0 9 KB
qt-4.8.7 | 3 34.1 MB
sphinx-1.4.1 | py27_0 1.2 MB
tornado-4.3 | py27_1 548 KB
astropy-helpers-1.1.1 | 0 162 KB
ipython-4.2.0 | py27_0 930 KB
jupyter_client-4.3.0 | py27_0 96 KB
lsst-astrometry-net-0.50.3.post1| 0 19.9 MB
lsst-esutil-0.5.3.post1 | 0 1.1 MB
lsst-log4cxx-0.10.0.6.post1| 0 10.6 MB
lsst-mpi4py-1.3.1.2.post1 | 0 1.5 MB
lsst-oorb-0.12.0 | 0 635.1 MB
lsst-palpy-1.7.0.2 | 0 1.4 MB
lsst-pyfits-3.4.0.post4 | 0 2.0 MB
lsst-scipy-eups-configs-0.0.1.1.post1| 0 11 KB
lsst-scisql-0.3.5.post14 | 0 169 KB
lsst-sconsutils-0.12.0 | 0 214 KB
lsst-tmv-0.73.post2 | 0 8.0 MB
pyqt-4.11.4 | py27_3 3.4 MB
terminado-0.6 | py27_0 18 KB
ipykernel-4.3.1 | py27_0 117 KB
lsst-astrometry-net-data-0.10.0.post77| 0 1.7 MB
lsst-base-0.12.0 | 0 6.1 MB
lsst-eups-environment-0.12.0| 0 30 KB
lsst-galsim-1.3.2.2.post2 | 0 2.4 MB
lsst-geom-0.12.0 | 0 183 KB
lsst-healpy-1.8.1.2.post1 | 0 8.8 MB
lsst-lmfit-0.9.3.post2 | 0 226 KB
lsst-psfex-0.12.0 | 0 2.4 MB
lsst-sncosmo-0.12.0 | 0 676 KB
matplotlib-1.5.1 | np111py27_0 8.2 MB
nbconvert-4.2.0 | py27_0 310 KB
lsst-log-0.12.0 | 0 2.6 MB
lsst-matplotlib-eups-configs-0.0.2.post1| 0 19 KB
lsst-ndarray-0.12.0 | 0 11.0 MB
lsst-pex-exceptions-0.12.0 | 0 5.3 MB
notebook-4.2.1 | py27_0 5.0 MB
ipython-notebook-4.0.4 | py27_0 5 KB
lsst-db-0.12.0.post1 | 0 25 KB
lsst-utils-0.12.0 | 0 5.3 MB
lsst-daf-base-0.12.0 | 0 8.0 MB
lsst-sims-maps-0.12.0 | 0 170.1 MB
lsst-sims-movingobjects-0.12.0| 0 306 KB
lsst-sims-utils-0.12.0 | 0 164 KB
lsst-ctrl-events-0.12.0 | 0 4.0 MB
lsst-pex-logging-0.12.0 | 0 6.4 MB
lsst-pex-policy-0.12.0 | 0 7.8 MB
lsst-sims-photutils-0.12.0 | 0 3.3 MB
lsst-daf-persistence-0.12.0| 0 41.4 MB
lsst-pex-config-0.12.0 | 0 2.8 MB
lsst-sims-skybrightness-0.12.0| 0 2.3 MB
lsst-afw-0.12.0 | 0 188.9 MB
lsst-cat-0.12.0 | 0 106 KB
lsst-sims-catalogs-generation-0.12.0| 0 5.4 MB
lsst-ctrl-provenance-0.12.0| 0 27 KB
lsst-display-ds9-0.12.0 | 0 2.2 MB
lsst-shapelet-0.12.0 | 0 17.6 MB
lsst-sims-catalogs-measures-0.12.0| 0 56 KB
lsst-sims-coordutils-0.12.0| 0 32 KB
lsst-skymap-0.12.0 | 0 260 KB
lsst-skypix-0.12.0 | 0 171 KB
lsst-ctrl-orca-0.12.0 | 0 582 KB
lsst-daf-butlerutils-0.12.0| 0 27.9 MB
lsst-ctrl-execute-0.12.0 | 0 38 KB
lsst-obs-test-0.12.0 | 0 38.9 MB
lsst-ctrl-platform-gordon-0.12.0| 0 15 KB
lsst-ctrl-platform-lsst-0.12.0| 0 14 KB
lsst-pipe-base-0.12.0 | 0 309 KB
lsst-coadd-utils-0.12.0 | 0 4.6 MB
lsst-ctrl-pool-0.12.0 | 0 259 KB
lsst-coadd-chisquared-0.12.0| 0 3.7 MB
lsst-meas-base-0.12.0 | 0 19.0 MB
lsst-meas-algorithms-0.12.0| 0 27.0 MB
lsst-meas-extensions-simpleshape-0.12.0| 0 4.6 MB
lsst-ip-isr-0.12.0 | 0 5.3 MB
lsst-meas-astrom-0.12.0 | 0 27.7 MB
lsst-meas-deblender-0.12.0 | 0 7.9 MB
lsst-meas-extensions-psfex-0.12.0| 0 5.8 MB
lsst-meas-extensions-shapehsm-0.12.0| 0 4.6 MB
lsst-ip-diffim-0.12.0 | 0 18.0 MB
lsst-pipe-tasks-0.12.0 | 0 9.9 MB
lsst-meas-modelfit-0.12.0 | 0 25.0 MB
lsst-obs-lsstsim-0.12.0 | 0 21.0 MB
lsst-obs-sdss-0.12.0 | 0 4.9 MB
lsst-pipe-drivers-0.12.0 | 0 296 KB
lsst-apps-0.12.0 | 0 23 KB
lsst-datarel-0.12.0 | 0 467 KB
lsst-obs-subaru-0.12.0 | 0 4.8 MB
lsst-sims-catutils-0.12.0 | 0 1.2 MB
lsst-sims-maf-0.12.0 | 0 12.6 MB
lsst-distrib-0.12.0 | 0 17 KB
lsst-sims-galsiminterface-0.12.0| 0 576 KB
lsst-sims-0.12.0 | 0 21 KB
------------------------------------------------------------
Total: 3.74 GB
The following NEW packages will be INSTALLED:
alabaster: 0.7.8-py27_0
astropy: 1.2.1-np111py27_0
astropy-helpers: 1.1.1-0
babel: 2.3.3-py27_0
backports: 1.0-py27_0
backports_abc: 0.4-py27_0
cairo: 1.12.18-6
configparser: 3.5.0b2-py27_1
cycler: 0.10.0-py27_0
cython: 0.24-py27_0
decorator: 4.0.10-py27_0
docutils: 0.12-py27_2
entrypoints: 0.2.2-py27_0
eups: 2.0.2-0
fontconfig: 2.11.1-6
freetype: 2.5.5-1
functools32: 3.2.3.2-py27_0
get_terminal_size: 1.0.0-py27_0
imagesize: 0.7.1-py27_0
ipykernel: 4.3.1-py27_0
ipython: 4.2.0-py27_0
ipython-notebook: 4.0.4-py27_0
ipython_genutils: 0.1.0-py27_0
jinja2: 2.8-py27_1
jsonschema: 2.5.1-py27_0
jupyter_client: 4.3.0-py27_0
jupyter_core: 4.1.0-py27_0
libgcc: 5.2.0-0
libgfortran: 3.0.0-1
libpng: 1.6.22-0
libsodium: 1.0.10-0
libxml2: 2.9.2-0
lsst-activemqcpp: 3.9.0.2.post3-0
lsst-afw: 0.12.0-0
lsst-apps: 0.12.0-0
lsst-apr: 1.5.2-0
lsst-apr-util: 1.5.4-0
lsst-astrometry-net: 0.50.3.post1-0
lsst-astrometry-net-data: 0.10.0.post77-0
lsst-astropy-eups-configs: 0.0.1.2-0
lsst-base: 0.12.0-0
lsst-boost: 1.60.post1-0
lsst-cat: 0.12.0-0
lsst-cfitsio: 3360.4-0
lsst-coadd-chisquared: 0.12.0-0
lsst-coadd-utils: 0.12.0-0
lsst-ctrl-events: 0.12.0-0
lsst-ctrl-execute: 0.12.0-0
lsst-ctrl-orca: 0.12.0-0
lsst-ctrl-platform-gordon: 0.12.0-0
lsst-ctrl-platform-lsst: 0.12.0-0
lsst-ctrl-pool: 0.12.0-0
lsst-ctrl-provenance: 0.12.0-0
lsst-daf-base: 0.12.0-0
lsst-daf-butlerutils: 0.12.0-0
lsst-daf-persistence: 0.12.0-0
lsst-datarel: 0.12.0-0
lsst-db: 0.12.0.post1-0
lsst-display-ds9: 0.12.0-0
lsst-distrib: 0.12.0-0
lsst-doxygen: 1.8.5.1-0
lsst-eigen: 3.2.5.1-0
lsst-esutil: 0.5.3.post1-0
lsst-eups-environment: 0.12.0-0
lsst-fftw: 3.3.4.2-0
lsst-freetds: 0.91.112.2-0
lsst-galsim: 1.3.2.2.post2-0
lsst-geom: 0.12.0-0
lsst-gsl: 1.16.3-0
lsst-healpy: 1.8.1.2.post1-0
lsst-ip-diffim: 0.12.0-0
lsst-ip-isr: 0.12.0-0
lsst-lmfit: 0.9.3.post2-0
lsst-log: 0.12.0-0
lsst-log4cxx: 0.10.0.6.post1-0
lsst-mariadb: 0.10.1.11.2-0
lsst-mariadbclient: 0.10.1.11.3-0
lsst-matplotlib-eups-configs: 0.0.2.post1-0
lsst-meas-algorithms: 0.12.0-0
lsst-meas-astrom: 0.12.0-0
lsst-meas-base: 0.12.0-0
lsst-meas-deblender: 0.12.0-0
lsst-meas-extensions-psfex: 0.12.0-0
lsst-meas-extensions-shapehsm: 0.12.0-0
lsst-meas-extensions-simpleshape: 0.12.0-0
lsst-meas-modelfit: 0.12.0-0
lsst-minuit2: 5.34.14-0
lsst-mpi: 0.0.1.post1-0
lsst-mpi4py: 1.3.1.2.post1-0
lsst-mpich: 3.2-0
lsst-mysqlpython: 1.2.3.2.post2-0
lsst-ndarray: 0.12.0-0
lsst-numpy-eups-configs: 0.0.2.post1-0
lsst-obs-lsstsim: 0.12.0-0
lsst-obs-sdss: 0.12.0-0
lsst-obs-subaru: 0.12.0-0
lsst-obs-test: 0.12.0-0
lsst-oorb: 0.12.0-0
lsst-palpy: 1.7.0.2-0
lsst-pex-config: 0.12.0-0
lsst-pex-exceptions: 0.12.0-0
lsst-pex-logging: 0.12.0-0
lsst-pex-policy: 0.12.0-0
lsst-pipe-base: 0.12.0-0
lsst-pipe-drivers: 0.12.0-0
lsst-pipe-tasks: 0.12.0-0
lsst-psfex: 0.12.0-0
lsst-pyephem: 3.7.5.1.1-0
lsst-pyfits: 3.4.0.post4-0
lsst-pykg-config: 1.2.0.post6-0
lsst-pymssql: 2.1.1.post4-0
lsst-python-d2to1: 0.2.12.1-0
lsst-python-eups-configs: 0.0.4-0
lsst-python-psutil: 4.1.0.post1-0
lsst-pyyaml-eups-configs: 3.11.1.post1-0
lsst-scipy-eups-configs: 0.0.1.1.post1-0
lsst-scisql: 0.3.5.post14-0
lsst-scons: 2.5.0.1-0
lsst-sconsutils: 0.12.0-0
lsst-shapelet: 0.12.0-0
lsst-sims: 0.12.0-0
lsst-sims-catalogs-generation: 0.12.0-0
lsst-sims-catalogs-measures: 0.12.0-0
lsst-sims-catutils: 0.12.0-0
lsst-sims-coordutils: 0.12.0-0
lsst-sims-data: 0.12.0-0
lsst-sims-galsiminterface: 0.12.0-0
lsst-sims-maf: 0.12.0-0
lsst-sims-maps: 0.12.0-0
lsst-sims-movingobjects: 0.12.0-0
lsst-sims-photutils: 0.12.0-0
lsst-sims-sed-library: 0.12.0-0
lsst-sims-skybrightness: 0.12.0-0
lsst-sims-skybrightness-data: 0.12.0-0
lsst-sims-utils: 0.12.0-0
lsst-skymap: 0.12.0-0
lsst-skypix: 0.12.0-0
lsst-sncosmo: 0.12.0-0
lsst-sqlalchemy-eups-configs: 1.0.8.3.post1-0
lsst-stsci-distutils: 0.3.7.1-0
lsst-swig-eups-configs: 3.0.2.1-0
lsst-throughputs: 0.12.0-0
lsst-tmv: 0.73.post2-0
lsst-utils: 0.12.0-0
lsst-wcslib: 5.13.1-0
lsst-xpa: 2.1.15.3-0
markupsafe: 0.23-py27_2
matplotlib: 1.5.1-np111py27_0
mistune: 0.7.2-py27_0
mkl: 11.3.3-0
nbconvert: 4.2.0-py27_0
nbformat: 4.0.1-py27_0
nomkl: 1.0-0
notebook: 4.2.1-py27_0
numexpr: 2.6.0-np111py27_0
numpy: 1.11.1-py27_0
pandas: 0.18.1-np111py27_0
path.py: 8.2.1-py27_0
pathlib2: 2.1.0-py27_0
pcre: 8.31-0
pexpect: 4.0.1-py27_0
pickleshare: 0.7.2-py27_0
pixman: 0.32.6-0
ptyprocess: 0.5.1-py27_0
py: 1.4.31-py27_0
pycairo: 1.10.0-py27_0
pygments: 2.1.3-py27_0
pyparsing: 2.1.4-py27_0
pyqt: 4.11.4-py27_3
pytest: 2.9.2-py27_0
python-dateutil: 2.5.3-py27_0
pytz: 2016.4-py27_0
pyyaml: 3.11-py27_4
pyzmq: 15.2.0-py27_1
qt: 4.8.7-3
scipy: 0.17.1-np111py27_1
setuptools-git: 1.1-0
simplegeneric: 0.8.1-py27_1
singledispatch: 3.4.0.3-py27_0
sip: 4.16.9-py27_0
six: 1.10.0-py27_0
snowballstemmer: 1.2.1-py27_0
sphinx: 1.4.1-py27_0
sphinx_rtd_theme: 0.1.9-py27_0
sqlalchemy: 1.0.13-py27_0
ssl_match_hostname: 3.4.0.2-py27_1
swig: 3.0.2-0
terminado: 0.6-py27_0
tornado: 4.3-py27_1
traitlets: 4.2.1-py27_0
yaml: 0.1.6-0
zeromq: 4.1.4-0There may be some versioning stuff I don’t understand with the conda.lsst.codes/stack channel, vs. the conda.lsst.codes/sims channel. I do believe that the version you get on the sims channel should be astropy1.1.2, although perhaps @jmatt could confirm that.
The sims channel will give you sims_2.2.6 + v_12 of the dm stack – the ‘stack’ channel will give you v_12 of everything, which in ‘lsst_sims’ corresponds to sims_2.2.5. The “stack” channel is the official channel, on the official DM release schedule. The “sims” channel is where we’ll put new sims releases (since we tend to have to release sims more often than the official DM releases). We may figure out a better way than multiple channels to handle all of this versioning stuff soon.
@timj, @heather999 The problem is in sims_utils. I was using UTC when I should have been using UT1 in one of the unit tests. I assume that the test did not fail before because this was happening at an MJD far enough in the future that astropy could not extrapolate the UTC-UT1 tables, so it was just assuming UTC=UT1. Astropy 1.2 updated the tables, so that was no longer the case. I will issue a pull request on this momentarily.
The build issue observed with sims_utils has been tested as not occuring when using astropy 1.1.1.
Alex pointed out to me last night that there is a leap second planned for this year now (so perhaps what was updated in astropy 1.2).
This is unrelated to this thread, but your comment made me wonder on one thing. Most of the astropy and affiliated packages have the helpers as a git submodule, so they won’t notice/use the conda installed version. Is there a package that requires it being installed? If yes, then it’s possible that package doesn’t yet require the latest helpers version, so you get v1.1.1 rather than the latest v1.2 installed.