I have been trying to create some custom coadds on DP1 and everything was going well until I got a “Disk quota exceeded” which is clearly because all the intermediate information and the products are being saved to the home directory… I have two questions:
is there a better directory where to store this kind of work, or is this a real limitation and I should work this somewhere else?
is a documentation somewhere about what files could be deleted after the process, and retain only the processed coadd?
For large temporary space allocations, you should use the directory specified in the environment variable $SCRATCH_DIR; this is a user-specific directory on a filesystem that is not quotaed, but will be purged every Sunday morning.
The tutorials will be updated to reflect this usage.
Indeed, the version of tutorial notebook 105.6. Create a custom coadded image has been updated to use the scratch space and to provide advice on which files to delete and retain.
To get the new version as an executable ipynb file, log in to the RSP at data.lsst.cloud, use the “Tutorials” drop-down menu to select tutorial 105.6., and if a pop-up window that says “target file exists” appears, click “overwrite” to overwrite the previously saved version with the latest edition.
