About HSC data process

Data Management
#21

sinceresly thanks, u and @price , your patient help really moved me a lot, I couldn’t believe u replyed me so fast. As a novice , only thanks can expressed my feeling.

#22

Oh, you probably want the --is-calibration command-line flag for butler register-dataset-type when declaring the bias dataset type.

#23

I made it with your guideline. :laughing:

And now I have all the data and registed them correctly. How can I process them like tutorial(part 2) had done .

#In tutorial
pipetask run -b $RC2_SUBSET_DIR/SMALL_HSC/butler.yaml \
             -p $RC2_SUBSET_DIR/pipelines/DRP.yaml#singleFrame \
             -i HSC/RC2/defaults \
             -o u/$USER/single_frame \
             --register-dataset-types

How can I arrange my data type or collections then I can use that command? :sob: Because In tutorial, DRP.yaml seems special for that datasets, not generaly for other HSC data

#24

I suppose you need to define a new defaults collection chain like this:

butler collection-chain $REPO newCollectionName commaSeparatedCollections

Include the runs corresponding to the raws, the calibrations, the refcats, and skymap.

1 Like
#25

Do u have any process detailled tutorial? emmm, I find u are in IUCAA， can I add your wechat?