Description of data directory layout

Top level:

The top level includes the following folders.

├── 12m_pointings
├── calibrated_working_images
├── data -> /orange/adamginsburg/ACES/rawdata/
├── hpglogs -> /blue/adamginsburg/adamginsburg/ACES/logs
├── images
├── mosaics
├── notebooks
├── qa2_fits
├── rawdata
├── reclean_images
├── reduction_ACES
├── sgrb2_pilot
├── upload
└── wp3_spectra_Feb2022

The directories of interest are data (which is a symlink to rawdata - they are the same) and upload.

The data/rawdata directories contain the full ALMA-style file tree, which we'll discuss more below.

upload is where you have write access and can upload new files.

The other directories contain either reduction & analysis tools (notebooks, reduction_ACES, 12m_pointings), WP-specific material (sgrb2_pilot, wp3_speectra_Feb2022), mosaics (mosaics), log files (hpglogs), or images (images, qa2_fits, reclean_images).

The data directories contain the following path: 2021.1.00172.L/science_goal.uid___A001_X1590_X30a8/group.uid___A001_X1590_X30a9 under which you'll find the individual SB directories:

├── member.uid___A001_X15a0_X114
├── member.uid___A001_X15a0_X130
├── member.uid___A001_X15a0_X132
├── member.uid___A001_X15a0_X138
├── member.uid___A001_X15a0_X14e
├── member.uid___A001_X15a0_X150
├── member.uid___A001_X15a0_X152
├── member.uid___A001_X15a0_X174
├── member.uid___A001_X15a0_X176
├── member.uid___A001_X15a0_X178
├── member.uid___A001_X15a0_X17a
├── member.uid___A001_X15a0_X17c
├── member.uid___A001_X15a0_X190
├── member.uid___A001_X15a0_X192
├── member.uid___A001_X15a0_X194
├── member.uid___A001_X15a0_X1a4
├── member.uid___A001_X15a0_Xa8
├── member.uid___A001_X15a0_Xae
├── member.uid___A001_X15a0_Xba
├── member.uid___A001_X15a0_Xd2
├── member.uid___A001_X15a0_Xda
├── member.uid___A001_X15a0_Xe8
├── member.uid___A001_X15a0_Xea
├── member.uid___A001_X15a0_Xec
├── member.uid___A001_X15a9_X12d5
├── member.uid___A001_X15b4_X43
└── member.uid___A001_X15b4_X4b

These contain the normal ALMA data hierarchy:

├── calibrated
├── calibration
├── log
├── product
├── qa
├── raw
└── script

but those that have been re-cleaned will also contain a reclean directory:

├── calibrated
├── calibration
├── log
├── product
├── qa
├── raw
├── reclean
└── script

There are generally two folders of interest: calibrated/ contains the final calibrated .ms or .split.cal files that should be used for imaging. calibrated/working/ contains re-runs of the pipeline and especially of the imaging pipeline.