You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2018A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20180201
REDUCED
1383 20180207 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.13 0.00
20180202
NODATA
162
 
 
 
 
 
 
 
 
 
1.61
0.00
20180203
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180204
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180205
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180206
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180207
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180208
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180209
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180210
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180211
REDUCED
1335 20180219 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.98 0.00
20180212
REDUCED
3818 20180219 GIF1 GIF2 GIF summary obs_log MSBTid.log 71.25 0.00
20180213
REDUCED
2878 20180219 GIF1 GIF2 GIF summary obs_log MSBTid.log 55.00 0.00
20180214
REDUCED
199 20180219 GIF1 GIF2 summary obs_log MSBTid.log 2.24 0.00
20180215
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180216
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180217
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180218
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180219
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180220
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180221
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180222
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.