You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2018A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20180201
REDUCED
1383 20180207 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.13 0.00
20180202
NODATA
162
 
 
 
 
 
 
 
 
 
1.61
0.00
20180203
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180204
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180205
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180206
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180207
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180208
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180209
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180210
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180211
REDUCED
1335 20180219 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.98 0.00
20180212
REDUCED
3818 20180219 GIF1 GIF2 GIF summary obs_log MSBTid.log 71.25 0.00
20180213
REDUCED
2878 20180219 GIF1 GIF2 GIF summary obs_log MSBTid.log 55.00 0.00
20180214
REDUCED
199 20180219 GIF1 GIF2 summary obs_log MSBTid.log 2.24 0.00
20180215
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180216
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180217
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180218
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180219
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180220
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180221
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180222
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180223
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180224
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180225
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180226
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180227
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180228
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180301
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180302
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180303
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180304
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180305
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180306
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180307
REDUCED
1173 20180312 GIF1 GIF2 GIF summary obs_log MSBTid.log 21.62 0.00
20180308
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180309
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180310
REDUCED
304 20180313 GIF1 GIF2 GIF summary obs_log MSBTid.log 4.45 0.00
20180311
NODATA
177
 
 
 
 
 
 
 
 
 
2.01
0.00
20180312
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180313
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180314
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180315
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180316
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180317
REDUCED
2326 20180323 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.34 0.00
20180318
REDUCED
2603 20180326 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.97 0.00
20180319
REDUCED
1140 20180326 GIF1 GIF2 GIF summary obs_log MSBTid.log 19.98 0.00
20180320
NODATA
158
 
 
 
 
 
 
 
 
 
1.56
0.00
20180321
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180322
NODATA
158
 
 
 
 
 
 
 
 
 
1.56
0.00
20180323
NODATA
163
 
 
 
 
 
 
 
 
 
1.69
0.00
20180324
NODATA
156
 
 
 
 
 
 
 
 
 
1.54
0.00
20180325
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180326
NODATA
156
 
 
 
 
 
 
 
 
 
1.54
0.00
20180327
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180328
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180329
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180330
REDUCED
1782 20180404 GIF1 GIF2 GIF summary obs_log MSBTid.log 34.35 0.00
20180331
REDUCED
1831 20180404 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.01 0.00
20180401
REDUCED
1294 20180404 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.32 0.00
20180402
REDUCED
243 20180404 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.95 0.00
20180403
NODATA
156
 
 
 
 
 
 
 
 
 
1.54
0.00
20180404
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180405
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180406
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180407
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180408
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180409
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180410
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180411
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180412
REDUCED
347 20180418 GIF1 GIF2 GIF summary obs_log MSBTid.log 5.03 0.00
20180413
PROCESSING
1968 obs_log 40.92 0.00
20180414
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180415
NODATA
156
 
 
 
 
 
 
 
 
 
1.47
0.00
20180416
NODATA
156
 
 
 
 
 
 
 
 
 
1.47
0.00
20180417
PROCESSING
554 obs_log 9.66 0.00
20180418
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.