You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2023A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20230201
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230202
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230203
REDUCED
1724 20230212 GIF1 GIF2 GIF summary obs_log MSBTid.log 33.33 0.00
20230204
NODATA
175
 
 
 
 
 
 
 
 
 
1.76
0.00
20230205
REDUCED
1828 20230212 GIF1 GIF2 GIF summary obs_log MSBTid.log 30.73 0.00
20230206
REDUCED
1069 20230211 GIF1 GIF2 GIF summary obs_log MSBTid.log 19.02 0.00
20230207
NODATA
196
 
 
 
 
 
 
 
 
 
1.96
0.00
20230208
REDUCED
670 20230220 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.91 0.00
20230209
REDUCED
905 20230220 GIF1 GIF2 GIF summary obs_log MSBTid.log 15.55 0.00
20230210
NODATA
175
 
 
 
 
 
 
 
 
 
1.76
0.00
20230211
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230212
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230213
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230214
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230215
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230216
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230217
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230218
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230219
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230220
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230221
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230222
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230223
NODATA
199
 
 
 
 
 
 
 
 
 
2.01
0.00
20230224
REDUCED
2283 20230310 GIF1 GIF2 GIF summary obs_log MSBTid.log 38.29 0.00
20230225
REDUCED
1951 20230310 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.47 0.00
20230226
REDUCED
2659 20230310 GIF1 GIF2 GIF summary obs_log MSBTid.log 48.23 0.00
20230227
NODATA
196
 
 
 
 
 
 
 
 
 
1.96
0.00
20230228
NODATA
280
 
 
 
 
 
 
 
 
 
2.78
0.00
20230301
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230302
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230303
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230304
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230305
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230306
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230307
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230308
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230309
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230310
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230311
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230312
NODATA
175
 
 
 
 
 
 
 
 
 
1.76
0.00
20230313
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230314
REDUCED
456 20230319 GIF1 GIF2 GIF summary obs_log MSBTid.log 6.69 0.00
20230315
REDUCED
367 20230319 GIF1 GIF2 GIF summary obs_log MSBTid.log 4.91 0.00
20230316
REDUCED
2465 20230324 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.51 0.00
20230317
REDUCED
1594 20230324 GIF1 GIF2 GIF summary obs_log MSBTid.log 23.46 0.00
20230318
REDUCED
2685 20230327 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.72 0.00
20230319
REDUCED
2304 20230326 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.33 0.00
20230320
REDUCED
2111 20230328 GIF1 GIF2 GIF summary obs_log MSBTid.log 36.37 0.00
20230321
REDUCED
2068 20230331 GIF1 GIF2 GIF summary obs_log MSBTid.log 35.65 0.00
20230322
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230323
NODATA
175
 
 
 
 
 
 
 
 
 
1.76
0.00
20230324
NODATA
177
 
 
 
 
 
 
 
 
 
1.76
0.00
20230325
REDUCED
2394 20230330 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.03 0.00
20230326
REDUCED
2416 20230330 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.69 0.00
20230327
REDUCED
1998 20230403 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.04 0.00
20230328
REDUCED
2016 20230404 GIF1 GIF2 GIF summary obs_log MSBTid.log 37.90 0.00
20230329
REDUCED
1024 20230403 GIF1 GIF2 GIF summary obs_log MSBTid.log 15.58 0.00
20230330
REDUCED
1115 20230403 GIF1 GIF2 GIF summary obs_log MSBTid.log 18.70 0.00
20230331
REDUCED
1722 20230405 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.69 0.00
20230401
REDUCED
592 20230412 GIF1 GIF2 GIF summary obs_log MSBTid.log 9.24 0.00
20230402
REDUCED
636 20230412 GIF1 GIF2 GIF summary obs_log MSBTid.log 9.57 0.00
20230403
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230404
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230405
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230406
REDUCED
912 20230412 GIF1 GIF2 GIF summary obs_log MSBTid.log 14.96 0.00
20230407
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230408
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230409
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230410
REDUCED
702 20230501 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.54 0.00
20230411
REDUCED
2701 20230501 GIF1 GIF2 GIF summary obs_log MSBTid.log 48.04 0.00
20230412
REDUCED
221 20230417 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.61 0.00
20230413
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230414
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230415
REDUCED
1822 20230505 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.26 0.00
20230416
REDUCED
1565 20230505 GIF1 GIF2 GIF summary obs_log MSBTid.log 28.33 0.00
20230417
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230418
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230419
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230420
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230422
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230423
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230424
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230425
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230426
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230427
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230428
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230429
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230430
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20230501
REDUCED
1534 20230512 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.72 0.00
20230502
REDUCED
2165 20230512 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.35 0.00
20230503
REDUCED
1212 20230512 GIF1 GIF2 GIF summary obs_log MSBTid.log 19.28 0.00
20230504
REDUCED
1267 20230512 GIF1 GIF2 GIF summary obs_log MSBTid.log 23.36 0.00
20230505
REDUCED
1631 20230512 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.23 0.00
20230506
REDUCED
1127 20230518 GIF1 GIF2 GIF summary obs_log MSBTid.log 18.95 0.00
20230507
REDUCED
1698 20230518 GIF1 GIF2 GIF summary obs_log MSBTid.log 28.49 0.00
20230508
REDUCED
1336 20230519 GIF1 GIF2 GIF summary obs_log MSBTid.log 17.73 0.00
20230509
REDUCED
1617 20230517 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.26 0.00
20230510
REDUCED
1871 20230518 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.11 0.00
20230511
REDUCED
737 20230526 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.04 0.00
20230512
REDUCED
2495 20230523 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.95 0.00
20230513
REDUCED
1667 20230523 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.35 0.00
20230514
REDUCED
1900 20230524 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.14 0.00
20230515
REDUCED
2187 20230522 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.19 0.00
20230516
REDUCED
2447 20230528 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.14 0.00
20230517
NODATA
178
 
 
 
 
 
 
 
 
 
1.81
0.00
20230518
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230519
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230520
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230521
PROCESSING
937 obs_log 17.52 0.00
20230522
PROCESSING
1238 obs_log 20.49 0.00
20230523
PROCESSING
2530 obs_log 45.80 0.00
20230524
PROCESSING
1881 obs_log 33.17 0.00
20230525
PROCESSING
2252 obs_log 45.54 0.00
20230526
NODATA
173
 
 
 
 
 
 
 
 
 
1.74
0.00
20230527
INGESTED 2236 obs_log 40.06 0.00
20230528
INGESTED 2265 obs_log 32.81 0.00
20230529
INGESTED 173 obs_log 1.74 0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.