You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2017A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20170201
REDUCED
2731 5 20170216 20170220 20170216 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.14 58.96
20170202
REDUCED
2866 5 20170216 20170220 20170216 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.91 86.85
20170203
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20170204
REDUCED
1136 5 20170216 20170220 20170216 GIF1 GIF2 GIF summary obs_log MSBTid.log 17.79 37.10
20170205
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170206
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170207
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170208
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170209
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170210
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170211
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170212
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170213
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170214
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170215
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170216
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170217
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170218
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170219
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170220
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170221
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170222
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170223
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170224
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170225
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170226
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170227
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170228
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170301
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170302
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170303
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170304
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170305
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170306
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170307
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170308
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170309
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170310
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170311
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170312
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170313
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170314
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170315
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170316
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170317
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170318
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170319
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170320
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170321
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170322
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170323
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170324
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170325
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170326
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170327
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170328
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170329
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170330
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170331
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170401
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170402
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170403
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170404
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170405
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170406
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170407
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170408
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170409
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170410
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170411
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170412
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170413
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170414
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170415
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170416
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170417
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170418
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170419
REDUCED
210 obs_log 2.61 2.76
20170420
REDUCED
1351 20170514 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.01 80.51
20170421
REDUCED
1428 20170517 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.84 80.49
20170422
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170423
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170424
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170425
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170426
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170427
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170428
NODATA
10
 
 
 
 
 
 
 
 
 
0.09
0.00
20170429
REDUCED
798 20170511 GIF1 GIF2 GIF summary obs_log MSBTid.log 14.96 29.59
20170430
REDUCED
203 20170511 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.30 3.08
20170501
NODATA
158
 
 
 
 
 
 
 
 
 
1.55
0.00
20170502
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170503
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20170504
REDUCED
1842 20170517 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.88 93.73
20170505
REDUCED
1967 20170518 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.50 106.85
20170506
REDUCED
1952 20170517 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.48 108.73
20170507
REDUCED
2269 20170518 GIF1 GIF2 GIF summary obs_log MSBTid.log 48.48 106.62
20170508
REDUCED
2392 20170518 GIF1 GIF2 GIF summary obs_log MSBTid.log 52.82 123.56
20170509
REDUCED
1840 20170523 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.09 92.53
20170510
REDUCED
1805 20170526 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.72 98.90
20170511
REDUCED
2457 20170523 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.91 98.42
20170512
REDUCED
1841 20170525 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.39 90.01
20170513
REDUCED
1881 20170523 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.33 99.97
20170514
REDUCED
1364 20170525 GIF1 GIF2 GIF summary obs_log MSBTid.log 28.17 55.72
20170515
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20170516
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20170517
REDUCED
2352 20170530 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.70 94.71
20170518
REDUCED
1842 20170609 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.76 100.04
20170519
REDUCED
1711 20170530 GIF1 GIF2 GIF summary obs_log MSBTid.log 37.03 88.69
20170520
REDUCED
1975 20170530 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.82 106.93
20170521
REDUCED
3040 20170601 GIF1 GIF2 GIF summary obs_log MSBTid.log 62.82 105.22
20170522
REDUCED
2218 20170605 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.81 0.00
20170523
REDUCED
2242 20170602 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.76 0.00
20170524
REDUCED
1961 20170605 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.50 0.00
20170525
REDUCED
2055 20170605 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.64 0.00
20170526
REDUCED
2085 20170606 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.83 0.00
20170527
REDUCED
2215 20170606 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.86 0.00
20170528
REDUCED
2036 20170607 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.13 0.00
20170529
REDUCED
2094 20170608 GIF1 GIF2 GIF summary obs_log MSBTid.log 37.53 0.00
20170530
REDUCED
1935 20170609 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.64 0.00
20170531
REDUCED
2716 20170613 GIF1 GIF2 GIF summary obs_log MSBTid.log 54.10 0.00
20170601
REDUCED
2012 20170619 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.46 0.00
20170602
REDUCED
1988 20170619 GIF1 GIF2 GIF summary obs_log MSBTid.log 37.73 0.00
20170603
REDUCED
1853 20170619 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.06 0.00
20170604
REDUCED
2149 20170616 GIF1 GIF2 GIF summary obs_log MSBTid.log 37.56 0.00
20170605
REDUCED
2236 20170622 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.45 0.00
20170606
REDUCED
2156 20170623 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.74 0.00
20170607
REDUCED
2225 20170623 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.27 0.00
20170608
REDUCED
2583 20170623 GIF1 GIF2 GIF summary obs_log MSBTid.log 55.30 0.00
20170609
REDUCED
2338 20170621 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.29 0.00
20170610
REDUCED
1942 20170622 GIF1 GIF2 GIF summary obs_log MSBTid.log 34.97 0.00
20170611
REDUCED
2286 20170625 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.23 0.00
20170612
PROCESSING
2238 obs_log 47.76 0.00
20170613
PROCESSING
1964 obs_log 38.08 0.00
20170614
PROCESSING
2093 obs_log 41.65 0.00
20170615
PROCESSING
1955 obs_log 37.07 0.00
20170616
PROCESSING
1759 obs_log 35.06 0.00
20170617
NODATA
163
 
 
 
 
 
 
 
 
 
1.70
0.00
20170618
INGESTED 2635 obs_log 48.54 0.00
20170619
INGESTED 2657 obs_log 44.02 0.00
20170620
INGESTED 2854 obs_log 54.57 0.00
20170621
INGESTED 2647 obs_log 55.64 0.00
20170622
INGESTED 2097 obs_log 46.21 0.00
20170623
INGESTED 2043 obs_log 44.84 0.00
20170624
INGESTED 2989 obs_log 62.28 0.00
20170625
INGESTED 2640 obs_log 52.45 0.00
20170626
INGESTED 2164 obs_log 44.42 0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.