You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2018A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20180201
REDUCED
1383 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.13 0.00
20180202
NODATA
162
 
 
 
 
 
 
 
 
 
1.61
0.00
20180203
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180204
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180205
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180206
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180207
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180208
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180209
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180210
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180211
REDUCED
1335 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.98 0.00
20180212
REDUCED
3818 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 71.25 0.00
20180213
REDUCED
2878 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 55.00 0.00
20180214
REDUCED
199 5 20180507 20180507 GIF1 GIF2 summary obs_log MSBTid.log 2.24 0.00
20180215
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180216
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180217
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180218
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180219
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180220
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180221
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180222
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180223
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180224
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180225
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180226
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180227
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180228
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180301
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180302
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180303
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180304
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180305
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180306
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180307
REDUCED
1173 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 21.62 0.00
20180308
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180309
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180310
REDUCED
304 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 4.45 0.00
20180311
NODATA
177
 
 
 
 
 
 
 
 
 
2.01
0.00
20180312
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180313
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180314
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180315
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180316
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180317
REDUCED
2326 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.34 0.00
20180318
REDUCED
2603 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.97 0.00
20180319
REDUCED
1140 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 19.98 0.00
20180320
NODATA
158
 
 
 
 
 
 
 
 
 
1.56
0.00
20180321
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180322
NODATA
158
 
 
 
 
 
 
 
 
 
1.56
0.00
20180323
NODATA
163
 
 
 
 
 
 
 
 
 
1.69
0.00
20180324
NODATA
156
 
 
 
 
 
 
 
 
 
1.54
0.00
20180325
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180326
NODATA
156
 
 
 
 
 
 
 
 
 
1.54
0.00
20180327
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180328
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180329
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180330
REDUCED
1782 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 34.35 0.00
20180331
REDUCED
1831 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.01 0.00
20180401
REDUCED
1294 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.32 0.00
20180402
REDUCED
243 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.95 0.00
20180403
NODATA
156
 
 
 
 
 
 
 
 
 
1.54
0.00
20180404
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180405
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180406
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180407
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180408
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180409
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180410
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180411
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180412
REDUCED
347 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 5.03 0.00
20180413
REDUCED
1968 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.92 0.00
20180414
NODATA
156
 
 
 
 
 
 
 
 
 
1.55
0.00
20180415
NODATA
156
 
 
 
 
 
 
 
 
 
1.47
0.00
20180416
NODATA
156
 
 
 
 
 
 
 
 
 
1.47
0.00
20180417
REDUCED
554 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 9.66 0.00
20180418
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180419
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180420
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180421
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180422
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180423
REDUCED
316 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 4.36 0.00
20180424
REDUCED
3460 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 66.03 0.00
20180425
REDUCED
2674 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 51.09 0.00
20180426
REDUCED
1907 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 33.32 0.00
20180427
REDUCED
1943 5 20180507 20180507 GIF1 GIF2 GIF summary obs_log MSBTid.log 38.35 0.00
20180428
NODATA
164
 
 
 
 
 
 
 
 
 
1.63
0.00
20180429
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180430
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180501
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180502
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180503
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180504
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180505
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180506
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180507
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180508
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180509
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180510
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180511
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180512
NODATA
175
 
 
 
 
 
 
 
 
 
1.74
0.00
20180513
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180514
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180515
REDUCED
1677 20180528 GIF1 GIF2 GIF summary obs_log MSBTid.log 35.97 0.00
20180516
REDUCED
1624 20180528 GIF1 GIF2 GIF summary obs_log MSBTid.log 33.23 0.00
20180517
REDUCED
420 20180524 GIF1 GIF2 GIF summary obs_log MSBTid.log 7.43 0.00
20180518
REDUCED
2003 20180528 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.40 0.00
20180519
REDUCED
2135 20180528 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.59 0.00
20180520
REDUCED
2123 20180530 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.83 0.00
20180521
REDUCED
2191 20180530 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.45 0.00
20180522
REDUCED
1793 20180531 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.35 0.00
20180523
REDUCED
1990 20180530 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.45 0.00
20180524
REDUCED
1882 20180530 GIF1 GIF2 GIF summary obs_log MSBTid.log 38.63 0.00
20180525
REDUCED
2198 20180604 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.30 0.00
20180526
REDUCED
2706 20180604 GIF1 GIF2 GIF summary obs_log MSBTid.log 56.23 0.00
20180527
REDUCED
2270 20180605 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.83 0.00
20180528
REDUCED
1598 20180605 GIF1 GIF2 GIF summary obs_log MSBTid.log 33.78 0.00
20180529
NODATA
189
 
 
 
 
 
 
 
 
 
2.30
0.00
20180530
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20180531
REDUCED
1845 20180606 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.09 0.00
20180601
REDUCED
2284 20180607 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.31 0.00
20180602
REDUCED
1529 20180609 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.43 0.00
20180603
REDUCED
1713 20180610 GIF1 GIF2 GIF summary obs_log MSBTid.log 35.13 0.00
20180604
REDUCED
2246 20180610 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.46 0.00
20180605
REDUCED
1953 20180612 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.55 0.00
20180606
REDUCED
2285 20180613 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.34 0.00
20180607
REDUCED
1142 20180616 GIF1 GIF2 GIF summary obs_log MSBTid.log 20.72 0.00
20180608
NODATA
160
 
 
 
 
 
 
 
 
 
1.58
0.00
20180609
NODATA
193
 
 
 
 
 
 
 
 
 
1.91
0.00
20180610
REDUCED
1986 20180619 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.13 0.00
20180611
REDUCED
1421 20180619 GIF1 GIF2 GIF summary obs_log MSBTid.log 27.80 0.00
20180612
REDUCED
2324 20180623 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.74 0.00
20180613
REDUCED
2106 20180623 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.80 0.00
20180614
REDUCED
2040 20180623 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.19 0.00
20180615
REDUCED
2256 20180625 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.86 0.00
20180616
REDUCED
2196 20180625 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.91 0.00
20180617
REDUCED
2051 20180629 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.04 0.00
20180618
REDUCED
309 20180625 GIF1 GIF2 GIF summary obs_log MSBTid.log 4.54 0.00
20180619
NODATA
160
 
 
 
 
 
 
 
 
 
1.58
0.00
20180620
NODATA
160
 
 
 
 
 
 
 
 
 
1.58
0.00
20180621
REDUCED
1867 20180629 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.18 0.00
20180622
REDUCED
2033 20180630 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.90 0.00
20180623
REDUCED
1858 20180630 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.07 0.00
20180624
REDUCED
1990 20180630 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.70 0.00
20180625
REDUCED
1856 20180704 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.13 0.00
20180626
REDUCED
1914 20180703 GIF1 GIF2 GIF summary obs_log MSBTid.log 35.66 0.00
20180627
REDUCED
1387 20180704 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.17 0.00
20180628
REDUCED
2558 20180704 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.89 0.00
20180629
REDUCED
2378 20180706 GIF1 GIF2 GIF summary obs_log MSBTid.log 49.06 0.00
20180630
REDUCED
2184 20180708 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.93 0.00
20180701
REDUCED
2267 20180714 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.95 0.00
20180702
REDUCED
241 20180710 GIF1 GIF2 GIF summary obs_log MSBTid.log 3.23 0.00
20180703
NODATA
174
 
 
 
 
 
 
 
 
 
1.74
0.00
20180704
REDUCED
2214 20180714 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.68 0.00
20180705
REDUCED
1977 20180714 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.39 0.00
20180706
REDUCED
1934 20180715 GIF1 GIF2 GIF summary obs_log MSBTid.log 38.27 0.00
20180707
REDUCED
668 20180714 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.38 0.00
20180708
REDUCED
1750 20180718 GIF1 GIF2 GIF summary obs_log MSBTid.log 37.95 0.00
20180709
REDUCED
1739 20180719 GIF1 GIF2 GIF summary obs_log MSBTid.log 36.81 0.00
20180710
REDUCED
2406 20180720 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.51 0.00
20180711
REDUCED
1984 20180719 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.11 0.00
20180712
REDUCED
2077 20180719 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.38 0.00
20180713
PROCESSING
2392 obs_log 45.92 0.00
20180714
PROCESSING
1640 obs_log 26.48 0.00
20180715
PROCESSING
1461 obs_log 24.75 0.00
20180716
PROCESSING
2146 obs_log 44.48 0.00
20180717
PROCESSING
2358 obs_log 44.81 0.00
20180718
INGESTED 1133 obs_log 21.19 0.00
20180719
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20180720
INGESTED 2121 obs_log 40.94 0.00
20180721
INGESTED 1453 obs_log 25.80 0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.