You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2017B

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20170801
REDUCED
2367 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 52.49 0.00
20170802
REDUCED
2156 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.09 0.00
20170803
REDUCED
2542 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.89 0.00
20170804
REDUCED
2219 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.28 0.00
20170805
REDUCED
2177 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.84 0.00
20170806
REDUCED
2316 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.42 0.00
20170807
REDUCED
2305 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.41 0.00
20170808
REDUCED
2176 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.98 0.00
20170809
REDUCED
1899 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.45 0.00
20170810
REDUCED
2180 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.78 0.00
20170811
REDUCED
1018 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 22.59 0.00
20170812
REDUCED
2290 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.78 0.00
20170813
REDUCED
2281 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 51.41 0.00
20170814
REDUCED
2385 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 53.76 0.00
20170815
REDUCED
2313 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 52.08 0.00
20170816
REDUCED
2293 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.26 0.00
20170817
REDUCED
2322 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.78 0.00
20170818
REDUCED
2376 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 53.28 0.00
20170819
NODATA
176
 
 
 
 
 
 
 
 
 
2.03
0.00
20170820
REDUCED
1991 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 33.57 0.00
20170821
NODATA
158
 
 
 
 
 
 
 
 
 
1.57
0.00
20170822
NODATA
158
 
 
 
 
 
 
 
 
 
1.56
0.00
20170823
REDUCED
1960 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 39.74 0.00
20170824
REDUCED
2582 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 48.09 0.00
20170825
REDUCED
2344 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.43 0.00
20170826
REDUCED
2321 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.14 0.00
20170827
REDUCED
2048 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.96 0.00
20170828
REDUCED
1400 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.29 0.00
20170829
REDUCED
790 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 12.02 0.00
20170830
REDUCED
2070 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.85 0.00
20170831
REDUCED
2555 5 20170924 20170924 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.08 0.00
20170901
REDUCED
3418 20170921 GIF1 GIF2 GIF summary obs_log MSBTid.log 65.38 0.00
20170902
REDUCED
2632 20170922 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.52 0.00
20170903
REDUCED
2854 20170922 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.15 0.00
20170904
REDUCED
2266 20170921 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.28 0.00
20170905
NODATA
158
 
 
 
 
 
 
 
 
 
1.56
0.00
20170906
REDUCED
2094 20170921 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.19 0.00
20170907
REDUCED
2632 20170921 GIF1 GIF2 GIF summary obs_log MSBTid.log 53.99 0.00
20170908
REDUCED
2429 20170920 GIF1 GIF2 GIF summary obs_log MSBTid.log 51.21 0.00
20170909
REDUCED
2535 20170921 GIF1 GIF2 GIF summary obs_log MSBTid.log 55.64 0.00
20170910
REDUCED
2635 20170921 GIF1 GIF2 GIF summary obs_log MSBTid.log 51.73 0.00
20170911
REDUCED
2580 20170926 GIF1 GIF2 GIF summary obs_log MSBTid.log 51.96 0.00
20170912
REDUCED
2154 20170926 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.99 0.00
20170913
REDUCED
2255 20170925 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.39 0.00
20170914
REDUCED
2098 20170926 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.26 0.00
20170915
REDUCED
2323 20170926 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.21 0.00
20170916
REDUCED
1887 20170925 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.64 0.00
20170917
REDUCED
2165 20170926 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.78 0.00
20170918
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170919
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170920
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170921
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20170922
REDUCED
2219 20171003 GIF1 GIF2 GIF summary obs_log MSBTid.log 48.50 0.00
20170923
REDUCED
2178 20171003 GIF1 GIF2 GIF summary obs_log MSBTid.log 38.41 0.00
20170924
REDUCED
2283 20171002 GIF1 GIF2 GIF summary obs_log MSBTid.log 48.11 0.00
20170925
REDUCED
2413 20171003 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.82 0.00
20170926
REDUCED
2302 20171003 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.14 0.00
20170927
REDUCED
4396 20171005 GIF1 GIF2 GIF summary obs_log MSBTid.log 82.94 0.00
20170928
REDUCED
4087 20171005 GIF1 GIF2 GIF summary obs_log MSBTid.log 78.14 0.00
20170929
REDUCED
1468 20171005 GIF1 GIF2 GIF summary obs_log MSBTid.log 27.62 0.00
20170930
REDUCED
2447 20171005 GIF1 GIF2 GIF summary obs_log MSBTid.log 51.49 0.00
20171001
REDUCED
2364 20171009 GIF1 GIF2 GIF summary obs_log MSBTid.log 50.67 0.00
20171002
REDUCED
2194 20171010 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.87 0.00
20171003
REDUCED
3462 20171010 GIF1 GIF2 GIF summary obs_log MSBTid.log 67.76 0.00
20171004
REDUCED
199 20171007 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.61 0.00
20171005
REDUCED
3234 20171013 GIF1 GIF2 GIF summary obs_log MSBTid.log 55.86 0.00
20171006
REDUCED
673 20171009 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.96 0.00
20171007
REDUCED
2378 20171010 GIF1 GIF2 GIF summary obs_log MSBTid.log 41.48 0.00
20171008
REDUCED
686 20171015 GIF1 GIF2 GIF summary obs_log MSBTid.log 9.98 0.00
20171009
REDUCED
611 20171015 GIF1 GIF2 GIF summary obs_log MSBTid.log 8.73 0.00
20171010
PROCESSING
4077 obs_log 78.23 0.00
20171011
REDUCED
327 20171016 GIF1 GIF2 GIF summary obs_log MSBTid.log 5.67 0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.