You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2017B

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20170801
REDUCED
2367 20170813 GIF1 GIF2 GIF summary obs_log MSBTid.log 52.49 0.00
20170802
REDUCED
2156 20170812 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.09 0.00
20170803
REDUCED
2542 20170812 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.89 0.00
20170804
REDUCED
2219 20170812 GIF1 GIF2 GIF summary obs_log MSBTid.log 47.28 0.00
20170805
REDUCED
2177 20170814 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.84 0.00
20170806
REDUCED
2316 20170814 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.42 0.00
20170807
REDUCED
2305 20170814 GIF1 GIF2 GIF summary obs_log MSBTid.log 43.41 0.00
20170808
REDUCED
2176 20170815 GIF1 GIF2 GIF summary obs_log MSBTid.log 40.98 0.00
20170809
PROCESSING
1899 obs_log 40.45 0.00
20170810
PROCESSING
2180 obs_log 47.78 0.00
20170811
PROCESSING
1018 obs_log 22.59 0.00
20170812
PROCESSING
2290 obs_log 50.78 0.00
20170813
PROCESSING
2281 obs_log 51.41 0.00
20170814
PROCESSING
2385 obs_log 53.76 0.00
20170815
PROCESSING
2313 obs_log 52.08 0.00
20170816
PROCESSING
2293 obs_log 44.26 0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.