You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 17A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw NESO Checked Transferred
by WFAU
Last header
update
Version Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBT id
Log
SkyProbe
(CFHT)
Size
raw [Gb]
Size
red [Gb]
N stacks
All
N stacks
UKIDSS
N stacks
LAS
N stacks
DXS
N stacks
UDS
N stacks
GPS
N stacks
GCS
20170201
reduced
2731 16 Feb 2017 20 Feb 2017 16 Feb 2017 5 GIF1 GIF2 GIF summary obs_log msbtid_log skyprobe 42.12 58.97
20170202
reduced
2866 16 Feb 2017 20 Feb 2017 16 Feb 2017 5 GIF1 GIF2 GIF summary obs_log msbtid_log skyprobe 42.89 86.82
20170203
nodata
156
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170204
reduced
1136 16 Feb 2017 20 Feb 2017 16 Feb 2017 5 GIF1 GIF2 GIF summary obs_log msbtid_log skyprobe 17.79 37.08
20170205
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170206
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170207
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.