You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 17A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw NESO Checked Transferred
by WFAU
Last header
update
Version Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBT id
Log
SkyProbe
(CFHT)
Size
raw [Gb]
Size
red [Gb]
N stacks
All
N stacks
UKIDSS
N stacks
LAS
N stacks
DXS
N stacks
UDS
N stacks
GPS
N stacks
GCS
20170201
reduced
2731 16 Feb 2017 20 Feb 2017 16 Feb 2017 5 GIF1 GIF2 GIF summary obs_log msbtid_log skyprobe 42.12 58.97
20170202
reduced
2866 16 Feb 2017 20 Feb 2017 16 Feb 2017 5 GIF1 GIF2 GIF summary obs_log msbtid_log skyprobe 42.89 86.82
20170203
nodata
156
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170204
reduced
1136 16 Feb 2017 20 Feb 2017 16 Feb 2017 5 GIF1 GIF2 GIF summary obs_log msbtid_log skyprobe 17.79 37.08
20170205
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170206
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170207
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170419
inspected 210 obs_log
 
skyprobe 2.61
20170420
inspected 1351 obs_log
 
skyprobe 28.99
20170421
inspected 1428 obs_log
 
skyprobe 29.83
20170422
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170423
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170424
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170425
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170426
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170427
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170428
nodata
10
 
 
 
 
 
 
 
 
 
0.09
 
 
 
 
 
 
 
 
20170429
inspected 798 obs_log
 
skyprobe 14.96
20170430
inspected 203 obs_log
 
skyprobe 2.30
20170501
nodata
158
 
 
 
 
 
 
 
 
 
1.55
 
 
 
 
 
 
 
 
20170502
nodata
0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
20170503
nodata
156
 
 
 
 
 
 
 
 
 
1.55
 
 
 
 
 
 
 
 
20170504
inspected 1842 obs_log
 
skyprobe 39.86
20170505
inspected 1967 obs_log
 
skyprobe 0.00
20170506
inspected 1952 obs_log
 
skyprobe 0.00
20170507
inspected 2269 obs_log
 
skyprobe 0.00
20170508
inspected 2392 obs_log
 
skyprobe 0.00
20170509
inspected 1840 obs_log
 
skyprobe 0.00
20170510
processing
1805 obs_log
 
skyprobe 0.00
20170511
inspected 2457 obs_log
 
skyprobe 0.00
20170512
processing
1841 obs_log
 
skyprobe 0.00
20170513
inspected 1881 obs_log
 
skyprobe 0.00
20170514
processing
1364 obs_log
 
skyprobe 0.00
20170515
inspected 156 obs_log
 
skyprobe 0.00
20170516
inspected 156 obs_log
 
skyprobe 0.00
20170517
processing
2352 obs_log
 
skyprobe 0.00
20170518
processing
1842 obs_log
 
skyprobe 0.00
20170519
inspected 1711 obs_log
 
skyprobe 0.00
20170520
inspected 1975 obs_log
 
skyprobe 0.00
20170521
inspected 3040 obs_log
 
skyprobe 0.00
20170522
inspected 2218 obs_log
 
skyprobe 0.00
20170523
inspected 2242 obs_log
 
skyprobe 40.74

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.