You are here: Home / Surveys & Projects / WFCAM / Data Processing

WFCAM Data Reduction Progress: Semester 2024A

This page displays the reduction progress of WFCAM data. Information is automatically updated every hour (you need to reload the page).

Night Status Nraw Version Released Transferred Last header
update
Summary
Plots
Photometry
Plots
Summary
Info
Observation
Log
MSBTid CFHT
conditions
Size
raw [GB]
Full Size
red [GB]
20240201
REDUCED
1580 20240211 GIF1 GIF2 GIF summary obs_log MSBTid.log 26.94 0.00
20240202
REDUCED
1101 20240211 GIF1 GIF2 GIF summary obs_log MSBTid.log 18.84 0.00
20240203
REDUCED
749 20240211 GIF1 GIF2 GIF summary obs_log MSBTid.log 11.22 0.00
20240204
REDUCED
3075 20240212 GIF1 GIF2 GIF summary obs_log MSBTid.log 46.02 0.00
20240205
REDUCED
2020 20240211 GIF1 GIF2 GIF summary obs_log MSBTid.log 30.50 0.00
20240206
REDUCED
2248 20240217 GIF1 GIF2 GIF summary obs_log MSBTid.log 33.20 0.00
20240207
REDUCED
2066 20240217 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.98 0.00
20240208
REDUCED
1872 20240216 GIF1 GIF2 GIF summary obs_log MSBTid.log 27.87 0.00
20240209
REDUCED
1405 20240216 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.44 0.00
20240210
REDUCED
1487 20240218 GIF1 GIF2 GIF summary obs_log MSBTid.log 26.51 0.00
20240211
REDUCED
1569 20240221 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.86 0.00
20240212
NODATA
180
 
 
 
 
 
 
 
 
 
1.81
0.00
20240213
REDUCED
479 20240221 GIF1 GIF2 GIF summary obs_log MSBTid.log 5.98 0.00
20240214
REDUCED
2390 20240222 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.79 0.00
20240215
REDUCED
1019 20240221 GIF1 GIF2 GIF summary obs_log MSBTid.log 14.59 0.00
20240216
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20240217
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20240218
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20240219
REDUCED
1867 20240226 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.56 0.00
20240220
REDUCED
1379 20240225 GIF1 GIF2 GIF summary obs_log MSBTid.log 21.99 0.00
20240221
REDUCED
1673 20240226 GIF1 GIF2 GIF summary obs_log MSBTid.log 28.67 0.00
20240222
REDUCED
1759 20240228 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.61 0.00
20240223
REDUCED
1849 20240229 GIF1 GIF2 GIF summary obs_log MSBTid.log 30.73 0.00
20240224
REDUCED
1152 20240303 GIF1 GIF2 GIF summary obs_log MSBTid.log 19.53 0.00
20240225
REDUCED
863 20240229 GIF1 GIF2 GIF summary obs_log MSBTid.log 13.06 0.00
20240226
REDUCED
1420 20240303 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.01 0.00
20240227
REDUCED
1661 20240304 GIF1 GIF2 GIF summary obs_log MSBTid.log 27.28 0.00
20240228
REDUCED
1657 20240307 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.68 0.00
20240229
REDUCED
1121 20240307 GIF1 GIF2 GIF summary obs_log MSBTid.log 18.22 0.00
20240301
REDUCED
798 20240310 GIF1 GIF2 GIF summary obs_log MSBTid.log 11.41 0.00
20240302
REDUCED
1845 20240310 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.80 0.00
20240303
REDUCED
232 20240314 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.87 0.00
20240304
NODATA
182
 
 
 
 
 
 
 
 
 
1.81
0.00
20240305
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240306
REDUCED
1735 20240318 GIF1 GIF2 GIF summary obs_log MSBTid.log 26.67 0.00
20240307
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240308
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240309
REDUCED
670 20240318 GIF obs_log MSBTid.log 10.12 0.00
20240310
NODATA
180
 
 
 
 
 
 
 
 
 
1.81
0.00
20240311
NODATA
180
 
 
 
 
 
 
 
 
 
1.81
0.00
20240312
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20240313
REDUCED
416 20240318 GIF1 GIF2 GIF summary obs_log MSBTid.log 5.77 0.00
20240314
REDUCED
2705 20240318 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.28 0.00
20240315
REDUCED
322 20240318 GIF1 GIF2 GIF summary obs_log MSBTid.log 4.26 0.00
20240316
REDUCED
1085 20240325 GIF1 GIF2 GIF summary obs_log MSBTid.log 17.10 0.00
20240317
REDUCED
1770 20240325 GIF1 GIF2 GIF summary obs_log MSBTid.log 30.23 0.00
20240318
REDUCED
2428 20240325 GIF1 GIF2 GIF summary obs_log MSBTid.log 45.24 0.00
20240319
REDUCED
1658 20240325 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.49 0.00
20240320
REDUCED
898 20240325 GIF1 GIF2 GIF summary obs_log MSBTid.log 13.45 0.00
20240321
REDUCED
1744 20240402 GIF1 GIF2 GIF summary obs_log MSBTid.log 27.43 0.00
20240322
REDUCED
1559 20240402 GIF1 GIF2 GIF summary obs_log MSBTid.log 23.70 0.00
20240323
REDUCED
1035 20240402 GIF1 GIF2 GIF summary obs_log MSBTid.log 16.59 0.00
20240324
REDUCED
214 20240328 GIF1 GIF2 GIF summary obs_log MSBTid.log 2.86 0.00
20240325
NODATA
178
 
 
 
 
 
 
 
 
 
1.80
0.00
20240326
NODATA
178
 
 
 
 
 
 
 
 
 
1.80
0.00
20240327
REDUCED
964 20240405 GIF1 GIF2 GIF summary obs_log MSBTid.log 15.41 0.00
20240328
NODATA
178
 
 
 
 
 
 
 
 
 
1.80
0.00
20240329
REDUCED
1151 20240405 GIF1 GIF2 GIF summary obs_log MSBTid.log 17.15 0.00
20240330
REDUCED
2088 20240407 GIF1 GIF2 GIF summary obs_log MSBTid.log 31.18 0.00
20240331
REDUCED
1577 20240407 GIF1 GIF2 GIF summary obs_log MSBTid.log 24.42 0.00
20240401
REDUCED
1808 20240407 GIF1 GIF2 GIF summary obs_log MSBTid.log 32.25 0.00
20240402
REDUCED
1439 20240408 GIF1 GIF2 GIF summary obs_log MSBTid.log 26.90 0.00
20240403
REDUCED
1114 20240411 GIF1 GIF2 GIF summary obs_log MSBTid.log 16.67 0.00
20240404
REDUCED
1724 20240408 GIF1 GIF2 GIF summary obs_log MSBTid.log 28.97 0.00
20240405
REDUCED
1437 20240411 GIF1 GIF2 GIF summary obs_log MSBTid.log 25.81 0.00
20240406
REDUCED
1732 20240411 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.23 0.00
20240407
REDUCED
735 20240415 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.45 0.00
20240408
REDUCED
713 20240415 GIF1 GIF2 GIF summary obs_log MSBTid.log 10.40 0.00
20240409
REDUCED
1851 20240415 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.06 0.00
20240410
REDUCED
1368 20240415 GIF1 GIF2 GIF summary obs_log MSBTid.log 24.24 0.00
20240411
NODATA
198
 
 
 
 
 
 
 
 
 
1.99
0.00
20240412
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240413
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20240414
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240415
NODATA
183
 
 
 
 
 
 
 
 
 
1.79
0.00
20240416
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240417
REDUCED
1821 20240429 GIF1 GIF2 GIF summary obs_log MSBTid.log 29.71 0.00
20240418
REDUCED
1347 20240429 GIF1 GIF2 GIF summary obs_log MSBTid.log 24.56 0.00
20240419
PROCESSING
1165 obs_log 19.19 0.00
20240420
NODATA
178
 
 
 
 
 
 
 
 
 
1.79
0.00
20240421
REDUCED
2451 20240428 GIF1 GIF2 GIF summary obs_log MSBTid.log 44.75 0.00
20240422
REDUCED
2230 20240428 GIF1 GIF2 GIF summary obs_log MSBTid.log 42.70 0.00
20240423
REDUCED
438 20240429 GIF1 GIF2 GIF summary obs_log MSBTid.log 6.26 0.00
20240424
PROCESSING
1902 obs_log 31.23 0.00
20240425
NODATA
0
 
 
 
 
 
 
 
 
 
0.00
0.00
20240426
PROCESSING
1609 obs_log 27.61 0.00
20240427
PROCESSING
1794 obs_log 28.21 0.00
20240428
INGESTED 1773 obs_log 27.94 0.00
20240429
PROCESSING
1070 obs_log 18.32 0.00
20240430
INGESTED 1379 obs_log 22.71 0.00

Table description :

  • Nraw: total number of raw images for the given night (this includes darks, flats, focus runs etc.).
  • NESO : if the icon is present, it means that public and UKIDSS data for the night have been transferred to ESO and should be soon available from the ESO Archive. In such case, the number of images that were transferred is shown as well. Please note that all the data is available also from CASU's WFCAM raw data archive in Cambridge. The data is available as soon as it has been 'ingested'. The delay in data transfers to ESO is due only to the limited bandwidth of the connection.
  • Checked: if the icon is present, it means that the night has been fully reduced and flagged to be transferred by WFAU. The date shown refers to the creation of the flag.
  • Transferred by WFAU: if the icon is present it means that the night has been successfully transferred by WFAU. The date shown refers to the creation of the corresponding flag by WFAU transfer software.
  • Last header update: this column is used to track updates to some keywords in the image headers (e.g. photometric/astrometric calibration) that do not (usually) involve re-transferring the data by WFAU.
  • Version: process version number. It's a link sending to the corresponding version notes.
  • DQC Plots: i.e. columns Summary Plots and Photometry Plots, refer to the corresponding description document.
  • Summary Info: ASCII file with all the DQC information for each image chip-by-chip. The same image name appears four times, on per chip, and always in this order: 1,2,3 and 4.
  • Observation Log: provides an handy summary of what was observed.
  • SkyProbe: Link to the SkyProbe atmospheric attenuation plots from CFHT.
  • Size raw/red [Gb]: these two columns display the total size (compressed) of raw/reduced data directory for the night in Gb.
  • N stacks: these columns show the number of stacked images that were produced by the pipeline for a given night. In particular the columns show the grand total and the total number of ukidss stacks, altogether and by-survey. If the column says 0, it means that there are no stacked frames available for that specific set (depending on the column type) but if the column is empty it simply means that the data for that night have not been ingested in the CASU Data Quality Control (DQC) database. The simple fact that a night is marked as "reduced" does not imply that the corresponding data have been ingested in the DQC db.

Exact meaning of the status values :

  • nodata: No science data to process.
  • un-processed: The night has not been processed because too much data are missing (e.g. one one the chip is missing for the entire night). See the observation log for more details.
  • pending: Awaiting data from JAC (usually indicating that data had to be re-sent a second time to fix some problem).
  • inspected: Data arrived at CASU, MEF files created and verified.
  • processing: Pipeline processing is running.
  • reduced: Pipeline processing completed.

For more information on the DQC plots please read the description document.