You are here: Home / Documents / Minutes of CASU Meetings / minutes_070327.txt

Plain Text icon — Plain Text, 15 KB (15811 bytes)

File contents

27th March 2007  Observatory Meeting Room 10:00 - 12:45

Present:   DWE, STH, JRL, PSB, MR, MJI, EGS, RGM
Apologies: NAW, WJS

Agenda
------

1.  Actions from last meeting
2.  Comments on WFAU minutes - UKLight saga update
3.  VDMT meeting
4.  Data archives update     - AAT, ING, WFCAM, UKIRT
5.  Optical processing update- IPHAS release
6.  WFCAM news               - raw data status
                             - processing status
                             - DR2
                             - photometric calibration update
                             - new WFCAM campaign proposals
7.  VISTA news               - delivery v0.5 pipeline
                             - test data from Paranal
                             - revised VISTA SMPs.
8.  Gaia                     - Bologna meeting resum\'e
9.  ADASS 2007               - latest
10. AOB                      - conference proceedings for ESO workshop
                             - cass38 resurrects yet again
                             - NAM (Preston, April 16-20)
                             - rolling grant application

Minutes
-------

1.  Actions from last meeting

JRL  is still awaiting a reply to his emails regarding the PostgreSQL
     problems with the AAT archive - ongoing                               <<<<
     MJI said that he would email Matthew Colless (AAT Director) to
     push things along.                                                    <<<<

RGM  has not finished working on the classification aspect of cross-talk 
     weeding. This work has started again (with help from EGS) since
     the LAS DR2 data has now become available - ongoing                   <<<<
	  
DWE  has finished the synching of the VIRCAM documentation from cvs to 
     HTML and then to Plone. This also worked when the Plone system was
     switched from apm25 to the backup machine apm26 as a test.

JRL  has sorted out the OMP database problems after an exchange of emails.

EGS  have not completed the ADASS 2007 registration web page since this is
MR   not required until May. What is required is the preliminary announcement
     page which is due 2nd April. Information is needed from the POC on the
     programme emphasis - action changed                                   <<<<

MR   continues to investigate credit card payments for ADASS 2007. JRL said
     that the university is not willing to help us set up a system and that
     we will have to do this ourselves. A secure site will be set up (ADB is
     confident about this) and Ian Bell will help with the administration.
     At the moment various issues have been left with Paul Aslin - ongoing <<<<

PSB  is in touch with someone local regarding wireless provision for ADASS 
     2007. If this fails, then we will have to use BT.                     <<<<

RGM  has drafted an official complaint to UKERNA, but since things seem to
     be progressing, it has not been sent off.

JRL  has sorted out the cvs server previously on cass38.

MR   set up a "pending" tag for appropriate nights on the data processing 
     page.

MJI  has investigated the effect of the bright edge channel problem in 
     the processed data. This can cause a complex range of problems because
     tke sky estimate is sometimes also affected and does generally impact
     the science products.  Some examples of this plus a brief summary of 
     known new features are available on the processing status web pages
     under 06B known features - see http://casu.ast.cam.ac.uk/surveys-projects/
     wfcam/data-processing/2006b-known-features/

STH  distributed the DR3 photometric calibration task list to all

ALL  did not send in any comments on above to STH (this was discussed later)

WJS  was investigating adding field rotation flat field tests to integration 
     tests - ongoing                                                       <<<<

JRL  is waiting for his phone call to be returned regarding his inquiry
     about the previous providers of wireless services at Kensington Town 
     Hall - ongoing                                                        <<<<
     
MJI  informed us that our secretarial support for ADASS 2007 was Elinor
     Jenkins (she even knows about this!).

ALL  sent in January/February reports to STH

MJI  has contacted Paul Aslin about the CASU out-of-APM tape store. The plan
     is to have 3 large locked cabinets located somewhere in the Observatory
     building. PSB said that the location should be sorted out soon since
     many people were eyeing up these locations.


2.  Comments on WFAU minutes

UKLight saga update:
summarising assorted minutes and emails on this PSB said that most parts are 
now in place. According to Dave Tinkler from UKERNA:
"Everything is in place on UKLight, I think we are just waiting for the
astronomy people at Edinburgh to connect their equipment to the UKLight node
at Edinburgh."

Once this has been done a commissioning phase can be entered and any
remaining problems identified and fixed.


3.  VDMT meeting

A VDMT telecon was held on 9th March. MJI gave a brief report on the main 
salient points.

The SMPs for the VISTA public surveys were discussed and it was noted that
telecons, meetings, and assorted email exchanges with the survey PIs will 
take place throughout April to sort out the remaining details.  Several of
the RIXs seem to be common to all the surveys.

MJI was actioned to ensure that the 0.5 DRL release went through JPE and JMS,
and it subsequently did.

The earliest date for a VDUC meeting will be May. This will be in
Edinburgh. RGM thought that it would be a good idea for the PIs to be
invited to this meeting. The agenda is yet to be decided. However, it was
felt that an updated UK VISTA User Requirements Document should be a key 
item for discussion.  RGM said that he would email Tim Naylor, JPE and WJS 
about this and the PI issue above.                                         <<<<

The next VDMT meeting is scheduled for Friday 27 April.


4.  Data archives update

AAT:
Nothing new to report.

ING: 
A few tasks remain with the ING archive. The very oldest data needs to be
redistributed in order for the archive to get access to them. A few scripts
need to be converted to Linux. Some manual header updates will be carried
out by RWA from the observer logs. RWA will go to La Palma in order to
recover data from some of the oldest tapes that were written using VMS
Backup and require access to a VMS system to recover correctly (all 3rd
party software attempts having failed miserably).

WFCAM:
MR reported that 8 tapes have been received recently. This includes data up 
to 5th March.  These are still in the process of being ingested and verified. 
Also further data has been received for detectors 2 and 3 for the period 
October to December. Data is still missing for detector#1 for 5 nights in 
January and 6 in February due to a tape writing problem. Thanks are due to 
Brad for his efforts in getting this data to us.

There has been a request for raw WFCAM PI data from Durham which was all
handled automatically.  We are curious to see how they get on and will
contact them in a month if we do not hear sooner.                          <<<<

ESO:
The transfer of raw WFCAM data to ESO has been resumed.  However, there
has not been as much UKIDSS data for 06B so far since a lot of the observing 
has been for PI projects.

UKIRT:
JRL said that work on getting the UKIRT archive up-to-date is ongoing and
there has been some contact with AJA recently about this.


5.  Optical processing update

IPHAS release:
EGS briefly described the new IPHAS database and reported that the release of 
band-merged IPHAS data via AstroGrid will occur at the end of April. The 
ingestion of the 500 million objects is still ongoing. He is giving a talk 
on this at the NAM 2007 meeting in Preston.

There was some discussion as to whether a press release should be written.

MJI noted that a large fraction of IPHAS project INT WFC data for detector#2 
had been "corrupted" by a random intermittment gain change in the output 
electronics for the latter half of October 2006 and all of November 2006.
He has devised and applied a correction scheme to recover the majority
of the affected data.


6.  WFCAM news

Raw data status:
This was discussed under item 4.

Processing status:
MJI said that as we are processing the latest batch of data we are 
encountering more problems than usual. This is partly because it contains 
a higher proportion of PI data which tends to use more non-standard 
observing parameters, but also is triggered by the inherent intermittent
faults.  The occasional corrupted frame triggers a WCS faux pas, that gives
a technically valid but meaningless WCS.  These are being investigated as
they arise.

In response to internal requests JRL pointed out that there was an internal 
Plone page covering changes made to the pipeline. This can be found at:
http://casu.ast.cam.ac.uk/internal/wfcam-software-changes

DR2:
STH said that there are appear to be no problems with the application of the 
photometric calibration. He added that the cross-identification with the Sloan
DR5 catalogue was a very nice feature. Congratulations are extended to the
WFAU team.

Photometric calibration update:
STH reminded us that there were 9 photometric calibration tasks that have to
be carried out before DR3. 3 of these were scheduled to be done by the end of
February, 3 by the end of March and the remainder and a final report by
mid-April. A paper would then be written from this.

A plot of the calibration of the Y offset was shown. Sloan colours were used
to select A0-like stars and after fitting a local gradient correction 
an offset (~0.07mag) could be measured, via interpolation, to put the Y 
calibration on the Vega system to within 2% (the requirement is 3%). 

The equivalent data for Z is sparser but the offset appears to be less than
half that of the Y-band.

RGM asked about equivalent plots using 2MASS J-K since there is no Sloan in
the South for VISTA to use. STH said that the 2MASS colours do not give enough
leverage for accurate A0 selection but noted that he had used a similar method
before for directly calibrating from 2MASS.

MJI said that he has added an additional decimal place in the FITS headers
for the photometric calibration information (this was one of the actions
noted above).  He will complete his investigation of the "illumination 
correction" for WFCAM by generating a series of correction tables and plots
on a ~monthly basis (ie. tracking the flatfield updates).

STH finally added that an estimate of possible Eddington bias in the 2MASS
calibration needs further investigation.  MJI noted that there is a simple 
analytic check for this.

New WFCAM campaign proposals:
MJI said that there were 4 new proposals, the Transit Survey being one of
them. There has been no official feedback yet for the survey PIs.
Andy Adamson has discussed these with MJI and as far as we can tell there 
are no new pipeline requirements arising from these proposals.

Other WFCAM topics:
The papers for the conference proceedings of the ESO calibration workshop 
need to be submitted by the end of the week. These should be distributed 
amongst the group today so that feedback comments can be made.             <<<<

A faster link now exsits between Mauna Kea and JAC. This makes it worthwhile
to investigate further the possiblity of transferring data over the
Internet.  A test of achievalbe bandwith is being set up.


7.  VISTA news

Delivery v0.5 pipeline:
PSB reported that the delivery of the v0.5 pipeline was made on time through
JPE and JMS. This consists of the software, test data and the DRLD. There
has been an email from Colin Vincent congratulating us on this. The other 
associated documents (cal, Instrument Data, ETC spec) are awaiting official 
release.

There was some discussion regarding the "tickets" coming from ESO.  Some of
these were expected such as ensuring v0.6 will cope with the recently
released new version of CPL.  However, some are new requirements involving
design changes which may involve manpower issues.  

Test data from Paranal:
There are 5 hot data frames available provided by the camera team in February.
The RAL team will be going out sometime soon and it may be possible to get 
some more data. MJI will ask about this at the next VDMT meeting.          <<<<

Other VISTA topics:
RIXes of the revised VISTA SMPs are starting to come in.  As noted earlier,
several of the RIXs are common to all the surveys with one in particular 
angling for more detailed assurances that CASU and WFAU will deliver
what they have "signed up" for.  RGM noted that ultimately it would be the 
responsibility of the PI to get the data processing and distribution done.

MJI commented on an email cc'd from JMS regarding the procurement of hardware
for the summit pipeline.


8.  Gaia

Bologna meeting resum\'e:
DWE reported on the Gaia CU5 (Photometric processing) meeting held in
Bologna last week. Most of the meeting was about sorting out 2 documents
(design and requirements) and reports from the various Development Units.
Thus, it should seem very familiar to VISTA bods. The boundaries between the
DUs are fairly well determined. However, who will carry out the work for the
2d Image Reconstruction DU is still to be determined.

The next CU5 meeting will be in Leiden in September (the week before ADASS).


9.  ADASS 2007

JRL said that apart from previously mentioned comments about the web site,
there was no additional news.


10. AOB

Conference proceedings for the ESO Calibration workshop:
MJI reminded us that the deadline is the end of the week, so if comments are
needed they have to be distributed soon.

cass38 resurrects yet again:
MJI said that cass38 had to be resurrected due to data backups not being
complete and some scripts being squirreled away there.  It has now gone 
off-line for hopefully the final time.

NAM (Preston, April 16-20):
MJI asked who was attending. Only EGS will be going. He will be giving an
AstroGrid presentation.

Rolling grant application:
MJI reminded us that our rolling grant application will need to be done
soon. Although no official date has been confirmed, it is likely to be in May.
This will cover the research part of our grants as well.  STH was surprised 
that this had come around so quickly again.

Marratech:
DWE encouraged members of the group to try out the Marratech video
conferencing system (see email). You don't need a username if you are just
trying out the public meeting room. To use the private rooms, you will need
a username (see Hardip Sanghera). If there is enough interest, a CASU
group and meeting room could be set up. 


Continuing Actions
------------------

JRL  repair AAT archive mirroring (PostgreSQL problems)

RGM  report back on classification aspect of cross-talk weeding

MR   sort out how ADASS 2007 credit card payments are to be made

PSB  sort out wireless provision for ADASS 2007

WJS  consider adding field rotation flat field tests to integration tests

JRL  find out more about previous providers of wireless services at
     Kensington Town Hall
     
New Actions
-----------

MJI  email Matthew Colless (AAT Director) regarding lack of response from
     AAT regarding AAT archive mirroring (PostgreSQL problems)

EGS  prepare ADASS 2007 preliminary announcement web page by 2nd April
MR

RGM  email Tim Naylor, JPE and WJS to ensure that discussing the updated
     UK User Requirements Document is part of the VDUC agenda

MR   contact Durham group about raw WFCAM data progress (~end of April)

MJI  distribute drafts of conference proceedings of ESO calibration
JRL  workshop
MR

ALL  comment on above drafts

MJI  ask about obtaining more VISTA data at next VDMT meeting