You are here: Home / Documents / Minutes of CASU Meetings / minutes_070221.txt

Plain Text icon — Plain Text, 15 KB (15670 bytes)

File contents

21st February 2007  Hoyle Committee Room 10:00 - 13:00

Present:   DWE, STH, JRL, PSB, MR, WJS, MJI, EGS
Late arrivals: RGM, NAW

Agenda
------

1.  Actions from last meeting
2.  Comments on WFAU minutes - UKLight saga update
3.  Data archives update     - AAT, ING, WFCAM, UKIRT
4.  Optical processing update- VST news
5.  WFCAM news               - raw data issues
                             - processing status
                             - news from AJA and GD visit
			     - sky brightness properties
                             - photometric calibration
6.  VISTA news               - comments on SMPs
                              (VVV, VIDEO, UltraV, Viking, VMC, VHS)
                             - delivery v0.5 pipeline
			     - change to cats keywords
                             - miscellaneous (too numerous to list)
7.  ADASS 2007               - update
8.  AOB                      - NAM (Preston, April 16-20)
                             - EURO-VO
			     - Kavli update
			     - CPL workshop

Minutes
-------

1.  Actions from last meeting

STH  has not investigated the effects of stacking on the 2MASS/WFCAM 
     non-linearity comparison. However, this has now been included in the
     photometric calibration tasks for DR3 and has thus been removed as a
     separate action.

JRL  is still awaiting a reply to his emails regarding the PostgreSQL
     problems with the AAT archive - ongoing                               <<<<

RGM  has not finished working on the classification aspect of cross-talk 
     weeding. This work will be rekindled when the DR2 data becomes 
     available - ongoing                                                   <<<<

DWE  has set up an automatic synching of the VIRCAM documentation from
     cvs to HTML. The transfer to Plone just requires a small scp issue to
     be sorted - ongoing                                                   <<<<
     
MJI  discussed data transfer issues for WFCAM with Andy Adamson (see item 5)

JRL  tried to check the OMP database to see what WFCAM data has been observed.
     However, the database link is broken.  JRL said that be would get in 
     touch with UKIRT to sort this out.                                    <<<<

RGM  updated the SMP guidelines and organized a meeting

EGS  are working on the ADASS 2007 registration web page - ongoing         <<<<
MR

MR   has contacted various people regarding credit card payments for ADASS
     2007. ADB is now looking into this - ongoing                          <<<<

JRL  organized an ADASS 2007 LOC meeting which was held yesterday (see item 7)

PSB  contacted BT regarding wireless provision for ADASS 2007 (see item 7)
     - ongoing                                                             <<<<


2.  Comments on WFAU minutes

PSB updated us on the latest news of his offspring's offspring.

PSB was grateful for having his attention drawn to the LTO4 tape drives (800
GB native per tape). We haven't needed to get any tape drives recently, but 
it's good to know about these.

PSB gave an update on the UKLight saga. Yesterday he received an email from
David Salmon. Apparently an implementation timescale will be drawn up in 
the next couple of days. It is possible that things might move in April 
and pigs might fly - well not so much fly, as plummet.

RGM said that he had been in touch with Steve Percival of UKERNA, who had
told him that he should send in an official complaint. RGM has drafted this
and will send it off soon.                                                 <<<<

It was noted that DR2 will be out next week, sans GPS.


3.  Data archives update 

AAT: all DVDs have been read and the data is now on disk. We are now
waiting for AAT to sort out the PostgreSQL problem.

ING: JRL said that the search engine problems in the archive have been fixed.
All the software has been migrated to apm20 and Sybase has been updated.  JRL 
was asked to sort out the cvs server on cass38 so that it can be retired.  <<<<
The schedule for retiring cass38 will commence early next week beginning
with unmounting the disks.

MJI noted that extra checks for the Internet transfer of data from La Palma 
had recently been introduced to cover the situation where no nightly logs 
had been generated by the observers. [A comparison against night log is one 
of the transfer checks.]

WFCAM: see item 5

UKIRT: JRL pointed out that the last data we have in the archive is from 
2.5 years ago. The proprietary period is 18 months, so there is 1 year of 
data that needs to be acquired.


4.  Optical processing update

MJI said that much processing of INT, Megacam and Subaru data has occured
recently mainly for Local Group surveys and to finish off outstanding IPHAS
GP processing.

The PIs of the UK-lead VST Public Surveys have received comments regarding 
the (re)submitted SMPs and got the green light.


5.  WFCAM news

Raw data issues:
MR reported that although the semester started on 26th October, the first
complete datasets we have received are still only for the period 19th December 
to 3rd January. There are still many problems with missing files and also the 
pre-19th December NDR data. The last batch of tapes had the missing data 
grouped by detector but not for all detectors. We have not had any tapes
for over a month.

Processing status:
All the data that has been received and is complete has now been processed.
It is now waiting to be checked by MJI (approximately by end of next week) 
and it will then by flagged as appropriate.

To give a better overview of status MR was asked to mark appropriate nights 
(mainly in November 2006) on the data processing page as "pending"
or similar.                                                                <<<<

An extra column on the status web page has also been added that records 
the date of the most recent "header updated" flag (UPDATED) in each date 
directory.

MR pointed out that none of 06B had been added to the DQC database because
of its problematic nature.

A new intermittent fault has occured on detector#3.  This is a bright edge 
channel fault which is noticeable in the flats as both channel boundaries and 
enhanced noise.  It is not clear if, or how, this will affect the science 
data.  This will be examined at the detailed checking stage.               <<<<

MR also noted that not enough darks were being taken per night for some of 
the science observing combinations used this semester. This issue has been 
raised with Andy Adamson.  For now, darks are being cannibalised from other
nearby nights to make up the defecit.

It was also noted that WFCAM has a new narrow-band J filter (and apparently
a narrow-band H-band filter may be coming shortly).  Some NBJ science frames
in 06B have already been spotted.

News from AJA and GD visit: several items covered are noted already.
MJI reported on further news from the meeting he, JRL, and MR had with 
Andy Adamson and Gary Davis.

JAC have come up with a way of uniquely identifying MSBs that are repeated. 
This will allow the data in the OMP database to be linked to an MSB 
observation (see also minutes_060718.txt).  This is not retrospective and 
will only apply to new data from early this year (exact date TBFO).

Sky brightness properties:
MR gave a presentation of his investigation into the correlations between
sky brightness and various parameters (Moon presence, temperature, time
after twilight,...). One of the problems of this investigation is that the
observations have not been planned with this in mind and so he has had to 
make the best use of the data that is available. The sky value used comes 
from the "SKYLEVEL" measure in the FITS headers of the observations.

There was much discussion during the presentation. The main conclusions were:
* there is no significant difference in sky brightness between bright and 
  dark time for YJHK, a 0.5 mag effect is seen in Z (brighter in bright time);
* there is no significant Moon effect in YJHK when at a reasonable (>20 deg) 
  distance, a safe distance for Z is >30 deg;
* sky brightness reduces as a function of time after twilight for J and K;
* there was a correlation with temperature for K as expected using a simple 
  Black Body model.

Photometric calibration:
STH said that he had a list of tasks agreed by the photometric calibration 
working group to be carried out before DR3. This implies a deadline of 
around mid-April. STH will email this list to everyone for comments.       <<<<

This will be a precursor to an MNRAS paper built around the available 
information from web-based reports.  STH pointed out that calibration of
narrow-band photometry has not been considered yet in any detail.  MJI
noted that the current default is simply to use the same ce's as for the 
closest broadband equivalent.


6.  VISTA news

Comments on SMPs (VVV, VIDEO, UltraV, Viking, VMC, VHS):
MJI noted that much time had been spent interacting with the PIs on their
SMPs. The most up-to-date versions of these are available on the internal
parts of our web and Plone pages. There will be feedback from ESO to the PIs
on 7th March and the SMPs will then have to be resubmitted by 2nd April.

WJS reported on progress with VISTA and presented a brief slide show.

Delivery of v0.5 pipeline:
JRL said that this was originally scheduled for the end of February, but 
this deadline will be slipped by a few weeks to allow for extra checks
to be made.  On a positive note he reported that recent critical comments 
from ESO ("tickets") have been getting even pickier and are mainly related
to previously undisclosed DFS interface standards.

Some software testing procedures (eg. valgrind) have been obtained from 
Sandra Castro which JRL is in the process of using for various extra checks.

STH and JRL are updating the relevant DRLD figures to reflect the latest
version of the actual software.

Concerns about dependency of flatfields and possibly associated illumination
corrections on the rotation angle have been raised.  This arose because of
problems seen with FORS data shown at the ESO calibration workshop.  
Although this problem is expected to be negligible for VISTA WJS has been 
asked to get this included in the list of integration tests.               <<<<

Change to catalogue keywords:
There are different WCS standards for image and table data. The current
method we use was devised before the standard for tables was agreed and
is simply to copy the relevant keyword information from the image headers 
to the catalogue headers -  mais fitsverify ne l'aime pas.  Since the same
catalogue generation software is being delivered to ESO as will be run
in Cambridge it was felt timely to update how the WCS information is
stored in the catalogues.  Conditional upon WFAU agreement, at some future
point it would be prudent to upgrade the WFCAM software in the same way 
(eg. ready for the start of 07B processing).

Jitter patterns: 
There was much discussion regarding standard templates for jitter patterns
and scaling factors for these.  PSB asked whether there was a specification 
for how a PI would input a scaling factor into OBs.  WJS assured that 
because a scaling factor was present in the VIRCAM instrument definition 
there would automatically be a parameter available to P2PP.

Will there be a jitter pattern recommendation and who will do this?

WJS was reminded that for VISTA, darks will be needed for each observing 
mode including exposure time, number of co-additions etc.


7.  ADASS 2007

JRL reported that there was a meeting of the ADASS 2007 LOC. It was 
unanimously decided that various problems associated with holding the 
conference dinner at the Globe Theatre had necessitated a rethink.  The 
current front runner is the conference location, Kensington Town Hall.

PSB said that BT did not advertize a temporary wireless service on their
web site. Eventually, he managed to get in touch with the relevant person
(conferences section) and is waiting for further information.  PSB is also 
in touch with a local network provider who is researching possible options 
for ADASS networking.

JRL recollected that BT had previously provided wireless services in
Kensington Town Hall. He will investigate further to see if he can get a
better contact.                                                            <<<<

MJI said that he would find out who is our secretarial support for 
ADASS 2007                                                                 <<<<

There is a university account for ADASS 2007 which will help with accepting
credit card payments.


8.  AOB

MJI asked if all the windows in the APM building have been fixed. This was
the case.

MJI also asked if there was any interest in attending NAM (Preston, April 
16-20). JRL and PSB said that they would be at the CPL workshop. MJI will
also be away in Strasbourg.

MJI noted the following extract from an email he had received:  

"If you are interested in applying to a EURO-VO supported research initiative, 
please see the details of a call for proposals to carry out astronomical 
projects using VO tools at: http://www.euro-vo.org/pub/fc/call.html

Deadline is April 1, 2007."

JRL said that there was a CPL workshop at ESO on 18 and 19 April. This was
for second generation instruments. JRL and PSB have been asked to attend
because they have experience in developing software using CPL. JRL suggested 
that he would like to broaden the scope of his contribution to include 
interaction with ESO in general.

STH said that he needs reports covering January and February for the next 
VDMT meeting.  RGM noted that this will be on 9 March 2pm.                 <<<<

MJI said that a VDUC meeting is being planned. Originally this was aimed
at the end of March, but due to availability constraints from himself and 
NCH this needs a rethink.

PSB reported that various meetings have been held concerning the Kavli
building and consequent demolition of his office (and quite a lot of the
building around him).  PSB will probably be relocated in the APM building.

Other consequence of this are that our out-of-APM building secure tape
store will also need relocating.  MJI will investigate alternatives and
make sure that the tapes are rationialized prior to moving.                <<<<

Plates in the SPO will also have to be found new homes. RWA is contacting 
Elizabeth Griffin about moving them to the Royal Observatory, Bruxelles. 

PSB added that the network cables will also have to be rerouted. There will
be some network disruption (makes a change!).


Continuing Actions
------------------

JRL  repair AAT archive mirroring (PostgreSQL problems)

RGM  report back on classification aspect of cross-talk weeding

DWE  finish off synching of VIRCAM documentation to Plone site

EGS  prepare ADASS 2007 registration web page
MR

MR   sort out how ADASS 2007 credit card payments are to be made

PSB  sort out BT wireless provision for ADASS 2007


New Actions
-----------

JRL  get UKIRT to fix the OMP database

RGM  send off official complaint to UKERNA

JRL  sort out cvs server on cass38 

MR   mark appropriate nights on data processing page as "pending"

MJI  investigate effect of bright edge channel problem in processed data

STH  distribute DR3 photometric calibration task list to all

ALL  send comments on above to STH

WJS  add field rotation flat field tests to integration tests

JRL  find out more about previous providers of wireless services at
     Kensington Town Hall

MJI  find out who is our secretarial support for ADASS 2007

ALL  send in January/February reports to STH

MJI  contact Paul Aslin about CASU out-of-APM tape store