WP1: Provide and operate processing facility of raw image data

Objectives:
  • develop, implement and operate a full wide-field imaging pipeline from raw data to astrometrically and photometrically calibrated images
  • populate the database with the necessary calibration information
Work description:
  • implementation of existing pipeline modules
  • implementation of interface to data base for all calibrations and survey system results
  • further develop, benchmark astrometric calibration, co-addition methods e.g. SWARP, multi-resolution decomposition of images
  • further develop techniques for reduction of IR data
  • operational tasks of populating database and maintaining pipeline

Planned total man month over 4 years (from contract)
 
 
NOVA   ESO   OAC   TERAPIX   USM  
Rengelink 17 Slijkhuis 4 Alcalà  7 Bertin 15 Neeser 10
Deul  8 Vandame 12 Grado 1 Domisse 7 EC-Snigula 10
EC-Vermey
 16 Rite  8 Radovich 7 EC-Magnard 6    
    EC-NN 6 Silvotti 8        
        EC-Volpicelli 10        
Total 41   30   33   28   20
WP 1 152                

 
TASK LEADER:  Rengelink

Current Group: Deul, Slijkhuis, Silvotti, Alcala, Radovich, Neeser, Snigula

MILESTONES
Phase I: be ready to receive first data without later redefinition's or re-shuffling - 2002

  1. T0 kick-off- prepare design review for  WP1
  2. T0 + 1Q design review WP1
  3. T0 + 2Q import pipeline
  4. T0 + 3Q WP1 fully operational at partners centres
Phase II: evaluate and prepare for mass production -  2003-2004
  1. T0 + 7Q WP1/WP3 One year operations and population of data base review deliverables: set of tools to users and populated calibration database
  2. T0 + 10Q System full mass production proof (i.e. 100 Tbyte data volume) deliverable: operational pipeline, tools, data, results in Tbyte regime
Phase III: qualify, operate and populate the mass production system - 2005
  1. T0 + 11Q Review and set goals of final delivery system
  2. T0 + 15Q End of implementation/development work of this program- deliver pipeline


ACTIONS Q1 2002- all closed
 - pipeline has been exported to USM and OAC

 
ACTIONS Q2 2002 - following 17 May meeting Paris
  • add glossary to ADD (Roeland) - closed 2/7/02
  • do a detailed scooping of the work involved in WP1, following the ADD (Roeland)
  • add history, origins  and scope of EIS in introduction  of ADD
  • update ADD according the various comments received  - closed 2/7/02
  • first steps towards a pipeline manual: Roeland writes a first introduction, Mark and Roberto expand this into a more user oriented manual - closed 2/7/02
  • Report on ASTRO-GRID interoperability and usage of XML (Jim)

Access to pipeline software

The OmegaCAM pipeline software (astro-wise prototype) can be retrieved through CVS.

setenv CVSROOT :pserver:anoncvs@cvs.astro-wise.org:/cvsroot
cvs login (use empty password)
cvs checkout awpipe

This will create a new directory named opipe (note, not awpipe, sorry for that) containing several subdirectories and a README file. Consult the README for further instructions.

Alternatively you can go  here   to browse the CVS contents, and  here   to browse on-line documentation.

An official release of a first version of the prototyp will be made on March, 1st. This version should include proper installation instructions and better documentation. See the TODO list in CVS for what we plan to do before then.