WP4: provide parallel processing power to ASTRO-WISE

Objectives:
  • provide the necessary computing power to the prime data centres
  • install and operate Linux-Beowulf 32 Gigabit PC parallel clusters
Work description:
  • hardware procurement and installation
  • upgrading and export to other main sites of existing 4 PC clusters
  • maintenance

Planned total man month over 4 years (from contract)
 
 
NOVA   ESO   OAC   TERAPIX   USM  
Begeman 12 Slijkhuis 6 Getman 1 Missonnier 7 EC- Snigula 3
Deul  4     Grado 6     Gabler 4
        Pavlov 7        




EC-Volpicelli 4



Total 16   6   18   7   7
WP 4 54                

 

TASK LEADER Deul + Grado

Current Group Bertin,  Neeser, Begeman, Pavlov, Cascone, Snigula , Missionier, Magnard
 

MILESTONES
Phase I: be ready to receive first data without later redefinition or re-shuffling - 2002
  1. T0 kick-off- prepare design review for  WP4
  2. T0 + 2Q procure hardware, start sub-component installation
  3. T0 + 3Q  deliverable: first version of operational (smaller) cluster
Phase II: evaluate and prepare for mass production -2003 -2004
  1. T0 + 9Q Upgrade hardware- ready for bulk operations
  2. T0 + 10Q System full mass production proof
Phase III: qualify, operate and populate the mass production system -2005
  1. T0 + 11Q Review and set goals of final delivery system

    2. T0 + 15Q deliverable: operational parallel clusters at partner centers
ACTIONS Q1 2002 All closed
ACTIONS Q2 2002 All closed
  1. Define the constraints on the reduction time - an upper limit. (1/6/2002) see here
ACTIONS Q3 2002 All closed
  1. Define a reasonable dataset for benchmarking. (1/8/2002)
  2. Create a dataset for benchmarking. (1/9/2002)
ACTIONS Q4 2002 All closed
  1. Distribute benchmarking facility to the different data reduction centers (1/12/2002) download here
ACTIONS Q1 2003
  1. Benchmark and compare performances of the different Beowulf implementations at the different ASTRO-WISE sites. (1/2/2003)see here
Considerations
on the use of a beowulf cluster for the pipeline. Report from the splinter meeting during the ASTRO-WISE course in Leiden