LSC Data Analysis Software Working Groups

Agenda: Wed, 24 January 2007

Minutes

Attendance:

Stuart Anderson (minutes)
Kent Blackburn
Duncan Brown
Kipp Cannon
Kevin Flasch
Nick Fotopoulos
Ben Johnson
Ed Maros
Greg Mendell
Dave Meyers
Keith Riles
Mike Samidi
Peter Shawhan
Keith Thorne
Igor Yakushin


Announcements:

- There will be a two day meeting after the LSC meeting on 17/18 March 2007.
  the first day will have a face-to-face computing committee session
  in the morning and a technical LIGO Data Grid meeting in the
  afternoon. The second day will be devoted to LDR development
  discussions. 

Segment Database
----------------
	There was a lengthy discussion on the new segment database proposal
put together by Igor. There was general consensus between Igor, Keith, Peter,
and Duncan on this proposal, though the documentation will be updated with
additional details and examples based on this discussion. In short the
current system has the following limitations:
	a) Unable to remove segments.
	b) Unable query by version.
	c) Performance problem with lots of short segments due to
	   on-the-fly merging.
and the proposed solution will:
	a) Add versions (each version has a full copy of all segments).
	b) Periodically coalesce short segments and increment version number.

The discussion concluded with the decision to reserve version 0 to denote
automatically generated segments (e.g., DMT), and anything at version 1 or
later will be a full copy of coalesced segments. Furthermore, comment lines
will be added to the output to record sufficient information for a given
query to be reproduced later in time even after new segment versions may
have been added.


Project Updates
---------------

GLUE (Cannon/Fotopoulos):
- numpy switch to be made today in glue and in documentation.
- Waiting for Adam to release new RPM via LSCSOFT repository

LDAS (Maros):
- Closing out PR's for the next release.

LDR (Flasch/Johnson):
- Updating the work plan for future LDR development/bug fixes based on
  the recent face-to-face meeting.
- Thinking further about adding the ability to query by channel rather
  than just frame type.
- Started publishing Hann SFT files for Vladimir.

MATAPPS (Thorne):
- Fixed channel package bug for trend frames.
- Having glibc problems testing the new Matlab release (R2007a Beta) on
  RHEL3.

OSG (David and Mike):
- Passed first milestone by running the full Hipe pipeline at SDSC at
  a sustained rate of > 25 CPU's being used.
- OSG version 0.5.2 has been released and is being tested on the OSG
  Integration Testbed.
- Working on problems submitting SRMCP jobs via DAG's.

$Id: 070124.html,v 1.1 2007/01/24 23:06:29 anderson Exp $