LIGO Data Grid

Navigation

CompComm
LSC
LIGO

DataGrid Details

What is LSC DataGrid?
Cluster Usage
Monitoring
Available Data
Service Details
OSG

User Manual

How to get started
Install Data Grid Client
Getting Certificates
Renewing Certificates
Certificates in your Browser
Account Request
CVS/Bug Account Request
Intro to Data Grid Tools
Matlab Cluster Tips
FAQ

Admin Manual

Install DataGrid Server
Get server certificates
Configure/deploy Condor
Configure/deploy CondorView
Graceful Condor shutdown
CondorC on LDG
LAMS / VOMS Admin
Syracuse X4500 Pages
Edit these web pages

Bug Tracking

LDG trouble ticket system

Policy

Reference O/S Schedule

LDG Collaborations

Condor-LIGO biweekly telecon
Globus-LIGO monthly telecon
Archival GriPhyN-LIGO WG pages

Exits

LSC
LIGO
OSG

Globusligo

Generating the S3 MACHO DAX

  1. Build and install LALApps by following the LALApps README, which is available from the LALApps home page. This will require you to install some required software and build LAL and the README will explain this. You should choose to build the required software from source, as this is the only method that has been validated.

  2. Assume that you installed LALAPPS into the directory LAL_LOCATION. Change directories to LAL_LOCATION/bin. Make sure that in that directory you have
    • lalapps_inspiral_pipe
    • lalapps_tmpltbank
    • lalapps_inspiral

    Also check that in the directory LAL_LOCATION/lib/python you have

    • inspiral.py
    • pipeline.py


  3. Add the directory LAL_LOCATION/lib/python to your PYTHONPATH environment variable so that the modules inspiral.py and pipeline.py can be found.

  4. Add the directory LAL_LOCATION/bin to your PATH environment variable so that the binaries can be found.

  5. The S3 MACHO search consists of three separate DAX, one for each interferometer L1, H1 and H2. Create a directory in which you are going to generate the DAX and copy the parameter files to this directory.

    These files are configuration files for lalapps_inspiral_pipe, which is the executable that generates the DAX. lalapps_inspiral_pipe will be run three times on each of these configuration files to generate the three DAX.

  6. In your working directory make a directory called cache_files. In that directory please put the files

    These calibration cache files point to the location of the calibration frames and are parsed during the generation of the DAX/DAG to determine the actual calibration files needed as part of the workflow.

    The paths in the in these calibration cache files are correct on the machines hydra.phys.uwm.edu and contra.phys.uwm.edu. If you want to generate a DAX on your own machine you will need to download the tarball S3_V02_CAL.tar.gz which contains the S3 calibration frames and edit the URLs in the calibration cache files to point to wherever you untar these frames.

    Eventually this mechanism will be replaced by calls to LSCdataFind or the like, but for now this file needs to exist.

  7. In your working directory put the three files files

    These files are listed in the configuration files as the file containing the list of segments to actually try and analyze. This is the data we need to analyze for the S3 search.

  8. Install the latest version of the LSC DataGrid Client.

    The LSC DataGrid Client 3.x is necessary for a couple or reasons. First, during generation of the DAX the program LSCdataFind needs to be run in order to determine using metadata like GPS times which logical filenames (LFNs) are part of the workflow.

    Second, the GriPhyN Virtual Data System (VDS) (otherwise known as Pegasus) is included in the LSC DataGrid, and you will need VDS tools in order to convert the DAX to a DAG.

    IMPORTANT NOTE: We really want to use version 3.x of the LSC DataGrid Client which has the latest LSCdataFind and VDS. Neither are in version 2.

  9. In your environment set the variable LSC_DATAFIND_SERVER. You can usually use the server at UWM which is dataserver.phys.uwm.edu

  10. Make sure LSCdataFind is in your path. Usually you want to do
    source ~/ldg-3.0/setup.sh
    

    You should probably also run LSCdataFind once with the --ping option to make sure you are able to authenticate to the server.

  11. In your working directory generate the the three DAX using the commands:
    ./lalapps_inspiral_pipe --dax --template-bank --inspiral 
            --config-file l1_s3_macho.ini --log-path /people/skoranda
    ./lalapps_inspiral_pipe --dax --template-bank --inspiral 
            --config-file h1_s3_macho.ini --log-path /people/skoranda
    ./lalapps_inspiral_pipe --dax --template-bank --inspiral 
            --config-file h2_s3_macho.ini --log-path /people/skoranda
    

    Replace /people/skoranda with a directory on your system.

    This will generate the three DAX files:

    • l1_s3_macho.dax
    • h1_s3_macho.dax
    • h2_s3_macho.dax

    which describe the workflow for the S3 MACHO search.


Supported by the National Science Foundation. Any opinions, findings and conclusions or recomendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation (NSF)
$Id: inspiral_dax_HOWTO.html,v 1.19 2006/10/26 18:17:23 bmoe Exp $