LIGO Data Grid

Welcome to the LSC DataGrid

The LSC DataGrid is the combination of LSC computational and data storage resources with so called "Grid Computing middleware" to create a coherent and uniform LIGO data analysis environment. The graph on the right shows the current CPU usage across the six active centers across the world

Getting started?

If you are new to the LSC DataGrid and need instructions for installing grid tools, getting a certificate, and requesting access to LSC resources then please see Getting Started on the LSC DataGrid or click on "Getting started" on the navigation bar on the left.

News

• 09/18/2008: VDT announced here that "it will no longer automatically install certificate authority certificates during installation". However, LDG 4.7 has been patched to automatically get the VDT CA certificate bundle. You do not need to do any post installation steps to get these. Messages explaining this have been added to the output during the installation and the detailed installation instructions.
  
  
• 07/21/2008: The release of Version 4.7 of the LSC DataGrid Client package and LSC DataGrid Server package has been announced. The installation instructions are to the right, or here: Install LSC DataGrid Client and Install LSC DataGrid Server. This release is primarly to add support for CentOS 5 and Debian 4. (Note that LDG 4.6 was a test release, and not formally announced here.)
  
  
• 11/19/2007: To get globus-gatekeeper to work with Condor, the LDG 4.5 Server has been changed to configure Condor for use with Globus as it did with LDG 4.4. If you have an existing installation of Condor, to install the LDG 4.5 Server you have to set VDTSETUP_CONDOR_CONFIG or VDTSETUP_CONDOR_LOCATION. The Server installation instruction, Install LSC DataGrid Server, have been updated with this information.
  
  
• 11/07/2007: The release of Version 4.5 of the LSC DataGrid Client package and LSC DataGrid Server package has been announced. The installation instructions are to the right, or here: Install LSC DataGrid Client and Install LSC DataGrid Server This release includes the latest versions of the certificate utilities, LSCrenewCert, LSCrequestCert, and LSCretrieveCert. See the documentation for other changes included with this release.
  
  
• 07/28/2007: The certificate utilities, LSCrenewCert, LSCrequestCert, and LSCretrieveCert, have changed and need to be updated. To do this, first download http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.4/software/LSCcertUtil.tar.gz. Next change directories to where you created the ldg-4.4 directory, move this tarball to ldg-4.4/ldg-client, and run "tar zxf LSCcertUtil.tar.gz". The new certificate utilities will be installed in ldg-4.4/ldg-client/bin and CertLib.pm will be installed in ldg-4.4/ldg-client/lib. Finally, add to ldg-4.4/ldg-client/lib to the PERL5LIB environmental variable ("export PERL5LIB=ldg-4.4/ldg-client/lib:$PERL5LIB" from the bash shell, "setenv PERL5LIB ldg-4.4/ldg-client/lib:${PERL5LIB}" from the tcsh shell). You can also reinstall LDG 4.4 to get these changes. At the moment the new utilities only work on Linux. We are working on support for Macs (and Solaris at some point). Other users may try the web based tools at http://www.doegrids.org/.
  
  
• 05/02/2007: The LSC DataGrid Client 4.4 has been updated to support Mac OS users on Intel, for example that want PyGlobus. Interested users should see the instructions here, and note those for installing MacProI.
  
  
• 04/18/2007: The release of Version 4.4 of the LSC DataGrid Client package and LSC DataGrid Server package has been announced. The installation instructions are to the right, or here: Install LSC DataGrid Client and Install LSC DataGrid Server
  
  
• 03/09/2007: A pre-release of Version 4.4 of the LSC DataGrid Client package and LSC DataGrid Server package has been announced for testing.
  
  
• 11/27/2006: Version 4.3 of the LSC DataGrid Client package and LSC DataGrid Server package are available. Several bugs are fixed at the Server side.
  
  
• 9/19/2006: Version 4.1 of the LSC DataGrid Client package and LSC DataGrid Server package with new certificate utilities are available.YOU ARE ADVISED TO UPGRADE TO THIS VERSION.
  
  
• 5/1/2006: Version 4.00 of the LSC DataGrid Client package and LSC DataGrid Server package with support for Fedora Core 4, Solaris and Mac (only for client) are available.
  
  
• 7/22/2005: Junwei Cao and Duncan Brown each presented a poster on the LSC Data Grid and LIGO Grid Computing work at the recent Open Science Grid Consortium Meeting held recently in Milwaukee, WI and hosted by the UWM LSC group.
  
  
• 7/11/2005: Version 3.5 0f the LSC DataGrid Client package and LSC DataGrid Server package with support for Fedora Core 3, Red Hat Enterprise Linux 3, and Solaris (only for client) are available.
  
  
• LSC Grid Computing Workshop (03/24/2005 - 03/26/2005): The LSC and the GRIDs center will hold the LSC Grid Computing Workshop at the Livingston Observatory immediately following the March LSC meeting. Learn the skills and tools needed to take advantage of the computational resources of the LSC DataGrid. No previous grid computing experience necessary.
  
  
• 10/28/2004: Version 3.0 0f the LSC DataGrid Client package and LSC DataGrid Server package with support for RedHat 7.x, RedHat 9, and RedHat Enterprise Linux are available.
  
  
• 05/07/2004: Version 2.0 of the LSC DataGrid Client package and LSC DataGrid Server package with support for RedHat 9 are available.
  
  
• 11/24/2003: The new Pleiades cluster at PSU has been added to the LSC DataGrid web pages.
  
  
• 11/01/2003: More details about the LSC DataGrid along with real-time cluster usage monitoring is now available.
  
  
• 11/01/2003: A brochure describing the demonstration to be presented by the LSC-GriPhyN group at SC2003 is available here.
  
  
• 9/25/2003: A first draft of some LSC DataGrid details is available. See also the links under "DataGrid Details" on the left.
  
  
• 8/14/2003: Version 1.0 of the LSC DataGrid Client software package is available for download. It includes a Grid-enabled OpenSSH client, Grid-enabled FTP client, Condor and CondorG for submitting jobs onto the LSC DataGrid, and LSCdataFind. It is built on top of the Virtual Data Toolkit (VDT) from the GriPhyN and iVDGL projects.

  LSC scientists who want to begin using grid tools should install this package on their workstations or laptops.
  
  

• 8/12/2003: Version 1.0 of the LSC DataGrid Server software package is available for download. It is built on top of the Virtual Data Toolkit (VDT) from the GriPhyN and iVDGL projects.

  LSC DataGrid administrators should install this package.