LIGO Data Grid

Installation

Note: These instructions have been tested on Fedora Core 4 (FC4), FC4 x86-64, Debian, Solaris, and Mac OS X on Intel and PowerPC. It may work from other versions of Linux as well. As indicated above, the LDG Client on Solaris and Mac PowerPC builds Globus Toolkit 4.0.5 from source, while on Linux and Mac OS on Intel the LDG Client is built on top of the Virtual Data Toolkit (VDT) from the OSG project. These use packages from VDT 1.8.1, and the VDT supported platforms are given here. See the "pacman -pretend-platform Fedora-4" option below to try the installation from an unsupported Linux platform. If you are interested in the client package for other platforms besides those listed here please send an email to Greg Mendell.

1. IMPORTANT: BEFORE YOU START
   If you have an existing LDG installation, please open a new shell and run the following:
   

    $ env | grep -i LDG
   

   This should return an empty list. However, if there is already anything in your environment pointing to an existing installation of LDG, then this will confuse the installation. (This is one of the main problems user have when installing LDG.) The solution in this case is to make sure that nothing to do with LDG is sourced, for example in ~/.bashrc, ~/.bash_profile ~/.tcshrc or ~/.cshrc files, before trying to install LDG. One possible solution to obtain a shell that satisfies the constraint above is to run

   env -i bash --login --norc --noprofile
   

   Once you have a shell running where "env | grep -i LDG" returns an empty list, then proceed with the installation from that shell.
2. QUICK INSTALLATION INSTRUCTIONS: Experienced user may wish to follow these quick instructions. Otherwise DETAILED INSTALLATION INSTRUCTIONS are given below; Debian and Solaris users should look at important notes given at the top of that section. (Also note that substituting LDG for http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5 will install LDG from http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg, which points to the current release.)
   
   Get pacman v3.21 from here:
   http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5/software/pacman-3.21.tar.gz
   
   and run these commands:

   
     $ tar zxf pacman-3.21.tar.gz
     $ cd pacman-3.21
     $ source setup.(c)sh
     $ cd ..
     $ mkdir ldg-4.5
     $ cd ldg-4.5/  
     $ pacman -allow non-snapshottable-downloads -get
     http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5:Client
   
     or
     
     $ pacman -allow non-snapshottable-downloads -get
     http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5:ClientPro
     
   

   You will be asked two questions, about adding ldg and vdt URLs to [trusted.caches]. Answer y to each. If you are using Linux and pacman does not recognize your platform, try

     $ pacman -pretend-platform Fedora-4
   

   and then repeat the "pacman -allow non-snapshottable-downloads -get..." command. On Debian, you may also have to run

     $ unsetenv POSIXLY_CORRECT
   

   first.
   
   Note that the Client contains gsi enabled ssh, certificate tools like grid-prox-init and grid-proxy-info, and Condor tools like condor_submit_dag. The ClientPro also contains PyGlobus, MyProxy, Globus WS and WSGRAM Clients, and Pegasus (on Linux only). (Solaris and Mac PowerPC users: the installion builds Globus Toolkit from source. This can take several hours. The only additional item in the ClientPro on Solaris and Mac PowerPC is PyGlobus.) All installations include the certificate utilities, LSCrenewCert, LSCrequestCert, and LSCretrieveCert.
   
   If the quick installation instructions succeed, next go to "Get a certificate" below. If the installation fails, remove it and make sure "env | grep -i LDG" returns an empty list. Look at the detailed installation instructions for further information and what to do in case of errors.
   
   
3. DETAILED INSTALLATION INSTRUCTIONS
   
   Actually there is no formal upgrade. If you installed a previous version of the LDG Client package we recommend that you simply install this newer version as directed. Once you are comfortable that everything works then you can simply delete the old installation.
   If you already have a digital certificate, note that it is not stored within the LDG Client distribution, so you don't have to worry about deleting it if you delete an old installation.
   • IMPORTANT
     PyGlobus requires python-devel. On Macs, you can get python-devel by installing the Apple Xcode tools package (google "xcode tools").
   • IMPORTANT
     On Debian, you may have to run "unsetenv POSIXLY_CORRECT" first. Running this and "pacman -pretend-platform Fedora-4" has been shown to work on Debian 4.0.
   • IMPORTANT(for Solaris users ONLY)
     You must have a recent version of Python (2.2 or better) installed and available in your PATH.
     You must make sure that the GNU version of tar is the tar that will be found first in your PATH.
     You must make sure that the version of perl that will be found first in your PATH has been compiled using gcc.
     You must make sure that gcc is available and will be found in your PATH.

     For most LIGO Lab users at Hanford and CIT these can be satisfied by doing the following:

      $ setenv PATH /ldcg/bin:$PATH
      $ setenv LD_LIBRARY_PATH /ldcg/lib
     

     At Livingston users can do

      $ setenv PATH /apps/bin:$PATH
      $ setenv LD_LIBRARY_PATH /apps/lib
     

   • Install Pacman:
     • We recommend that you do not install the LDG Client package as root. You should install the tools using your normal login.
     • Download Pacman. This is version 3.21 which has been tested with LDG 4.5. Please make sure you are using the Pacman downloaded from this site, though more recent versions and additional information about Pacman may be available from the Pacman web site.
     • Unpack Pacman:

        $ tar zxf pacman-3.21.tar.gz
       

     • Setup your shell environment to use pacman:

        $ cd pacman-3.21
        $ source setup.(c)sh
       

       This will set your PATH environment variable to find Pacman.
   • Prepare to install the LDG Client:
     • If you already installed previous versions of LDG, make sure you did not source setup.sh of the previous LDG.
     • Decide where to install. It doesn't matter what you choose as long as you have write permissions. We recommend you create the directory ldg-4.5 in your home directory:

        $ cd
        $ mkdir ldg-4.5
       

     • Change into that directory:

        $ cd ldg-4.5
       

     • If you are using Fedora Core 5 or higher, run:

        $ pacman -pretend-platform Fedora-4
       

       If pacman may tells you that there is a more recent version available, ignore it. You must use the version specified in step 3 above for the installation to work.
   • Install the LDG Client:
     • We support two levels of client installation: basic and professional. The basic client provides all certificate utilities and necessary tools described here plus the VOMS client. The ClientPro also contains PyGlobus, MyProxy, Globus WS and WSGRAM Clients, and Pegasus (on Linux only). (Solaris and Mac PowerPC users: the installion builds Globus Toolkit from source. This can take several hours. The only additional item in the ClientPro on Solaris and Mac PowerPC is PyGlobus.) All installation include the certificate utilities, LSCrenewCert, LSCrequestCert, and LSCretrieveCert. Users that want just basic access to the LDG clusters can install just the Client, which has a better chance to be successfully installed on unsupported platforms. (Finally, note that substituting LDG for http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5 will install LDG from http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg, which points to the current release.)
     • Install the basic client package using:

         $ pacman -allow non-snapshottable-downloads -get 
         http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5:Client
       

       or install the professional client package using:

         $ pacman -allow non-snapshottable-downloads -get 
         http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5:ClientPro
       

       You will be asked this question:
       Do you want to add [http://www.ldas-sw.ligo.caltech.edu/ldg_dist/ldg4.5] to [trusted.caches]? (y or n): Answer 'y' to continue.
       You might also be asked this question:
       Do you want to add [http://vdt.cs.wisc.edu/vdt_181_cache] to [trusted.caches]? (y or n): Answer 'y'.
       (Though note that the Solaris and Mac PowrPC installations build Globus gt4.0.5 from source. Solaris and Mac on Intel and PowerPC install PyGlobus-gt4.0.1-1.15, rather than getting this from VDT. However, pacman still checks VDT for packages during these installations.)
     • During the installation you will see messages that a number of packages are being installed. Note that all packages are installed under the directory you created.
     • At the end of the installation you should see something similar to

        The LSC Data Grid Client 4.5 has been installed.
       

       If you do not see this and see any errors then please send mail to Greg Mendell.
       ***You may also see one or two lines of additional output after the above message, which can be ignored.***
4. Get a certificate:
   The LDG Client is installed and configured but you still need to apply for a digital certificate if you don't already have one before using the client tools. Go to Getting Certificates, but don't forget to come back here! (Note that if you use the client certificate utilities that come with LDG, LSCrenewCert, LSCrequestCert, and LSCretrieveCert, that these require the perl modules LWP and SSLeay. In most cases these are installed with LDG. However, if you get errors that refer to these, ask your local systems administrator for help, or try installing them from cpan, or send an email to Greg Mendell.
   If you already have a certificate then you can continue onto the next step. There is no need to get a new certificate.
5. Read documentation:
   Once the LDG Client is installed and you have a valid certificate you can use the client tools. Go to Documentation for links to documentation for the tools. You can request accounts on the LDG clusters here.