LSC Data Grid (6 sources) Load

Navigation

General Information
LSC LIGO Scientific Collaboration
LIGO-Caltech
LIGO-Hanford Observatory
LIGO-Livingston Observatory

DataGrid Details

What is LSC DataGrid?
LDG Clusters Usage [Ganglia]
Available Data per site
Grid Service Details [Monitoring]

User Manual

How to get started
Install Data Grid Client
Getting Certificates
Account Request
SSH Login Portal
CVS/Bug Account Request
Request Software changes to SCCB

Admin Manual [(*) = optional]

Install DataGrid Server
Get server certificates
Configure/deploy Condor
Include site into Grid Monitoring
Graceful Condor shutdown
(*) Configure/deploy CondorView
(*) Configure Condor Flocking
(*) CondorC on LDG
LAMS / VOMS Admin [LSC internal]
Syracuse X4500 wiki [passwd required]
Edit these web pages

Request/Bug Tracking

Request Tracking System [RT]
LDG trouble ticket system

Policy

Reference O/S Schedule

LDG Collaborations

Condor-LIGO biweekly telecon
Globus-LIGO monthly telecon
LIGO VO in Open Science Grid [OSG]
Archival GriPhyN-LIGO WG pages

Exits

OSG

General Information

Configuring and Deploying Condor C

This page is meant to document the current best CondorC configuration.


Detailed deployment notes

condorcm.phys.uwm.edu / condorcm.nemo.phys.uwm.edu

role of central manager
CONDOR_HOST             = condorcm.nemo.phys.uwm.edu
SEC_DEFAULT_AUTHENTICATION_METHODS = CLAIMTOBE
HOSTALLOW_ADMINISTRATOR = $(CONDOR_HOST)
HOSTALLOW_READ = 192.168.0.0/16, *.cs.wisc.edu, 129.89.61.0/24
HOSTALLOW_WRITE = 192.168.0.0/16, 129.89.61.0/24
HOSTALLOW_NEGOTIATOR = $(CONDOR_HOST)
HOSTALLOW_NEGOTIATOR_SCHEDD = $(CONDOR_HOST), $(FLOCK_NEGOTIATOR_HOSTS)

In config.local:
NETWORK_INTERFACE = 192.168.0.14
BIND_ALL_INTERFACES = True

marlin.phys.uwm.edu / nemo-master0002.nemo.phys.uwm.edu m0002 nemo-master0002

role of schedd in existing pool being configured to enable CondorC
CONDOR_HOST             = condorcm.nemo.phys.uwm.edu
SEC_DEFAULT_AUTHENTICATION_METHODS = CLAIMTOBE
HOSTALLOW_ADMINISTRATOR = $(CONDOR_HOST)
HOSTALLOW_OWNER = $(FULL_HOSTNAME), $(HOSTALLOW_ADMINISTRATOR)
HOSTALLOW_READ = 192.168.0.0/16, *.cs.wisc.edu, 129.89.61.0/24
HOSTALLOW_WRITE = 192.168.0.0/16, 129.89.61.0/24
HOSTALLOW_NEGOTIATOR = $(CONDOR_HOST), condorcm.phys.uwm.edu
HOSTALLOW_NEGOTIATOR_SCHEDD = condorcm.phys.uwm.edu, $(FLOCK_NEGOTIATOR_HOSTS), $(CONDOR_HOST)
MAX_C_GAHP_LOG  = 1000000

config.local:
NETWORK_INTERFACE = 129.89.61.92
BIND_ALL_INTERFACE=TRUE
ALLOW_WRITE = 192.168.*, 129.89.61.0/24

hydra.phys.uwm.edu / nemo-master0003.nemo.phys.uwm.edu m0003 nemo-master0003

role of schedd in existing pool that is not being configured to accept CondorC
CONDOR_HOST             = condorcm.nemo.phys.uwm.edu
SEC_DEFAULT_NEGOTIATION = NEVER
HOSTALLOW_ADMINISTRATOR = $(CONDOR_HOST)
HOSTALLOW_OWNER = $(FULL_HOSTNAME), $(HOSTALLOW_ADMINISTRATOR)
HOSTALLOW_READ = *.nemo.phys.uwm.edu, *.phys.uwm.edu, *.cs.wisc.edu
HOSTALLOW_WRITE = *.nemo.phys.uwm.edu
HOSTALLOW_NEGOTIATOR = $(CONDOR_HOST)
HOSTALLOW_NEGOTIATOR_SCHEDD = $(CONDOR_HOST), $(FLOCK_NEGOTIATOR_HOSTS)

config.local:
NETWORK_INTERFACE = 192.168.0.13
# BIND_ALL_INTERFACES = True

nemo-slave0004.nemo.phys.uwm.edu s0004

role of worker node in cluster
CONDOR_HOST             = condorcm.nemo.phys.uwm.edu
COLLECTOR_HOST  = $(CONDOR_HOST)
HOSTALLOW_ADMINISTRATOR = $(CONDOR_HOST)
HOSTALLOW_OWNER = $(FULL_HOSTNAME), $(HOSTALLOW_ADMINISTRATOR)
HOSTALLOW_READ = 192.168.0.0/16, *.cs.wisc.edu, 129.89.61.0/24
HOSTALLOW_WRITE = 192.168.0.0/16, 129.89.61.100, 129.89.61.92
HOSTALLOW_NEGOTIATOR = $(CONDOR_HOST)
HOSTALLOW_NEGOTIATOR_SCHEDD = $(CONDOR_HOST),$(FLOCK_NEGOTIATOR_HOSTS)

config.local
#SEC_DEFAULT_NEGOTIATION = OPTIONAL
SEC_DEFAULT_AUTHENTICATION_METHODS = CLAIMTOBE

ldg-portal.phys.uwm.edu 129.89.61.100

role of schedd through which users submit jobs to be sent to other pools
COLLECTOR_HOST  = $(CONDOR_HOST)
HOSTALLOW_ADMINISTRATOR = $(CONDOR_HOST)
HOSTALLOW_OWNER = $(FULL_HOSTNAME), $(HOSTALLOW_ADMINISTRATOR)
HOSTALLOW_READ = *.phys.uwm.edu
HOSTALLOW_WRITE = 129.89.61.100
HOSTALLOW_WRITE_COLLECTOR = $(HOSTALLOW_WRITE), $(FLOCK_FROM)
HOSTALLOW_WRITE_STARTD    = $(HOSTALLOW_WRITE), $(FLOCK_FROM)
HOSTALLOW_NEGOTIATOR = $(CONDOR_HOST)
HOSTALLOW_NEGOTIATOR_SCHEDD = $(CONDOR_HOST), $(FLOCK_NEGOTIATOR_HOSTS)

config.local:
SEC_DEFAULT_AUTHENTICATION_METHODS = FS,KERBEROS,GSI,CLAIMTOBE
CONDOR_HOST = ldg-portal.phys.uwm.edu

routing table hack on slaves

netstat [root@nemo-slave0004 ~]# netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt Iface
129.89.61.92    192.168.0.12    255.255.255.255 UGH       0 0          0 eth0
192.168.0.0     0.0.0.0         255.255.248.0   U         0 0          0 eth0




Supported by the National Science Foundation. Any opinions, findings and conclusions or recomendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation (NSF)
$Id$