LIGO Data Replicator

LDR has a number of features that we hope make it very useful for organizations that need to replicate data sets to member sites:
  • High-speed data transfers due to using multiple parallel data streams, tunable TCP windows, and tunable write/read buffers. This functionality is provided by the Globus GridFTP-enabled servers and clients included as part of LDR.

  • The locations of files at sites within an organization or Data Grid are tracked using a database backend, and the databases at each site inform each other so that one can query any member site's database to locate a particular file. This functionality is provided by the Globus Replica Location Service (RLS). We use a MySQL database backend.

  • Information about data files, the so-called metadata, is also stored using a database backend. This allows site administrators to select groups of files for replication based on the characteristics of data files rather than just the names of the files.

  • All authentication for all clients and servers involved with LDR is done using the Globus Grid Security Infrastructure (GSI). This is a PKI-based authentication infrastructure that uses standard X.509 digital certificates.

LDR Logo
Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.