Online Analysis Web Monitoring
OnasysWeb contains the onasysd online analysis daemon along with the accompanying utilities. onasysd is used to provide automated online control and monitoring of DAG-based analysis pipelines.
Project Librarian
Brian Moe. Email: bmoe at gravity.phys.uwm.edu
Documentation
Please note that OnasysWeb is, in many aspects, beta-quality software at best. Installation may not be as simple as it should be nor is this documentation likely to be completely sufficient for some OS configurations. If you have problems with incorrect or insufficient information in this document, please feel free to let the project librarian know so it can be corrected.
A best effort is made to keep this documentation available here synchronized with the most recent release, but that sychronization should not be relied upon.
Download
OnasysWeb can be obtained as as a release tar-ball or directly from CVS. It is recommended that only people involved in the development of OnasysWeb make use of the CVS tree. Non-developers should use a release tar-ball.
See below for information on obtaining OnasysWeb from either CVS or as a release tar-ball.
Releases
The following release is available at this time:
| CVS Tag | Description | Tarball |
|---|---|---|
| onasysweb_0_1_0 | Initial Release. | onasysweb-0.1.0.tar.gz |
CVS Archive
cvs -d ':pserver:anonymous@gravity.phys.uwm.edu:2402/usr/local/cvs/lscsoft' co -d onasysweb onasys/src/onasysweb
http://www.lsc-group.phys.uwm.edu/cgi-bin/cvs/viewcvs.cgi/onasys/src/onasysweb/?cvsroot=lscsoft
The latest development snap-shot of the Onasys package is available from the LSCSoft CVS archive as onasysweb/src/onasysweb. The CVS repository can be accessed read-only using the anonymous account (no password is needed). The CVS repository root is:
:pserver:anonymous@gravity.phys.uwm.edu:2402/usr/local/cvs/lscsoftContact the Onasys librarian to obtain your own CVS account for read/write access.
You can also browse the OnasysWeb CVS archive using the web interface.
Bug Reporting
Bug reports and feature requests can be submitted to the Onasys bug database. Please use the "web-scripts" category. Help can also be obtained via the daswg-online mailing list.
Mailing Lists
Issues involving OnasysWeb may be discussed on the daswg-online mailing list.
Required Software
OnasysWeb requires the Python library DAG which can be
found in the Onasys package.
OnasysWeb requires you to have the following non-LSC-supplied software installed. Both RedHat FC3, FC4 and Debian Sarge are known to provide suitable native packages of this software. All of these are also available wherever Onasys is installed.
- MySQL-python.
- eGenix mx Extensions for Python.
- SQLObject (note: Debian provides this, but neither FC3 nor FC4 do; FC3 and FC4 rpms can be found in the LSCSoft yum repository, which can be found in the links in side bar).
Note: sqlobject, mx, and MySQL-python are also required for onasysd.
Installation and Configuration
OnasysWeb installs into 3 directories.
LIB_DIRThe python library code will be installed in this directory. This include the OnasysWeb and HTMLgen libraries.CGI_DIRThe CGI scripts are installed here. The web server needs to be configured so that either this directory is CGI enabled or some file, CGI_DIR/CGI_FILE is enabled as a CGI script.SITE_DIRStatic web content is installed here. The web server needs to be configured to serve content from this directory such that the fileSITE_DIR/filewill be served as"http://yourhost" + SITE_URL + "/file"
Configure The Web Server
The web server should satisfy the following:
- The URL
http://YOURHOST/BASE_URLshould execute the scriptCGI_DIR/CGI_FILE. - The URL
http://YOURHOST/SITE_URL/fileshould serve the fileSITE_DIR/file
Install OnasysWeb
Un-tar the tarball in some temp area, cd to that
direcotory , then run
python setup.py install
--install-lib=LIB_DIR
--install-scripts=CGI_DIR
--install-data=SITE_DIR.
NOTE: Make sure that the first line in $CGI_DIR/onasysweb.bin
references the python interpreter on the machine where it will be
executed. The setup script tries to guess, but may be wrong in
certain environments.
Configure OnasysWeb
The only configuration required should be to set the environment
variables in CGI_DIR/onasysweb.cgi.
SITE- The full name of the site.
SHORT_SITE- Abbreviated name of the site.
BASE_URL- The path of the CGI script as it appears in the URL. This
is the same as the
BASE_URLdescribed in the web server configuration instructions.
SITE_DIR- Location in the filesystem of the web content.
This is the same as
SITE_DIRin the python setup instructions.
SITE_URL- The path of the web content as it appears in the URL.
MONITOR_DIR- Location of directory in the filesystem where the Onasys daemons keep their status files.
DOT- Location on the filesystem of the
dotprogram. If thedotprogram is not available, set toNoneor to anything that isn't an executable. It must be set, though.
LIB_DIR- Location of OnasysWeb python libraries. This is the same as
LIB_DIRas described above.
ONASYS_LIB- Location of Onasys python libraries. Specifically, where DAG.py is.
STDLIBCPP- Location of directory containing
stdlibc++.so
MYSQL_CLIENT_LIB- Location of directory containing MySQL client libraries.
Rename onasysweb.cgi to match what you would like to
appear in your site's URL.
Links
Sample Live Onasys Job Status
As of 5/9/2006, known OnasysWeb pages can be found at:
- LIGO Hanford online job status can be seen here.
- LIGO Livingston online job status can be seen here.
Contributors
Cannon, Kipp
Moe, Brian