Globus Job Managers
Jobmanagers can be set up using scripts located in globus-4.2.1/setup/globus. Ones which are available with the GT4.2.1 distribution or VDT include: fork, PBS, LSF, SGE, Condor... Many of the notes about this on the Web assume you have installed Globus GT2 which is slightly different, however they can offer a good starting point, e.g. http://www.cs.wisc.edu/condor/condor_globus.html or http://www.apgrid.org/globus-sge/gt4.html. Here we attempt to provide an initial repository for available jobmanagers, with local links to tarballs if possible.
The Globus GT4.2.1 installer tarball has the following make targets: globus_gram_job_manager_setup_fork, globus_gram_job_manager_setup_pbs, globus_gram_job_manager_setup_condor, globus_gram_job_manager_setup_lsf. These are in gt4.2.1-all-source-installer/source-trees/gram/jobmanager/setup.
The "official" way to install a jobmanager and associated gram reporter was documented on the Condor Web site. If you are installing something else, e.g. PBS, replace the condor string with that. Note $GLOBUS_LOCATION is /panfs/usr/local/globus-4.2.1 in our case.
- Make sure GLOBUS_LOCATION and/or GPT_LOCATION are set appropriately.
- Run the following command:
- $GLOBUS_LOCATION/setup/globus/setup-globus-gram-job-manager -type=condor
- Edit $GLOBUS_LOCATION/etc/grid-services/jobmanager-condor to add the parameters -condor-arch and -condor-os, which specify what ARCH/OPSYS to use. The results should look something like this (everything on a single line), except that you will change the pathnames to be correct for your system:
- stderr_log,local_cred - /scratch/globus/libexec/globus-job-manager globus-job-manager -conf /scratch/globus/etc/globus-job-manager.conf -type condor -rdn jobmanager-condor -machine-type unknown -condor-arch INTEL -condor-os LINUX
- Run the following command:
- $GLOBUS_LOCATION/setup/globus/setup-globus-gram-reporter -type=condor
In practice, this no longer works with GT4.2.1. Instead ensure that the appropriate GT4.2.1 tarball is unpacked in the correct location, e.g. gt4.2.1-all-source-installer/source-trees/gram/jobmanager/setup/condor then use one of the pre-ws makefile targets as follows.
export GLOBUS_LOCATION=/panfs/usr/local/globus-4.2.1 cd gt4.2.1-all-source-installer ./configure --prefix=/panfs/usr/local/globus-4.2.1 --with-flavor=gcc32dbg make globus_gram_job_manager_setup_condor make install
The tarballs listed below contain makefiles and a number of *.in files which are processed. One of these will be processed into the jobmanager script, for instance sge.in will become sge.pm. This can be done by hand by editing it to add in required definitions if necessary rather than doing the above. However the necessary configuration files and validation files will also need to be installed by hand.
Fork
PBS
LSF
Condor
Information from Condor Web site: http://www.cs.wisc.edu/condor/condor_globus.html
SGE
Information from Acia Pacific Grid Web site: http://www.apgrid.org/globus-sge/gt4.html. This jobmanager cannot be installed using the procedure above. Instead read the INSTALL file in the tarball. You can also try the following. Untar it into gt4.2.1-all-source-installer/source-trees/gram/jobmanager/setup/sge then do:
export GLOBUS_LOCATION=/panfs/usr/local/globus-4.2.1 cd gt4.2.1-all-source-installer ./configure --prefix=/panfs/usr/local/globus-4.2.1 --with-flavor=gcc32dbg /panfs/usr/local/globus-4.2.1/sbin/gpt-build -force -srcdir=source-trees/gram/jobmanager/setup/sge gcc32dbg make install
Some final configuration by hand will still be needed, and this will probably be before the "make install" step as certain definitions of the SGE configuration are required.
APIC 0.12 tarball for GT4
GridWiseTech GT-GE tarball contains v0.41 - need to complete license form before download.
LeSC 1.1 tarball for GT2
Custom
To create a custom jobmanager, e.g. for specific application requirements, copy one of the above and follow an installation procedure similar to that for SGE which is not directly supported in the GT4.2.1 distribution.