OSG Accounting Services - Gratia - Probe Installation

Preliminary notes

IMPORTANT NOTE! If you have been notified that your site is not reporting correctly in some way, please see these troubleshooting instructions.

  1. Select the probe(s) you wish to install from the table of available probes.
    Note: In general, the RPMs are non-architecture-specific. However, the PBS/LSF probe RPM is a binary package built for a 32-bit i386 architecture. This is also true of the VDT distribution. If your platform is different, you will need to install the source RPM and follow the instructions for building it under the Details column in the table below.

  2. People with VDT or OSG installations are advised to install using Pacman for those releases that provide their required probe (see the below); if a probe you require is not available for your version or you require the latest version, please install from RPM.

  3. For all probe installations via Pacman or RPM, please read the appropriate detailed configuration notes ("Details" column in the probe table). At a minimum, please ensure correct values for MeterName, SiteName, CollecorHost and EnableProbe (if present).

  4. Important: If, previously, you had installed the probe(s) by RPM at sites where they were not yet available via OSG/VDT and are now upgrading to an OSG/VDT version that contains the probe(s), you must remove the RPM installed probe(s). In addition, you should check your root crontab entry and remove the cron entry before upgrading. The OSG/VDT installation will create a new cron entry for the probe.

  5. For Pacman installs, use the standard Pacman command to install the probes you require, for instance:

    pacman -get Gratia-Condor-Probe


    • Please see the installation notes for the condor probe if you install it as it requires versions of VDT prior to 1.5.1 to be patched for operation with versions of Condor prior to v6.9.0.
    • The Gratia-Probe-Common package will be pulled in as a dependency for all probes, so explicit installation is not required.

Probe availability

Probe RPM VDT package name Available since Notes Details
ALL gratia-probe-common-1.08.00a-1 Gratia-Probe-Common0. Common infrastructure, needed by all probes.
Condor gratia-probe-condor-1.08.00a-1 Gratia-Condor-Probe 0.4.1 1.3.10 Condor probe (install on CE)1 Condor probe configuration notes
GlideinWMS probe configuration notes
gratia-probe-condor-itb-1.08.00a-1 Condor probe (install on ITB CE)2


Gratia-PBS-Probe 0.6.0 1.6.0 PBS probe (install on CE)1 PBS/LSF probe configuration notes


PBS probe (install on ITB CE)2


Gratia-LSF-Probe 0.6.0 1.6.0 LSF probe (install on CE)1


LSF probe (install on ITB CE)2
SGE gratia-probe-sge-1.08.00a-1 Gratia-SGE-Probe 0.6.0 1.6.1a SGE probe (install on CE)1 SGE probe configuration notes
gratia-probe-sge-itb-1.08.00a-1 SGE probe (install on ITB CE)2
gLexec gratia-probe-glexec-1.08.00a-1 Gratia-Glexec-Probe 0.8.0 1.7.1 gLexec probe (install on worker nodes)1 gLexec probe configuration notes
gratia-probe-glexec-itb-1.08.00a-1 gLexec probe (install on ITB worker nodes)2
ps-accounting gratia-probe-psacct-1.08.00a-1 - - - If installed, install on CE and all worker nodes3. PS-accounting probe configuration notes
metric gratia-probe-metric-1.08.00a-1 Gratia-Metric-Probe 0.8.0 1.7.1b Metric probe (install on worker nodes)1 Metric probe configuration notes
gratia-probe-metric-itb-1.08.00a-1 Metric probe (install on ITB worker nodes)2
gridftp-transfer gratia-probe-gridftp-transfer-1.08.00a-1 - - - GridFTP transfer probe (install on Bestman master)
gratia-probe-gridftp-transfer-itb-1.08.00a-1 GridFTP transfer probe (install on ITB Bestman master)
SOURCE gratia-probe-1.08.00a-1 - - - Source RPM. Detailed notes for SRPM

Installation from RPM

  • If you install any probe at all, you will need the gratia-probe-common RPM listed below; this contains common infrastructure required by all probes.

  • The Gratia Condor currently requires that $VDT_LOCATION/gratia/var/data points to the same directory as the directory mentioned in the DataFolder variable of the Gratia Condor probe's ProbeConfig file.

  • Depending on your batch system, you should install the appropriate Condor or PBS/LSF probe on your CE. If you are running both batch systems, you should install both probes.

  • Read the configuration notes for each probe you install.

  • If you require the extra granularity of process accounting (unlikely except in rare circumstances), you should install the ps-accounting probe on the CE and every worker node. This is a re-incarnation of a legacy FNAL admin utility and as such is only likely to be of use to FNAL admins.

  • Note that the gratia-probe-common RPM contains example probes, samplemeter.{py,pl}. If you wish to write or customize your own probe, please take a look at the general configuration notes. For specific probes, see the appropriate notes for that probe as listed in the table below.

  • Install the appropriate RPMS. Note that the main install prefix may be changed with this addition to the rpm command line: --relocate /opt/vdt/gratia=/desired/path. It is recommended to use, for example:

    • Condor:
      rpm -Uvh --relocate /opt/vdt/gratia=$VDT_LOCATION/gratia \
      http://gratia.fnal.gov/Files/probe/RPMS/gratia-probe-common-%ProbeVersion%.noarch.rpm \

    • PBS/LSF:
      rpm -Uvh --relocate /opt/vdt/gratia=$VDT_LOCATION/gratia \
      http://gratia.fnal.gov/Files/probe/RPMS/gratia-probe-common-%ProbeVersion%.noarch.rpm \

  1. The default configuration files are configured to send data to the official OSG Gratia server
  2. The default configuration files are configured to send data to the OSG Gratia ITB server
  3. This probe uses the Linux processing accounting facility and reporting is daily. The default configuration files are configured to send data to the OSG Gratia psacct server. Note that unlike the other probes, the psacct probe must be installed on every worker node.

-- ChrisGreen - 16 Oct 2007 - Updated to 0.27.5c for release to VDT.

-- ChrisGreen - 11 Sep 2007 - Updated to 0.27.3 for release to VDT.

-- ChrisGreen - 14 Jun 2007 - 0.24 synced with (still) imminent services release.

-- ChrisGreen - 13 Jun 2007 - 0.23 synced with imminent services release.

-- ChrisGreen - 08 Jun 2007 - Added gLexec section.

-- ChrisGreen - 18 May 2007 - New version renders patch text obsolete.

-- JohnWeigand - 16 Mar 2007 - Added 0.12i_patch rpms for LSF and PBS probes for the changes to pbs-lsf_meter.cron.sh to resolve the lock file problems

-- ChrisGreen - 22 Feb 2007

-- PenelopeConstanta - 30 Aug 2006

Topic revision: r120 - 04 Aug 2011 - 19:40:13 - PhilippeCanal
Hello, TWikiGuest


TWiki | Report Bugs | Privacy Policy

This site is powered by the TWiki collaboration platformCopyright by the contributing authors. All material on this collaboration platform is the property of the contributing authors..