Gratia Development and Test Environment

Description

The document describes the development and test environment for the Gratia accounting services.

Machine allocation and usage is described on the Fermigrid Systems and Services pages.

Software

In order to insure consistency in the development environment across multiple real/xen nodes, the software packages that are required by Gratia have been stored in the gratia user's $HOME directory which is shared file file system.

  • /home/gratia/tomcat-tarballs: Tomcat tarballs. The latest version is automatically picked up by the install-release script.
  • mysql-gui-tools may be installed on RHEL5-based systems under /opt as downloaded from the mysql.com site.
  • JRE / JDK and mysql client should be installed from the base distribution.

Daily Builds

Daily builds take place from HEAD, and the mechanism for same is described on the Gratia Daily Builds page. The locations of the build host, collector and database nodes are described on the FermiGrid machine allocation and usage page.

Logs from the daily build may always be found under ~gratia/gratia-builds, along with the builds themselves.

Daily installs and upgrades

Developers' integration instances are installed from a cron entry on the nightly build host using the daily builds described in the previous section.

This allows developers to test committed changes on a regular basis.

The daily upgrade is performed using the install-nightly-builds script, as found in gratia/build-scripts.

Refer to the Gratia upgrade script (gratia-upgrade.sh) documentation for details on location of log files. An email notification is sent upon completion (successful or failed).

###################################################################
#----------------------------------
# Daily upgrade of integration collectors
#
25 0 * * * /home/gratia/cron-scripts/install-nightly-builds
###################################################################

Installing your own collector.

The main flexible, does-everything-you-might-want-and-more script is the Gratia upgrade script (gratia-upgrade.sh).

However, gratia/build-scripts contains a simpler wrapper, install-release. It handles installs on production, development and integration servers of official nightly builds, official releases or local builds; see the link for usage information.

Test Site Grid

In order to provide a predictable and controlled test environment, a test grid site has been established. It will contain all the necessary components of an OSG grid site:

  • The VOMS service has been populated with several VOs. If you are a member of the Gratia development team, you should have administrative privileges to view any data.

  • The GUMS service uses the OSG gums.config template at this time. So it contains all OSG VOs and memberships as defined by the OSG GOC. At some point, it will be changed to use a gums.config file using the gratiax34 VOMS service.

  • Several Compute Elements (CE) nodes running the various job batch queue managers (condor and pbs at this time). The authorization modes for these CE's can be established to use all three of the OSG modes: grid3, compatibility and full privilege. All will derive their membership lists for authorizations from the Gratia VOMS and GUMS servers mentioned above.

  • at least one Worker Node (WN) with glExec.

The definitive description of the location of these services may be found on John Weigand's machine usage page.

VOMS Test Data


The table below shows the VOs, Groups and Roles that have been created for Gratia testing. The DNs shown below are members where of every group/role where designated by All in the Members column:

  • /DC=org/DC=doegrids/OU=People/CN=John Weigand 458491
  • /DC=gov/DC=fnal/O=Fermilab/OU=People/CN=Margherita Vittone Wiersma/UID=vittone
  • /DC=org/DC=doegrids/OU=People/CN=Christopher H. Green (DES) 572851
  • /DC=org/DC=doegrids/OU=People/CN=Christopher H. Green 851859
  • /DC=org/DC=doegrids/OU=People/CN=Christopher H. Green (GADU) 478276
  • /DC=org/DC=doegrids/OU=People/CN=Christopher H. Green (OSG) 826295
  • /DC=org/DC=doegrids/OU=People/CN=Christopher H. Green (SDSS) 519040
  • /DC=gov/DC=fnal/O=Fermilab/OU=People/CN=Philippe G. Canal/UID=pcanal
  • /DC=org/DC=doegrids/OU=People/CN=Penelope Constanta 136958
  • /DC=gov/DC=fnal/O=Fermilab/OU=People/CN=Penelope Constanta/UID=penelope
  • /DC=gov/DC=fnal/O=Fermilab/OU=People/CN=Jeffrey E. Mack/UID=jeffmack
  • /DC=gov/DC=fnal/O=Fermilab/OU=People/CN=John Urish/UID=urish
  • /DC=org/DC=doegrids/OU=People/CN=John Urish 288784

VO Groups Roles Members
gratia-vo1 /gratia-vo1   All
  /gratia-vo1/group-1   All
  /gratia-vo1/group-1/group-1-1 role-1 All
  /gratia-vo1/group-1/group-1-1 role-2 All
  /gratia-vo1/group-2 role-2 All
  /gratia-vo1/group-2/gratia-admin   All
  /gratia-vo1/group-empty   No members
gratia-vo2 /gratia-vo2   All
  /gratia-vo2/group-1   All
  /gratia-vo2/group-1/group-1-1 role-1 All
  /gratia-vo2/group-1/group-1-1 role-2 All
  /gratia-vo2/group-2 role-2 All
  /gratia-vo2/group-2/gratia-admin   All
  /gratia-vo2/group-empty   No members
gratia-empty /gratia-vo2   No members
  /gratia-vo2/group-1   No members
  /gratia-vo2/group-1/group-1-1 role-1 No members
  /gratia-vo2/group-1/group-1-1 role-2 No members
  /gratia-vo2/group-2 role-2 No members
  /gratia-vo2group-2/gratia-admin   No members
  /gratia-vo2/group-empty   No members

Major updates:
-- JohnWeigand - 29 Jun 2007
-- ChrisGreen - 27 Oct 2009
-- ChrisGreen - 27 Jul 2010

Topic revision: r27 - 27 Jul 2010 - 16:12:15 - ChrisGreen
Hello, TWikiGuest
Register

 
TWIKI.NET

TWiki | Report Bugs | Privacy Policy

This site is powered by the TWiki collaboration platformCopyright by the contributing authors. All material on this collaboration platform is the property of the contributing authors..