Storage Element Admins
This page contains how-to guides and other necessary information for setting up a Storage Element (SE) or testing a Storage Element Implementation.
For information about CE-Storages ($DATA, ...) and their configuration, please refer to Local Storage Configuration
Is this page needed? Maybe just for the gridftp-based thing and maybe srm-tester? The other setups are just links.
How to Setup SE based on Gridftp-based File System
The easiest way to install a Gridftp server with all the required certificates is using VDT (or even the whole OSG package). There is no special requirement about the directory: it has to be a valid path for the Gridftp server and have the protections set to provide the desired access to Grid users. Sometime sticky (only the creator of a file can remove it) or setgroup (group is maintained in subdirectories) ids may be useful.
Making a Gridftp-based File System that is also a CE-Storage (like OSG_DATA) involves creating a data directory and mounting it on all worker nodes so the storage is accessible to applications running on that site via some environment variables. The SE (host, port, path) has then to point to the same data directory.
To make a concrete example let's say that you have:
- a host where you have a disk space that you want to use as SE and a Gridftp server installed using VDT (this host may be the gatekeeper or a separate host):
- the directory on
ftpserver.domain that you want to use as SE is
- on the worker nodes you want to have it visible as
Then you have to set accordingly these values in configure-osg:
And you have to:
- create the directory in
ftpserver.domain, make it worls writable with sticky flag set
ftpserver.domain to export the directory, e.g. using NFS
- configure all workernodes and the gatekeeper (or wherever you run your fork jobs) to mount that directory as
E.g. To obtain the configuration above you can ececute these commands on
mkdir -p /storage/root/dir
chmod a+rwx /storage/root/dir
chmod o+t /storage/root/dir
you'll have a line like (the IPs depend on your subnet):
If you have NFS static mounts (the alternative is to use automount), in
of the gatekeeper and all workernodes you'll have an entry like:
ftpserver:/storage/root/dir /share/osgdata nfs bg,intr,noatime
Example is very specific
How to Setup SE based on SRM/dCache
SRM/dCache Installation and Configuration using the VDT-dCache package
How to Setup SE based on BeSTMAN??!
Need a link here
How to Setup Generic Information Provider (GIP)
To configure this component, see the
Generic Information Providers
document in this guide.
See Configure "CE Storage"
SRM-TESTER is available to test SRM based storage sites as well as popular file transfer protocol such as gsiftp, http or ftp, based storage sites. SRM-TESTER is available as a stand-alone tester. SRM-TESTER can be installed through VDT pacman, or downloadable from http://sdm.lbl.gov/srm-dist
The SRM Client Tools are an optional module in the OSG Cache. They are supported by the SRM-dCACHE team: firstname.lastname@example.org.
DON'T NEED HERE
- GlueOSG? - Glue Schema description
- 17 Oct 2007
Reviewer - date: RobGardner
- 08 Nov 2007
Comment: Update?Delete? RobGardner