Edge Services Framework Objectives and Scope Contact Information Introduction VirtualOrganizations/VOInfo Specific Edge Services ATLAS and CMS Requirements Dynamically Deployed Edge Services Technology Options LCG Interoperability Planning and Schedule Tracking ESF Testbeds Documents Logos, Miscellaneous Topics, Search

NOTE: Please look for major updates in content of ESF TWiki in near future. These may include a Service Readiness Plan, alongwith more information on ESF Deployment Model, ESF Usage Model, Globus Virtual Workspaces (VM), and related topics. ESF Activity in OSG is expected to be in fast gear again in future, as concrete usecases for the ESF technology become available. This is projected to happen in time with heavy-duty usage of OSG resources, and with commissioning of real-life needs of active VirtualOrganizations?/VOInfo's.
-- A. S. Rana & K. Keahey

Objectives and Scope

This is a web-based collaboration forum for Edge Services Framework design, development, and deployment. Effort is co-ordinated as an Activity within the Open Science Grid Consortium.

Contact Information

• OSG Activity Chairs: Kate Keahey (Globus/ANL) & Abhishek Singh Rana (CMS/UCSD)
• Email list (osg-edgeservices at opensciencegrid dot org)
• Archived listserv: http://listserv.fnal.gov/archives/osg-edgeservices.html

Introduction

VirtualOrganizations?/VOInfo specific Edge Services are necessary for the US LHC experiments in support of a baseline set of OSG services. In a recent document the Edge Services are identified as an OSG Activity where ATLAS and CMS are expected to provide effort.

VirtualOrganizations?/VOInfo Specific Edge Services

Going beyond many of the core middleware services in use, we envision a scenario in which resources will be partitioned into specific, VirtualOrganizations?/VOInfo-dedicated servers along side shared, open grid services used by many VOs in opportunistic fashion. A related issue is deployment of foreign VirtualOrganizations?/VOInfo-specific services on sites hosting common OSG infrastructure. This could be accomplished through scheduling of a gatekeeper-like resource via a grid job. OSG refers to such services as dynamically deployed Edge Services. LHC experiments strongly encourage OSG to develop a framework that allows for such services.

ATLAS and CMS Requirements

We attempt here to bring together requirements of the framework coming initially from ATLAS and CMS.

• ATLAS Requirements
• CMS Requirements?

Dynamically Deployed Edge Services

Resources today are often configured so that all resources within a site are available only via a private network (LAN). The site can be accessed across WAN through a limited number of public addresses. An external client can use these to communicate with specialized services acting on its behalf within the site�s private boundary. Such services are sometimes referred to as gateways or gatekeepers, e.g., Compute Element (CE), Storage Element (SE). Since these services expose their interfaces and execute at the edge of this public/private network boundary, we call them Edge Services or ES.

Each VirtualOrganizations?/VOInfo may want to use different software to implement any particular kind of an Edge Service, and each VirtualOrganizations?/VOInfo may put different requirements on Edge Services in terms of resource usage. Thus, we envision a scenario in which resources will be partitioned into specific, VirtualOrganizations?/VOInfo-dedicated Edge Services alongside shared, open grid services such as a regular CE (GRAM) and SE (SRM) used by many VOs.

At any rate, we expect both US ATLAS and US CMS will require partitioning of VirtualOrganizations?/VOInfo-dedicated CE and SE resources from shared, common OSG gateways until such services mature and become reliable.

Technology Options

This Activity explores designing, building and operating an Edge Services Framework (ESF) developed as a joint endeavor between EGEE, LCG, and OSG. One attractive possibility for the framework is based on virtual machine technology. In combination with Condor-C, this would allow us to isolate different VOs in different virtual machines on the same physical machine. We hope to use this to provide service guarantees on shared hardware resources at the site boundaries.

LCG Interoperability

To address similar requirements, LCG is rapidly developing a VirtualOrganizations?/VOInfo-box concept. Although it is not clear at this time what would be the technological choices made by LCG, an interoperability of LCG VirtualOrganizations?/VOInfo-boxes and OSG Edge Services Framework will provide benefits for the LHC experiments.

• VirtualOrganizations/VOInfo Box Meeting I
• VirtualOrganizations/VOInfo Box Meeting II
• Conclusions of VirtualOrganizations/VOInfo Box WG
• VirtualOrganizations/VOInfo Box How-To page

Planning and Schedule Tracking

• Status of testbeds
• Calendar of milestones

ESF Testbeds

Information about the ESF testbeds (Proposed: University of California at San Diego, University of Chicago, Piocon Inc, Fermi National Accelerator Laboratory, Argonne National Laboratory).

• Bootstrapping Testbed (UCSD) [Annulled. Information on its page may still be useful.]
• Stable Testbed (UCSD)
• FNAL Testbed (FNAL)
• Production OSG-Site ESF (DISUN site at SDSC/UCSD)
• DesktopXen (U Chicago)

Documents

• ESF Collaborators, Edge Services Framework, Poster presentation at IEEE Nuclear Science Symposium (NSS'06) and Medical Imaging Conference, San Diego, CA, Oct. 30 - Nov. 2, 2006.
• ESF Collaborators, An Edge Services Framework (ESF) for EGEE, LCG, and OSG, CHEP'06 Proceedings, Mumbai, India, Feb. 13-17, 2006.
• ESF Collaborators, An Edge Services Framework (ESF) for EGEE, LCG, and OSG, CHEP'06 Presentation, Mumbai, India, Feb. 13-17, 2006.
• ESF Collaborators, ESF, an OSG-kiosk panel display at FNAL/SLAC Booth, Supercomputing'05 (SC|05), Seattle, WA, Nov. 12-18, 2005.
• Kate Keahey and Abhishek Rana, Living on the Edge: OSG Edge Services Framework, presentation at ANL Booth and FNAL/SLAC Booth, Supercomputing'05 (SC|05), Seattle, WA, Nov. 12-18, 2005.
• Alexandre Vaniachine, Edge Services Framework for Computational Grids, a flyer for distribution at ANL Booth and FNAL/SLAC Booth, Supercomputing'05 (SC|05), Seattle, WA, Nov. 12-18, 2005.
• Abhishek Rana and Kate Keahey, Edge Services Framework, presentation at the Joint OSG and EGEE Operations Workshop, RAL, Abingdon, UK, Sep. 27-29, 2005.
• Frank Würthwein, Edge Services, presentation at the OSG Consortium Meeting, Milwaukee, WI, July 20-21, 2005.
• Kate Keahey et al., Edge Services Framework for OSG.

Logos, Miscellaneous Topics, Search

• Logo Draft - Small Image | Large Image | Theme
• Working with TWiki

More in WebSearch

Using Google

Major updates:

-- RobGardner - 08 Sep 2005

-- AbhishekSinghRana - 2005, 2006