Login | Register
Login | Register

My pages Projects SunSource.net openCollabNet

Grid Engine 6.2 and SDM 1.0u1 Courtesy Binaries now Available for Download

Regensburg, Germany -- September 23, 2008

After releaseing the Sun Grid Engine 6.2 software by Sun Microsystems on August 5, 2008, the open source Grid Engine 6.2 and SDM 1.0u1 courtesy binaries are now available for download.

Grid Engine 6.2, which has undergone significant changes in qmaster to significantly improve its scalability in challenging environments, adds powerful features to the core system, introduces multi cluster support for the Accounting and Reporting Console (ARCo) and comes with a new module extending the scope of Grid Engine to a new domain of use cases: the Service Domain Manager (SDM), aka. project Hedeby allows to dynamically (re-)assign computational resources on demand.

The courtesy binaries are available at

The courtesy binary distribution is now hosted on Sun Microsystems servers on Sun Download Center (SDLC).

The corresponding source code tag in the CVS repository has the name
         V62_TAG (Grid Engine and ARCo) and V10_U1_TAG (Service Domain Manager)

A snapshot of the sources is available at the Documents & Files page
        arco-V62_TAG-src.tar.gz
        ge-V62_TAG-src.tar.gz
        sdm-V10_U1_TAG-src.tar.gz

The documentation and release notes are available at
        http://wikis.sun.com/display/GridEngine
       
A list of fixed problems since SGE 6.2 beta2 is available at
        http://gridengine.sunsource.net/project/gridengine/62patches.txt
       

What's new in Grid Engine 6.2

  1. Service Domain Manager
  2. New in Grid Engine "core" and Accounting and Reporting Console (ARCo)

Service Domain Manager

This release adds a new module, extending the scope of Grid Engine to a new domain of use cases: The Service Domain Manager (SDM), aka. project Hedeby will allow to dynamically (re-)assign computational resources on demand through configurable SLOs (Service Level Objectives), measured by KPIs (Key Performance Indicators) of the managed resources. Through adapters it will be possible to add virtually any type of service, be it for example a Grid Engine cluster, an application server farm, other types of Grid middle ware applications. Manageable resources can be e.g. physical or virtual hosts, software licenses.

This release of SDM will support to manage two or more Grid Engine clusters. Futures releases will add more adapters, add support for GreenIT (manage spare pools of resources). An integration with Sun's virtualization stacks is planned.

We welcome the active evaluation, feedback and contribution of our community to this project. See http://hedeby.sunsource.net for more information and mailing lists for discussion.

New in Grid Engine "core" and Accounting and Reporting console (ARCo)

  • Scalability improvements - scale up to 63000 cores
    • improved qmaster-execd protocol
    • scheduler running as a thread in qmaster (faster communication between qmaster and scheduler threads) 
    • improved resource matching in scheduler
    • faster qmaster startup
    • reduced memory requirements in big clusters
  • Advance Reservation (AR)
    • specified resources (e.g. machines, licenses) will be available for a guaranteed time window for specified users or user groups
  • New implementation of Interactive Job Support (IJS)
    • IJS is now natively implemented. No more need for external commands (rlogin, telnet, ssh)
  • Array Job Interdependencies
    • start task N of successor array job once predecessor array job task N has completed. Flexible definition of interdependencies possible
  • Multi cluster support for Accounting and Reporting Console (ARCo)
    • collect data of multiple Grid Engine clusters in a single (physical) database
    • do queries and get reports from single Web GUI from multiple ARCO databases
  • ARCo scalability improvements
    • improved dbwriter (component which writes Grid Engine reporting data into the database) speed
    • improved speed of queries
  • Improved ARCo installation experience
    • the documentation on ARCo installation has been significantly improved
  • Java Virtual Machine running as a thread in qmaster
    • A JVM thread providing a JMX server allows to contact qmaster natively from Java applications (the API is not yet officially supported). The SDM uses the new JMX interface. 
  •  Support for Solaris 10 startup scripts (SMF - Solaris Management Facility)
  • Support for Sun Service Tags - inventory management through Sun Connected Services