Skip to content

Latest commit

 

History

History
58 lines (34 loc) · 3.46 KB

README.md

File metadata and controls

58 lines (34 loc) · 3.46 KB

awesome-clusterscheduler

This repository contains a curated list of freely downloadable or open source software, services, and recipes compatible with Open Cluster Scheduler and Gridware Cluster Scheduler.

The main compatibility layer is the continued support of "SGE" ("Sun Grid Engine") interfaces. This includes command-line calls (like qsub, qstat, etc.), DRMAA-compatible job submission libraries (for Python, Java, Go, C), JSV interfaces, and more.

If any "SGE" integration isn't working as expected, please let us know. We're committed to ensuring compatibility with existing software packages.

Life Science

  • Nextflow - A DSL for data-driven computational pipelines.
  • Cromwell - Scientific workflow engine designed for simplicity & scalability. Trivially transition between one off use cases to massive scale production environments. The integration is here
  • XNAT - XNAT is an open source imaging informatics platform.

Automation

Programming

Go

  • Go DRMAA - Simple job submission library for Go. A wrapper around the libdrmaa.so job submission library compatible to many HPC workload managers
  • go-clusterscheduler - Official command line wrapper for OCS / GCS simplifying cluster configuration and control from Go applications.
  • Go JSV - Implements the Job Submission Verifier Protocol (JSV) to write applications which makes changes to qsub parameters on the server side.

Java

  • Java DRMAA - Simple job submission library for Java. A wrapper around the libdrmaa.so job submission library compatible with OCS/GCS.

Julia

The Julia language supports "SGE" since its first version.

MPI Libraries (any MPI lib can be integrated using hostfile and tight integration wrappers)

  • Intel MPI - Check the "Grid Engine" part (which is compatible) here
  • Open MPI - Check “Launching with Grid Engine” mentioned here

Python

  • PyGridtools - Job submission library based on the libdrmaa.so.
  • Dask - Deploy Dask on job schedulers.
  • Python DRMAA - Simple job submission library for Python.

REST API

  • REST API EPAM REST API for Grid Engine.

R

  • rtemis rtemis is a platform for advanced machine learning and visualization in R. Check the integration here