This is release 3.2.0 of Xenon.
- improved the behavior of the AT adaptor.
- switched to github actions for CI
- switched from jcenter/bintray to Maven Central for distribution of jar files
- improved error state returned by getJobStatusses to show the difference between no job and connection loss.
- added support for slurm 19
- added heartbeat in the SSH adaptor quickly detect lost connections.
- moved to version 2.4.0 of SSHD
- fixed bug in FTP adaptor when listing the root directory
- fixed bug in SFTP adaptor when listing the root directory
- fixed the FTP adaptor which lost bytes due to being in ASCII mode
- fixed the numbering in this changelog
- updated jaxb dependencies to prevent illegal access warning from JVM
- removed leftover debug print in webdav
- fixed minute delay on shutdown when SSH adaptor was used (discussed as part of #654).
- Moved adaptors with large dependencies (such as S3 and HDFS) into separate libraries, resulting in a much smaller "core" distribution.
- Changed JobDescription to a tasks+cores model, instead of nodes+processes+thread (#625).
- Remove the JOB_OPTIONS hack from JobDescription (#629 and #628)
- Added support for memory requirements and job name in JobDescription (#562 and #609)
- Added an adaptor for the at scheduler (#381)
- Dropped offline support (#649)
- Require Java 11 or greater (#647)
- Many smaller bugfixes and updates of dependencies.
- added support for temp space in JobDescription.
- added support stdout, stderr and stdin to Torque.
- fixed several unit tests that failed on OSX
- fixed hashCode and equals of JobDescription
- added support for scheduler specific arguments to JobDescription
- fixed specification of runtime limit in gridengine adaptor
- added equals to KeytabCredential (#615)
- added getSupportedCrenentials to AdaptorDescription (#595)
- clarified description of JobState.getState (#596)
- fixed JobDescription equals, hashCode and toString (#612)
- fixed slurm adaptors status retrieval of finished jobs (#613)
- fixed slurm adaptors parsing of scontrol output on pre 17 slurm versions
- added name to job description and job status (#609)
- added max memory to job description (#562)
- added threads per process to job description
- added an HDFS filesystem adaptor
- fixed bug in GridEngineSchedulers for complex configurations of number of slots per node
- various code cleanups, etc.
- extended CredentialMap to retrieve all keys
- removed logback config from jar
- fixed bug in handling workdir of Local and TorqueSchedulers
- many small bugfixes, additional tests, etc.
- added getCredential to Scheduler and FileSystem
- fixed a bug in equals of CredentialMap
- added proper check of supported credential types in adaptors
- many small bugfixes, additional tests, etc.
- complete overhaul of public API, which should increase ease-of-use significantly.
- complete overhaul of integration test framework, which should improve performance and make it easier to test against different versions of the same middleware.
- complete overhaul of implementation, which should make implementing adaptors much more straightforward.
- replaced Jsch with Apache SSHD in the SSH and SFTP adaptors
- replaced Apache Jackrabbit with Sardine in the Webdav adaptor.
- added an S3 filesystem adaptor.
- fixed various issues flagged by sonarqube
- fixed bug in the copy engine that would ignore a copy if source and destination had exactly the same path (even when on different machines).
- added timeout overflow detection in Jobs.waitUntilDone and Jobs.waitUntilRunning.
- added SonarQube code for quality analysis and coverage
- we have a new logo!
- fixed nasty inconsistency in adaptor implementations of waiting for jobs to start or finish.
- added support for WebDAV file access.
- added OSX testing in Travis
- added support for Slurm version 15.08.6
- fixed several bugs related to Windows local file system semantics
- many small bugfixes, additional tests, etc.
- added support for FTP file access.
- added support for Torque resource manager.
- added support for Slurm versions 2.6.0, 14.03.0 and 14.11.9-Bull.1.0.
- added option to specify resources in sge adaptor.
- added support for SSH agent and agent proxies
- added a -lot- of unit and integration tests
- javadoc is java 8 compliant.
- the adaptor documentation is now part of the javadoc.
- Xenon releases are now available in jCenter.
- switched from and ant to gradle based build system, this is reflected in the directory structure
- split unit and integration tests
- added docker support for integration tests
- now using travis-ci for continous integration
- now using PMD and codacy for code quality
- now using codecov for unit and integration test coverage
- moved examples and tutorial to a separate repository https://github.com/NLeSC/Xenon-examples
The GridFTP adaptor is not considered stable yet. It is not part of this release.
There is no adaptor writing documentation at the moment, nor is the Javadoc complete for the internals methods of the adaptor implementations.
It should be made easier to inspect at runtime which adaptors are available and what properties they support.
We can always use more adaptors, e.g, for SWIFT, HDFS, YARN, Azure-Batch, etc. These are planned for 2.1.0 or later.
We can always use more interfaces, e.g. for clouds (to start and stop VMs). This is planned for 3.0.0.