CloudEvents Java Benchmarks

Benchmarks of CloudEvents implementations for Java.

Usage

Requirements:

• JDK 8

Run make benchmark on Linux, MacOS, etc. On Windows gradlew --no-daemon jmh should work.

Benchmarks

CloudEvents SDK for Java

Official CloudEvents SDK for Java: https://github.com/cloudevents/sdk-java

JSON

CloudEvents 1.0 JSON spec.

• benchmarkSdkJsonDecodeEvent: Decode a single event
• benchmarkSdkJsonEncodeEvent: Encode a single event

ScalePlan CloudEvents for Java

SPCE CloudEvents for Java: https://github.com/scaleplandev/spce-java

JSON

CloudEvents 1.0 JSON spec.

• benchmarkSpceJsonDecodeEvent: Decode a single event
• benchmarkSpceJsonEncodeEvent: Encode a single event
• benchmarkSpceJsonDecodeEventBundle10: Decode a bundle of 10 events
• benchmarkSpceJsonEncodeEventBundle10: Encode a bundle of 10 events

Avro

Using CloudEvents 1.0 Avro schema at https://github.com/cloudevents/spec/blob/v1.0/spec.avsc

• benchmarkAvroDecodeEvent: Decode a single event
• benchmarkAvroEncodeEvent: Encode a single event

Avro SPCE

Using SPCE 1.0 Avro schema at: https://github.com/scaleplandev/spce-java/blob/master/etc/cloudevents_spce_spec.avsc

• benchmarkAvroSpceDecodeEvent: Decode a single event
• benchmarkAvroSpceEncodeEvent: Encode a single event
• benchmarkAvroSpceDecodeEventBundle10: Decode a bundle of 10 events
• benchmarkAvroSpceEncodeEventBundle10: Encode a bundle of 10 events

Sample Result

Below is a result from a typical run on my system. The exact numbers may be different on your system, but the overall picture should be the same.

Benchmark                                                  Mode  Cnt    Score    Error   Units
EventCodecBenchmark.benchmarkAvroDecodeEvent              thrpt   10  253.527 ±  8.203  ops/ms
EventCodecBenchmark.benchmarkAvroEncodeEvent              thrpt   10  269.207 ±  9.189  ops/ms
EventCodecBenchmark.benchmarkAvroSpceDecodeEvent          thrpt   10  461.694 ± 16.964  ops/ms
EventCodecBenchmark.benchmarkAvroSpceDecodeEventBundle10  thrpt   10   39.816 ±  7.879  ops/ms
EventCodecBenchmark.benchmarkAvroSpceEncodeEvent          thrpt   10  408.037 ± 17.207  ops/ms
EventCodecBenchmark.benchmarkAvroSpceEncodeEventBundle10  thrpt   10   40.102 ±  3.235  ops/ms
EventCodecBenchmark.benchmarkSdkJsonDecodeEvent           thrpt   10  268.276 ± 16.190  ops/ms
EventCodecBenchmark.benchmarkSdkJsonEncodeEvent           thrpt   10  319.856 ± 12.765  ops/ms
EventCodecBenchmark.benchmarkSpceJsonDecodeEvent          thrpt   10  519.292 ± 19.978  ops/ms
EventCodecBenchmark.benchmarkSpceJsonDecodeEventBundle10  thrpt   10   50.152 ± 10.112  ops/ms
EventCodecBenchmark.benchmarkSpceJsonEncodeEvent          thrpt   10  942.562 ± 16.331  ops/ms
EventCodecBenchmark.benchmarkSpceJsonEncodeEventBundle10  thrpt   10   98.450 ±  5.817  ops/ms

License

(c) 2020 Scale Plan Yazılım A.Ş. https://scaleplan.io

Licensed under Apache 2.0. See the LICENSE.

Copyright 2020 Scale Plan Yazılım A.Ş.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.