Alpakka Kafka 2.0.5

Release notes in the Alpakka Kafka documentation

Changes

• Generate version information when publishing artifacts #1188 by @marcospereira

Alpakka Kafka core

• RestrictedConsumer: correct deprecation since version #1197 by @ennru
• Allow typed Actor Systems in SendProducer and DiscoverySupport #1192 by @ennru
• Deprecate RestrictedConsumer.committed(TopicPartition) #1178 by @seglo
• Cleanup build warnings #1177 by @seglo
• Order logging params for RetriableException consumer failures #1168 by @seglo

Tests

• Reduce bloat of log when testsuite log reported in failed travis build #1182 by @seglo
• Simplify consuming stream for AssignmentSpec "consume from the specified topic pattern" test #1181 by @seglo
• Cleanup testcontainers docs snippets #1180 by @seglo
• Cleanup build warnings #1177 by @seglo

Alpakka Kafka Testkit

• Cleanup build warnings #1177 by @seglo

Documentation

• 2.0.5 Release notes #1199 by @ennru
• Run & materialize stream in Akka Cluster Sharding Example #1190 by @seglo
• docs: update Akka version #1198 by @ennru

Updates

• scalapb-runtime 0.10.8 (was 0.10.7) #1171 by @scala-steward
• metrics-core 4.1.12.1 (was 4.1.11) #1194 by @scala-steward
• sbt-java-formatter 0.6.0 (was 0.5.1) #1193 by @scala-steward
• jackson-databind 2.10.5 (was 2.10.4) #1169 by @scala-steward
• metrics-core 4.1.11 (was 4.1.10.1) #1172 by @scala-steward
• mockito-core 3.4.6 (was 2.28.2) #1173 by @scala-steward
• sbt-scalafmt 2.4.2 (was 2.4.0) #1174 by @scala-steward
• Update paradox akka to 0.35, new links to LB.com #1167 by @johanandren

Alpakka Kafka 2.0.4

Release notes in the Alpakka Kafka documentation

Alpakka Kafka core

• Emit offset batches on timer #1160 by @jyates
• Do not commit offsets for unassigned partitions #1123 by @jyates

Alpakka Kafka Akka Cluster Sharding

• Use bulk update API for shard allocation #1139 by @chbatey
• Don't use ctx.log in KafkaClusterSharding #1138 by @chbatey

Alpakka Kafka Testkit

• Deprecate embedded kafka support #1136 by @seglo
• Replace embedded kafka with schema registry with testcontainers #1135 by @seglo
• Add produce consume check to KafkaContainerCluster #1131 by @seglo

Updates

• mockito-core 2.28.2 (was 2.24.5) #1151 by @scala-steward
• scala-collection-compat 2.1.6 (was 2.1.2) #1152 by @scala-steward
• jul-to-slf4j, log4j-over-slf4j 1.7.30 (was 1.7.26) #1155 by @scala-steward
• embedded-kafka 2.4.1.1 (was 2.4.1) #1147 by @scala-steward
• protobuf-java 3.12.2 (was 3.11.4) #1142 by @scala-steward
• sbt 1.3.13 (was 1.3.9) #1153 by @scala-steward
• akka-stream-alpakka-csv 2.0.1 (was 2.0.0) #1143 by @scala-steward

Alpakka Kafka 2.0.3

Release notes in the Alpakka Kafka documentation

Alpakka Kafka core

• Committing: retry commits marked as retriable #1111 by @ennru
• Build: Jackson 2.10.4 and sbt plugin updates #1112 by @ennru
• Security: mask passwords in settings' toString #1110 by @ennru
• Commit when next offset is observed #1093 by @seglo
• Non-streaming producer wrapper #1085 by @ennru
• Simplify commit replying #1095 by @ennru
• DrainingControl: creation in toMat #1084 by @ennru
• Simpler use with the new actors API #1088 by @ennru
• Cluster-sharding: single listener per entity type key + Java DSL #1080 by @chbatey
• Drain partial offset commit batches on upstream failure #1058 by @sdudzin
• Kafka cluster sharding support with external sharding allocation #1067 by @seglo
• Add MetadataClient getCommittedOffsets #1073 by @epalace

Alpakka Kafka 2.0.2

Release notes in the Alpakka Kafka documentation

Alpakka Kafka core

• CommittingProducerSink: outstanding commits on multi-msg #1041 by @gabrielreid
• CommittingProducerSink: Fix count on failure #1043 by @gabrielreid
• Don't close shared Producer on fail #1046 by @gabrielreid
• Java API createCommittableOffsetBatch accepts Committable #1033 by @jewertow
• Discard of external offsets on rebalance #1037 by @gabrielreid
• Fix logging an error with cause #1035 by @Sebruck
• Fix slow-loading offsets during rebalance #1029 by @gabrielreid

Alpakka Kafka Testkit

• Upgrade to CP 5.4.0 #1034 by @seglo

Alpakka Kafka 2.0.1

Release notes in the Alpakka Kafka documentation

Alpakka Kafka core

• Producer: avoid race between failure and upstream finish #1025 by @ennru
• CommittableProducer: Record outstanding commits on pass-through #1022 by @gabrielreid

Changes

• sbt 1.3.7 #1024 by @ennru

Alpakka Kafka 2.0.0

Release notes in the Alpakka Kafka documentation

Teskit

• Embedded Kafka 2.4.0 #1018 by @seglo

Benchmarks

• Record inflight metrics during benchmarks #1014 by @seglo

Documentation

• Release notes 2.0.0 #1019 by @ennru

Build

• sbt 1.3.5 #926 by @ennru
• Build: use improved code style plugins #1013 by @ennru

Alpakka Kafka 2.0.0-RC1

Release notes in the Alpakka Kafka documentation

Changes

Alpakka Kafka core

• CommittingSpec: add logging #1007 by @ennru
• Rebalance: filter messages of revoked partitions (partitioned) #992 by @seglo
• Stage ID traceability #995 by @seglo

Tests

• CommittingSpec: add logging #1007 by @ennru
• Rebalance: filter messages of revoked partitions (partitioned) #992 by @seglo
• Stage ID traceability #995 by @seglo

Alpakka Kafka Testkit

• Kafka 2.4.0 final #1005 by @ennru
• Build: fail for unformatted Java sources #1003 by @ennru
• Rebalance: filter messages of revoked partitions (partitioned) #992 by @seglo

Documentation

• Alpakka Kafka 2.0.0-RC1 release notes #1010 by @seglo
• Kafka 2.4.0 final #1005 by @ennru
• Fix failing apidoc links #1008 by @ennru
• Docs: use apidoc for most classes #1002 by @ennru

Alpakka Kafka 2.0.0-M2

Release notes in the Alpakka Kafka documentation

Note: the Alpakka Kafka 2.0.0-M1 release process failed

Alpakka Kafka core

• Temporary fix for #978: avoid ConcatIterator #997 by @ennru
• Deprecations: since version 2.0.0 #996 by @ennru
• ConsumerSetting: Add group instance id setter #861 by @def1ne
• PartitionAssignmentHandler: add onLost #986 by @ennru
• Add partitioned transactional source phase 1 #930 by @seglo
• Stage Logic and Actor logging with ID #991 by @seglo
• Committing producer sink: producer and committer in a sink stage #963 by @ennru
• Add wrapper for Metadata requests #497 #900 by @jewertow
• Kafka 2.4.0-RC1 #971 by @seglo
• Commit refreshing: fix bug from aggregating offsets #975 by @ennru
• Producer: remove unreleased variants; simplify producer passing #967 by @ennru
• Committable: deprecate commitJavadsl and commitScaladsl #959 by @ennru
• Producer: some concurrency and naming improvements #962 by @ennru
• DrainingControl: expose failures on overwritten methods #958 by @ennru
• Rebalance: filter messages of revoked partitions #946 by @ennru
• Consumer: make partition assignment handler public API #949 by @ennru
• Pass ProducerSettings to stage #952 by @seglo
• CommittableOffsetBatch: Handle multiple committer refs #953 by @ennru
• Producer: change default parallelism #944 by @ennru
• Remove methods deprecated before 1.0 #945 by @ennru
• Use testcontainers for multi-broker integration tests and benchmarks #939 by @seglo
• Akka Discovery support #836 by @ennru
• Mima 0.6.0 and exclusions for #931 #937 by @ennru
• Create committableSink as combination of Producer.flexiFlow an… #932 by @ennru
• Committer: change type bound to allow offset batches #931 by @ennru

Alpakka Kafka Testkit

• Cleanup KafkaSpec before termination of embedded server #970 by @shobull
• Use testcontainers for multi-broker integration tests and benchmarks #939 by @seglo

Tests

• Tests: capture logging to show it for failed tests #993 by @ennru
• Use akka.test.timefactor #994 by @seglo
• Docs: remove duplicated producer tests #960 by @ennru
• Make EmbeddedKafka a provided dependency #954 by @ennru
• Use testcontainers for multi-broker integration tests and benchmarks #939 by @seglo
• Illustrate how max.poll.records affects buffer #865 by @ennru

Documentation

• Docs: more links to API docs #981 by @ennru
• Docs: remove duplicated producer tests #960 by @ennru

Other changes

• Scalafmt: don't remove redundant braces #972 by @ennru
• Akka 2.6.0 in scheduled build #964 by @ennru
• Akka 2.6.0-RC1 for the scheduled build #938 by @ennru
• Scala 2.13.1 and 2.12.10; plugin and test library upgrades #935 by @ennru

Benchmarks

• Committing producer sink: producer and committer in a sink stage #963 by @ennru
• Producer: change default parallelism #944 by @ennru
• Use testcontainers for multi-broker integration tests and benchmarks #939 by @seglo

Alpakka Kafka 1.1.0

Release notes in the Alpakka Kafka documentation

Changes

• Testkit & tests: Sort out some dependencies with security warnings #928 by @ennru

Benchmarks

• Benchmarks: don't reuse topics for raw batched consumers #922 by @ennru
• Benchmarks: try fresh topic for batched consumer 5000k #919 by @ennru

Tests

• Tests: change assertions to fix #832 #892 by @ennru

Documentation

• Release notes for 1.1.0 #925 by @ennru

Alpakka Kafka 1.1.0-RC2

The release notes are in the Alpakka Kafka documentation.

Changes since Alpakka Kafka 1.1.0-RC1

• Cron builds: allow compiler warnings #916 by @ennru
• Akka 2.6.0-M8 for nightly builds #914 by @ennru
• CI: update Adopt Open JDK versions #913 by @ennru
• Configure autolabeler bot; update release helpers #897 by @ennru

Benchmarks

• Benchmarks: create new topics for producers tests #917 by @ennru
• Benchmarks: try producing with even more ridiculous parallelism #907 by @ennru
• Benchmarks: try producing with ridiculous parallelism #906 by @ennru
• Benchmarks: producer writing 500 bytes messages #902 by @ennru
• Benchmarks: Create topics with data only once per run #898 by @ennru
• Benchmarks: await all messages #896 by @ennru

Alpakka Kafka core

• Committable partitioned source with manual offset seek support #908 by @seglo

Tests

• Committable partitioned source with manual offset seek support #908 by @seglo

Documentation

• Release notes for 1.1.0-RC2 #918 by @ennru
• Committable partitioned source with manual offset seek support #908 by @seglo
• Clarify exactly-once-semantics limitations #903 by @raboof