Skip to content

Commit

Permalink
Upgrade kafka to 3.4.0 (#59)
Browse files Browse the repository at this point in the history
* [INTERNAL] [BUILD] Publish docker images to adobe/kafka-operator and adobe/kafka docker hub repos

- build the koperator docker image
- build Apache kafka docker image
When `kafka-*` tags are created a github action is triggered
to build and push a new adobe/kafka docker image version

* [INTERNAL] make manifests should be called manually, if needed (#25)

We made some chnages for spinnaker annotations and `preserveUnknownFields` that would be overriden by `make manifests`

* [INTERNAL] Allow Kafka to use External DNS for inter-broker protocol (#17) (#22)

* [INTERNAL] Allow external listeners to be used for inner communication (#26)

* [INTERNAL] Ensure external listerners are always the first the advertised.listeners configuration

This is needed for old clients connecting to kafka through Zookeeper that does not have a way
to infer the right listener.
In this case, the first listener in the advertised.listener config is used to connect to brokers.
This patch ensures the external listeners (those reachable from outside) are listed before internal ones

* [INTERNAL] Generate CRDs resources

* [INTERNAL] Upgrade to Kafka 2.8.1 (#36)

* Enable envoy idleTimeout and TCP keep-alive for connections to kafka and clients

1/ Kafka broker defines connections.max.idle.ms=600s
To ensure envoy as a client for kafka broker is terminating
the connection first to avoid network disconnects
this patch is setting the idleTimeout to value slightly less
than that

2/ Enable tcp-keep alive for all TCP connections established by envoy to kafka
and to client (or fronting Load Balancer)

* Enable envoy tls termination (#41)

* [INTERNAL] Build kafka 3.1.1 using Oracle OpenJDK

* Envoy config generated by the operator is invalid in envoy 1.22


Added explicit typeconfig for envoy.filters.http.router

```
[2022-06-16 13:27:58.425][1][info][main] [source/server/server.cc:939] exiting
Didn't find a registered implementation for 'envoy.filters.http.router' with type URL: ''
```

* Added TaintedBrokersSelector to kafkaClusterSpec (#48)

Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>

* Build kafka 3.2.2

* Upgrade kafka to 3.2.3

* Upgrade kafka to 3.3.1

* [Internal] Update helm for adobe builds (#52)

* [INTERNAL] Use local replacement for sub-modules (#54)

As part of banzaicloud#929, the local
replacement for sub-modules was removed in favor of using valid tags.
Adobe Koperator fork has some internal changes in the api sub-module,
so we need to use the local version of the sub-module instead of
the upstream version, so we are  forced to revert the changes from banzaicloud#929.

* Upgrade kafka to 3.4.0

---------

Co-authored-by: Adi Muraru <amuraru@adobe.com>
Co-authored-by: Adrian Lungu <adrian.lungu89@gmail.com>
Co-authored-by: Razvan Dobre <dobre.razvan@gmail.com>
Co-authored-by: Adrian Muraru <adi.muraru@gmail.com>
Co-authored-by: Adrian Coman <acoman@adobe.com>
Co-authored-by: aguzovatii <guzovatii.anatolii@gmail.com>
  • Loading branch information
7 people committed Jun 8, 2023
1 parent 9cbf688 commit 609bc2e
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions docker/kafka/Dockerfile
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
FROM alpine:latest AS kafka_dist

ARG scala_version=2.13
ARG kafka_version=3.3.1
ARG kafka_version=3.4.0
ARG kafka_distro_base_url=https://downloads.apache.org/kafka

ENV kafka_distro=kafka_$scala_version-$kafka_version.tgz
Expand All @@ -26,7 +26,8 @@ RUN rm -r kafka_$scala_version-$kafka_version/bin/windows
FROM debian:bullseye-slim

ARG scala_version=2.13
ARG kafka_version=3.3.1
ARG kafka_version=3.4.0


RUN set -eux; \
apt-get update; \
Expand Down

0 comments on commit 609bc2e

Please sign in to comment.