Run kafka on arm architecture #4121

lanzhiwang · 2020-12-17T05:05:44Z

lanzhiwang
Dec 17, 2020

I want run strimzi kafka operator and kafka on arm architecture. I package the jar package in the docker container.

I use maven:3-jdk-8-alpine as the base image.

The java and maven versions in the maven:3-jdk-8-alpine mirror are:

$ echo ${JAVA_HOME}
/usr/lib/jvm/java-1.8-openjdk

$ java -version
openjdk version "1.8.0_212"
OpenJDK Runtime Environment (IcedTea 3.12.0) (Alpine 8.212.04-r0)
OpenJDK 64-Bit Server VM (build 25.212-b04, mixed mode)

$ mvn -version
Apache Maven 3.6.1 (d66c9c0b3152b2e69ee9bac180bb8fcc8e6af555; 2019-04-04T19:00:29Z)
Maven home: /usr/share/maven
Java version: 1.8.0_212, vendor: IcedTea, runtime: /usr/lib/jvm/java-1.8-openjdk/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.18.0-80.7.2.el7.aarch64", arch: "aarch64", family: "unix"

I added some configuration in pom.xml and api/pom.xml

$ git diff pom.xml
diff --git a/pom.xml b/pom.xml
index 1c9291582..e5c0c48a1 100644
--- a/pom.xml
+++ b/pom.xml
@@ -630,6 +630,10 @@
                     <groupId>org.apache.maven.plugins</groupId>
                     <artifactId>maven-compiler-plugin</artifactId>
                     <version>${maven.compiler.version}</version>
+                    <configuration>
+                        <source>1.8</source>
+                        <target>1.8</target>
+                    </configuration>
                     <executions>
                         <execution>
                             <id>default-compile</id>
$
$ git diff api/pom.xml
diff --git a/api/pom.xml b/api/pom.xml
index 59eb991c1..04222b753 100644
--- a/api/pom.xml
+++ b/api/pom.xml
@@ -100,6 +100,10 @@
             <plugin>
                 <artifactId>maven-compiler-plugin</artifactId>
                 <version>${maven.compiler.version}</version>
+                <configuration>
+                    <source>1.8</source>
+                    <target>1.8</target>
+                </configuration>
                 <executions>
                     <execution>
                         <id>default-compile</id>
$

I compiled the source code of version 0.18.0

$ git clone https://github.com/strimzi/strimzi-kafka-operator.git
$ git checkout -b 0.18.9.dev remotes/origin/release-0.18.x

dockerfile:

FROM maven:3-jdk-8-alpine as builder

ARG WORK_DIR=/root/work

# Cache third-party dependent jar packages to speed up packaging
COPY ./maven_m2/ /root/.m2/

# Set up the fastest mirror
COPY ./maven_m2/settings.xml /usr/share/maven/conf/settings.xml

# copy source code to container
COPY ./ ${WORK_DIR}/

WORKDIR ${WORK_DIR}

RUN mvn -Dmaven.test.skip=true clean package

An error occurred when packaging the api module

[INFO] ---------------------------< io.strimzi:api >---------------------------
[INFO] Building api 0.18.0                                               [8/18]
[INFO] --------------------------------[ jar ]---------------------------------
[INFO]
[INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ api ---
[INFO]
[INFO] --- maven-checkstyle-plugin:3.1.0:check (validate) @ api ---
[INFO] Starting audit...
Audit done.
[INFO]
[INFO] --- maven-enforcer-plugin:3.0.0-M2:enforce (enforce-banned-dependencies) @ api ---
[INFO]
[INFO] --- jacoco-maven-plugin:0.7.9:prepare-agent (default) @ api ---
[INFO] surefireArgLine set to -javaagent:/root/.m2/repository/org/jacoco/org.jacoco.agent/0.7.9/org.jacoco.agent-0.7.9-runtime.jar=destfile=/root/work/api/target/jacoco.exec
[INFO]
[INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ api ---
[INFO] Using 'UTF-8' encoding to copy filtered resources.
[INFO] skip non existing resourceDirectory /root/work/api/src/main/resources
[INFO]
[INFO] --- maven-compiler-plugin:3.8.1:compile (default-compile) @ api ---
[INFO] Changes detected - recompiling the module!
[INFO] Compiling 192 source files to /root/work/api/target/classes
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary for Strimzi - Apache Kafka on Kubernetes and OpenShift 0.18.0:
[INFO]
[INFO] Strimzi - Apache Kafka on Kubernetes and OpenShift . SUCCESS [  9.200 s]
[INFO] kafka-agent ........................................ SUCCESS [  3.427 s]
[INFO] mirror-maker-agent ................................. SUCCESS [  1.432 s]
[INFO] tracing-agent ...................................... SUCCESS [  1.162 s]
[INFO] test ............................................... SUCCESS [  4.222 s]
[INFO] crd-annotations .................................... SUCCESS [  1.146 s]
[INFO] crd-generator ...................................... SUCCESS [  4.169 s]
[INFO] api ................................................ FAILURE [  0.787 s]
[INFO] mockkube ........................................... SKIPPED
[INFO] config-model ....................................... SKIPPED
[INFO] cluster-operator-generator ......................... SKIPPED
[INFO] certificate-manager ................................ SKIPPED
[INFO] operator-common .................................... SKIPPED
[INFO] topic-operator ..................................... SKIPPED
[INFO] cluster-operator ................................... SKIPPED
[INFO] user-operator ...................................... SKIPPED
[INFO] kafka-init ......................................... SKIPPED
[INFO] systemtest ......................................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  25.853 s
[INFO] Finished at: 2020-12-17T04:49:15Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.1:compile (default-compile) on project api: Fatal error compiling: invalid target release: 8u212 -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :api
The command '/bin/sh -c mvn -Dmaven.test.skip=true clean package' returned a non-zero code: 1
#

Do I need to do any special configuration?

Packaging directly on the virtual machine is successful, but not in the container。

scholzj · 2020-12-17T15:50:51Z

scholzj
Dec 17, 2020
Maintainer

I honestly do not know what the error means. But I do not think you should need to build the JARs for ARM in some ARM container. It is Java, so it does not build into native code. You just need to build the container images for Arm. In master, you can do this using docker buildx - https://github.com/strimzi/strimzi-kafka-operator/blob/master/development-docs/DEV_GUIDE.md#building-container-images-for-other-platforms-with-docker-buildx. There is also a separate discussion on this topic in #3557 (lot of interest in Arm today :-))

0 replies

lanzhiwang · 2020-12-24T02:36:06Z

lanzhiwang
Dec 24, 2020
Author

I have built an arm image on an arm architecture machine, can I contribute to the community? We go through some regular functional tests

1 reply

scholzj Dec 24, 2020
Maintainer

Contributions are always welcome. But I guess you would need to first explain what do you want to contribute. I do not think we can take the images them self. We would need to build them our self in our CIs.

lanzhiwang · 2020-12-31T10:34:45Z

lanzhiwang
Dec 31, 2020
Author

The following error occurred after building the image

operator pod log

[root@hudi-arm-master-0001 cluster-operator]# kubectl -n kafka logs strimzi-cluster-operator-795d5d685c-kdsjk
+ shift
+ export MALLOC_ARENA_MAX=2
+ MALLOC_ARENA_MAX=2
+ JAVA_OPTS=' -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom'
++ get_gc_opts
++ '[' '' == true ']'
++ echo ''
+ JAVA_OPTS=' -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom '
+ exec /usr/bin/tini -w -e 143 -- java -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom -classpath lib/io.strimzi.cluster-operator-0.18.0.jar:lib/io.prometheus.simpleclient_common-0.7.0.jar:lib/io.strimzi.kafka-oauth-client-0.5.0.jar:lib/io.netty.netty-handler-4.1.45.Final.jar:lib/io.netty.netty-codec-http-4.1.45.Final.jar:lib/org.quartz-scheduler.quartz-2.2.1.jar:lib/org.bouncycastle.bcprov-jdk15on-1.60.jar:lib/com.squareup.okio.okio-1.15.0.jar:lib/org.keycloak.keycloak-core-10.0.0.jar:lib/io.netty.netty-buffer-4.1.45.Final.jar:lib/org.yaml.snakeyaml-1.24.jar:lib/io.fabric8.openshift-client-4.6.4.jar:lib/io.netty.netty-common-4.1.45.Final.jar:lib/org.apache.logging.log4j.log4j-api-2.13.0.jar:lib/org.xerial.snappy.snappy-java-1.1.7.3.jar:lib/org.hdrhistogram.HdrHistogram-2.1.11.jar:lib/io.prometheus.simpleclient-0.7.0.jar:lib/com.sun.activation.jakarta.activation-1.2.1.jar:lib/org.apache.yetus.audience-annotations-0.5.0.jar:lib/com.fasterxml.jackson.dataformat.jackson-dataformat-yaml-2.10.2.jar:lib/io.micrometer.micrometer-core-1.3.1.jar:lib/io.netty.netty-codec-4.1.45.Final.jar:lib/org.keycloak.keycloak-common-10.0.0.jar:lib/jakarta.activation.jakarta.activation-api-1.2.1.jar:lib/io.vertx.vertx-core-3.8.5.jar:lib/io.strimzi.certificate-manager-0.18.0.jar:lib/io.strimzi.kafka-oauth-common-0.5.0.jar:lib/io.strimzi.kafka-oauth-server-0.5.0.jar:lib/io.netty.netty-codec-dns-4.1.45.Final.jar:lib/io.fabric8.kubernetes-model-4.6.4.jar:lib/io.netty.netty-codec-socks-4.1.45.Final.jar:lib/com.github.mifmif.generex-1.0.2.jar:lib/io.netty.netty-resolver-4.1.45.Final.jar:lib/com.github.luben.zstd-jni-1.4.4-7.jar:lib/io.netty.netty-handler-proxy-4.1.45.Final.jar:lib/com.squareup.okhttp3.logging-interceptor-3.12.6.jar:lib/io.strimzi.operator-common-0.18.0.jar:lib/org.bouncycastle.bcpkix-jdk15on-1.62.jar:lib/org.lz4.lz4-java-1.7.1.jar:lib/io.netty.netty-transport-native-epoll-4.1.45.Final-linux-x86_64.jar:lib/io.netty.netty-transport-native-unix-common-4.1.45.Final.jar:lib/dk.brics.automaton.automaton-1.11-8.jar:lib/io.vertx.vertx-micrometer-metrics-3.8.5.jar:lib/org.apache.kafka.kafka-clients-2.5.0.jar:lib/com.fasterxml.jackson.core.jackson-core-2.10.2.jar:lib/org.apache.zookeeper.zookeeper-jute-3.5.7.jar:lib/io.netty.netty-transport-4.1.45.Final.jar:lib/io.netty.netty-transport-native-epoll-4.1.45.Final.jar:lib/jakarta.xml.bind.jakarta.xml.bind-api-2.3.2.jar:lib/org.apache.logging.log4j.log4j-slf4j-impl-2.13.0.jar:lib/com.fasterxml.jackson.core.jackson-annotations-2.10.2.jar:lib/io.fabric8.zjsonpatch-0.3.0.jar:lib/org.apache.zookeeper.zookeeper-3.5.7.jar:lib/io.strimzi.api-0.18.0.jar:lib/io.fabric8.kubernetes-client-4.6.4.jar:lib/com.fasterxml.jackson.module.jackson-module-jaxb-annotations-2.10.2.jar:lib/com.squareup.okhttp3.okhttp-3.12.6.jar:lib/io.netty.netty-codec-http2-4.1.45.Final.jar:lib/io.strimzi.config-model-0.18.0.jar:lib/org.apache.logging.log4j.log4j-core-2.13.0.jar:lib/io.fabric8.kubernetes-model-common-4.6.4.jar:lib/com.fasterxml.jackson.core.jackson-databind-2.10.2.jar:lib/io.strimzi.crd-annotations-0.18.0.jar:lib/io.netty.netty-resolver-dns-4.1.45.Final.jar:lib/org.slf4j.slf4j-api-1.7.25.jar:lib/org.latencyutils.LatencyUtils-2.0.3.jar:lib/io.micrometer.micrometer-registry-prometheus-1.3.1.jar io.strimzi.operator.cluster.Main
[FATAL tini (7)] exec java failed: No such file or directory
[root@hudi-arm-master-0001 cluster-operator]#

Error message when running the container directly

[root@hudi-arm-master-0001 cluster-operator]# docker run --rm -ti  harbor-b.alauda.cn/tdsql/kafka/operator:0.18.0 bash
[strimzi@40160969a08e strimzi]$ cd /opt/strimzi
[strimzi@40160969a08e strimzi]$ ls
bin  lib
[strimzi@40160969a08e strimzi]$ cd bin
[strimzi@40160969a08e bin]$ ls
cluster_operator_run.sh  kafka_init_run.sh  launch_java.sh  tls_prepare_certificates.sh  topic_operator_run.sh  user_operator_run.sh
[strimzi@40160969a08e bin]$ ./launch_java.sh
+ shift
+ export MALLOC_ARENA_MAX=2
+ MALLOC_ARENA_MAX=2
+ JAVA_OPTS=' -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom'
++ get_gc_opts
++ '[' '' == true ']'
++ echo ''
+ JAVA_OPTS=' -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom '
+ exec /usr/bin/tini -w -e 143 -- java -Dvertx.cacheDirBase=/tmp -Djava.security.egd=file:/dev/./urandom -classpath
[WARN  tini (20)] Tini is not running as PID 1 and isn't registered as a child subreaper.
Zombie processes will not be re-parented to Tini, so zombie reaping won't work.
To fix the problem, use the -s option or set the environment variable TINI_SUBREAPER to register Tini as a child subreaper, or run Tini as PID 1.
[FATAL tini (22)] exec java failed: No such file or directory
[strimzi@40160969a08e bin]$

Have you encountered this kind of problem, or how should I debug

3 replies

scholzj Dec 31, 2020
Maintainer

Did you replaced the x86 version of tini with its arm64 version?

scholzj Dec 31, 2020
Maintainer

Eventually, do you have ARM Java installed?

lanzhiwang Jan 2, 2021
Author

I get

lanzhiwang · 2021-01-02T10:06:19Z

lanzhiwang
Jan 2, 2021
Author

I think there are two ways to support arm64 architecture. Respectively are：
Take building an operator image as an example

one:

$ docker build --platform linux/arm64 --build-arg TARGETPLATFORM=linux/arm64 --build-arg strimzi_version=0.18.0 -t strimzi/operator:arm64-0.18.0 ./

$ docker build --platform linux/amd64 --build-arg TARGETPLATFORM=linux/amd64 --build-arg strimzi_version=0.18.0 -t strimzi/operator:amd64-0.18.0 ./

$ docker manifest create --amend strimzi/operator:0.18.0 strimzi/operator:amd64-0.18.0 strimzi/operator:arm64-0.18.0

TARGETPLATFORM is used to mark the architecture of the build

#####
# Add Tini
#####
ENV TINI_VERSION v0.18.0
RUN set -ex; \
    if [[ ${TARGETPLATFORM} = "linux/arm64" ]]; then \
        wget -O /usr/bin/tini https://github.com/krallin/tini/releases/download/${TINI_VERSION}/tini-arm64; \
        echo "7c5463f55393985ee22357d976758aaaecd08defb3c5294d353732018169b019 */usr/bin/tini" | sha256sum -c; \
        chmod +x /usr/bin/tini; \
    else \
        wget -O /usr/bin/tini https://github.com/krallin/tini/releases/download/${TINI_VERSION}/tini; \
        echo "12d20136605531b09a2c2dac02ccee85e1b874eb322ef6baf7561cd93f93c855 */usr/bin/tini" | sha256sum -c; \
        chmod +x /usr/bin/tini; \
    fi

two:

$ docker buildx build --platform linux/amd64,linux/arm64 -t strimzi/operator:0.18.0 --push .

At present, I have used the first method to build a mirror image of the two architectures, of course on our own pipeline.

I would like to ask the community which method will be adopted if it builds a multi-architecture mirror?

2 replies

scholzj Jan 2, 2021
Maintainer

The second option IMHO does not work as part of the Strimzi build because there are too many limitations to how the docker buildx build works for this (mainly in how it treats the base images etc.). The first one should be more feasible to integrate. But as I said before - we currently don't have any plans for building multi-arch images. In order to do that, we would need to have the ability to test on all the platforms which we support and we currently don't have that.

lanzhiwang Jan 2, 2021
Author

I get

bitvijays · 2021-01-14T11:44:17Z

bitvijays
Jan 14, 2021

@lanzhiwang Hope you are doing well. As you are running Apache Kafka on arm (probably raspberry pi). Could you tell us more about your architecture?

Is it Cloud --> Edge -->End devices?

where

Kubernetes control plane is in the cloud? K3S Master? at the cloud?
or Kubernetes control plane is at the edge? K3S master at the edge?

I have the first scenario and facing some difficulties. Any help is really appreciated :)

2 replies

lanzhiwang Jan 14, 2021
Author

Kubernetes control plane is in the cloud.
k8s 1.16
What are your difficulties？

bitvijays Jan 16, 2021

@lanzhiwang How does your edge side looks like? Arm devices are they Raspberry Pi? Also, are you on Slack for quick chat?

I have K8S control plane at the cloud and multiple edge sites (Raspberry Pi) and I want one Kafka broker at each edge site without installing the control plane at the edge.

lanzhiwang · 2021-01-17T08:01:41Z

lanzhiwang
Jan 17, 2021
Author

Our scenario is not as complicated as this, and ARM devices are just some cloud hosts. We build an arm image, deploy k8s on the cloud host, and run operator and kafka directly in k8s.

1 reply

bitvijays Jan 18, 2021

Okies.. Thank you :)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Strimzi

Run kafka on arm architecture #4121

{{title}}

Replies: 6 comments 9 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Strimzi

Run kafka on arm architecture #4121

lanzhiwang Dec 17, 2020

Replies: 6 comments · 9 replies

scholzj Dec 17, 2020 Maintainer

lanzhiwang Dec 24, 2020 Author

scholzj Dec 24, 2020 Maintainer

lanzhiwang Dec 31, 2020 Author

scholzj Dec 31, 2020 Maintainer

scholzj Dec 31, 2020 Maintainer

lanzhiwang Jan 2, 2021 Author

lanzhiwang Jan 2, 2021 Author

scholzj Jan 2, 2021 Maintainer

lanzhiwang Jan 2, 2021 Author

bitvijays Jan 14, 2021

lanzhiwang Jan 14, 2021 Author

bitvijays Jan 16, 2021

lanzhiwang Jan 17, 2021 Author

bitvijays Jan 18, 2021

lanzhiwang
Dec 17, 2020

Replies: 6 comments 9 replies

scholzj
Dec 17, 2020
Maintainer

lanzhiwang
Dec 24, 2020
Author

scholzj Dec 24, 2020
Maintainer

lanzhiwang
Dec 31, 2020
Author

scholzj Dec 31, 2020
Maintainer

scholzj Dec 31, 2020
Maintainer

lanzhiwang Jan 2, 2021
Author

lanzhiwang
Jan 2, 2021
Author

scholzj Jan 2, 2021
Maintainer

lanzhiwang Jan 2, 2021
Author

bitvijays
Jan 14, 2021

lanzhiwang Jan 14, 2021
Author

lanzhiwang
Jan 17, 2021
Author