Re: [DISCUSS] KIP-826: Define platforms supported

2022-04-04 Thread Ismael Juma
On Mon, Apr 4, 2022 at 3:15 PM Ismael Juma wrote: > Regarding 2, relying on CI alone is quite challenging from a debugging > perspective. Committers typically rely on the ability to run locally or via > a VM on a given platform. For platforms that are not particularly popular, > I am not sure if

Re: [DISCUSS] KIP-826: Define platforms supported

2022-04-04 Thread Ismael Juma
Regarding 2, relying on CI alone is quite challenging from a debugging perspective. Committers typically rely on the ability to run locally or via a VM on a given platform. For platforms that are not particularly popular, I am not sure if the Apache Kafka committer should incur the burden of

Re: [DISCUSS] KIP-826: Define platforms supported

2022-03-31 Thread Mickael Maison
Hi Ismael, Thanks for the feedback! 1. I agree we need to run system tests. As far as I can tell we don't currently run system tests for any platforms in the Apache CI, not even for x86_64. System tests require a lot of resources so I'm not sure we can run them daily on all platforms in the

Re: [DISCUSS] KIP-826: Define platforms supported

2022-03-31 Thread Mickael Maison
Hi Divij, Thanks for taking a look at the KIP! 1. I'm not sure we should include the kernel as part of the support statement. Kafka does not interact with the kernel directly and instead relies on the JVM to make the right system calls. So I think it's best to keep that out. 2. That's a good

Re: [DISCUSS] KIP-826: Define platforms supported

2022-03-30 Thread Ismael Juma
Thanks for the KIP. I would say there are 2 requirements to fully support platforms that the KIP does not mention: 1. Running system tests on that platform nightly. 2. Committers need a mechanism to be able to debug and fix issues affecting the platforms. arm64 seems like the kind of platform

Re: [DISCUSS] KIP-826: Define platforms supported

2022-03-30 Thread Divij Vaidya
Thanks for starting this KIP Mickael. 1. Could we expand the scope of this KIP to include the linux kernel versions supported by Kafka? I am asking this because newer kernels have features such as io_uring and kernel based TLS, which could potentially be used to improve Kafka's performance.

[DISCUSS] KIP-826: Define platforms supported

2022-03-30 Thread Mickael Maison
Hi, I recently started a thread (https://lists.apache.org/thread/4ffpspc59cnzqbgjf3l50ykcvyp7vwtv) about whether we should consider aarch64 (ARM64) and ppc64le (PowerPC) as supported platforms because we've recently started using these platforms in the Kafka CI. Unfortunately nobody replied so I