[jira] [Created] (KAFKA-17226) Refactor pipeline to generate both docker artifacts
Vedarth Sharma created KAFKA-17226: -- Summary: Refactor pipeline to generate both docker artifacts Key: KAFKA-17226 URL: https://issues.apache.org/jira/browse/KAFKA-17226 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma We currently have two separate docker images which are built and released by two separate pipeline runs. We can merge them in a single workflow so that we won't need to generate them separately. Also we need to reduce the possibility of human error by allowing the RM to only input the RC number instead of the entire image name -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16594) Add a test to detect CDS errors
Vedarth Sharma created KAFKA-16594: -- Summary: Add a test to detect CDS errors Key: KAFKA-16594 URL: https://issues.apache.org/jira/browse/KAFKA-16594 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Currently pipeline cannot detect whether CDS is working as expected or not. A test for this will help. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16453) Improve documentation and error message for not supporting zookeeper mode
Vedarth Sharma created KAFKA-16453: -- Summary: Improve documentation and error message for not supporting zookeeper mode Key: KAFKA-16453 URL: https://issues.apache.org/jira/browse/KAFKA-16453 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Docker image doesn't support zookeeper mode. This needs to be stated explicitly in docs and communicated clearly in the error message. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16400) Update notification settings for cve detection scheduled workflow
Vedarth Sharma created KAFKA-16400: -- Summary: Update notification settings for cve detection scheduled workflow Key: KAFKA-16400 URL: https://issues.apache.org/jira/browse/KAFKA-16400 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Currently failure email is only sent to the last github user who edited the pipeline. We need to figure out a way to send the workflow failure email notification to dev mailing list -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16170) Infinite logs observed when running single node kafka in kraft mode with default KRaft properties in 3.7.0 RC2
Vedarth Sharma created KAFKA-16170: -- Summary: Infinite logs observed when running single node kafka in kraft mode with default KRaft properties in 3.7.0 RC2 Key: KAFKA-16170 URL: https://issues.apache.org/jira/browse/KAFKA-16170 Project: Kafka Issue Type: Bug Affects Versions: 3.7.0 Reporter: Vedarth Sharma Attachments: kafka_logs.txt After kafka server startup, endless logs are observed, even when server is sitting idle. This behaviour was not observed in previous versions. It is easy to reproduce this issue * Download the RC tarball for 3.7.0 * Follow the [quickstart guide|https://kafka.apache.org/quickstart] to run kafka in KRaft mode i.e. execute following commands ** KAFKA_CLUSTER_ID="$(bin/kafka-storage.sh random-uuid)" ** bin/kafka-storage.sh format -t $KAFKA_CLUSTER_ID -c config/kraft/server.properties ** bin/kafka-server-start.sh config/kraft/server.properties * Once kafka server is started wait for a few seconds and you should see endless logs coming in. I have attached a small section of the logs in the ticket just after kafka startup line, just to showcase the nature of endless logs observed. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (KAFKA-16016) Migrate utility scripts to kafka codebase
[ https://issues.apache.org/jira/browse/KAFKA-16016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma resolved KAFKA-16016. Reviewer: Manikumar Resolution: Fixed > Migrate utility scripts to kafka codebase > - > > Key: KAFKA-16016 > URL: https://issues.apache.org/jira/browse/KAFKA-16016 > Project: Kafka > Issue Type: Sub-task > Components: core >Reporter: Vedarth Sharma >Assignee: Vedarth Sharma >Priority: Blocker > Fix For: 3.8.0 > > > Migrate the logic implemented in golang to kafka codebase by creating a new > entrypoint for docker images -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16091) Pipeline to run docker build test on a PR
Vedarth Sharma created KAFKA-16091: -- Summary: Pipeline to run docker build test on a PR Key: KAFKA-16091 URL: https://issues.apache.org/jira/browse/KAFKA-16091 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Create a new pipeline that will allow the capability to run the docker sanity tests on a PR -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16090) Refactor call to storage tool from kafka docker wrapper
Vedarth Sharma created KAFKA-16090: -- Summary: Refactor call to storage tool from kafka docker wrapper Key: KAFKA-16090 URL: https://issues.apache.org/jira/browse/KAFKA-16090 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Once rewrite of kafka storage tool is done, refactor how we are calling storage tool from kafka docker wrapper -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-16016) Migrate utility scripts to kafka codebase
Vedarth Sharma created KAFKA-16016: -- Summary: Migrate utility scripts to kafka codebase Key: KAFKA-16016 URL: https://issues.apache.org/jira/browse/KAFKA-16016 Project: Kafka Issue Type: Sub-task Components: core Reporter: Vedarth Sharma Assignee: Vedarth Sharma Migrate the logic implemented in golang to kafka codebase by creating a new entrypoint for docker images -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (KAFKA-15881) Make changes in Release Process Wiki and Release Process
[ https://issues.apache.org/jira/browse/KAFKA-15881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma resolved KAFKA-15881. Fix Version/s: 3.7.0 Reviewer: Manikumar Resolution: Fixed Release Process is updated > Make changes in Release Process Wiki and Release Process > > > Key: KAFKA-15881 > URL: https://issues.apache.org/jira/browse/KAFKA-15881 > Project: Kafka > Issue Type: Sub-task >Reporter: Vedarth Sharma >Assignee: Vedarth Sharma >Priority: Major > Fix For: 3.7.0 > > > Make changes to Release Process Wiki and docker README.md for detailed > release process instructions -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-15994) Add complex example compose file
Vedarth Sharma created KAFKA-15994: -- Summary: Add complex example compose file Key: KAFKA-15994 URL: https://issues.apache.org/jira/browse/KAFKA-15994 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Fix For: 3.7.0 Add a more real world complex example docker compose file -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (KAFKA-15903) Add github actions workflow for building and pushing RC Docker Image
[ https://issues.apache.org/jira/browse/KAFKA-15903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma resolved KAFKA-15903. Fix Version/s: 3.7.0 Reviewer: Manikumar Resolution: Fixed > Add github actions workflow for building and pushing RC Docker Image > > > Key: KAFKA-15903 > URL: https://issues.apache.org/jira/browse/KAFKA-15903 > Project: Kafka > Issue Type: Sub-task >Reporter: Vedarth Sharma >Assignee: Vedarth Sharma >Priority: Major > Fix For: 3.7.0 > > > This github actions workflow should build and push the multi arch RC docker > image to docker registry -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (KAFKA-15880) Add github actions workflow for promoting RC docker image
[ https://issues.apache.org/jira/browse/KAFKA-15880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma resolved KAFKA-15880. Fix Version/s: 3.7.0 Reviewer: Manikumar Resolution: Fixed PR merged > Add github actions workflow for promoting RC docker image > - > > Key: KAFKA-15880 > URL: https://issues.apache.org/jira/browse/KAFKA-15880 > Project: Kafka > Issue Type: Sub-task >Reporter: Vedarth Sharma >Assignee: Vedarth Sharma >Priority: Major > Fix For: 3.7.0 > > > RC docker image needs to be pulled and pushed to apache/kafka through this > github actions workflow. > We need to ensure that only PMC members can access this workflow. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (KAFKA-15879) Add documentation and examples for the Docker image
[ https://issues.apache.org/jira/browse/KAFKA-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vedarth Sharma resolved KAFKA-15879. Fix Version/s: 3.7.0 Reviewer: Manikumar Resolution: Fixed Documentation PR merged > Add documentation and examples for the Docker image > --- > > Key: KAFKA-15879 > URL: https://issues.apache.org/jira/browse/KAFKA-15879 > Project: Kafka > Issue Type: Sub-task >Reporter: Vedarth Sharma >Assignee: Vedarth Sharma >Priority: Major > Fix For: 3.7.0 > > > AC:- > * Update quickstart with docker image details and docker section in getting > started section > * Add a link to the examples folder in docker > * Add example compose files in docker folder -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-15903) Add github actions workflow for building and pushing RC Docker Image
Vedarth Sharma created KAFKA-15903: -- Summary: Add github actions workflow for building and pushing RC Docker Image Key: KAFKA-15903 URL: https://issues.apache.org/jira/browse/KAFKA-15903 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma This github actions workflow should build and push the multi arch RC docker image to docker registry -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-15882) Scheduled nightly github actions workflow for CVE reports on published docker images
Vedarth Sharma created KAFKA-15882: -- Summary: Scheduled nightly github actions workflow for CVE reports on published docker images Key: KAFKA-15882 URL: https://issues.apache.org/jira/browse/KAFKA-15882 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma This scheduled github actions workflow will check supported published docker images for CVEs and generate reports. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-15881) Update release.py script to include docker image
Vedarth Sharma created KAFKA-15881: -- Summary: Update release.py script to include docker image Key: KAFKA-15881 URL: https://issues.apache.org/jira/browse/KAFKA-15881 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Make changes in release.py to include build and push of RC docker image to RM's dockerhub account and include the details in VOTE email template. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-15880) Add github actions workflow for promoting RC docker image
Vedarth Sharma created KAFKA-15880: -- Summary: Add github actions workflow for promoting RC docker image Key: KAFKA-15880 URL: https://issues.apache.org/jira/browse/KAFKA-15880 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma RC docker image needs to be pulled and pushed to apache/kafka through this github actions workflow. We need to ensure that only PMC members can access this workflow. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (KAFKA-15879) Add documentation for the Docker image
Vedarth Sharma created KAFKA-15879: -- Summary: Add documentation for the Docker image Key: KAFKA-15879 URL: https://issues.apache.org/jira/browse/KAFKA-15879 Project: Kafka Issue Type: Sub-task Reporter: Vedarth Sharma Assignee: Vedarth Sharma Update quickstart with docker image details and docker section in getting started section -- This message was sent by Atlassian Jira (v8.20.10#820010)
