[jira] [Created] (KAFKA-13021) Improve Javadocs for API Changes from KIP-633
Israel Ekpo created KAFKA-13021: --- Summary: Improve Javadocs for API Changes from KIP-633 Key: KAFKA-13021 URL: https://issues.apache.org/jira/browse/KAFKA-13021 Project: Kafka Issue Type: Improvement Components: documentation, streams Affects Versions: 3.0.0 Reporter: Israel Ekpo Assignee: Israel Ekpo There are Javadoc changes from the following PR that needs to be completed prior to the 3.0 release. This Jira item is to track that work [https://github.com/apache/kafka/pull/10926] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-12994) Migrate all Tests to New API and Remove Suppression for Deprecation Warnings related to KIP-633
Israel Ekpo created KAFKA-12994: --- Summary: Migrate all Tests to New API and Remove Suppression for Deprecation Warnings related to KIP-633 Key: KAFKA-12994 URL: https://issues.apache.org/jira/browse/KAFKA-12994 Project: Kafka Issue Type: Improvement Components: streams, unit tests Affects Versions: 3.0.0 Reporter: Israel Ekpo Assignee: Israel Ekpo Fix For: 3.0.0 Due to the API changes for KIP-633 a lot of deprecation warnings have been generated in tests that are using the old deprecated APIs. There are a lot of tests using the deprecated methods. We should absolutely migrate them all to the new APIs. The applies to all Java and Scala examples and tests using the deprecated APIs in the JoinWindows, SessionWindows, TimeWindows and SlidingWindows classes. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-12658) bin/kafka-metadata-shell.sh cannot find or load main class org.apache.kafka.shell.MetadataShell
Israel Ekpo created KAFKA-12658: --- Summary: bin/kafka-metadata-shell.sh cannot find or load main class org.apache.kafka.shell.MetadataShell Key: KAFKA-12658 URL: https://issues.apache.org/jira/browse/KAFKA-12658 Project: Kafka Issue Type: Bug Components: core Affects Versions: 3.0.0, 2.8.0 Environment: Ubuntu, Java 11 Reporter: Israel Ekpo Assignee: John Roesler With the latest release candidate for 2.8.0, the binaries from the Scala 2.13 and 2.12 tarballs are not finding the class for the meta data shell from the classpath [https://home.apache.org/~vvcephei/kafka-2.8.0-rc1/] kafka-run-class.sh is not able to load it. cd ../kafka_2.12-2.8.0$ bin/kafka-metadata-shell.sh --help Error: Could not find or load main class org.apache.kafka.shell.MetadataShell Caused by: java.lang.ClassNotFoundException: org.apache.kafka.shell.MetadataShell cd ../kafka_2.13-2.8.0/ bin/kafka-metadata-shell.sh --help Error: Could not find or load main class org.apache.kafka.shell.MetadataShell Caused by: java.lang.ClassNotFoundException: org.apache.kafka.shell.MetadataShell !https://ssl.gstatic.com/ui/v1/icons/mail/images/cleardot.gif! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-12644) Add Missing Class-Level Javadoc to Decendants of org.apache.kafka.common.errors.ApiException
Israel Ekpo created KAFKA-12644: --- Summary: Add Missing Class-Level Javadoc to Decendants of org.apache.kafka.common.errors.ApiException Key: KAFKA-12644 URL: https://issues.apache.org/jira/browse/KAFKA-12644 Project: Kafka Issue Type: Improvement Components: clients, documentation Affects Versions: 3.0.0, 2.8.1 Reporter: Israel Ekpo Assignee: Israel Ekpo Fix For: 3.0.0, 2.8.1 I noticed that class-level Javadocs are missing from some classes in the org.apache.kafka.common.errors package. This issue is for tracking the work of adding the missing class-level javadocs for those Exception classes. https://kafka.apache.org/27/javadoc/org/apache/kafka/common/errors/package-summary.html https://github.com/apache/kafka/tree/trunk/clients/src/main/java/org/apache/kafka/common/errors Basic class-level documentation could be derived by mapping the error conditions documented in the protocol https://kafka.apache.org/protocol#protocol_constants -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-12458) Implementation of Tiered Storage Integration with Azure Storage (ADLS + Blob Storage)
Israel Ekpo created KAFKA-12458: --- Summary: Implementation of Tiered Storage Integration with Azure Storage (ADLS + Blob Storage) Key: KAFKA-12458 URL: https://issues.apache.org/jira/browse/KAFKA-12458 Project: Kafka Issue Type: Sub-task Reporter: Israel Ekpo Assignee: Israel Ekpo Task to cover integration support for Azure Storage * Azure Blob Storage * Azure Data Lake Store Will split task up later into distinct tracks and components -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-9861) Process Simplification - Community Validation Kafka Release Candidates
Israel Ekpo created KAFKA-9861: -- Summary: Process Simplification - Community Validation Kafka Release Candidates Key: KAFKA-9861 URL: https://issues.apache.org/jira/browse/KAFKA-9861 Project: Kafka Issue Type: Improvement Components: build, documentation, system tests Affects Versions: 2.6.0, 2.4.2, 2.5.1 Environment: Linux, Java 8/11, Scala 2.x Reporter: Israel Ekpo Assignee: Israel Ekpo Fix For: 2.6.0, 2.4.2, 2.5.1 When new KAFKA release candidates are published and there is a solicitation for the community to get involved in testing and verifying the release candidates, it would be great to have the test process thoroughly documented for newcomers to participate effectively. For new contributors, this can be very daunting and it would be great to have this process clearly documented in a way that lowers the level of effort necessary to get started. The goal of this task is to create the documentation and supporting artifacts that would make this goal a reality. Going forward for future releases, it would be great to have the link to this documentation included in the RC announcements so that the community (especially end users) can help test and participate in the voting process effectively. These are the items that I believe should be included in this documentation * How to set up test environment for unit and functional tests * Java version(s) needed for the tests * Scala version(s) needed for the tests * Gradle version needed * Sample script for running sanity checks and unit tests * Sample Helm Charts for running all the basic components on a Kubernetes * Sample Ansible Script for running all the basic components on Virtual Machines The first 4 items will be part of the documentation that shows how to install these dependencies in a Linux VM. The 5th item is a script that will download PGP keys, check signatures, validate checksums and run unit/integration tests. The 6th item is a Helm chart with basic components necessary to validate critical components in the ecosystem (Zookeeper, Brokers, Streams etc) within a Kubernetes cluster. The last item is similar to the 6th item but installs these components on virtual machines instead. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (KAFKA-9283) Flaky Test - kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker
Israel Ekpo created KAFKA-9283: -- Summary: Flaky Test - kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker Key: KAFKA-9283 URL: https://issues.apache.org/jira/browse/KAFKA-9283 Project: Kafka Issue Type: Bug Components: core Affects Versions: 2.4.0 Environment: OS: Ubuntu 18.04.3 LTS Java Version: OpenJDK 11.0.4 Scala Versions: 12.13.0, 12.13.1 Gradle Version: 5.6.2 Reporter: Israel Ekpo Fix For: 2.4.0 This same test fails occasionally on when run in Scala 2.12.10 but has been failing consistently in Scala versions 12.13.0, 12.13.1. Needs review OS: Ubuntu 18.04.3 LTS Java Version: OpenJDK 11.0.4 Scala Versions: 12.13.0, 12.13.1 Gradle Version: 5.6.2 ./gradlew :core:integrationTest --tests kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker > Configure project : Building project 'core' with Scala version 2.13.1 Building project 'streams-scala' with Scala version 2.13.1 > Task :core:integrationTest FAILED kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker failed, log available in /home/isekpo/scratchpad/111744.out/kafka-2.4.0-src/core/build/reports/testOutput/kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker.test.stdout kafka.admin.ReassignPartitionsClusterTest > shouldMoveSinglePartitionWithinBroker FAILED org.scalatest.exceptions.TestFailedException: Partition should have been moved to the expected log directory at org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:530) at org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:529) at org.scalatest.Assertions$.newAssertionFailedException(Assertions.scala:1389) at org.scalatest.Assertions.fail(Assertions.scala:1091) at org.scalatest.Assertions.fail$(Assertions.scala:1087) at org.scalatest.Assertions$.fail(Assertions.scala:1389) at kafka.utils.TestUtils$.waitUntilTrue(TestUtils.scala:842) at kafka.admin.ReassignPartitionsClusterTest.shouldMoveSinglePartitionWithinBroker(ReassignPartitionsClusterTest.scala:177) 1 test completed, 1 failed FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':core:integrationTest'. > There were failing tests. See the report at: > file:///home/isekpo/scratchpad/111744.out/kafka-2.4.0-src/core/build/reports/tests/integrationTest/index.html * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.6.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1m 56s 13 actionable tasks: 4 executed, 9 up-to-date -- This message was sent by Atlassian Jira (v8.3.4#803005)
