Yash Mayya created KAFKA-14193:
----------------------------------
Summary: Connect system test ConnectRestApiTest is failing
Key: KAFKA-14193
URL: https://issues.apache.org/jira/browse/KAFKA-14193
Project: Kafka
Issue Type: Bug
Components: KafkaConnect
Reporter: Yash Mayya
Assignee: Yash Mayya
[ConnectRestApiTest|https://github.com/apache/kafka/blob/trunk/tests/kafkatest/tests/connect/connect_rest_test.py]
is currently failing on `trunk` and `3.3` with the following assertion error:
{code:java}
AssertionError()
Traceback (most recent call last):
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
183, in _do_run
data = self.run_test()
File
"/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py", line
243, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
433, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/connect/connect_rest_test.py",
line 106, in test_rest_api
self.verify_config(self.FILE_SOURCE_CONNECTOR, self.FILE_SOURCE_CONFIGS,
configs)
File "/opt/kafka-dev/tests/kafkatest/tests/connect/connect_rest_test.py",
line 219, in verify_config
assert config_def == set(config_names){code}
On closer inspection, this is because of the new source connector EOS related
configs added in [https://github.com/apache/kafka/pull/11775.] Adding the
following new configs -
{code:java}
offsets.storage.topic, transaction.boundary, exactly.once.support,
transaction.boundary.interval.ms{code}
in the expected config defs
[here|https://github.com/apache/kafka/blob/6f4778301b1fcac1e2750cc697043d674eaa230d/tests/kafkatest/tests/connect/connect_rest_test.py#L35]
fixes the tests on the 3.3 branch. However, the tests still fail on trunk due
to the changes from [https://github.com/apache/kafka/pull/12450.]
The plan to fix this is to raise two PRs against trunk patching
connect_rest_test.py - the first one fixing the EOS configs related issue which
can be backported to 3.3 and the second one fixing the issue related to
propagation of full connector configs to tasks which shouldn't be backported to
3.3 (because the commit from https://github.com/apache/kafka/pull/12450 is only
on trunk and not on 3.3)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
