[ https://issues.apache.org/jira/browse/KAFKA-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155832#comment-15155832 ]
Anna Povzner commented on KAFKA-3256: ------------------------------------- [~becket_qin] Most of these tests are reproducible locally, so should be easier to debug. I found the issue with some of the connect tests, which produce output like this: Expected ["foo", "bar", "baz", "razz", "ma", "tazz"] but saw ["CreateTime:1455962742782\tfoo", "CreateTime:1455962742789\tbar", "CreateTime:1455962742789\tbaz", "CreateTime:1455962758003\trazz", "CreateTime:1455962758009\tma", "CreateTime:1455962758009\ttazz"] in Kafka Traceback (most recent call last): File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/tests/runner.py", line 102, in run_all_tests result.data = self.run_single_test() File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/tests/runner.py", line 154, in run_single_test return self.current_test_context.function(self.current_test) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/mark/_mark.py", line 331, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/tests/kafkatest/tests/connect_test.py", line 86, in test_file_source_and_sink assert expected == actual, "Expected %s but saw %s in Kafka" % (expected, actual) AssertionError: Expected ["foo", "bar", "baz", "razz", "ma", "tazz"] but saw ["CreateTime:1455962742782\tfoo", "CreateTime:1455962742789\tbar", "CreateTime:1455962742789\tbaz", "CreateTime:1455962758003\trazz", "CreateTime:1455962758009\tma", "CreateTime:1455962758009\ttazz"] in Kafka ConsoleConsumer was changed to also output timestamp type and timestamp value in addition to key/value. However, it looks connect tests expect output with just key and value. See test_file_source_and_sink in connect_test.py for example. > Large number of system test failures > ------------------------------------ > > Key: KAFKA-3256 > URL: https://issues.apache.org/jira/browse/KAFKA-3256 > Project: Kafka > Issue Type: Bug > Reporter: Geoff Anderson > Assignee: Jiangjie Qin > > Confluent's nightly run of the kafka system tests reported a large number of > failures beginning 2/20/2016 > Test run: 2016-02-19--001.1455897182--apache--trunk--eee9522/ > Link: > http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-02-19--001.1455897182--apache--trunk--eee9522/report.html > Pass: 136 > Fail: 0 > Test run: 2016-02-20--001.1455979842--apache--trunk--5caa800/ > Link: > http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-02-20--001.1455979842--apache--trunk--5caa800/report.html > Pass: 72 > Fail: 64 > I.e. trunk@eee9522 was the last passing run, and trunk@5caa800 had a large > number of failures. > Given its complexity, the most likely culprit is 45c8195fa, and I confirmed > this is the first commit with failures on a small number of tests. > [~becket_qin] do you mind investigating? > {code} > commit 5caa800e217c6b83f62ee3e6b5f02f56e331b309 > Author: Jun Rao <jun...@gmail.com> > Date: Fri Feb 19 09:40:59 2016 -0800 > trivial fix to authorization CLI table > commit 45c8195fa14c766b200c720f316836dbb84e9d8b > Author: Jiangjie Qin <becket....@gmail.com> > Date: Fri Feb 19 07:56:40 2016 -0800 > KAFKA-3025; Added timetamp to Message and use relative offset. > commit eee95228fabe1643baa016a2d49fb0a9fe2c66bd > Author: Yasuhiro Matsuda <yasuh...@confluent.io> > Date: Thu Feb 18 09:39:30 2016 +0800 > MINOR: remove streams config params from producer/consumer configs > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)