[ https://issues.apache.org/jira/browse/KAFKA-5663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122570#comment-16122570 ]
Colin P. McCabe edited comment on KAFKA-5663 at 8/11/17 12:08 AM: ------------------------------------------------------------------ [~lindong], this seems to have failed again. {code} 08:56:03 [INFO:2017-08-10 08:56:05,118]: Triggering test 48 of 301... 08:56:03 [INFO:2017-08-10 08:56:05,127]: RunnerClient: Loading test {'directory': '/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/core', 'file_name': 'log_dir_failure_test.py', 'method_name': 'test_replication_with_disk_failure', 'cls_name': 'LogDirFailureTest', 'injected_args': {'bounce_broker': False, 'security_protocol': 'PLAINTEXT', 'broker_type': 'follower'}} 08:56:03 [INFO:2017-08-10 08:56:05,134]: RunnerClient: kafkatest.tests.core.log_dir_failure_test.LogDirFailureTest.test_replication_with_disk_failure.bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower: Setting up... 08:56:10 [INFO:2017-08-10 08:56:11,791]: RunnerClient: kafkatest.tests.core.log_dir_failure_test.LogDirFailureTest.test_replication_with_disk_failure.bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower: Running... 08:57:27 [INFO:2017-08-10 08:57:28,608]: RunnerClient: kafkatest.tests.core.log_dir_failure_test.LogDirFailureTest.test_replication_with_disk_failure.bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower: FAIL: Consumer failed to consume messages for 60s. 08:57:27 Traceback (most recent call last): 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", line 123, in run 08:57:27 data = self.run_test() 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", line 176, in run_test 08:57:27 return self.test_context.function(self.test) 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py", line 321, in wrapper 08:57:27 return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/core/log_dir_failure_test.py", line 119, in test_replication_with_disk_failure 08:57:27 self.start_producer_and_consumer() 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/produce_consume_validate.py", line 79, in start_producer_and_consumer 08:57:27 self.consumer_start_timeout_sec) 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/utils/util.py", line 36, in wait_until 08:57:27 raise TimeoutError(err_msg) 08:57:27 TimeoutError: Consumer failed to consume messages for 60s. {code} Full logs here: [s3://confluent-kafka-system-test-results/2017-08-10--001.1502382693--apache--trunk--75b0f30/LogDirFailureTest/test_replication_with_disk_failure/bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower/48.tgz] was (Author: cmccabe): [~lindong], this seems to have failed again. {code} 08:56:03 [INFO:2017-08-10 08:56:05,118]: Triggering test 48 of 301... 08:56:03 [INFO:2017-08-10 08:56:05,127]: RunnerClient: Loading test {'directory': '/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/core', 'file_name': 'log_dir_failure_test.py', 'method_name': 'test_replication_with_disk_failure', 'cls_name': 'LogDirFailureTest', 'injected_args': {'bounce_broker': False, 'security_protocol': 'PLAINTEXT', 'broker_type': 'follower'}} 08:56:03 [INFO:2017-08-10 08:56:05,134]: RunnerClient: kafkatest.tests.core.log_dir_failure_test.LogDirFailureTest.test_replication_with_disk_failure.bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower: Setting up... 08:56:10 [INFO:2017-08-10 08:56:11,791]: RunnerClient: kafkatest.tests.core.log_dir_failure_test.LogDirFailureTest.test_replication_with_disk_failure.bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower: Running... 08:57:27 [INFO:2017-08-10 08:57:28,608]: RunnerClient: kafkatest.tests.core.log_dir_failure_test.LogDirFailureTest.test_replication_with_disk_failure.bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower: FAIL: Consumer failed to consume messages for 60s. 08:57:27 Traceback (most recent call last): 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", line 123, in run 08:57:27 data = self.run_test() 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", line 176, in run_test 08:57:27 return self.test_context.function(self.test) 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py", line 321, in wrapper 08:57:27 return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/core/log_dir_failure_test.py", line 119, in test_replication_with_disk_failure 08:57:27 self.start_producer_and_consumer() 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/produce_consume_validate.py", line 79, in start_producer_and_consumer 08:57:27 self.consumer_start_timeout_sec) 08:57:27 File "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/utils/util.py", line 36, in wait_until 08:57:27 raise TimeoutError(err_msg) 08:57:27 TimeoutError: Consumer failed to consume messages for 60s. {code} Full logs here: s3://confluent-kafka-system-test-results/2017-08-10--001.1502382693--apache--trunk--75b0f30/LogDirFailureTest/test_replication_with_disk_failure/bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower/48.tgz > LogDirFailureTest system test fails > ----------------------------------- > > Key: KAFKA-5663 > URL: https://issues.apache.org/jira/browse/KAFKA-5663 > Project: Kafka > Issue Type: Bug > Reporter: Apurva Mehta > Assignee: Dong Lin > Fix For: 1.0.0 > > > The recently added JBOD system test failed last night. > {noformat} > Producer failed to produce messages for 20s. > Traceback (most recent call last): > File > "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", > line 123, in run > data = self.run_test() > File > "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", > line 176, in run_test > return self.test_context.function(self.test) > File > "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py", > line 321, in wrapper > return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) > File > "/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/core/log_dir_failure_test.py", > line 166, in test_replication_with_disk_failure > self.start_producer_and_consumer() > File > "/home/jenkins/workspace/system-test-kafka-trunk/kafka/tests/kafkatest/tests/produce_consume_validate.py", > line 75, in start_producer_and_consumer > self.producer_start_timeout_sec) > File > "/home/jenkins/workspace/system-test-kafka-trunk/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/utils/util.py", > line 36, in wait_until > raise TimeoutError(err_msg) > TimeoutError: Producer failed to produce messages for 20s. > {noformat} > Complete logs here: > http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2017-07-26--001.1501074756--apache--trunk--91c207c/LogDirFailureTest/test_replication_with_disk_failure/bounce_broker=False.security_protocol=PLAINTEXT.broker_type=follower/48.tgz -- This message was sent by Atlassian JIRA (v6.4.14#64029)