[jira] [Updated] (KAFKA-2363) ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread Transient Failure
[
https://issues.apache.org/jira/browse/KAFKA-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fangmin Lv updated KAFKA-2363:
--
Assignee: (was: Fangmin Lv)
Reviewer: (was: Jason Gustafson)
Fix Version/s: 0.9.0
Description:
{code}
kafka.api.ProducerSendTest testCloseWithZeroTimeoutFromCallerThread
STANDARD_OUT
[2015-07-24 23:13:05,148] WARN fsync-ing the write ahead log in SyncThread:0
took 1084ms which will adversely effect operation latency. See the ZooKeeper
troubleshooting guide (org.apache.zookeeper.s
erver.persistence.FileTxnLog:334)
kafka.api.ProducerSendTest testCloseWithZeroTimeoutFromCallerThread FAILED
java.lang.AssertionError: No request is complete.
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:44)
at
kafka.api.ProducerSendTest$$anonfun$testCloseWithZeroTimeoutFromCallerThread$1.apply$mcVI$sp(ProducerSendTest.scala:343)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
kafka.api.ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread(ProducerSendTest.scala:340)
{code}
was:
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread Transient Failure
---
Key: KAFKA-2363
URL: https://issues.apache.org/jira/browse/KAFKA-2363
Project: Kafka
Issue Type: Sub-task
Reporter: Fangmin Lv
Labels: newbie
Fix For: 0.9.0
{code}
kafka.api.ProducerSendTest testCloseWithZeroTimeoutFromCallerThread
STANDARD_OUT
[2015-07-24 23:13:05,148] WARN fsync-ing the write ahead log in SyncThread:0
took 1084ms which will adversely effect operation latency. See the ZooKeeper
troubleshooting guide (org.apache.zookeeper.s
erver.persistence.FileTxnLog:334)
kafka.api.ProducerSendTest testCloseWithZeroTimeoutFromCallerThread FAILED
java.lang.AssertionError: No request is complete.
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:44)
at
kafka.api.ProducerSendTest$$anonfun$testCloseWithZeroTimeoutFromCallerThread$1.apply$mcVI$sp(ProducerSendTest.scala:343)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
kafka.api.ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread(ProducerSendTest.scala:340)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (KAFKA-2363) ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread Transient Failure
Fangmin Lv created KAFKA-2363:
-
Summary: ProducerSendTest.testCloseWithZeroTimeoutFromCallerThread
Transient Failure
Key: KAFKA-2363
URL: https://issues.apache.org/jira/browse/KAFKA-2363
Project: Kafka
Issue Type: Sub-task
Reporter: Fangmin Lv
Assignee: Fangmin Lv
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641027#comment-14641027
]
Fangmin Lv commented on KAFKA-2055:
---
Sure, update it now.
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2055.patch, KAFKA-2055.patch
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640833#comment-14640833
]
Fangmin Lv commented on KAFKA-2055:
---
Hi Jason, sorry for lately reply, if you don't mind, I will keep working on
this JIRA, and provide a patch soon.
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2055.patch
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14640943#comment-14640943
]
Fangmin Lv commented on KAFKA-2055:
---
[~guozhang], I've just settled down in a new company, a bit messy until now. I
will follow up, and provide a patch today. I'm also interested in the general
fix, hope I can make more contribution on that.
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2055.patch
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fangmin Lv updated KAFKA-2055:
--
Attachment: KAFKA-2055.patch
Update patch to use TestUtils.waitUntilTrue instead of sleep.
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2055.patch, KAFKA-2055.patch
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fangmin Lv updated KAFKA-2055:
--
Attachment: KAFKA-2055.patch
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2055.patch
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503051#comment-14503051
]
Fangmin Lv commented on KAFKA-2055:
---
There is a case that the leader is shutting down just before syncing the last
high watermark to the followers. After that, one of the followers will be
elected as the new leader, which will return the previous high watermark when
calling the consumer.seekToEnd(). This is why the
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures failed occasionally.
For example, assume broker B0 is the leader of topic partition (topic, 0),
broker B1 and B2 are followers.
1. At the moment before B0 is going to shutdown, the (LOE, HW) on B0, B1, B2
are (1000, 1000), (1000, 984), (1000, 984).
2. B0 is shutting down.
3. B1 and B2 issue fetch request with fetch offset 1000.
4. B1 and B2 received error in fetch request.
5. Consumer send seekToEnd request to the leader, but it failed due to the new
leader is not ready.
6. One of B1 or B2 is elected as the new leader.
7. When the client retry to fetch the last offset, the new leader will return
the HW 984.
8. Assert failure, as the client is expecting to receive 1000 instead of 984.
Is this the expected behaviour of Kafka? Any suggestion to fix this except
adding sleep time before starting BounceBrokerSchedule in the test case?
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KAFKA-2056) PartitionAssignorTest.testRangePartitionAssignor transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fangmin Lv updated KAFKA-2056:
--
Attachment: KAFKA-2056.patch
PartitionAssignorTest.testRangePartitionAssignor transient failure
--
Key: KAFKA-2056
URL: https://issues.apache.org/jira/browse/KAFKA-2056
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2056.patch, KAFKA-2056.patch
{code}
unit.kafka.consumer.PartitionAssignorTest testRangePartitionAssignor FAILED
java.lang.NullPointerException
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:173)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:172)
at scala.collection.immutable.List.foreach(List.scala:318)
at
unit.kafka.consumer.PartitionAssignorTest$.unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify(PartitionAssignorTest.scala:172)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$testRangePartitionAssignor$1.apply$mcVI$sp(PartitionAssignorTest.scala:79)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
unit.kafka.consumer.PartitionAssignorTest.testRangePartitionAssignor(PartitionAssignorTest.scala:60)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2056) PartitionAssignorTest.testRangePartitionAssignor transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14495463#comment-14495463
]
Fangmin Lv commented on KAFKA-2056:
---
[~guozhang] I attached a patch, within which the consumers with no partitions
are given Map.empty value. This is done before exiting the assign function.
Instead of this way, we can also initialize partitionAssignments with the
Map.empty for every consumer at the beginning. Which way do you think is more
acceptable?
PartitionAssignorTest.testRangePartitionAssignor transient failure
--
Key: KAFKA-2056
URL: https://issues.apache.org/jira/browse/KAFKA-2056
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2056.patch, KAFKA-2056.patch
{code}
unit.kafka.consumer.PartitionAssignorTest testRangePartitionAssignor FAILED
java.lang.NullPointerException
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:173)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:172)
at scala.collection.immutable.List.foreach(List.scala:318)
at
unit.kafka.consumer.PartitionAssignorTest$.unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify(PartitionAssignorTest.scala:172)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$testRangePartitionAssignor$1.apply$mcVI$sp(PartitionAssignorTest.scala:79)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
unit.kafka.consumer.PartitionAssignorTest.testRangePartitionAssignor(PartitionAssignorTest.scala:60)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2056) PartitionAssignorTest.testRangePartitionAssignor transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493495#comment-14493495
]
Fangmin Lv commented on KAFKA-2056:
---
Hi [~guozhang], I agree with you, it's more robust to return a kv pair with an
empty Map if no partitions are assigned. To make sure we don't break anything,
I will check the code base before changing the behaviour of
PartitionAssignor.assign().
PartitionAssignorTest.testRangePartitionAssignor transient failure
--
Key: KAFKA-2056
URL: https://issues.apache.org/jira/browse/KAFKA-2056
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
Attachments: KAFKA-2056.patch
{code}
unit.kafka.consumer.PartitionAssignorTest testRangePartitionAssignor FAILED
java.lang.NullPointerException
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:173)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:172)
at scala.collection.immutable.List.foreach(List.scala:318)
at
unit.kafka.consumer.PartitionAssignorTest$.unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify(PartitionAssignorTest.scala:172)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$testRangePartitionAssignor$1.apply$mcVI$sp(PartitionAssignorTest.scala:79)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
unit.kafka.consumer.PartitionAssignorTest.testRangePartitionAssignor(PartitionAssignorTest.scala:60)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14493497#comment-14493497
]
Fangmin Lv commented on KAFKA-2055:
---
[~guozhang] Sure, I'd like to take it over.
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Assigned] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fangmin Lv reassigned KAFKA-2055:
-
Assignee: Fangmin Lv
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Assignee: Fangmin Lv
Labels: newbie
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2056) PartitionAssignorTest.testRangePartitionAssignor transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492121#comment-14492121
]
Fangmin Lv commented on KAFKA-2056:
---
The last few consumers may not be assigned with topic partitions if the
partitions are all assigned to the previous consumers. In this case, some
elements in the assignments collection are null which caused the NPE. We can
check the null element before processing in assignAndVerify function.
PartitionAssignorTest.testRangePartitionAssignor transient failure
--
Key: KAFKA-2056
URL: https://issues.apache.org/jira/browse/KAFKA-2056
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
{code}
unit.kafka.consumer.PartitionAssignorTest testRangePartitionAssignor FAILED
java.lang.NullPointerException
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:173)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:172)
at scala.collection.immutable.List.foreach(List.scala:318)
at
unit.kafka.consumer.PartitionAssignorTest$.unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify(PartitionAssignorTest.scala:172)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$testRangePartitionAssignor$1.apply$mcVI$sp(PartitionAssignorTest.scala:79)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
unit.kafka.consumer.PartitionAssignorTest.testRangePartitionAssignor(PartitionAssignorTest.scala:60)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (KAFKA-2056) PartitionAssignorTest.testRangePartitionAssignor transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Fangmin Lv updated KAFKA-2056:
--
Attachment: KAFKA-2056.patch
PartitionAssignorTest.testRangePartitionAssignor transient failure
--
Key: KAFKA-2056
URL: https://issues.apache.org/jira/browse/KAFKA-2056
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
Attachments: KAFKA-2056.patch
{code}
unit.kafka.consumer.PartitionAssignorTest testRangePartitionAssignor FAILED
java.lang.NullPointerException
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:173)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify$1.apply(PartitionAssignorTest.scala:172)
at scala.collection.immutable.List.foreach(List.scala:318)
at
unit.kafka.consumer.PartitionAssignorTest$.unit$kafka$consumer$PartitionAssignorTest$$assignAndVerify(PartitionAssignorTest.scala:172)
at
unit.kafka.consumer.PartitionAssignorTest$$anonfun$testRangePartitionAssignor$1.apply$mcVI$sp(PartitionAssignorTest.scala:79)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at
unit.kafka.consumer.PartitionAssignorTest.testRangePartitionAssignor(PartitionAssignorTest.scala:60)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490758#comment-14490758
]
Fangmin Lv commented on KAFKA-2055:
---
Hi Guozhang,
I cannot find the ConsumerBounceTest.scala, but I do see this failure occurred:
kafka.api.ConsumerTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:790
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerTest.seekAndCommitWithBrokerFailures(ConsumerTest.scala:201)
at
kafka.api.ConsumerTest.testSeekAndCommitWithBrokerFailures(ConsumerTest.scala:182)
Best,
Fangmin
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2055) ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
[
https://issues.apache.org/jira/browse/KAFKA-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490792#comment-14490792
]
Fangmin Lv commented on KAFKA-2055:
---
[~ewencp] I can see the test case after pulling the latest code base, thanks
for your help.
ConsumerBounceTest.testSeekAndCommitWithBrokerFailures transient failure
Key: KAFKA-2055
URL: https://issues.apache.org/jira/browse/KAFKA-2055
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
{code}
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:976
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
kafka.api.ConsumerBounceTest testSeekAndCommitWithBrokerFailures FAILED
java.lang.AssertionError: expected:1000 but was:913
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.failNotEquals(Assert.java:689)
at org.junit.Assert.assertEquals(Assert.java:127)
at org.junit.Assert.assertEquals(Assert.java:514)
at org.junit.Assert.assertEquals(Assert.java:498)
at
kafka.api.ConsumerBounceTest.seekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:117)
at
kafka.api.ConsumerBounceTest.testSeekAndCommitWithBrokerFailures(ConsumerBounceTest.scala:98)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2059) ZookeeperConsumerConnectorTest.testBasic trasient failure
[
https://issues.apache.org/jira/browse/KAFKA-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482537#comment-14482537
]
Fangmin Lv commented on KAFKA-2059:
---
Every run takes 30 seconds on my machine. I've run the test for a whole day,
and haven't seen any failure. Can you help paste the failed log info so that we
can check what happened? You can use this command to run the single testBasic
test case until it fails:
$ R=0; while [[ $R -eq 0 ]]; do ./gradlew core:test --tests
kafka.javaapi.consumer.ZookeeperConsumerConnectorTest.testBasic --rerun-tasks
-i; R=$?; done | tee ./testBasic.log
ZookeeperConsumerConnectorTest.testBasic trasient failure
-
Key: KAFKA-2059
URL: https://issues.apache.org/jira/browse/KAFKA-2059
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
{code}
kafka.javaapi.consumer.ZookeeperConsumerConnectorTest testBasic FAILED
kafka.common.InconsistentBrokerIdException: Configured brokerId 1 doesn't
match stored brokerId 0 in meta.properties
at kafka.server.KafkaServer.getBrokerId(KafkaServer.scala:443)
at kafka.server.KafkaServer.startup(KafkaServer.scala:116)
at kafka.utils.TestUtils$.createServer(TestUtils.scala:126)
at
kafka.integration.KafkaServerTestHarness$$anonfun$setUp$1.apply(KafkaServerTestHarness.scala:57)
at
kafka.integration.KafkaServerTestHarness$$anonfun$setUp$1.apply(KafkaServerTestHarness.scala:57)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
at scala.collection.AbstractTraversable.map(Traversable.scala:105)
at
kafka.integration.KafkaServerTestHarness$class.setUp(KafkaServerTestHarness.scala:57)
at
kafka.javaapi.consumer.ZookeeperConsumerConnectorTest.setUp(ZookeeperConsumerConnectorTest.scala:41)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-2059) ZookeeperConsumerConnectorTest.testBasic trasient failure
[
https://issues.apache.org/jira/browse/KAFKA-2059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14388046#comment-14388046
]
Fangmin Lv commented on KAFKA-2059:
---
Hi Guozhang,
Is this failure repeatable? How often, occasionally or always failed on your
environment?
I've run this testcase for an hour and haven't seen any failure (run based on
SHA c5df2a8) :
$ while ./gradlew --rerun-tasks -Dtest.single=ZookeeperConsumerConnectorTest
core:test; do echo .; done
Thanks,
Fangmin
ZookeeperConsumerConnectorTest.testBasic trasient failure
-
Key: KAFKA-2059
URL: https://issues.apache.org/jira/browse/KAFKA-2059
Project: Kafka
Issue Type: Sub-task
Reporter: Guozhang Wang
Labels: newbie
{code}
kafka.javaapi.consumer.ZookeeperConsumerConnectorTest testBasic FAILED
kafka.common.InconsistentBrokerIdException: Configured brokerId 1 doesn't
match stored brokerId 0 in meta.properties
at kafka.server.KafkaServer.getBrokerId(KafkaServer.scala:443)
at kafka.server.KafkaServer.startup(KafkaServer.scala:116)
at kafka.utils.TestUtils$.createServer(TestUtils.scala:126)
at
kafka.integration.KafkaServerTestHarness$$anonfun$setUp$1.apply(KafkaServerTestHarness.scala:57)
at
kafka.integration.KafkaServerTestHarness$$anonfun$setUp$1.apply(KafkaServerTestHarness.scala:57)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
at scala.collection.Iterator$class.foreach(Iterator.scala:727)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:72)
at scala.collection.AbstractIterable.foreach(Iterable.scala:54)
at
scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
at scala.collection.AbstractTraversable.map(Traversable.scala:105)
at
kafka.integration.KafkaServerTestHarness$class.setUp(KafkaServerTestHarness.scala:57)
at
kafka.javaapi.consumer.ZookeeperConsumerConnectorTest.setUp(ZookeeperConsumerConnectorTest.scala:41)
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
