[
https://issues.apache.org/jira/browse/KAFKA-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248993#comment-14248993
]
lokesh Birla commented on KAFKA-1806:
-------------------------------------
This problem occurs multiple times in server.log.
Currently I am using:
#added replica fetchers
num.replica.fetchers=4
[2014-08-30 04:00:58,419] ERROR [ReplicaFetcherThread-1-2], Current offset
7343326909 for partition [mmetopic1,0] out of range; reset offset to 7351079341
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:01:58,351] ERROR [ReplicaFetcherThread-1-2], Current offset
7352830699 for partition [mmetopic1,0] out of range; reset offset to 7360600212
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:01:58,398] ERROR [ReplicaFetcherThread-2-2], Current offset
7362122784 for partition [mmetopic1,1] out of range; reset offset to 7369788902
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:01:58,428] ERROR [ReplicaFetcherThread-3-2], Current offset
7349217662 for partition [mmetopic1,2] out of range; reset offset to 7356979468
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:02:58,380] ERROR [ReplicaFetcherThread-3-2], Current offset
7358748697 for partition [mmetopic1,2] out of range; reset offset to 7366511359
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:02:58,431] ERROR [ReplicaFetcherThread-2-2], Current offset
7371546217 for partition [mmetopic1,1] out of range; reset offset to 7379322019
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:02:58,491] ERROR [ReplicaFetcherThread-1-2], Current offset
7362381355 for partition [mmetopic1,0] out of range; reset offset to 7370131818
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:03:58,553] ERROR [ReplicaFetcherThread-3-2], Current offset
7368280588 for partition [mmetopic1,2] out of range; reset offset to 7376042337
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:03:58,606] ERROR [ReplicaFetcherThread-1-2], Current offset
7371895090 for partition [mmetopic1,0] out of range; reset offset to 7379659373
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:03:58,745] ERROR [ReplicaFetcherThread-2-2], Current offset
7381073377 for partition [mmetopic1,1] out of range; reset offset to 7388856060
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:04:58,377] ERROR [ReplicaFetcherThread-2-2], Current offset
7390601461 for partition [mmetopic1,1] out of range; reset offset to 7398383811
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:04:58,378] ERROR [ReplicaFetcherThread-1-2], Current offset
7381410731 for partition [mmetopic1,0] out of range; reset offset to 7389193402
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:04:58,462] ERROR [ReplicaFetcherThread-3-2], Current offset
7377936663 for partition [mmetopic1,2] out of range; reset offset to 7385573885
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:05:58,440] ERROR [ReplicaFetcherThread-2-2], Current offset
7400170911 for partition [mmetopic1,1] out of range; reset offset to 7407915357
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:05:58,441] ERROR [ReplicaFetcherThread-1-2], Current offset
7390968588 for partition [mmetopic1,0] out of range; reset offset to 7398725995
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:05:58,442] ERROR [ReplicaFetcherThread-3-2], Current offset
7387325243 for partition [mmetopic1,2] out of range; reset offset to 7395096361
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:06:58,326] ERROR [ReplicaFetcherThread-1-2], Current offset
7400572665 for partition [mmetopic1,0] out of range; reset offset to 7411422730
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:06:58,346] ERROR [ReplicaFetcherThread-2-2], Current offset
7409827554 for partition [mmetopic1,1] out of range; reset offset to 7417436416
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:06:58,511] ERROR [ReplicaFetcherThread-3-2], Current offset
7396889418 for partition [mmetopic1,2] out of range; reset offset to 7404620618
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:07:58,328] ERROR [ReplicaFetcherThread-2-2], Current offset
7419467753 for partition [mmetopic1,1] out of range; reset offset to 7420615385
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:07:58,362] ERROR [ReplicaFetcherThread-3-2], Current offset
7406461331 for partition [mmetopic1,2] out of range; reset offset to 7410977640
(kafka.server.ReplicaFetcherThread)
[2014-08-30 04:07:58,588] ERROR [ReplicaFetcherThread-1-2], Current offset
7413376626 for partition [mmetopic1,0] out of range; reset offset to 7414599975
(kafka.server.ReplicaFetcherThread)
> broker can still expose uncommitted data to a consumer
> ------------------------------------------------------
>
> Key: KAFKA-1806
> URL: https://issues.apache.org/jira/browse/KAFKA-1806
> Project: Kafka
> Issue Type: Bug
> Components: consumer
> Affects Versions: 0.8.1.1
> Reporter: lokesh Birla
> Assignee: Neha Narkhede
>
> Although following issue: https://issues.apache.org/jira/browse/KAFKA-727
> is marked fixed but I still see this issue in 0.8.1.1. I am able to
> reproducer the issue consistently.
> [2014-08-18 06:43:58,356] ERROR [KafkaApi-1] Error when processing fetch
> request for partition [mmetopic4,2] offset 1940029 from consumer with
> correlation id 21 (kafka.server.Kaf
> kaApis)
> java.lang.IllegalArgumentException: Attempt to read with a maximum offset
> (1818353) less than the start offset (1940029).
> at kafka.log.LogSegment.read(LogSegment.scala:136)
> at kafka.log.Log.read(Log.scala:386)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSet(KafkaApis.scala:530)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:476)
> at
> kafka.server.KafkaApis$$anonfun$kafka$server$KafkaApis$$readMessageSets$1.apply(KafkaApis.scala:471)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
> at
> scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:233)
> at scala.collection.immutable.Map$Map1.foreach(Map.scala:119)
> at
> scala.collection.TraversableLike$class.map(TraversableLike.scala:233)
> at scala.collection.immutable.Map$Map1.map(Map.scala:107)
> at
> kafka.server.KafkaApis.kafka$server$KafkaApis$$readMessageSets(KafkaApis.scala:471)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:783)
> at
> kafka.server.KafkaApis$FetchRequestPurgatory.expire(KafkaApis.scala:765)
> at
> kafka.server.RequestPurgatory$ExpiredRequestReaper.run(RequestPurgatory.scala:216)
> at java.lang.Thread.run(Thread.java:745)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
