my bad its consumer.endOffsets in ConsumerGroupCommand.scala. https://github.com/apache/kafka/blob/ef97ed7ee5cb883a30245ea4f77ef99d4db15373/core/src/main/scala/kafka/admin/ConsumerGroupCommand.scala#L467
On 23 December 2017 at 13:07, Ted Yu <yuzhih...@gmail.com> wrote: > Sahil: > I did a quick search in 0.11.0 branch and trunk for getEndOffsets but > didn't find any occurrence. > > Mind giving us the location (and class) where getEndOffsets is called ? > > Thanks > > On Fri, Dec 22, 2017 at 11:29 PM, sahil aggarwal <sahil.ag...@gmail.com> > wrote: > > > Fixed it by some code change in ConsumerGroupCommand.scala. Possible to > > push it upstream for 0.10.* ? > > > > It seems to be fixed in 0.11.* where it uses getEndOffsets() which has > > requestTimeoutMs instead of Long.MAX_VALUE. > > > > On 23 December 2017 at 02:46, Matthias J. Sax <matth...@confluent.io> > > wrote: > > > > > Your observation is correct. KafkaConsumer.position() is a blocking > > > call. It's a know issue that there is no configurable timeout value. > > > > > > I am not aware of any workaround. > > > > > > > > > -Matthias > > > > > > On 12/21/17 6:05 AM, sahil aggarwal wrote: > > > > Hi, > > > > > > > > Facing issue where *kafka-consumer-groups.sh --describe * get stuck > if > > > one > > > > of the partition is unavailable i.e no leader. Going through some > code > > > > found that it does following to get log end offset: > > > > > > > > * Create consumer > > > > * For each partition > > > > * assign partition > > > > * seek to end > > > > * get position > > > > > > > > Issue is KafkaConsumer.posiiton() use Fetcher. > retrieveOffsetsByTimes() > > > > internally which is called with timeout Long.MAX_VALUE and it gets > > stuck > > > in > > > > loop there. > > > > > > > > > > > > Any pointers? > > > > > > > > > > > > *Version*: 0.10.0.1 > > > > > > > > > > > > Thanks, > > > > Sahil > > > > > > > > > > > > >
