t; > different (it’s the other class for me). The only thing I can offer
> now
> > > is
> > > > did you put quotes around the arg to --formatter so you don’t get
> weird
> > > > shell interference?
> > > >
> > > > -Todd
> > &g
ifferent (it’s the other class for me). The only thing I can offer now
> is
> > did you put quotes around the arg to --formatter so you don’t get weird
> > shell interference?
> >
> > -Todd
> >
> >
> > On Mon, May 9, 2016 at 8:18 AM, Cliff Rhyne <crh..
atter kafka.coordinator.GroupMetadataManager\$OffsetsMessageFormatter
>
>
> If for some reason that doesn’t work, you can try
> "kafka.server.OffsetManager\$OffsetsMessageFormatter” instead.
>
> -Todd
>
>
>
>
> On Sun, May 8, 2016 at 1:26 PM, Cliff Rhyne <crh...@
Is there a special way to read the consumer offsets topic?
Thanks,
Cliff
--
Cliff Rhyne
Software Engineering Manager
e: crh...@signal.co
signal.co
Cut Through the Noise
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may
me. I consider it very
> likely in the next iteration that we will either 1) add a background thread
> to the consumer for asynchronous heartbeating or 2) expose an API to make
> it easy for users to do the same thing.
>
>
> Thanks,
> Jason
>
> On Wed, May 4, 2016 at 1:4
iff Rhyne
--
Cliff Rhyne
Software Engineering Manager
e: crh...@signal.co
signal.co
Cut Through the Noise
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s) and may contain confidential and privileged
information. Any unauthori
monitor whether the latency will
> start degrading over time (in 1 week's time for instance). Hopefully, with
> Kafka 0.9.0.0 that won't happen.
>
> If you have other ideas what may be causing that, please, let me know. I
> appreciate it.
>
> Cheers,
> Leo
>
> On 21
p of [group,
> partition]
> > ->
> > > > > latest_offset, while the offset commit history is kept in the log.
> > When
> > > > we
> > > > > delete the group, we remove the corresponding entry from memory map
> > and
> > &g
Just following up on this concern. Is there a constraint that prevents
ConsumerGroupCommand from reporting offsets on a group if no members are
connected, or is this just the current implementation?
Thanks,
Cliff
On Mon, Jan 25, 2016 at 3:50 PM, Cliff Rhyne <crh...@signal.co> wrote:
lly resolve your case.
>
> Guozhang
>
>
> On Thu, Jan 28, 2016 at 12:13 PM, Cliff Rhyne <crh...@signal.co> wrote:
>
> > Just following up on this concern. Is there a constraint that prevents
> > ConsumerGroupCommand from reporting offsets on a group if no members a
[
https://issues.apache.org/jira/browse/KAFKA-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Cliff Rhyne updated KAFKA-3161:
---
Description:
The KafkaConsumer takes a Properties class for the config, but then instead of
using
Cliff Rhyne created KAFKA-3161:
--
Summary: Refactor Java client's use of the Properties class
Key: KAFKA-3161
URL: https://issues.apache.org/jira/browse/KAFKA-3161
Project: Kafka
Issue Type
that I'm not aware of or is this something that could
be changed?
Thanks,
Cliff
--
Cliff Rhyne
Software Engineering Lead
e: crh...@signal.co
signal.co
Cut Through the Noise
This e-mail and any files transmitted with it are for the sole use of the
intended recipient(s
ault.replication.factor=3
>
> auto.create.topics.enable=true
>
> controlled.shutdown.enable=true
>
> delete.topic.enable=true
>
> # Zookeeper #
>
> # Zookeeper connection string (see zookeeper docs for details).
> #
gt; >
>
> Not sure I understand the issue. Rebalances are triggered when either 1)
> group membership changes, 2) a consumer's subscription changes, or 3) when
> the number of partitions for a topic changes.
>
> -Jason
>
> On Thu, Jan 7, 2016 at 1:38 PM, Cliff Rhyne <
ers just use separate groups.
> Would that not make sense in this case?
>
> -Jason
>
> On Thu, Jan 7, 2016 at 1:54 PM, Cliff Rhyne <crh...@signal.co> wrote:
>
> > I'll explain.
> >
> > Say there are two topics, foo and bar. Foo has two partitions (foo-0 and
&g
urning too.
> > > > > >
> > > > > > If those assumptions are correct, I think a configuration makes
> > more
> > > > > sense.
> > > > > > 1. We are unlikely to want this parameter to be change at the
> > > lifetime
>
gt; wrote:
> > > > > > >
> > > > > > > > Given the background, it sounds like you'll generally want
> each
> > > > call
> > > > > to
> > > > > > > > poll() to return the same number of events (which is
(with the committed() method), but it doesn't replace
the OffsetRequest.
Is this a value we could either create another request type for or add it
to the OffsetAndMetadata response for the committed() method?
Thanks,
Cliff
On Thu, Nov 5, 2015 at 1:12 PM, Cliff Rhyne <crh...@signal.co> wrote:
h producer and consumer (both high level and
> > >> simple) class/object should I be using
> > >>
> > >> Thanks a lot,
> > >> Prabhjot
> > >>
> > >
> > >
> > >
> > > --
> > > -
v. 6 (Friday) and start the RC on Nov. 9 (Monday).
> > >
> > >
> > >
> >
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20KAFKA%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND%20priorit
Cliff Rhyne created KAFKA-2725:
--
Summary: high level consumer rebalances with auto-commit disabled
should throw an exception
Key: KAFKA-2725
URL: https://issues.apache.org/jira/browse/KAFKA-2725
Project
upports callbacks during rebalances
> and can address the problem in KAFKA-2725 better.
>
> Thanks,
>
> Jun
>
>> On Mon, Nov 2, 2015 at 11:16 AM, Cliff Rhyne <crh...@signal.co> wrote:
>>
>> Hi Jun,
>>
>> I openned KAFKA-2725 based on my exper
ous in our situation.
One or both of these might need to be behind a consumer config parameter,
I'm not familiar enough with when these get created and when the behavior
is simply changed for the better for the kafka project.
What are your thoughts?
Thanks,
Cliff
On Fri, Oct 23, 2015 at 10:57 AM, C
mer
> itself dropped out of the group and rejoins. This typically happens when
> you have a ZK session timeout. In that case, you should see "ZK expired" in
> your log. You can search for that and see if that is the problem.
>
> Jiangjie (Becket) Qin
>
>
> On Thu, O
on a partition and shutdown is called before starting a high level consumer
but shutdown is done asynchronously?
- What are the various things that can cause a consumer rebalance other
than adding / removing high level consumers?
Thanks,
Cliff
On Wed, Oct 21, 2015 at 4:20 PM, Cliff Rhyne <
Hi,
My team and I are looking into a problem where the Java high level consumer
provides duplicate messages if we turn auto commit off (using version
0.8.2.1 of the server and Java client). The expected sequence of events
are:
1. Start high-level consumer and initialize a KafkaStream to get a
> when they start consuming again, that they will consume from the last
> committed offset.
>
> You should get more verification on this, tho. I might be remembering
> wrong.
>
> -James
>
> > On Oct 21, 2015, at 8:40 AM, Cliff Rhyne <crh...@signal.co>
> Hi Cliff,
>
> One other case I observed in my environment is - when there were gc pauses
> on one of our high level consumer in the group.
>
> Thanks,
> Kris
>
> On Wed, Oct 21, 2015 at 10:12 AM, Cliff Rhyne <crh...@signal.co> wrote:
>
> > Hi James,
&
29 matches
Mail list logo
