On Thu, Nov 2, 2017 at 12:58 AM, Manikumar
wrote:
> Any exceptions in the mirror maker logs? may be you can enable mirror maker
> trace logs.
> maybe all messages are having same key? Can you recheck partition count on
> target cluster?
>
>
> On Thu, Nov 2, 2017 at 2:45 A
Apologies for bumping my own post, but really hoping someone has experience
with MirrorMaker who might be able to help with my question below. :)
Thanks!
Chris
On Fri, Oct 27, 2017 at 10:59 AM, Chris Neal wrote:
> Hi all,
>
> I've been struggling with this for awhile and need so
Hi all,
I've been struggling with this for awhile and need some help please. :)
I have a source cluster running Kafka 0.8.1.1 with about 900 topics.
I have a target cluster running Kafka 0.10.2 with those same topics
pre-created with the same number of partitions per topic as the source
cluster.
gt;
> Carl
>
> On Fri, Jul 21, 2017 at 10:50 AM, Chris Neal wrote:
>
> > Thanks Carl.
> >
> > Always fun to do this stuff in production... ;)
> >
> > Appreciate the input. I'll try a full cycle and see how that works.
> >
> > In your op
p the Kafka process on each broker and take Zookeeper
> offline before removing the files and zookeeper paths. Otherwise there may
> be a race condition between brokers which could cause the cluster to retain
> information for the topic.
>
> Carl
>
> On Fri, Jul 21, 2017 at 9:06 A
> For Windows based cluster implementation, log/topic cleanup doesn't work
> out of the box. Users are more or less aware of it, and doing their own
> maintenance as workaround.
> If you have issues on Topic deletion not working properly on Windows (i.e.
> with topic de
On Thu, Jul 20, 2017 at 10:37 PM, Chris Neal wrote:
> Thanks again for the replies. VERY much appreciated. I'll check both
> /admin/delete_topics and /config/topics.
>
> Chris
>
> On Thu, Jul 20, 2017 at 9:22 PM, Carl Haferd
> wrote:
>
>> If delete normally w
l zookeeper entries in the /admin/delete_topics
> path or in the other /admin folders?
>
> Does the topic name still exist in zookeeper under /config/topics? If so,
> that should probably deleted as well.
>
> Carl
>
> On Thu, Jul 20, 2017 at 6:42 PM, Chris Neal wrote:
>
>
ually remove the topic's log files from the configured log.dirs folder
> > on each broker in addition to removing the topic's zookeeper path.
> >
> > Carl
> >
> > On Thu, Jul 20, 2017 at 10:06 AM, Chris Neal wrote:
> >
> > > Hi all,
> >
Hi all,
I have a weird situation here. I have deleted a few topics on my 0.8.1.1
cluster (old, I know...). The deletes succeeded according to the
controller.log:
[2017-07-20 16:40:31,175] INFO [TopicChangeListener on Controller 1]: New
topics: [Set()], deleted topics:
[Set(perf_doorway-supplier
g...
Sorry to keep bugging you for something that should be quite simple. :(
Chris
On Fri, Mar 24, 2017 at 12:37 PM, Chris Neal wrote:
> Again, thank you for the feedback. That link was very helpful!
>
> I adjusted my consumer/producer configs to be:
>
> consumer:
&
d to set num.consumer.fetchers, partition.assignment.strategy
> props.
> Use the --num.streams option to specify the number of consumer threads to
> create.
>
> https://community.hortonworks.com/articles/79891/kafka-
> mirror-maker-best-practices.html
>
> On Fri, Mar 24, 2017
are sending keyed messages, they may be going to the same partition.
>
> On Thu, Mar 23, 2017 at 11:15 PM, Chris Neal wrote:
>
> > Hi everyone,
> >
> > I am using MirrorMaker to consume from a 0.8.2.2 cluster and produce to a
> > 0.10.2 cluster. All the topi
Hi everyone,
I am using MirrorMaker to consume from a 0.8.2.2 cluster and produce to a
0.10.2 cluster. All the topics have two partitions on both clusters. My
consumer.properties is:
zookeeper.connect=[string of servers]
group.id=MirrorMaker
num.consumer.fetchers=2
partition.assignment.strategy
On Wed, Apr 13, 2016 at 9:55 AM, Chris Neal wrote:
>
> > Hi all.
> >
> > I'm running a two node cluster that has been rock solid for almost a year
> > and a half. We experienced an outage of one of the two brokers this
> > morning, and from the logs, I&#
Hi all.
I'm running a two node cluster that has been rock solid for almost a year
and a half. We experienced an outage of one of the two brokers this
morning, and from the logs, I'm not sure what happened, and how to prevent
it.
The Kafka version is 0.8.1.1 with Scala 2.10. Java version is Open
tell.
>
> -Clark
>
> Sent from my iPhone
>
> > On May 17, 2015, at 3:42 PM, Chris Neal wrote:
> >
> > Done, and things look clean in Zookeeper now. I'm guessing that it is
> safe
> > for me to try to increase the replication count on this topic again? :)
&
ontroller znode gets instantly re-created but with a different broker
> as the controller.
>
> If you do a get /controller you can see the values change
>
> -Clark
>
> Sent from my iPhone
>
> > On May 17, 2015, at 11:48 AM, Chris Neal wrote:
> >
> > Gah. Sorry f
Gah. Sorry for the spamming replies.
The reassign_partitions znode is also still there, and still emptyFor
what that's worth. :)
Back to thinking that deleting the reassign_partitions znode is the right
way to go.
Chris
On Sun, May 17, 2015 at 1:46 PM, Chris Neal wrote:
> Ok,
(kafka.server.ZookeeperLeaderElector)
[2015-05-17 14:36:58,975] INFO New leader is 0
(kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
[2015-05-17 14:36:58,975] INFO New leader is 0
(kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
Chris
On Sun, May 17, 2015 at 1:43 PM, Chris Neal wrote:
> Thank you ag
see
> if that cleans up the znode.
>
> Delete /controller
>
> If that doesn't work you will have to delete the reassign_partitions znode
> manually
>
> -Clark
>
> Sent from my iPhone
>
> > On May 17, 2015, at 11:16 AM, Chris Neal wrote:
> >
> > Sorry
phemeralOwner = 0x0
dataLength = 29
numChildren = 0
Thank you!
Chris
On Sun, May 17, 2015 at 12:58 PM, Clark Haskins wrote:
> Do a get /admin/reassign_partitions
>
> -Clark
>
> Sent from my iPhone
>
> > On May 17, 2015, at 10:20 AM, Chris Neal wrote:
> >
> > Sure
my iPhone
>
> > On May 17, 2015, at 10:14 AM, Chris Neal wrote:
> >
> > Hi Clark,
> >
> > Thank you for your reply! I do see that znode under /admin:
> >
> > root>
> >
> ./opt/cloudera/parcels/CDH-5.1.3-1.cdh5.1.3.p0.12/lib/zookeeper/
my iPhone
>
> > On May 16, 2015, at 7:16 PM, Chris Neal wrote:
> >
> > Sorry for bumping my own thread. :S Just wanted to get it in front of
> some
> > eyes again!
> >
> > Thanks for your time and help.
> > Chris
> >
> >> On Thu,
Sorry for bumping my own thread. :S Just wanted to get it in front of some
eyes again!
Thanks for your time and help.
Chris
On Thu, May 14, 2015 at 10:24 AM, Chris Neal wrote:
> Hi All,
>
> I am running: kafka_2.10-0.8.1.1, and when I run the
> reassign-partitions.sh script
Hi All,
I am running: kafka_2.10-0.8.1.1, and when I run the
reassign-partitions.sh script, I get this:
Partitions reassignment failed due to Partition reassignment currently in
progress for Map(). Aborting operation
kafka.common.AdminCommandFailedException: Partition reassignment currently
in p
> > Founder, Principal Consultant
> > Big Data Open Source Security LLC
> > http://www.stealth.ly
> > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
> > /
> >
> >
> > On Fri, Jul 25, 2014 at 11:34 AM, Chris Neal wrote:
> >
>
Hi guys,
This JIRA (https://issues.apache.org/jira/browse/KAFKA-1477) leads me to
believe that an authentication layer implementation is planned as part of
the 0.8.2 release. I was wondering if this is still the case?
There was an earlier thread talking about security, but there hasn't been
acti
Pramod,
I got that same error when following the configuration from Raja's
presentation earlier in this thread. If you'll notice the usage for the
console_producer.sh, it is slightly different, which is also slightly
different than the scala code for the ConsoleProducer. :)
When I changed this:
than 6 -> 7, and we didn¹t
> have any problems moving to 7.
>
> -Todd
>
>
> On 6/17/14, 6:22 AM, "Chris Neal" wrote:
>
> >Hi,
> >
> >I was wondering if Kafka has been tested/certified under JRE 1.8?
> >
> >Thanks!
> >Chris
>
>
Hi,
I was wondering if Kafka has been tested/certified under JRE 1.8?
Thanks!
Chris
d it from the source release (as you attempted) - although
> you need to use gradle. Just run "./gradlew jar" - you can see the
> README.md file for more information.
>
> Joel
>
> On Fri, May 23, 2014 at 02:17:21PM -0500, Chris Neal wrote:
> > Hi everyone.
>
Hi everyone.
Looking for some help running the Kafka performance testing shell script.
First got the NoClassDefFound error, and then built from src from these
instructions:
wget http://archive.apache.org/dist/kafka/0.8.1.1/kafka-0.8.1.1-src.tgz
tar -xvf kafka-0.8.1.1-src.tgz
cd kafka-0.8.1.1-src
33 matches
Mail list logo
