I am automating Kafka clusters in the cloud and I am using Ips (stripped to
keep only numbers) to define the broker ids.
You might have to add a shell script or whatever fits to set the broker id.
I hope this might help a bit.
Regards,
Le 3 nov. 2014 23:04, "Otis Gospodnetic" a
écrit :
> Hi,
>
You might be interested by something like Logstash http://logstash.org for
logs and event processing.
Regards,
Florian
Le 5 août 2014 23:17, "Jonathan Weeks" a écrit :
> You can look at something like:
>
> https://github.com/harelba/tail2kafka
>
> (although I don’t know what the effort would be
r, Samza SRE
> Mobile: 505.385.1484
> BlueJeans: https://www.bluejeans.com/chaskins
>
>
> chask...@linkedin.com
> https://www.linkedin.com/in/clarkhaskins
> There is no place like 127.0.0.1
>
>
>
>
> On 7/10/14, 6:07 PM, "Florian Dambrine" wrote:
>
>
Thanks for your answer,
Indeed, I have already worked on this kind of script. I ended up with 800
lines of groovy script that rebalance partitions across the cluster and
minimizing the number of partition moves. I also worked on the partition
leadership balancing.
I still have to work on my scri
chaskins
>
>
> chask...@linkedin.com
> https://www.linkedin.com/in/clarkhaskins
> There is no place like 127.0.0.1
>
>
>
>
> On 7/8/14, 11:11 AM, "Florian Dambrine" wrote:
>
> >I realized that I did not respond to you Clark,
> >
> >Here is th
1812541]},{"topic":"SLOTS","partition":18,"replicas":[102311671,101862816,105114483]},{"topic":"B_IMPRESSION","partition":23,"replicas":[101421743,101671664,101811991]},{"topic":"B_IMPRESSION","partiti
signment.json --verify --broker-list
"ALL_BROKERS_THAT_ARE_RETURNED_BY_ZOOKEEPER_ON_STEP_#1"
#8 Execute a new json part file similar as step #5 util all of them have
ran.
Hope that will help you guys.
On Tue, Jul 8, 2014 at 10:31 AM, Clark Haskins <
chask...@linkedin.com.invalid> w
tation.html#monitoring).
>
> Thanks,
>
> Jun
>
>
> On Mon, Jul 7, 2014 at 4:42 PM, Florian Dambrine
> wrote:
>
> > When I run the tool with the --verify option it says failed for the some
> > partitions.
> >
> > The problem is I do not know if it i
S Site Reliability Engineer
> Kafka, Zookeeper, Samza SRE
> Mobile: 505.385.1484
> BlueJeans: https://www.bluejeans.com/chaskins
>
>
> chask...@linkedin.com
> https://www.linkedin.com/in/clarkhaskins
> There is no place like 127.0.0.1
>
>
>
>
> On 7/7/14,
rebalance a Kafka 0.8.1.1? What could you advise me?
Thanks, and feel free to ask me if you need more details.
--
*Florian Dambrine* | Intern, Big Data
*GumGum* <http://www.gumgum.com/> | *Ads that stick*
209-797-3994 | flor...@gumgum.com
afraid to run this tool on bigger topics.
I also took a look into the manual way of reassigning partitions. the
problem is that I always have to specify 3 replicas even if I just want to
move only one to my new broker.
Do you know any tool or script to help me in this process?
Thanks for your help
afraid to run this tool on bigger topics.
I also took a look into the manual way of reassigning partitions. the
problem is that I always have to specify 3 replicas even if I just want to
move only one to my new broker.
Do you know any tool or script to help me in this process?
Thanks for your help
afraid to run this tool on bigger topics.
I also took a look into the manual way of reassigning partitions. the
problem is that I always have to specify 3 replicas even if I just want to
move only one to my new broker.
Do you know any tool or script to help me in this process?
Thanks for your help
13 matches
Mail list logo
