RE: how to sync HaProxy config with ZooKeeper
Hi, thanks! Looking forward to look at it and try to use С уважением, Зайцев Сергей Александрович, Департамент Реализации Интеграционных Решений Т. +7 (495) 514 1410 (доб. 4236) M. +7 (926) 143-4858 s.zayt...@r-style.com www.r-style.com -Original Message- From: Steven Le Roux [mailto:ste...@le-roux.info] Sent: Thursday, July 10, 2014 1:21 AM To: Зайцев Сергей Александрович Cc: Vincent Bernat; haproxy@formilux.org Subject: Re: how to sync HaProxy config with ZooKeeper Hi, we have a component that is exactly doing this. I will see if we can opensource it. It's written in Golang using gozk. I was planning to give a glimpse at etcd doing the same thing. On Wed, Jul 9, 2014 at 4:38 PM, Зайцев Сергей Александрович s.zayt...@r-style.com wrote: Thanks a lot! Seems to be exactly what I was looking for ) Gonna check it up С уважением, Зайцев Сергей Александрович, Департамент Реализации Интеграционных Решений Т. +7 (495) 514 1410 (доб. 4236) M. +7 (926) 143-4858 s.zayt...@r-style.com www.r-style.com -Original Message- From: Vincent Bernat [mailto:ber...@luffy.cx] Sent: Wednesday, July 09, 2014 6:36 PM To: Зайцев Сергей Александрович Cc: haproxy@formilux.org Subject: Re: how to sync HaProxy config with ZooKeeper ❦ 9 juillet 2014 14:28 GMT, Зайцев Сергей Александрович s.zayt...@r-style.com : I want to automatically udpate HaProxy's configuration depending on my app's state. I mean, that when I have a number of components running, I update my ZooKeeper configuration as soon as new node joins the cluster ( an leaves it also ). But what I also need - is a way ZooKeeper's watcher being able to udpate HaProxy configuraion in order to provide actual information for the load balance to avoid balance for absent cluster nodes. So the question is - is the a way to synchronized HaProxy's configuration with ZooKeeper ( somehow ). It is unlikely that someone has integrated Zookeeper into HAProxy but you can rely on an external process to watch zookeeper, update HAProxy state and reload. https://github.com/rs/zkfarmer https://github.com/twitter/twitcher The first one needs some additional glue to watch file changes and rebuild HAProxy configuration. -- printk(Entering UltraSMPenguin Mode...\n); 2.2.16 /usr/src/linux/arch/sparc64/kernel/smp.c -- Steven Le Roux Jabber-ID : ste...@jabber.fr 0x39494CCB ste...@le-roux.info 2FF7 226B 552E 4709 03F0 6281 72D7 A010 3949 4CCB
Re: how to sync HaProxy config with ZooKeeper
It's not zookeeper backed, but I'm curious if anybody's using: https://github.com/kelseyhightower/confd to rewrite haproxy config and reloading. On Thu, Jul 10, 2014 at 12:19 AM, Зайцев Сергей Александрович s.zayt...@r-style.com wrote: Hi, thanks! Looking forward to look at it and try to use С уважением, Зайцев Сергей Александрович, Департамент Реализации Интеграционных Решений Т. +7 (495) 514 1410 (доб. 4236) M. +7 (926) 143-4858 s.zayt...@r-style.com www.r-style.com -Original Message- From: Steven Le Roux [mailto:ste...@le-roux.info] Sent: Thursday, July 10, 2014 1:21 AM To: Зайцев Сергей Александрович Cc: Vincent Bernat; haproxy@formilux.org Subject: Re: how to sync HaProxy config with ZooKeeper Hi, we have a component that is exactly doing this. I will see if we can opensource it. It's written in Golang using gozk. I was planning to give a glimpse at etcd doing the same thing. On Wed, Jul 9, 2014 at 4:38 PM, Зайцев Сергей Александрович s.zayt...@r-style.com wrote: Thanks a lot! Seems to be exactly what I was looking for ) Gonna check it up С уважением, Зайцев Сергей Александрович, Департамент Реализации Интеграционных Решений Т. +7 (495) 514 1410 (доб. 4236) M. +7 (926) 143-4858 s.zayt...@r-style.com www.r-style.com -Original Message- From: Vincent Bernat [mailto:ber...@luffy.cx] Sent: Wednesday, July 09, 2014 6:36 PM To: Зайцев Сергей Александрович Cc: haproxy@formilux.org Subject: Re: how to sync HaProxy config with ZooKeeper ❦ 9 juillet 2014 14:28 GMT, Зайцев Сергей Александрович s.zayt...@r-style.com : I want to automatically udpate HaProxy's configuration depending on my app's state. I mean, that when I have a number of components running, I update my ZooKeeper configuration as soon as new node joins the cluster ( an leaves it also ). But what I also need - is a way ZooKeeper's watcher being able to udpate HaProxy configuraion in order to provide actual information for the load balance to avoid balance for absent cluster nodes. So the question is - is the a way to synchronized HaProxy's configuration with ZooKeeper ( somehow ). It is unlikely that someone has integrated Zookeeper into HAProxy but you can rely on an external process to watch zookeeper, update HAProxy state and reload. https://github.com/rs/zkfarmer https://github.com/twitter/twitcher The first one needs some additional glue to watch file changes and rebuild HAProxy configuration. -- printk(Entering UltraSMPenguin Mode...\n); 2.2.16 /usr/src/linux/arch/sparc64/kernel/smp.c -- Steven Le Roux Jabber-ID : ste...@jabber.fr 0x39494CCB ste...@le-roux.info 2FF7 226B 552E 4709 03F0 6281 72D7 A010 3949 4CCB
Re: how to sync HaProxy config with ZooKeeper
Hi, Зайцев Сергей Александрович wrote: So the question is - is the a way to synchronized HaProxy's configuration with ZooKeeper ( somehow ). Airbnb uses a tool called Synapse [1] as part of their Smartstack platform [2]. It integrates HAProxy and zookeeper to provide high availability by using node-local loadbalancers that get reconfigured on the fly according to data in zookeeper. Synapse provides an external watcher program which reconfigures HAProxy using both the unix socket (where possible) as well as by generating updated config files. To try it out, you could use the provided smartstack Chef cookbook [3]. Patrick Viet (formerly of Airbnb, now at GetYourGuide) recently talked about Smartstack (and the adaptations they have done at GetYourGuide, i.e. changing from Zookeeper to Serf) at the Berlin Devops Meetup. You can find the video on Youtube [4]. Maybe, you could gather some ideas and implementation details from their solution. Regards, Holger [1] https://github.com/airbnb/synapse [2] http://nerds.airbnb.com/smartstack-service-discovery-cloud/ [3] https://github.com/airbnb/smartstack-cookbook [4] https://www.youtube.com/watch?v=y739V9MMoLE
Re: how to sync HaProxy config with ZooKeeper
❦ 9 juillet 2014 14:28 GMT, Зайцев Сергей Александрович s.zayt...@r-style.com : I want to automatically udpate HaProxy's configuration depending on my app's state. I mean, that when I have a number of components running, I update my ZooKeeper configuration as soon as new node joins the cluster ( an leaves it also ). But what I also need - is a way ZooKeeper's watcher being able to udpate HaProxy configuraion in order to provide actual information for the load balance to avoid balance for absent cluster nodes. So the question is - is the a way to synchronized HaProxy's configuration with ZooKeeper ( somehow ). It is unlikely that someone has integrated Zookeeper into HAProxy but you can rely on an external process to watch zookeeper, update HAProxy state and reload. https://github.com/rs/zkfarmer https://github.com/twitter/twitcher The first one needs some additional glue to watch file changes and rebuild HAProxy configuration. -- printk(Entering UltraSMPenguin Mode...\n); 2.2.16 /usr/src/linux/arch/sparc64/kernel/smp.c
RE: how to sync HaProxy config with ZooKeeper
Thanks a lot! Seems to be exactly what I was looking for ) Gonna check it up С уважением, Зайцев Сергей Александрович, Департамент Реализации Интеграционных Решений Т. +7 (495) 514 1410 (доб. 4236) M. +7 (926) 143-4858 s.zayt...@r-style.com www.r-style.com -Original Message- From: Vincent Bernat [mailto:ber...@luffy.cx] Sent: Wednesday, July 09, 2014 6:36 PM To: Зайцев Сергей Александрович Cc: haproxy@formilux.org Subject: Re: how to sync HaProxy config with ZooKeeper ❦ 9 juillet 2014 14:28 GMT, Зайцев Сергей Александрович s.zayt...@r-style.com : I want to automatically udpate HaProxy's configuration depending on my app's state. I mean, that when I have a number of components running, I update my ZooKeeper configuration as soon as new node joins the cluster ( an leaves it also ). But what I also need - is a way ZooKeeper's watcher being able to udpate HaProxy configuraion in order to provide actual information for the load balance to avoid balance for absent cluster nodes. So the question is - is the a way to synchronized HaProxy's configuration with ZooKeeper ( somehow ). It is unlikely that someone has integrated Zookeeper into HAProxy but you can rely on an external process to watch zookeeper, update HAProxy state and reload. https://github.com/rs/zkfarmer https://github.com/twitter/twitcher The first one needs some additional glue to watch file changes and rebuild HAProxy configuration. -- printk(Entering UltraSMPenguin Mode...\n); 2.2.16 /usr/src/linux/arch/sparc64/kernel/smp.c
Re: how to sync HaProxy config with ZooKeeper
Hi, we have a component that is exactly doing this. I will see if we can opensource it. It's written in Golang using gozk. I was planning to give a glimpse at etcd doing the same thing. On Wed, Jul 9, 2014 at 4:38 PM, Зайцев Сергей Александрович s.zayt...@r-style.com wrote: Thanks a lot! Seems to be exactly what I was looking for ) Gonna check it up С уважением, Зайцев Сергей Александрович, Департамент Реализации Интеграционных Решений Т. +7 (495) 514 1410 (доб. 4236) M. +7 (926) 143-4858 s.zayt...@r-style.com www.r-style.com -Original Message- From: Vincent Bernat [mailto:ber...@luffy.cx] Sent: Wednesday, July 09, 2014 6:36 PM To: Зайцев Сергей Александрович Cc: haproxy@formilux.org Subject: Re: how to sync HaProxy config with ZooKeeper ❦ 9 juillet 2014 14:28 GMT, Зайцев Сергей Александрович s.zayt...@r-style.com : I want to automatically udpate HaProxy's configuration depending on my app's state. I mean, that when I have a number of components running, I update my ZooKeeper configuration as soon as new node joins the cluster ( an leaves it also ). But what I also need - is a way ZooKeeper's watcher being able to udpate HaProxy configuraion in order to provide actual information for the load balance to avoid balance for absent cluster nodes. So the question is - is the a way to synchronized HaProxy's configuration with ZooKeeper ( somehow ). It is unlikely that someone has integrated Zookeeper into HAProxy but you can rely on an external process to watch zookeeper, update HAProxy state and reload. https://github.com/rs/zkfarmer https://github.com/twitter/twitcher The first one needs some additional glue to watch file changes and rebuild HAProxy configuration. -- printk(Entering UltraSMPenguin Mode...\n); 2.2.16 /usr/src/linux/arch/sparc64/kernel/smp.c -- Steven Le Roux Jabber-ID : ste...@jabber.fr 0x39494CCB ste...@le-roux.info 2FF7 226B 552E 4709 03F0 6281 72D7 A010 3949 4CCB
