Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Guys. It seems that this patch: https://review.openstack.org/#/c/93815/ should fix everything. If it does not, let's do additional research. Also, Ryan says that kombu version 3 works much better, so if the fix is not good enough we can update kombu, but we will need to check its compliance with nailgun and astute. On Tue, May 13, 2014 at 3:17 PM, Vladimir Kuklin vkuk...@mirantis.comwrote: Alexey, could you link this particular change? I think, there is some miscommunication - it does not seem that keepalive patch helped a lot. On Tue, May 13, 2014 at 2:53 PM, Alexei Kornienko alexei.kornie...@gmail.com wrote: Hi, No good news from me now. I think I need to spend additional time to reproduce this issue. I've done some code research and it seems that problem may be related to how nova uses oslo.messaging library. P.S. I've seen a patch in fuel changing tcp_keepalive option and it says that it fixed the problem, am I right? Regards, On May 13, 2014 2:05 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Alexey Kornienko promised to give us an update. Alexey, do you have newer info? 12 мая 2014 г. 13:22 пользователь Vladimir Kuklin vkuk...@mirantis.com написал: Guys, I suggest that we meet at Mirantis booth as it is in the same hall with lunch 12 мая 2014 г. 13:02 пользователь Andrew Woodward xar...@gmail.com написал: Correct. Openstack HA On May 12, 2014 12:43 PM, Mike Scherbakov mscherba...@mirantis.com wrote: A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Alexey Kornienko promised to give us an update. Alexey, do you have newer info? 12 мая 2014 г. 13:22 пользователь Vladimir Kuklin vkuk...@mirantis.com написал: Guys, I suggest that we meet at Mirantis booth as it is in the same hall with lunch 12 мая 2014 г. 13:02 пользователь Andrew Woodward xar...@gmail.com написал: Correct. Openstack HA On May 12, 2014 12:43 PM, Mike Scherbakov mscherba...@mirantis.com wrote: A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Hi, No good news from me now. I think I need to spend additional time to reproduce this issue. I've done some code research and it seems that problem may be related to how nova uses oslo.messaging library. P.S. I've seen a patch in fuel changing tcp_keepalive option and it says that it fixed the problem, am I right? Regards, On May 13, 2014 2:05 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Alexey Kornienko promised to give us an update. Alexey, do you have newer info? 12 мая 2014 г. 13:22 пользователь Vladimir Kuklin vkuk...@mirantis.com написал: Guys, I suggest that we meet at Mirantis booth as it is in the same hall with lunch 12 мая 2014 г. 13:02 пользователь Andrew Woodward xar...@gmail.com написал: Correct. Openstack HA On May 12, 2014 12:43 PM, Mike Scherbakov mscherba...@mirantis.com wrote: A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Alexey, could you link this particular change? I think, there is some miscommunication - it does not seem that keepalive patch helped a lot. On Tue, May 13, 2014 at 2:53 PM, Alexei Kornienko alexei.kornie...@gmail.com wrote: Hi, No good news from me now. I think I need to spend additional time to reproduce this issue. I've done some code research and it seems that problem may be related to how nova uses oslo.messaging library. P.S. I've seen a patch in fuel changing tcp_keepalive option and it says that it fixed the problem, am I right? Regards, On May 13, 2014 2:05 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Alexey Kornienko promised to give us an update. Alexey, do you have newer info? 12 мая 2014 г. 13:22 пользователь Vladimir Kuklin vkuk...@mirantis.com написал: Guys, I suggest that we meet at Mirantis booth as it is in the same hall with lunch 12 мая 2014 г. 13:02 пользователь Andrew Woodward xar...@gmail.com написал: Correct. Openstack HA On May 12, 2014 12:43 PM, Mike Scherbakov mscherba...@mirantis.com wrote: A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Correct. Openstack HA On May 12, 2014 12:43 PM, Mike Scherbakov mscherba...@mirantis.com wrote: A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Fuel][HA][RabbitMQ] Rabbitmq-related HA issues
Guys, I suggest that we meet at Mirantis booth as it is in the same hall with lunch 12 мая 2014 г. 13:02 пользователь Andrew Woodward xar...@gmail.com написал: Correct. Openstack HA On May 12, 2014 12:43 PM, Mike Scherbakov mscherba...@mirantis.com wrote: A little note - it's going to be about OpenStack HA issues, not about Fuel master node HA, right? On May 12, 2014 8:37 PM, Vladimir Kuklin vkuk...@mirantis.com wrote: Fuelers, We are going to discuss rabbit/kombu related HA issues today. I suggest we do this at 1pm today in Hall B2 during lunch. Feel free to provide alternative suggestions if you have any objections. Also bring in anyone who may be of help. List of problems and bugs is here: https://etherpad.openstack.org/p/fuel-ha-rabbitmq -- Yours Faithfully, Vladimir Kuklin, Fuel Library Tech Lead, Mirantis, Inc. +7 (495) 640-49-04 +7 (926) 702-39-68 Skype kuklinvv 45bk3, Vorontsovskaya Str. Moscow, Russia, www.mirantis.com http://www.mirantis.ru/ www.mirantis.ru vkuk...@mirantis.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
