[openstack-dev] [kolla][kolla-k8s] Installation in ubuntu 14.04
Hi All, I am trying to install openstack containers using kolla-k8s. I am following below link: https://docs.openstack.org/kolla-kubernetes/latest/deployment-guide.html# As per link, its only supported/validated for ubuntu 16.04. Please let me know if any version 0.6/0.5.0.4 is supported for ubuntu 14.04. Its not mentioned in release notes. Also how to determine upfront which openstack version does it support. Thanks Eswar Rao __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack] [celery][taskflow] Reg. celery and task-flow
Hi Joshua, Thanks for the response. As you mentioned, I went through below which has taskflow as celery front end: https://etherpad.openstack.org/p/TaskFlowWorkerBasedEngine https://blueprints.launchpad.net/taskflow/+spec/distributed-celery I guess if we have a job = task1 + task2 ; if we execute them through a taskflow parallel pattern, they will be executed in parallel. Just curious to know that since this threading is built on eventlets/green threads/python threads they will be affected by GIL and we may not utilize multi-core capability of our systems. It seems in celery, we can have these tasks run as multiple processes so that they are not affected by GIL. Please correct me if my understanding is wrong ?? Thanks Eswar On Sat, Jan 9, 2016 at 3:06 AM, Joshua Harlow <harlo...@fastmail.com> wrote: > I also updated https://wiki.openstack.org/wiki/DistributedTaskManagement > to denote that said wiki is no longer active (it was an attempt to back a > taskflow engine[1] with celery); although if u are interested in continuing > down this path feel free. > > Hopefully that clears up some 'confusion' around that wiki. > > [1] http://docs.openstack.org/developer/taskflow/engines.html > > > Joshua Harlow wrote: > >> So actually they are quite different, (although similar at some level), >> >> Given that celery isn't really a replacement for taskflow although one >> could say, from what I've heard from others, that taskflow is a >> super-set of what celery is so taskflow likely can replace parts of >> celery (but not vice-versa). >> >> Feel free to jump on #openstack-state-management IRC channel if u want >> to chat in person more about why (it gets into details that might just >> be easier to explain in person). >> >> ESWAR RAO wrote: >> >>> Hi All, >>> >>> Please let me know whether celery is replacement for taskflow. >>> >>> As per my understanding, task-flow can break jobs into tasks and execute >>> them. >>> >>> From celery wiki, it also does almost similar behaviour. >>> >>> I guess in most of openstack components taskflow is widely used. >>> Any places where its being replaced with celery ?? >>> >>> Celery: https://wiki.openstack.org/wiki/Celery >>> Distributed: https://wiki.openstack.org/wiki/DistributedTaskManagement >>> TaskFlow: https://wiki.openstack.org/wiki/TaskFlow >>> >>> Thanks >>> Eswar >>> >>> >>> __ >>> >>> OpenStack Development Mailing List (not for usage questions) >>> Unsubscribe: >>> openstack-dev-requ...@lists.openstack.org?subject:unsubscribe >>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >>> >> >> ___ >> Mailing list: >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> Post to : openst...@lists.openstack.org >> Unsubscribe : >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack >> > > ___ > Mailing list: > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack > Post to : openst...@lists.openstack.org > Unsubscribe : > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Openstack] [celery][taskflow] Reg. celery and task-flow
Thanks Joshua for the clear explanation. On Sat, Jan 9, 2016 at 6:24 AM, Joshua Harlow <harlo...@fastmail.com> wrote: > ESWAR RAO wrote: > >> Hi Joshua, >> >> Thanks for the response. >> >> As you mentioned, I went through below which has taskflow as celery >> front end: >> >> https://etherpad.openstack.org/p/TaskFlowWorkerBasedEngine >> >> https://blueprints.launchpad.net/taskflow/+spec/distributed-celery >> > > I think the idea way-back-when was celery would be a backend, not a > front-end, although my memory might be fuzzy in this area (since it was a > few years ago). > > >> >> I guess if we have a job = task1 + task2 ; if we execute them through a >> taskflow parallel pattern, they will be executed in parallel. >> >> Just curious to know that since this threading is built on >> eventlets/green threads/python threads they will be affected by GIL and >> we may not utilize multi-core capability of our systems. >> > > So that assumes u are using a taskflow engine which is powered by threads > (or greenthreads), there are two types that do not use threads but actually > run out of process: > > http://docs.openstack.org/developer/taskflow/engines.html#types > > 1. http://docs.openstack.org/developer/taskflow/workers.html (runs out of > process, across different machines, using kombu for triggering > start/status... of tasks on other machines) > > 2. A parallel engine that uses a process pool executor ( > https://docs.python.org/dev/library/concurrent.futures.html#processpoolexecutor) > will then execute tasks using out of process child-processes. > > So both of these don't have the same GIL issue (although greenthreads by > there very nature are not affected by the GIL either). > > The example (aptly named hello world) shows these different types > (although it doesn't show the worker based one, since that requires more > things to setup) @ > https://github.com/openstack/taskflow/blob/master/taskflow/examples/hello_world.py#L82 > > -Josh > > >> It seems in celery, we can have these tasks run as multiple processes so >> that they are not affected by GIL. >> > > Right, the above starts to show why taskflow is really a super-set of > celery (for some combination/interpretation of what taskflow or celery do). > > >> Please correct me if my understanding is wrong ?? >> >> Thanks >> Eswar >> >> >> On Sat, Jan 9, 2016 at 3:06 AM, Joshua Harlow <harlo...@fastmail.com >> <mailto:harlo...@fastmail.com>> wrote: >> >> I also updated >> https://wiki.openstack.org/wiki/DistributedTaskManagement to denote >> that said wiki is no longer active (it was an attempt to back a >> taskflow engine[1] with celery); although if u are interested in >> continuing down this path feel free. >> >> Hopefully that clears up some 'confusion' around that wiki. >> >> [1] http://docs.openstack.org/developer/taskflow/engines.html >> >> >> Joshua Harlow wrote: >> >> So actually they are quite different, (although similar at some >> level), >> >> Given that celery isn't really a replacement for taskflow >> although one >> could say, from what I've heard from others, that taskflow is a >> super-set of what celery is so taskflow likely can replace parts >> of >> celery (but not vice-versa). >> >> Feel free to jump on #openstack-state-management IRC channel if >> u want >> to chat in person more about why (it gets into details that >> might just >> be easier to explain in person). >> >> ESWAR RAO wrote: >> >> Hi All, >> >> Please let me know whether celery is replacement for taskflow. >> >> As per my understanding, task-flow can break jobs into tasks >> and execute >> them. >> >> From celery wiki, it also does almost similar behaviour. >> >> I guess in most of openstack components taskflow is widely >> used. >> Any places where its being replaced with celery ?? >> >> Celery: https://wiki.openstack.org/wiki/Celery >> Distributed: >> https://wiki.openstack.org/wiki/DistributedTaskManagement >> TaskFlow: https://wiki.openstack.org/wiki/TaskFlow >> >> Thanks >> Eswar >> >> >>
[openstack-dev] [celery][taskflow] Reg. celery and task-flow
Hi All, Please let me know whether celery is replacement for taskflow. As per my understanding, task-flow can break jobs into tasks and execute them. >From celery wiki, it also does almost similar behaviour. I guess in most of openstack components taskflow is widely used. Any places where its being replaced with celery ?? Celery: https://wiki.openstack.org/wiki/Celery Distributed: https://wiki.openstack.org/wiki/DistributedTaskManagement TaskFlow: https://wiki.openstack.org/wiki/TaskFlow Thanks Eswar __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [heat] scaling in a tenant
Hi All, Please help me in understanding below scenario ??? I am doing manual scaling based on inputs from monitoring framework instead of ceilometer alarms. I launched my heat stack in a tenant using python-api bindings: >>> tenant_id = 'Tenant-A' >>> heat_url = 'http://heat.example.org:8004/v1/%s' % tenant_id >>> auth_token = 'user-A-in-Tenant-A auth-token' >>> from heatclient.client import Client >>> heat = Client('1', endpoint=heat_url, token=auth_token) If I need to scale VM's belonging to this tenant, can I use tenant_id = 'Tenant-A' and auth_token corresponding to admin Tenant who has role access in Tenant-A. Because through monitoring framework, i can have admin details and no tenant context ?? Thanks Eswar __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [keystone] Auth-token expiration time
Hi All, I have an application which does some HEAT transactions of creating stack,polling for it and updating stack in a loop. In my setup, /etc/keystone/keystone.conf has below settings: expiration=3600 But my transaction loop takes more than 1 hr and AUTH token is expired in between and I am getting : Exception in heat start task for stack jsm-e08dceac-71fe-48e8-817e-93ec78881827 of network service e08dceac-71fe-48e8-817e-93ec78881827 due to ERROR: Authentication failed.Please try again with option --include-password or export HEAT_INCLUDE_PASSWORD=1 Is there any means of making the auth-token not getting expired instead of changing expiration time in keystone conf ?? Thanks Eswar __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [heat] perfomance benchmark metrics of heat-api
Hi all, Has anyone done any performance tests on heat-api servers on any standard setup so as to know how many stack requests it can handle before it can stumble so that we can deploy scaling of heat-servers ?? Thanks Eswar __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] Reg. glance image in different domain
In Juno version, its failing like: # glance --os-tenant-id 73e6f673c9684c43966dfa3174d2430c --os-username eswar-new-user --os-password eswar --os-auth-token bef0a7aa06064c39ad042ce368aecdec --os-user-domain-name eswar-new-domain image-list An auth plugin is required to determine the endpoint URL. On Mon, Aug 24, 2015 at 5:10 PM, ESWAR RAO eswar7...@gmail.com wrote: Hi All, I have created a different domain as below: domain-name: Heat-stack tenant-name: heat-tenant user-name: heat-user I have assigned admin role to the tenant. I have added tenant-id as a member to existing image in glance in default domain. # glance --os-tenant-id ad3688ad21b9492599761b54ed58649a --os-username heat-user --os-password heat --os-auth-token auth-token image-list The request you have made requires authentication. (HTTP 401) # heat --os-tenant-id ad3688ad21b9492599761b54ed58649a --os-username heat-user --os-password heat --os-auth-token auth-token stack-list +--+--+-+--+ | id | stack_name | stack_status| creation_time| +--+--+-+--+ | 569700fb-9533-43e7-90a7-734be8a86947 | heat-0e6475bd-0853-4340-9636-83457c9223fb | CREATE_COMPLETE | 2015-08-24T07:00:44Z | +--+--+-+--+ The stack is in CREATE_COMPLETE but instance is not launched in nova. I suspect this could be due to glance image problems. How can i see images with the user in different domain? Thanks Eswar Rao __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] Reg. glance image in different domain
Hi All, I have created a different domain as below: domain-name: Heat-stack tenant-name: heat-tenant user-name: heat-user I have assigned admin role to the tenant. I have added tenant-id as a member to existing image in glance in default domain. # glance --os-tenant-id ad3688ad21b9492599761b54ed58649a --os-username heat-user --os-password heat --os-auth-token auth-token image-list The request you have made requires authentication. (HTTP 401) # heat --os-tenant-id ad3688ad21b9492599761b54ed58649a --os-username heat-user --os-password heat --os-auth-token auth-token stack-list +--+--+-+--+ | id | stack_name | stack_status| creation_time| +--+--+-+--+ | 569700fb-9533-43e7-90a7-734be8a86947 | heat-0e6475bd-0853-4340-9636-83457c9223fb | CREATE_COMPLETE | 2015-08-24T07:00:44Z | +--+--+-+--+ The stack is in CREATE_COMPLETE but instance is not launched in nova. I suspect this could be due to glance image problems. How can i see images with the user in different domain? Thanks Eswar Rao __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] taskflow usage
Hi All, I am looking into taskflow userguide and examples. http://www.giantflyingsaucer.com/blog/?p=4896 Can anyone please help me how the job/job-board is related to task and flows. I understood atom is similar to a abstract interface and taskflow is an atom that has execute()/revert() methods and a flow is structure that links these tasks. Is it that a job is broken into tasks?? Can a job be broken into set of tasks??? Thanks Eswar Rao __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev