[Openstack] Savanna 0.2 release details and screencast
Hello everyone! As you remember, we had 0.2 release this week and I’m really happy to do one more announcement today. We've prepared blog post for you with all new features appeared in our release. The most beautiful thing is that my colleague, Dmitry Mescheryakov made an awesome screencast with demonstration of brand new Savanna and you can find it in the post - http://www.mirantis.com/blog/savanna-0-2-released-new-hadoop-on-openstack-features/ You are welcome to read, watch and comment. Thank you! Sincerely yours, Sergey Lukjanov Savanna Technical Lead Mirantis Inc. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Savanna] Savanna 0.2 is released!
JFYI Savanna Dashboard is already available at PYPI as savanna-dashboard. Big thanks for OpenStack Infra guys for help! Sincerely yours, Sergey Lukjanov Savanna Technical Lead Mirantis Inc. On Jul 16, 2013, at 2:14, Sergey Lukjanov wrote: > Hello everyone, > > I'm very happy to announce the immediate release of Savanna 0.2. This release > contains 3 components: Savanna core, plugin for OpenStack Dashboard and > diskimage-builder elements. > > Release Notes (https://wiki.openstack.org/wiki/Savanna/ReleaseNotes/0.2): > > * Plugin Provisioning Mechanism implemented > * Vanilla Hadoop plugin implemented with the following features supported: >* creation of Hadoop clusters with different topologies >* scaling: resizing existing node groups and adding new ones >* support of Swift as input and output for Hadoop jobs > * diskimage-builder elements for automation of Hadoop images creation > * Cinder supported as block storage provider > * Anti-affinity supported for Hadoop processes > * OpenStack Dashboard plugin which supports almost all the operations exposed > through Savanna REST API (screencast will be available soon) > * Integration tests for Vanilla plugin > > Savanna wiki: https://wiki.openstack.org/wiki/Savanna > Launchpad project: https://launchpad.net/savanna > Savanna docs: https://savanna.readthedocs.org/en/latest/index.html > (quickstart and installation, user and dev guides) > > Enjoy! > > P.S. Savanna Dashboard isn't available yet, but will be very soon. > > Sincerely yours, > Sergey Lukjanov > Savanna Technical Lead > Mirantis Inc. > ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [Savanna] Savanna 0.2 is released!
Hello everyone, I'm very happy to announce the immediate release of Savanna 0.2. This release contains 3 components: Savanna core, plugin for OpenStack Dashboard and diskimage-builder elements. Release Notes (https://wiki.openstack.org/wiki/Savanna/ReleaseNotes/0.2): * Plugin Provisioning Mechanism implemented * Vanilla Hadoop plugin implemented with the following features supported: * creation of Hadoop clusters with different topologies * scaling: resizing existing node groups and adding new ones * support of Swift as input and output for Hadoop jobs * diskimage-builder elements for automation of Hadoop images creation * Cinder supported as block storage provider * Anti-affinity supported for Hadoop processes * OpenStack Dashboard plugin which supports almost all the operations exposed through Savanna REST API (screencast will be available soon) * Integration tests for Vanilla plugin Savanna wiki: https://wiki.openstack.org/wiki/Savanna Launchpad project: https://launchpad.net/savanna Savanna docs: https://savanna.readthedocs.org/en/latest/index.html (quickstart and installation, user and dev guides) Enjoy! P.S. Savanna Dashboard isn't available yet, but will be very soon. Sincerely yours, Sergey Lukjanov Savanna Technical Lead Mirantis Inc. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Where is glance's bin directory on github's master branch ?
Hi, the setup.py file contains all commands instead of several "executables" in bin folder - https://github.com/openstack/glance/blob/master/setup.py#L48 Sincerely yours, Sergey Lukjanov Software Engineer Mirantis Inc. GTalk: m...@frostman.ru Skype: lukjanovsv On May 27, 2013, at 8:04, Long Suo wrote: > Hi, all > > I am wondering why it is disappeared ? > > https://github.com/openstack/glance.git > ___ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [Savanna] 0.1.1 Release!
Hi everybody, today we have released new Savanna version 0.1.1 - https://launchpad.net/savanna/0.1 It contains several bug fixes and improvements. Additionally we moved our site to the new place: https://savanna.readthedocs.org/en/0.1.1/ Savanna can be installed using pip: pip install savanna. P.S. We are working hard on pluggable provisioning mechanism for Phase 2 of our roadmap, you can join discussions in out mailing list - savanna-...@lists.launchpad.net. Sergey Lukjanov ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Savanna] Weekly IRC meeting - May 9 -> May 8
Adding openstack@lists.launchpad.net and savanna-...@lists.launchpad.net Sergey Lukjanov On May 6, 2013, at 21:03, Sergey Lukjanov wrote: > Hi, > > we are moving Savanna weekly IRC meeting at this week from May 9 to May 8 > because our core team will be unavailable due to the Russian holidays. > > It'll be on Wednesday at 18:00 UTC in #openstack-meeting-alt channel at > freenode. > > Sergey Lukjanov ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [Savanna] Weekly IRC meeting
Hi, today there will be regular Savanna community meeting at 18:00 UTC on irc channel #openstack-meeting-alt at freenode. Come along. Sergey Lukjanov ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [Savanna] 0.1 Release!
Absolutely. The main difference is that Savanna is the Hadoop oriented service. It aims to provide unified user-friendly API that will allow users to deploy Hadoop clusters fastly and without additional configurations for cluster provisioning. Sergey Lukjanov On Apr 11, 2013, at 20:21, Lloyd Dewolf wrote: > On Wed, Apr 10, 2013 at 3:45 PM, Robert Collins > wrote: >> >> On 11 April 2013 08:30, Sergey Lukjanov wrote: >>> Hi everybody, >>> >>> we finished Phase 1 of our roadmap and released the first project release! >>> >>> Currently Savanna has the REST API for Hadoop cluster provisioning using >>> pre-installed images and we started working on pluggable mechanism for >>> custom cluster provisioning tools. >>> >>> Also I'd like to note that custom pages for OpenStack Dashbord have been >>> published too. >>> >>> You can find more info on Savanna site: >> >> Savanna seems to fit into the same space as Heat (going off your >> diagram on http://savanna.mirantis.com/) - can you explain how it is >> different? > > > My understanding of Savanna is it's complete focus on Hadoop. > > Monty also recently asked about the opportunity for Savanna to use > Heat in a thread titled "Re: [openstack-dev] [EHO] Project name change > [Savanna]" > http://markmail.org/message/2vre6r4kgwqhvhav > > Hope that helps, > Lloyd > > -- > @lloyddewolf > http://www.pistoncloud.com/ ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [Savanna] 0.1 Release!
Hi everybody, we finished Phase 1 of our roadmap and released the first project release! Currently Savanna has the REST API for Hadoop cluster provisioning using pre-installed images and we started working on pluggable mechanism for custom cluster provisioning tools. Also I'd like to note that custom pages for OpenStack Dashbord have been published too. You can find more info on Savanna site: http://savanna.mirantis.com http://savanna.mirantis.com/quickstart.html http://savanna.mirantis.com/horizon/howto.html Sergey Lukjanov Mirantis Inc. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [Savanna] Weekly meeting (#openstack-meeting-alt)
Hi, Today there will be our third weekly community meeting about Savanna at 18:00 UTC on irc channel #openstack-meeting-alt at freenode. Come along. Sergey Lukjanov ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] [EHO] Project name change [Savanna]
Hi everybody, we have changed our project codename to Savanna (from EHO). Here is our new wiki page - https://wiki.openstack.org/wiki/Savanna and new site - http://savanna.mirantis.com. We decided to do that because of the following reasons: * we don't want to violate trademarks usage of Hadoop and OpenStack * we think that Savanna sounds much better than EHO for the english speaking audience * if Savanna will become an integrated OpenStack project, OpenStack Savanna is much better than OpenStack Elastic Hadoop on OpenStack * Savanna is the place where elephants leave :) Sergey ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] [EHO] Publishing our first screencast!
Thanks for a good question! Yes, sure. Bare metal provisioning will be one of the natural options for EHO once it will be fully ready on the OpenStack side. Of course, special images with pre-installed Hadoop would be used for it at the first time. The common provisioning logic is described in the blogpost you sent. This feature is in the our internal roadmap and we are waiting for the release of bare metal provisioning mechanism in OpenStack to find out how it is ready to be used by us out of the box. Thanks for the notice, we will update our roadmap to cover this feature. Sergey On Mar 22, 2013, at 1:10, John van Ommen wrote: > Great video. > > I know that OpenStack does baremetal > (http://www.mirantis.com/blog/bare-metal-provisioning-with-openstack-cloud/); > > Is it possible to do this on bare metal servers instead of VMs? > > John > > On Thu, Mar 21, 2013 at 12:46 PM, Dmitry Mescheryakov > wrote: >> Hello folks, >> >> We've prepared a screencast demonstrating proof-of-concept >> implementation of Hadoop cluster provisioning: >> http://www.youtube.com/watch?v=UUt2gqGHcPg >> >> And by the way, it is the first time we're showing our Horizon-based >> UI in action! >> >> You may find more info at http://eho.mirantis.com >> >> Dmitry >> >> ___ >> Mailing list: https://launchpad.net/~openstack >> Post to : openstack@lists.launchpad.net >> Unsubscribe : https://launchpad.net/~openstack >> More help : https://help.launchpad.net/ListHelp > > ___ > Mailing list: https://launchpad.net/~openstack > Post to : openstack@lists.launchpad.net > Unsubscribe : https://launchpad.net/~openstack > More help : https://help.launchpad.net/ListHelp ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Weekly EHO meeting
Hello community, Today there will be our second weekly community meeting about EHO at 18:00 UTC on our irc channel #eho at freenode. Come along. -- Sergey Lukjanov Mirantis Inc. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Announcing Elastic Hadoop on OpenStack project
Hello community, Today there will be our first weekly community meeting about EHO at 18:00 UTC on our irc channel #eho at freenode. Come along. -- Sergey Lukjanov Mirantis Inc. On Mar 13, 2013, at 22:16, Sergey Lukjanov wrote: > Hello community, > > At Mirantis within our customer and partner base we see growing demand to > deploy and run Hadoop clusters on OpenStack cloud and manage them via an > OpenStack API. > > The main goal of this initiative, codenamed EHO (Elastic Hadoop on > OpenStack), is to create native OpenStack component for fast provisioning and > operating Hadoop clusters on demand. > > The key features are as follows: > * Open source; > * Native for OpenStack; > * Support for different Hadoop distributions; > * Fast clusters provisioning (e.g. for deploying Dev or QA environments); > * Elastic MapReduce job execution similar to Amazon EMR > > We would appreciate all for your feedback and comments. > > Here are the key links: > * Project blueprint: https://wiki.openstack.org/wiki/EHO | > http://eho.mirantis.com/index.html > * Roadmap: https://wiki.openstack.org/wiki/EHO/Roadmap | > http://eho.mirantis.com/roadmap.html > * API draft: http://eho.mirantis.com/restapi/v02.html > * Sources: https://github.com/mirantis/eho > * Launchpad project: https://launchpad.net/eho > * Quickstart: http://eho.mirantis.com/quickstart.html > * Horizon pages screenshots: http://eho.mirantis.com/horizon/index.html > > If you would like to ask some questions or make proposals, feel free to reply > to this message in OpenStack mailing list or reach us on #eho irc channel at > freenode. Typically somebody from our team will be online at irc from 6:00 to > 20:00 UTC. You can also contact EHO community directly by email > mailto:e...@lists.launchpad.net (please, note that your email address should > be registered in launchpad, otherwise your mail will be ignored by mailing > system). > > We're going to hold public weekly meetings on Thursday at 18:00 UTC on our > irc channel. > > Also we would greatly appreciate if you consider contributing to EHO project. > For both docs and code, simply send us pull requests via github. > > -- > Sergey Lukjanov > Mirantis Inc. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
Re: [Openstack] Announcing Elastic Hadoop on OpenStack project
Hi Brad, First of all, thank you for the question. EHO is not just a Hadoop deployment or management tool, but complete fully-integrated native OpenStack component. EHO will provide an ability to apply different deployment and provisioning tools using extension mechanism. So, deployment could be backed by Chef, Puppet, JuJu, etc or even you can use handmade provisioning tools. The same thing is with management and monitoring tools. As for integration with OpenStack, for example, EHO web GUI is a part of OpenStack Dashboard (preview: http://eho.mirantis.com/horizon/index.html, screencast will be available in a few days). Additionally, EHO uses OpenStack Identity Service (Keystone) for auth routines. All resources (VMs, IPs, volumes) used for cluster creation are provisioned by EHO. Generally, we build complete extensible solution with UI and REST API available right away - not just a toolbox. -- Sergey Lukjanov Mirantis Inc. On Mar 13, 2013, at 23:35, Brad Knowles wrote: > On Mar 13, 2013, at 1:16 PM, Sergey Lukjanov wrote: > >> The main goal of this initiative, codenamed EHO (Elastic Hadoop on >> OpenStack), is to create native OpenStack component for fast provisioning >> and operating Hadoop clusters on demand. > > I'm curious -- how does this compare to IronFan from the folks at InfoChimps? > Seems to me like that's a complete "Hadoop in a Box" type of solution, based > on Opscode Chef plus a bunch of other components. > > -- > Brad Knowles > Senior Consultant > ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
[Openstack] Announcing Elastic Hadoop on OpenStack project
Hello community, At Mirantis within our customer and partner base we see growing demand to deploy and run Hadoop clusters on OpenStack cloud and manage them via an OpenStack API. The main goal of this initiative, codenamed EHO (Elastic Hadoop on OpenStack), is to create native OpenStack component for fast provisioning and operating Hadoop clusters on demand. The key features are as follows: * Open source; * Native for OpenStack; * Support for different Hadoop distributions; * Fast clusters provisioning (e.g. for deploying Dev or QA environments); * Elastic MapReduce job execution similar to Amazon EMR We would appreciate all for your feedback and comments. Here are the key links: * Project blueprint: https://wiki.openstack.org/wiki/EHO | http://eho.mirantis.com/index.html * Roadmap: https://wiki.openstack.org/wiki/EHO/Roadmap | http://eho.mirantis.com/roadmap.html * API draft: http://eho.mirantis.com/restapi/v02.html * Sources: https://github.com/mirantis/eho * Launchpad project: https://launchpad.net/eho * Quickstart: http://eho.mirantis.com/quickstart.html * Horizon pages screenshots: http://eho.mirantis.com/horizon/index.html If you would like to ask some questions or make proposals, feel free to reply to this message in OpenStack mailing list or reach us on #eho irc channel at freenode. Typically somebody from our team will be online at irc from 6:00 to 20:00 UTC. You can also contact EHO community directly by email mailto:e...@lists.launchpad.net (please, note that your email address should be registered in launchpad, otherwise your mail will be ignored by mailing system). We're going to hold public weekly meetings on Thursday at 18:00 UTC on our irc channel. Also we would greatly appreciate if you consider contributing to EHO project. For both docs and code, simply send us pull requests via github. -- Sergey Lukjanov Mirantis Inc. ___ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
