Re: [openstack-dev] [sahara] Sahara + Cinder use cases?

2015-04-08 Thread Daniele Venzano
Hello, Did you have any success in finding Sahara and Cinder use cases? Using Cinder one loses the data locality property around which hadoop and hdfs are built, so I am curious of what benefits there are in such a configuration. Thanks, Daniele -Original Message- From: Jacob Liberman

Re: [openstack-dev] [sahara] About Sahara Oozie plan and Spark CDH Issues

2015-01-28 Thread Daniele Venzano
ry support and also facing some problems about Oozie > > support. > > > > So it should be good to share the experience with each other. > > > > > > > > 2. Spark CDH Issues: > > > > Could you provide more information abo

Re: [openstack-dev] [Ceilometer] MySQL performance and Mongodb backend maturity question

2014-09-26 Thread Daniele Venzano
On 09/25/14 17:55, Clint Byrum wrote: Now I use Ceilometer's pipeline to forward events to elasticsearch via udp + logstash and do not use Ceilometer's DB or API at all. Interesting, this almost sounds like what should be the default configuration honestly. Ceilometer generates a lot of data in

Re: [openstack-dev] [Ceilometer] MySQL performance and Mongodb backend maturity question

2014-09-25 Thread Daniele Venzano
On 09/25/14 10:12, Qiming Teng wrote: Yes, just about 3 VMs running on two hosts, for at most 3 weeks. This is leading me to another question -- any best practices/tools to retire the old data on a regular basis? Regards, Qiming There is a tool: ceilometer-expirer I tried to use it on a mysql

[openstack-dev] [Sahara] Spark plugin: EDP and Spark jobs

2014-06-06 Thread Daniele Venzano
Dear all, A short while ago the Spark plugin for Sahara was merged, opening up the possibility of deploying Spark clusters with one click from OpenStack. Since Spark is quite different from Hadoop, we need to take a number of decisions on how to proceed implementing important features, like, in pa

Re: [openstack-dev] [Savanna] Spark plugin status

2014-01-10 Thread Daniele Venzano
HDFS datasource? We are very interested in that, but I lost track of the development during the holidays. On 01/09/2014 03:41 AM, Sergey Lukjanov wrote: Hi, I'm really glad to here that! Answers inlined. Thanks. On Thu, Jan 9, 2014 at 11:33 AM, Daniele Venzano mailto:daniele

Re: [openstack-dev] [Savanna] Spark plugin status

2014-01-09 Thread Daniele Venzano
On 01/09/14 09:41, Sergey Lukjanov wrote: On Thu, Jan 9, 2014 at 11:33 AM, Daniele Venzano mailto:daniele.venz...@eurecom.fr>> wrote: Hello, we are finishing up the development of the Spark plugin for Savanna. In the next few days we will deploy it on an OpenStack cluste

[openstack-dev] [Savanna] Spark plugin status

2014-01-08 Thread Daniele Venzano
that I send immediately the code for review or should I send a link here on the mailing list first for some feedback/discussion? Thank you, Daniele Venzano, Hoang Do and Vo Thanh Phuc ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org