Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread Jay Pipes 

On 06/02/2016 04:02 AM, Monty Taylor wrote:

On 06/02/2016 10:06 AM, Hochmuth, Roland M wrote:

Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, 
https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/.
 Up until that announcement, InfluxDB was planning on supporting all their 
clustering and HA capabilities in the open-source version, which is one of the 
reasons we had added it to Monasca.

There has been some discussion on supporting other databases in Monasca. Due to 
performance and reliability concerns with InfluxDB, we had started looking at 
Cassandra as an alternative. There are several reviews to look at if you are 
interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya 
Kawabata has been looking into Cassandra most recently.


I'm sad that InfluxDB has decided to turn Open Core - but I'm glad that
work was already underway to look at Cassandra. Well done.


Seems to me that a database that doesn't support aggregate/grouping 
operations isn't particularly appropriate for time-series metric 
structured data. Am I missing something basic here?


-jay

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread Jay Pipes 

On 06/02/2016 04:02 AM, Monty Taylor wrote:

On 06/02/2016 10:06 AM, Hochmuth, Roland M wrote:

Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, 
https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/.
 Up until that announcement, InfluxDB was planning on supporting all their 
clustering and HA capabilities in the open-source version, which is one of the 
reasons we had added it to Monasca.

There has been some discussion on supporting other databases in Monasca. Due to 
performance and reliability concerns with InfluxDB, we had started looking at 
Cassandra as an alternative. There are several reviews to look at if you are 
interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya 
Kawabata has been looking into Cassandra most recently.


I'm sad that InfluxDB has decided to turn Open Core - but I'm glad that
work was already underway to look at Cassandra. Well done.


I looked at OpenTSDB several years ago. There are several concerns with 
OpenTSDB, but the more significant one for us has been around deployment, as it 
requires HBase which is built on HDFS. If you already have Hadoop, HDFS and 
Hbase deployed then OpenTSDB is an incremental addition, but if you don't, it 
is a significant investment. At the time that I had evaluated OpenTSDB 
performance was not on-par with the other alternatives I considered.

Regards --Roland

From: Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>>
Reply-To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Date: Monday, May 30, 2016 at 9:59 AM
To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Subject: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial 
option".

Hi, Monasca developers and users,

https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/
"For our current and future customers, we’ll be offering clustering and high 
availability through Influx Cloud, our managed hosting offering, and Influx 
Enterprise, our on-premise offering, in the coming months.”


It seems like “clustering” and “high availablity” of influxDB will be available 
only in commercial version.
Monasca is currently leveraging influxDB as a metrics and alarm database. 
Beside vertical, influxDB is currently only an open source option to use.

With this update stating “influxDB open source sw version will not have 
clustering / ha feature”,
I would like to know if there has been any discussion among monasca community 
to add more database backend rather than influxDB, especially OpenTSDB.


Thank you.





--
Jaesuk Ahn, Ph.D.
Software Defined Infra Tech. Lab.
SKT
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev




__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread Monty Taylor 
On 06/02/2016 10:06 AM, Hochmuth, Roland M wrote:
> Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, 
> https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/.
>  Up until that announcement, InfluxDB was planning on supporting all their 
> clustering and HA capabilities in the open-source version, which is one of 
> the reasons we had added it to Monasca.
> 
> There has been some discussion on supporting other databases in Monasca. Due 
> to performance and reliability concerns with InfluxDB, we had started looking 
> at Cassandra as an alternative. There are several reviews to look at if you 
> are interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya 
> Kawabata has been looking into Cassandra most recently.

I'm sad that InfluxDB has decided to turn Open Core - but I'm glad that
work was already underway to look at Cassandra. Well done.

> I looked at OpenTSDB several years ago. There are several concerns with 
> OpenTSDB, but the more significant one for us has been around deployment, as 
> it requires HBase which is built on HDFS. If you already have Hadoop, HDFS 
> and Hbase deployed then OpenTSDB is an incremental addition, but if you 
> don't, it is a significant investment. At the time that I had evaluated 
> OpenTSDB performance was not on-par with the other alternatives I considered.
> 
> Regards --Roland
> 
> From: Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>>
> Reply-To: OpenStack List 
> <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
> Date: Monday, May 30, 2016 at 9:59 AM
> To: OpenStack List 
> <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
> Subject: [openstack-dev] [Monasca] influxDB clustering and HA will be 
> "commercial option".
> 
> Hi, Monasca developers and users,
> 
> https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/
> "For our current and future customers, we’ll be offering clustering and high 
> availability through Influx Cloud, our managed hosting offering, and Influx 
> Enterprise, our on-premise offering, in the coming months.”
> 
> 
> It seems like “clustering” and “high availablity” of influxDB will be 
> available only in commercial version.
> Monasca is currently leveraging influxDB as a metrics and alarm database. 
> Beside vertical, influxDB is currently only an open source option to use.
> 
> With this update stating “influxDB open source sw version will not have 
> clustering / ha feature”,
> I would like to know if there has been any discussion among monasca community 
> to add more database backend rather than influxDB, especially OpenTSDB.
> 
> 
> Thank you.
> 
> 
> 
> 
> 
> --
> Jaesuk Ahn, Ph.D.
> Software Defined Infra Tech. Lab.
> SKT
> __
> OpenStack Development Mailing List (not for usage questions)
> Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
> 


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread Hochmuth, Roland M 
Hi László, as another alternative you could achieve something similar in 
Monasca, without using the InfluxDB Relay project, by configuring multiple 
Monasca Persisters each in a different consumer group, and with it's own 
independent InfluxDB server instance. Not sure which is the better approach. I 
believe the answer to your question is that multiple instances of a metrics 
database in Monasca is already supported. Regards --Roland

From: László Hegedüs 
<laszlo.hege...@ericsson.com<mailto:laszlo.hege...@ericsson.com>>
Organization: Ericsson AB
Reply-To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Date: Thursday, June 2, 2016 at 12:51 AM
To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Subject: Re: [openstack-dev] [Monasca] influxDB clustering and HA will be 
"commercial option".

The blog post also states that:

"For our users looking for free open source options, we’ll be releasing the 
open source InfluxDB Relay project along with a landing page how to achieve 
high availability using pure open source and subscription options with the 
0.12.0 releases and beyond. From that point forward our clustering efforts will 
be focused on the closed source Influx Enterprise offering."

https://github.com/influxdata/influxdb-relay/blob/master/README.md

So there is still an option to have it HA.

Of course it would be nice if multiple databases were supported by Monasca.

On 05/31/2016 09:30 AM, Julien Danjou wrote:

On Mon, May 30 2016, Jaesuk Ahn wrote:



It seems like “clustering” and “high availablity” of influxDB will be
available only in commercial version.
Monasca is currently leveraging influxDB as a metrics and alarm database.
Beside vertical, influxDB is currently only an open source option to use.


Indeed, it's a shame than there's nobody developing an opensource TSDB
based on open technologies that is used in OpenStack, which supports
high availability, clustering, and a ton of other features…

Wait… what about OpenStack Gnocchi?

  http://gnocchi.xyz/

:)





__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: 
openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread Hochmuth, Roland M 
My understanding of Prometheus is that it doesn't support HA, fault-tolerant 
clustering either.

The recommendation from the Prometheus developers for HA and 
fault-tolerance/reliability is to run multiple Prometheus servers with one 
server scraping metrics from another server.

To do something similar in Monasca you could run multiple instances of InfluxDB 
using the Kafka metrics topic and multiple consumer groups to replicate all 
metrics to each InfluxDB server, or use the InfluxDB Relay project at, 
https://github.com/influxdata/influxdb-relay.

The non-clustered version of InfluxDB remains free and open-source. It is only 
the clustered version of InfluxDB that has now moved to a closed source license.


From: Martinx - ジェームズ 
<thiagocmarti...@gmail.com<mailto:thiagocmarti...@gmail.com>>
Reply-To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Date: Monday, May 30, 2016 at 7:20 PM
To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Subject: Re: [openstack-dev] [Monasca] influxDB clustering and HA will be 
"commercial option".



On 30 May 2016 at 11:59, Jaesuk Ahn 
<bluejay@gmail.com<mailto:bluejay@gmail.com>> wrote:
Hi, Monasca developers and users,

https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/
"For our current and future customers, we’ll be offering clustering and high 
availability through Influx Cloud, our managed hosting offering, and Influx 
Enterprise, our on-premise offering, in the coming months.”


It seems like “clustering” and “high availablity” of influxDB will be available 
only in commercial version.
Monasca is currently leveraging influxDB as a metrics and alarm database. 
Beside vertical, influxDB is currently only an open source option to use.

With this update stating “influxDB open source sw version will not have 
clustering / ha feature”,
I would like to know if there has been any discussion among monasca community 
to add more database backend rather than influxDB, especially OpenTSDB.


Thank you.





--
Jaesuk Ahn, Ph.D.
Software Defined Infra Tech. Lab.
SKT


What about Prometheus?

https://prometheus.io/

https://prometheus.io/docs/introduction/comparison/

Cheers!
Thiago
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread Hochmuth, Roland M 
Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, 
https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/.
 Up until that announcement, InfluxDB was planning on supporting all their 
clustering and HA capabilities in the open-source version, which is one of the 
reasons we had added it to Monasca.

There has been some discussion on supporting other databases in Monasca. Due to 
performance and reliability concerns with InfluxDB, we had started looking at 
Cassandra as an alternative. There are several reviews to look at if you are 
interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya 
Kawabata has been looking into Cassandra most recently.

I looked at OpenTSDB several years ago. There are several concerns with 
OpenTSDB, but the more significant one for us has been around deployment, as it 
requires HBase which is built on HDFS. If you already have Hadoop, HDFS and 
Hbase deployed then OpenTSDB is an incremental addition, but if you don't, it 
is a significant investment. At the time that I had evaluated OpenTSDB 
performance was not on-par with the other alternatives I considered.

Regards --Roland

From: Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>>
Reply-To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Date: Monday, May 30, 2016 at 9:59 AM
To: OpenStack List 
<openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>
Subject: [openstack-dev] [Monasca] influxDB clustering and HA will be 
"commercial option".

Hi, Monasca developers and users,

https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/
"For our current and future customers, we’ll be offering clustering and high 
availability through Influx Cloud, our managed hosting offering, and Influx 
Enterprise, our on-premise offering, in the coming months.”


It seems like “clustering” and “high availablity” of influxDB will be available 
only in commercial version.
Monasca is currently leveraging influxDB as a metrics and alarm database. 
Beside vertical, influxDB is currently only an open source option to use.

With this update stating “influxDB open source sw version will not have 
clustering / ha feature”,
I would like to know if there has been any discussion among monasca community 
to add more database backend rather than influxDB, especially OpenTSDB.


Thank you.





--
Jaesuk Ahn, Ph.D.
Software Defined Infra Tech. Lab.
SKT
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-06-02 Thread László Hegedüs 

The blog post also states that:

"For our users looking for free open source options, we’ll be releasing 
the open source InfluxDB Relay project along with a landing page how to 
achieve high availability using pure open source and subscription 
options with the 0.12.0 releases and beyond. From that point forward our 
clustering efforts will be focused on the closed source Influx 
Enterprise offering."


https://github.com/influxdata/influxdb-relay/blob/master/README.md

So there is still an option to have it HA.

Of course it would be nice if multiple databases were supported by Monasca.

On 05/31/2016 09:30 AM, Julien Danjou wrote:

On Mon, May 30 2016, Jaesuk Ahn wrote:


It seems like “clustering” and “high availablity” of influxDB will be
available only in commercial version.
Monasca is currently leveraging influxDB as a metrics and alarm database.
Beside vertical, influxDB is currently only an open source option to use.

Indeed, it's a shame than there's nobody developing an opensource TSDB
based on open technologies that is used in OpenStack, which supports
high availability, clustering, and a ton of other features…

Wait… what about OpenStack Gnocchi?

   http://gnocchi.xyz/

:)



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-05-31 Thread Julien Danjou 
On Mon, May 30 2016, Jaesuk Ahn wrote:

> It seems like “clustering” and “high availablity” of influxDB will be
> available only in commercial version.
> Monasca is currently leveraging influxDB as a metrics and alarm database.
> Beside vertical, influxDB is currently only an open source option to use.

Indeed, it's a shame than there's nobody developing an opensource TSDB
based on open technologies that is used in OpenStack, which supports
high availability, clustering, and a ton of other features…

Wait… what about OpenStack Gnocchi?

  http://gnocchi.xyz/

:)

-- 
Julien Danjou
-- Free Software hacker
-- https://julien.danjou.info


signature.asc
Description: PGP signature
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-05-30 Thread Martinx - ジェームズ 
On 30 May 2016 at 11:59, Jaesuk Ahn  wrote:

> Hi, Monasca developers and users,
>
>
> https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/
> "For our current and future customers, we’ll be offering clustering and
> high availability through Influx Cloud, our managed hosting offering, and
> Influx Enterprise, our on-premise offering, in the coming months.”
>
>
> It seems like “clustering” and “high availablity” of influxDB will be
> available only in commercial version.
> Monasca is currently leveraging influxDB as a metrics and alarm database.
> Beside vertical, influxDB is currently only an open source option to use.
>
> With this update stating “influxDB open source sw version will not have
> clustering / ha feature”,
> I would like to know if there has been any discussion among monasca
> community to add more database backend rather than influxDB, especially
> OpenTSDB.
>
>
> Thank you.
>
>
>
>
>
> --
> Jaesuk Ahn, Ph.D.
> Software Defined Infra Tech. Lab.
> SKT
>


What about Prometheus?

https://prometheus.io/

https://prometheus.io/docs/introduction/comparison/

Cheers!
Thiago
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

[openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".

2016-05-30 Thread Jaesuk Ahn 
Hi, Monasca developers and users,

https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/
"For our current and future customers, we’ll be offering clustering and
high availability through Influx Cloud, our managed hosting offering, and
Influx Enterprise, our on-premise offering, in the coming months.”


It seems like “clustering” and “high availablity” of influxDB will be
available only in commercial version.
Monasca is currently leveraging influxDB as a metrics and alarm database.
Beside vertical, influxDB is currently only an open source option to use.

With this update stating “influxDB open source sw version will not have
clustering / ha feature”,
I would like to know if there has been any discussion among monasca
community to add more database backend rather than influxDB, especially
OpenTSDB.


Thank you.





-- 
Jaesuk Ahn, Ph.D.
Software Defined Infra Tech. Lab.
SKT
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev