Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
On 06/02/2016 04:02 AM, Monty Taylor wrote: On 06/02/2016 10:06 AM, Hochmuth, Roland M wrote: Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/. Up until that announcement, InfluxDB was planning on supporting all their clustering and HA capabilities in the open-source version, which is one of the reasons we had added it to Monasca. There has been some discussion on supporting other databases in Monasca. Due to performance and reliability concerns with InfluxDB, we had started looking at Cassandra as an alternative. There are several reviews to look at if you are interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya Kawabata has been looking into Cassandra most recently. I'm sad that InfluxDB has decided to turn Open Core - but I'm glad that work was already underway to look at Cassandra. Well done. Seems to me that a database that doesn't support aggregate/grouping operations isn't particularly appropriate for time-series metric structured data. Am I missing something basic here? -jay __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
On 06/02/2016 04:02 AM, Monty Taylor wrote: On 06/02/2016 10:06 AM, Hochmuth, Roland M wrote: Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/. Up until that announcement, InfluxDB was planning on supporting all their clustering and HA capabilities in the open-source version, which is one of the reasons we had added it to Monasca. There has been some discussion on supporting other databases in Monasca. Due to performance and reliability concerns with InfluxDB, we had started looking at Cassandra as an alternative. There are several reviews to look at if you are interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya Kawabata has been looking into Cassandra most recently. I'm sad that InfluxDB has decided to turn Open Core - but I'm glad that work was already underway to look at Cassandra. Well done. I looked at OpenTSDB several years ago. There are several concerns with OpenTSDB, but the more significant one for us has been around deployment, as it requires HBase which is built on HDFS. If you already have Hadoop, HDFS and Hbase deployed then OpenTSDB is an incremental addition, but if you don't, it is a significant investment. At the time that I had evaluated OpenTSDB performance was not on-par with the other alternatives I considered. Regards --Roland From: Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>> Reply-To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Date: Monday, May 30, 2016 at 9:59 AM To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Subject: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option". Hi, Monasca developers and users, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/ "For our current and future customers, we’ll be offering clustering and high availability through Influx Cloud, our managed hosting offering, and Influx Enterprise, our on-premise offering, in the coming months.” It seems like “clustering” and “high availablity” of influxDB will be available only in commercial version. Monasca is currently leveraging influxDB as a metrics and alarm database. Beside vertical, influxDB is currently only an open source option to use. With this update stating “influxDB open source sw version will not have clustering / ha feature”, I would like to know if there has been any discussion among monasca community to add more database backend rather than influxDB, especially OpenTSDB. Thank you. -- Jaesuk Ahn, Ph.D. Software Defined Infra Tech. Lab. SKT __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
On 06/02/2016 10:06 AM, Hochmuth, Roland M wrote: > Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, > https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/. > Up until that announcement, InfluxDB was planning on supporting all their > clustering and HA capabilities in the open-source version, which is one of > the reasons we had added it to Monasca. > > There has been some discussion on supporting other databases in Monasca. Due > to performance and reliability concerns with InfluxDB, we had started looking > at Cassandra as an alternative. There are several reviews to look at if you > are interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya > Kawabata has been looking into Cassandra most recently. I'm sad that InfluxDB has decided to turn Open Core - but I'm glad that work was already underway to look at Cassandra. Well done. > I looked at OpenTSDB several years ago. There are several concerns with > OpenTSDB, but the more significant one for us has been around deployment, as > it requires HBase which is built on HDFS. If you already have Hadoop, HDFS > and Hbase deployed then OpenTSDB is an incremental addition, but if you > don't, it is a significant investment. At the time that I had evaluated > OpenTSDB performance was not on-par with the other alternatives I considered. > > Regards --Roland > > From: Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>> > Reply-To: OpenStack List > <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> > Date: Monday, May 30, 2016 at 9:59 AM > To: OpenStack List > <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> > Subject: [openstack-dev] [Monasca] influxDB clustering and HA will be > "commercial option". > > Hi, Monasca developers and users, > > https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/ > "For our current and future customers, we’ll be offering clustering and high > availability through Influx Cloud, our managed hosting offering, and Influx > Enterprise, our on-premise offering, in the coming months.” > > > It seems like “clustering” and “high availablity” of influxDB will be > available only in commercial version. > Monasca is currently leveraging influxDB as a metrics and alarm database. > Beside vertical, influxDB is currently only an open source option to use. > > With this update stating “influxDB open source sw version will not have > clustering / ha feature”, > I would like to know if there has been any discussion among monasca community > to add more database backend rather than influxDB, especially OpenTSDB. > > > Thank you. > > > > > > -- > Jaesuk Ahn, Ph.D. > Software Defined Infra Tech. Lab. > SKT > __ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
Hi László, as another alternative you could achieve something similar in Monasca, without using the InfluxDB Relay project, by configuring multiple Monasca Persisters each in a different consumer group, and with it's own independent InfluxDB server instance. Not sure which is the better approach. I believe the answer to your question is that multiple instances of a metrics database in Monasca is already supported. Regards --Roland From: László Hegedüs <laszlo.hege...@ericsson.com<mailto:laszlo.hege...@ericsson.com>> Organization: Ericsson AB Reply-To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Date: Thursday, June 2, 2016 at 12:51 AM To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Subject: Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option". The blog post also states that: "For our users looking for free open source options, we’ll be releasing the open source InfluxDB Relay project along with a landing page how to achieve high availability using pure open source and subscription options with the 0.12.0 releases and beyond. From that point forward our clustering efforts will be focused on the closed source Influx Enterprise offering." https://github.com/influxdata/influxdb-relay/blob/master/README.md So there is still an option to have it HA. Of course it would be nice if multiple databases were supported by Monasca. On 05/31/2016 09:30 AM, Julien Danjou wrote: On Mon, May 30 2016, Jaesuk Ahn wrote: It seems like “clustering” and “high availablity” of influxDB will be available only in commercial version. Monasca is currently leveraging influxDB as a metrics and alarm database. Beside vertical, influxDB is currently only an open source option to use. Indeed, it's a shame than there's nobody developing an opensource TSDB based on open technologies that is used in OpenStack, which supports high availability, clustering, and a ton of other features… Wait… what about OpenStack Gnocchi? http://gnocchi.xyz/ :) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe<mailto:openstack-dev-requ...@lists.openstack.org?subject:unsubscribe>http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
My understanding of Prometheus is that it doesn't support HA, fault-tolerant clustering either. The recommendation from the Prometheus developers for HA and fault-tolerance/reliability is to run multiple Prometheus servers with one server scraping metrics from another server. To do something similar in Monasca you could run multiple instances of InfluxDB using the Kafka metrics topic and multiple consumer groups to replicate all metrics to each InfluxDB server, or use the InfluxDB Relay project at, https://github.com/influxdata/influxdb-relay. The non-clustered version of InfluxDB remains free and open-source. It is only the clustered version of InfluxDB that has now moved to a closed source license. From: Martinx - ジェームズ <thiagocmarti...@gmail.com<mailto:thiagocmarti...@gmail.com>> Reply-To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Date: Monday, May 30, 2016 at 7:20 PM To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Subject: Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option". On 30 May 2016 at 11:59, Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>> wrote: Hi, Monasca developers and users, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/ "For our current and future customers, we’ll be offering clustering and high availability through Influx Cloud, our managed hosting offering, and Influx Enterprise, our on-premise offering, in the coming months.” It seems like “clustering” and “high availablity” of influxDB will be available only in commercial version. Monasca is currently leveraging influxDB as a metrics and alarm database. Beside vertical, influxDB is currently only an open source option to use. With this update stating “influxDB open source sw version will not have clustering / ha feature”, I would like to know if there has been any discussion among monasca community to add more database backend rather than influxDB, especially OpenTSDB. Thank you. -- Jaesuk Ahn, Ph.D. Software Defined Infra Tech. Lab. SKT What about Prometheus? https://prometheus.io/ https://prometheus.io/docs/introduction/comparison/ Cheers! Thiago __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
Hi Jaesuk, The change in InfluxDB licensing was announced in the blog at, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/. Up until that announcement, InfluxDB was planning on supporting all their clustering and HA capabilities in the open-source version, which is one of the reasons we had added it to Monasca. There has been some discussion on supporting other databases in Monasca. Due to performance and reliability concerns with InfluxDB, we had started looking at Cassandra as an alternative. There are several reviews to look at if you are interested at, https://review.openstack.org/#/q/monasca+cassandra. Shinya Kawabata has been looking into Cassandra most recently. I looked at OpenTSDB several years ago. There are several concerns with OpenTSDB, but the more significant one for us has been around deployment, as it requires HBase which is built on HDFS. If you already have Hadoop, HDFS and Hbase deployed then OpenTSDB is an incremental addition, but if you don't, it is a significant investment. At the time that I had evaluated OpenTSDB performance was not on-par with the other alternatives I considered. Regards --Roland From: Jaesuk Ahn <bluejay@gmail.com<mailto:bluejay@gmail.com>> Reply-To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Date: Monday, May 30, 2016 at 9:59 AM To: OpenStack List <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Subject: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option". Hi, Monasca developers and users, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/ "For our current and future customers, we’ll be offering clustering and high availability through Influx Cloud, our managed hosting offering, and Influx Enterprise, our on-premise offering, in the coming months.” It seems like “clustering” and “high availablity” of influxDB will be available only in commercial version. Monasca is currently leveraging influxDB as a metrics and alarm database. Beside vertical, influxDB is currently only an open source option to use. With this update stating “influxDB open source sw version will not have clustering / ha feature”, I would like to know if there has been any discussion among monasca community to add more database backend rather than influxDB, especially OpenTSDB. Thank you. -- Jaesuk Ahn, Ph.D. Software Defined Infra Tech. Lab. SKT __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
The blog post also states that: "For our users looking for free open source options, we’ll be releasing the open source InfluxDB Relay project along with a landing page how to achieve high availability using pure open source and subscription options with the 0.12.0 releases and beyond. From that point forward our clustering efforts will be focused on the closed source Influx Enterprise offering." https://github.com/influxdata/influxdb-relay/blob/master/README.md So there is still an option to have it HA. Of course it would be nice if multiple databases were supported by Monasca. On 05/31/2016 09:30 AM, Julien Danjou wrote: On Mon, May 30 2016, Jaesuk Ahn wrote: It seems like “clustering” and “high availablity” of influxDB will be available only in commercial version. Monasca is currently leveraging influxDB as a metrics and alarm database. Beside vertical, influxDB is currently only an open source option to use. Indeed, it's a shame than there's nobody developing an opensource TSDB based on open technologies that is used in OpenStack, which supports high availability, clustering, and a ton of other features… Wait… what about OpenStack Gnocchi? http://gnocchi.xyz/ :) __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
On Mon, May 30 2016, Jaesuk Ahn wrote: > It seems like “clustering” and “high availablity” of influxDB will be > available only in commercial version. > Monasca is currently leveraging influxDB as a metrics and alarm database. > Beside vertical, influxDB is currently only an open source option to use. Indeed, it's a shame than there's nobody developing an opensource TSDB based on open technologies that is used in OpenStack, which supports high availability, clustering, and a ton of other features… Wait… what about OpenStack Gnocchi? http://gnocchi.xyz/ :) -- Julien Danjou -- Free Software hacker -- https://julien.danjou.info signature.asc Description: PGP signature __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
On 30 May 2016 at 11:59, Jaesuk Ahnwrote: > Hi, Monasca developers and users, > > > https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/ > "For our current and future customers, we’ll be offering clustering and > high availability through Influx Cloud, our managed hosting offering, and > Influx Enterprise, our on-premise offering, in the coming months.” > > > It seems like “clustering” and “high availablity” of influxDB will be > available only in commercial version. > Monasca is currently leveraging influxDB as a metrics and alarm database. > Beside vertical, influxDB is currently only an open source option to use. > > With this update stating “influxDB open source sw version will not have > clustering / ha feature”, > I would like to know if there has been any discussion among monasca > community to add more database backend rather than influxDB, especially > OpenTSDB. > > > Thank you. > > > > > > -- > Jaesuk Ahn, Ph.D. > Software Defined Infra Tech. Lab. > SKT > What about Prometheus? https://prometheus.io/ https://prometheus.io/docs/introduction/comparison/ Cheers! Thiago __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Monasca] influxDB clustering and HA will be "commercial option".
Hi, Monasca developers and users, https://influxdata.com/blog/update-on-influxdb-clustering-high-availability-and-monetization/ "For our current and future customers, we’ll be offering clustering and high availability through Influx Cloud, our managed hosting offering, and Influx Enterprise, our on-premise offering, in the coming months.” It seems like “clustering” and “high availablity” of influxDB will be available only in commercial version. Monasca is currently leveraging influxDB as a metrics and alarm database. Beside vertical, influxDB is currently only an open source option to use. With this update stating “influxDB open source sw version will not have clustering / ha feature”, I would like to know if there has been any discussion among monasca community to add more database backend rather than influxDB, especially OpenTSDB. Thank you. -- Jaesuk Ahn, Ph.D. Software Defined Infra Tech. Lab. SKT __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev