RE: Cassandra monitoring

2020-12-18 Thread Manu Chadha
org<mailto:user@cassandra.apache.org> Subject: RE: Cassandra monitoring Thanks. I tried it but I still don’t see anything on http://localhost:9103/. My suspicion is that I am not putting the jars or am not setting the JVM_OPTS correctly or maybe the path is not being picked correctl

RE: Cassandra monitoring

2020-12-18 Thread Manu Chadha
no love ☹ Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10 From: Ahmed Eljami<mailto:ahmed.elj...@gmail.com> Sent: 18 December 2020 09:21 To: user@cassandra.apache.org<mailto:user@cassandra.apache.org> Subject: Re: Cassandra monitoring Hi, I sugges

Re: Cassandra monitoring

2020-12-18 Thread Ahmed Eljami
utorial - > https://www.robustperception.io/monitoring-cassandra-with-prometheus > > > > I thought I’ll test it on my Windows laptop first but I can’t connect with > using localhost:7199. > > > > As I am on Windows, instead of echo 'JVM_OPTS="$JVM_OPTS > -java

RE: Cassandra monitoring

2020-12-18 Thread Manu Chadha
Sorry, clicked send too soon. I am trying to use Prometheus and followed this tutorial - https://www.robustperception.io/monitoring-cassandra-with-prometheus I thought I’ll test it on my Windows laptop first but I can’t connect with using localhost:7199. As I am on Windows, instead of echo

Cassandra monitoring

2020-12-18 Thread Manu Chadha
Hi Could the group please suggest options for monitoring Cassandra in production (GCP)? I am trying to use Prometheus and followed this tutorial - https://www.robustperception.io/monitoring-cassandra-with-prometheus Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for W

Re: oversized partition detection ? monitoring the partitions growth ?

2019-11-01 Thread Chris Lohfink
stable {} Chris On Thu, Oct 31, 2019 at 8:01 AM Eric LELEU wrote: > Hi, > > I'm not sure that your are able to log which partition has reached 100MB > but you may monitor the "EstimatedPartitionSizeHistogram" and take the > max value (or 99ct, 95ct) to trigger an alert using y

Re: oversized partition detection ? monitoring the partitions growth ?

2019-10-31 Thread Eric LELEU
Hi, I'm not sure that your are able to log which partition has reached 100MB but you may monitor the "EstimatedPartitionSizeHistogram"and take the max value (or 99ct, 95ct) to trigger an alert using your monitoring system. http://cassandra.apache.org/doc/latest/operating/metrics.

oversized partition detection ? monitoring the partitions growth ?

2019-10-31 Thread jagernicolas
Hi, how can I detect a partition that reaches the 100MB ? is it possible to log the size of every partition one time per day ? regards, Nicolas Jäger

Re: good monitoring tool for cassandra

2019-03-14 Thread Rahul Singh
I wrote this last year. It's mostly still relevant --- as Jonathan said, Prometheus+Grafana is the best "make your own hammers and nails" approach. https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance/ On Thu, Mar 14, 2019 at 8:13 PM Jonathan Had

Re: good monitoring tool for cassandra

2019-03-14 Thread Jonathan Haddad
Jeff Jirsa wrote: > > -dev, +user > > Datadog worked pretty well last time I used it. > > > -- > Jeff Jirsa > > > > On Mar 14, 2019, at 11:38 PM, Sundaramoorthy, Natarajan < > natarajan_sundaramoor...@optum.com> wrote: > > > > Can someone shar

Re: good monitoring tool for cassandra

2019-03-14 Thread Jeff Jirsa
-dev, +user Datadog worked pretty well last time I used it. -- Jeff Jirsa > On Mar 14, 2019, at 11:38 PM, Sundaramoorthy, Natarajan > wrote: > > Can someone share knowledge on good monitoring tool for cassandra? Thanks > > This e-mail, including attachments, may in

Re: Cassandra DCOS | monitoring connection and user activity

2018-11-01 Thread Ben Bromhead
a security perspective). Alternatively, whatever monitoring solution you land on will likely need a local agent to connect to JMX via loopback. To answer your specific monitoring questions, iirc JMX will expose the number of active connections per node, however, it does not show what queries

Re: Cassandra DCOS | monitoring connection and user activity

2018-10-31 Thread Anup Shirolkar
Hi, Looks like you need a monitoring for Cassandra but without using JMX. It is possible to use metric reporting libraries in Cassandra: https://wiki.apache.org/cassandra/Metrics#Reporting I do not have specific experience with using Cassandra on DCOS but, monitoring with libraries and tools

Cassandra DCOS | monitoring connection and user activity

2018-10-31 Thread Caesar, Maik
Hello All, have someone experience with monitoring cassandra in DCOS? If we increase the load to the Casandra in DCOS, the application get timeouts and loose the connection and I do not have any information about what happened. Is there a way to get information about the amount of current

Resources for Monitoring Cassandra, Spark, Solr

2018-07-02 Thread Rahul Singh
Folks, We often get questions on monitoring here so I assembled this post with articles from those in the community as well as links to the component tools to give folks a more comprehensive listing. https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance

RE: How do you monitoring Cassandra Cluster?

2018-06-21 Thread Jonathan Baynes
g marketplace<http://www.tradeweb.com/About-Us/Awards/> for electronic fixed income, derivatives and ETF trading From: Rahul Singh [mailto:rahul.xavier.si...@gmail.com] Sent: 21 June 2018 15:15 To: user@cassandra.apache.org; user@cassandra.apache.org Subject: Re: How do you monitoring Cassandra

Re: How do you monitoring Cassandra Cluster?

2018-06-21 Thread Rahul Singh
I’ve collected a bunch at http://leaves.anant.us/#!/?tag=cassandra,monitoring I reommend Grafana / Prometheus if you don’t have DSE (which has OpsCenter) -- Rahul Singh rahul.si...@anant.us Anant Corporation On Jun 19, 2018, 1:06 PM -0400, Romain Gérard , wrote: > Hi Felipe, > > Yo

Re: How do you monitoring Cassandra Cluster?

2018-06-19 Thread Romain Gérard
.com > > (mailto:2535...@qq.com)> wrote: > > > Dear All, > > > > > > we are currently using Cassandra 2.1.13,and it has grown to 5TB size with > > > 32 nodes in one DC. > > > For monitoring,opsCenter does not send alarm and not fre

Re: How do you monitoring Cassandra Cluster?

2018-06-18 Thread Felipe Esteves
AM, Peng Xiao <2535...@qq.com> wrote: > >> Dear All, >> >> we are currently using Cassandra 2.1.13,and it has grown to 5TB size with >> 32 nodes in one DC. >> For monitoring,opsCenter does not send alarm and not free in higher >> version.so we have to us

Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread Rahul Singh
l support to take > > > snapshot and restore via GUI. > > > > > > Regards, > > > Aneesh > > > > > > > On Fri, May 25, 2018 at 10:00 PM, Harikrishnan Pillai > > > > <hpil...@walmartlabs.com> wrote: > > > > > I a

Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread Joaquin Casares
> > Regards, > Aneesh > > On Fri, May 25, 2018 at 10:00 PM, Harikrishnan Pillai < > hpil...@walmartlabs.com> wrote: > >> I assume you are using open source cassandra and you can look at >> Prometheus grafana for cassandra monitoring and lot information av

Re: Cassandra Monitoring tool

2018-05-25 Thread Joaquin Casares
ng > http://www.thelastpickle.com > > 2018-05-25 17:23 GMT+01:00 ANEESH KUMAR K.M <anee...@gmail.com>: > >> Please suggest me some good cluster monitoring tool for cassandra multi >> region cluster. >> >> >

Re: Cassandra Monitoring tool

2018-05-25 Thread Alain RODRIGUEZ
http://www.thelastpickle.com 2018-05-25 17:23 GMT+01:00 ANEESH KUMAR K.M <anee...@gmail.com>: > Please suggest me some good cluster monitoring tool for cassandra multi > region cluster. > >

Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread ANEESH KUMAR K.M
pil...@walmartlabs.com> wrote: > I assume you are using open source cassandra and you can look at > Prometheus grafana for cassandra monitoring and lot information available > in internet regarding how to setup the Prometheus monitoring for cassandra . > > > Sent from my iPhone > >

Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread Harikrishnan Pillai
I assume you are using open source cassandra and you can look at Prometheus grafana for cassandra monitoring and lot information available in internet regarding how to setup the Prometheus monitoring for cassandra . Sent from my iPhone > On May 25, 2018, at 9:23 AM, ANEESH KUMAR K.M &l

Cassandra Monitoring tool

2018-05-25 Thread ANEESH KUMAR K.M
Please suggest me some good cluster monitoring tool for cassandra multi region cluster.

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
This works when the count value is changing/increasing. In my case if the Hints total value is 10 for 2 hours, the difference(sum("TotalHints_Count")) is going to be 10 for that 10 seconds time period and then it will be 0 later on. where as the value should be constantly 10 until there is a

Re: Cassandra Hints monitoring

2018-02-26 Thread Nicolas Guyomar
I find DIFFERENCE to be working for dropped mutation, which IMHO works the same way as Hint metrics *select difference(sum("Dropped_Count")) FROM "cassandraDroppedMessage" groupby host* is valid when I check with nodetool over a period of time Not sure what is not working on your side On 26

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
DIFFERENCE may not work here, if the Hints count is 10 for few hours, the difference is always is zero. which is not the correct value. On Mon, Feb 26, 2018 at 1:18 AM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Thanks Alex, > > Let me try it. > > > On Monday, February 26, 2018,

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
Thanks Alex, Let me try it. On Monday, February 26, 2018, Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Thank you Alex, >> >> I tried "TotalHintsInProgress" already, and I don't see

Re: Cassandra Hints monitoring

2018-02-26 Thread Oleksandr Shulgin
On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Thank you Alex, > > I tried "TotalHintsInProgress" already, and I don't see it sending the > correct metrics. I used mean("TotalHintsInProgress") and I see 0 always > on grafana. > Do you know what is

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
Thank you Alex, I tried "TotalHintsInProgress" already, and I don't see it sending the correct metrics. I used mean("TotalHintsInProgress") and I see 0 always on grafana. Do you know what is the correct way to do rate or diff for hints using "TotalHints"? I am currently using the below query

Re: Cassandra Hints monitoring

2018-02-26 Thread Oleksandr Shulgin
On Mon, Feb 26, 2018 at 8:21 AM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > > I am trying to evaluate the JMX hints metrics for cassandra(TotalHints). > However, when I am testing the metrics, the total hints accumulated count > shows perfectly fine, but when the hints are

Cassandra Hints monitoring

2018-02-25 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to evaluate the JMX hints metrics for cassandra(TotalHints). However, when I am testing the metrics, the total hints accumulated count shows perfectly fine, but when the hints are replayed and the hints count(cql> SELECT * from system.hints; ) becomes zero on cql, and the JMX

Re: How do you monitoring Cassandra Cluster?

2017-06-28 Thread Petrus Gomes
at 5:55 AM, Peng Xiao <2535...@qq.com> wrote: > Dear All, > > we are currently using Cassandra 2.1.13,and it has grown to 5TB size with > 32 nodes in one DC. > For monitoring,opsCenter does not send alarm and not free in higher > version.so we have to use a simple JMX+Zab

How do you monitoring Cassandra Cluster?

2017-06-28 Thread Peng Xiao
Dear All, we are currently using Cassandra 2.1.13,and it has grown to 5TB size with 32 nodes in one DC. For monitoring,opsCenter does not send alarm and not free in higher version.so we have to use a simple JMX+Zabbix template.And we plan to use Jolokia+JMX2Graphite to draw the metrics chart

Re: Cassandra monitoring

2016-06-15 Thread Julien Anguenot
ed, Jun 15, 2016 at 8:58 AM, Julien Anguenot <jul...@anguenot.org > <mailto:jul...@anguenot.org>> wrote: > >> On Jun 14, 2016, at 2:10 PM, Arun Ramakrishnan <sinchronized.a...@gmail.com >> <mailto:sinchronized.a...@gmail.com>> wrote: > > […] > &g

Re: Cassandra monitoring

2016-06-15 Thread Otis Gospodnetić
rty service we would consider an APM or > monitoring service that is on the cheaper side. > Right. Using N open-source tools can lead to the image like the one on https://sematext.com/blog/2015/04/22/monitoring-stream-processing-tools-cassandra-kafka-and-spark/ Otis -- Monitoring - Log Mana

Re: Cassandra monitoring

2016-06-15 Thread Julien Anguenot
> On Jun 14, 2016, at 2:10 PM, Arun Ramakrishnan <sinchronized.a...@gmail.com> > wrote: […] > > Sematext has a integrations for monitoring cassandra. Does anyone have good > experience with it ? We are using Sematext with Cassandra 3.0.x and it is mostly working fine

Re: Cassandra monitoring

2016-06-15 Thread Kai Wang
I use graphite/jmxtrans/collectd to monitor not just Cassandra but also other jvm applications as well as OS. I found it's more useful and flexible than opscenter in terms of monitoring. On Jun 14, 2016 3:10 PM, "Arun Ramakrishnan" <sinchronized.a...@gmail.com> wrote: What

Re: Cassandra monitoring

2016-06-14 Thread Michał Łowicki
I want to be able to monitor >> for cluster health and hook this info to some alerting platform. We are AWS >> heavy. We just really heavily on AWS cloud watch for our metrics as of now. >> We prefer to not spend our time setting up additional tools if we can help >> it. So, if

Re: Cassandra monitoring

2016-06-14 Thread Jonathan Haddad
latform. We are AWS > heavy. We just really heavily on AWS cloud watch for our metrics as of now. > We prefer to not spend our time setting up additional tools if we can help > it. So, if we needed a 3rd party service we would consider an APM or > monitoring service that is on the cheap

Re: Cassandra monitoring

2016-06-14 Thread Arun Ramakrishnan
cloud watch for our metrics as of now. We prefer to not spend our time setting up additional tools if we can help it. So, if we needed a 3rd party service we would consider an APM or monitoring service that is on the cheaper side. On Tue, Jun 14, 2016 at 12:20 PM, Jonathan Haddad &l

Re: Cassandra monitoring

2016-06-14 Thread Jonathan Haddad
you use for monitoring in your infra? I've used a mix of OSS tools (nagios, statsd, graphite, ELK), and hosted solutions. The nice part about them is that you can monitor your whole stack in a single UI not just your database. On Tue, Jun 14, 2016 at 12:10 PM Arun Ramakrishnan < sinchron

Cassandra monitoring

2016-06-14 Thread Arun Ramakrishnan
What are the options for a very small and nimble startup to do keep a cassandra cluster running well oiled. We are on AWS. We are interested in a monitoring tool and potentially also cluster management tools. We are currently on apache cassandra 3.7. We were hoping the datastax opscenter would

Re: Creation of Async Datacenter for Monitoring purposes and Engineering Services purpose

2016-04-13 Thread Alain RODRIGUEZ
> > Live Data delay of 1-2 Hours is acceptable. It is essential that > replication to this DC to not impact the other 2 data centers. > Well, you can have immediate replication with no impact on other DC. Basically set your clients to use LOCAL_ONE/QUORUM and specify a DCAWARE policy on the

Creation of Async Datacenter for Monitoring purposes and Engineering Services purpose

2016-04-13 Thread Bhuvan Rawal
Hi All, We have 2 Running Datacenters in physically seperate DC's with 3 Nodes each. There is a requirement of an Audit DC for issuing queries which will not be concerned with live application traffic. Live Data delay of 1-2 Hours is acceptable. It is essential that replication to this DC to not

RE: management and monitoring nodetool repair

2015-10-19 Thread aeljami.ext
Thx Carlos, How can I get information on error during repair ? Thx. De : Carlos Alonso [mailto:i...@mrcalonso.com] Envoyé : lundi 19 octobre 2015 11:09 À : user@cassandra.apache.org Objet : Re: management and monitoring nodetool repair So repair process has two phases: First one is all about

Re: management and monitoring nodetool repair

2015-10-19 Thread Carlos Alonso
! Carlos Alonso | Software Engineer | @calonso <https://twitter.com/calonso> On 16 October 2015 at 14:09, <aeljami@orange.com> wrote: > Hi, > > I'm looking for a tool for management and monitoring of the status of > nodetool repair. > > Currently I am trying to tes

Re: management and monitoring nodetool repair

2015-10-19 Thread Carlos Alonso
Alonso [mailto:i...@mrcalonso.com] > *Envoyé :* lundi 19 octobre 2015 11:09 > *À :* user@cassandra.apache.org > *Objet :* Re: management and monitoring nodetool repair > > > > So repair process has two phases: > > > > First one is all about calculating Merkel trees

management and monitoring nodetool repair

2015-10-16 Thread aeljami.ext
Hi, I'm looking for a tool for management and monitoring of the status of nodetool repair. Currently I am trying to test cassandra-reaper, but if you tested other tools thank you to share. Thanks

is Thrift support, from Cassandra, really mandatory for OpsCenter monitoring ?

2015-04-27 Thread DE VITO Dominique
Hi, While reading the OpsCenter 5.1 docs, it looks like OpsCenter can't work if Cassandra does not provide a Thrift interface (see [1] below). Is it really the case ? At first sight, it sounded weird to me, as CQL 3 is provided for months. Just to know, is a OpsCenter future version, not

Re: is Thrift support, from Cassandra, really mandatory for OpsCenter monitoring ?

2015-04-27 Thread Michael Shuler
On 04/27/2015 08:18 AM, DE VITO Dominique wrote: Just to know, is a OpsCenter future version, not relying on a mandatory Thrift interface, on the road ? Yes. -- Kind regards, Michael

Re: How to store weather station Details along with monitoring data efficiently?

2015-01-24 Thread Srinivasa T N
Let me try to pictorially what I understood: [image: Inline image 1] Is it correct? Regards, Seenu. On Sat, Jan 24, 2015 at 2:37 AM, Jan cne...@yahoo.com wrote: The model you are using seems OK. Your question: This forces me to enter the wea_name and wea_add for each new row, so how to

Re: How to store weather station Details along with monitoring data efficiently?

2015-01-23 Thread Jan
The model you are using seems OK.  Your question: This forces me to enter the wea_name and wea_add for each new row, so how to identify a new row has been created? Answer:    You do 'not'  need to add the wea_name or wea_address during inserts for every new row.    Your insert could only

How to store weather station Details along with monitoring data efficiently?

2015-01-23 Thread Srinivasa T N
Hi All, I was following the TimeSeries data modelling in PlanetCassandra by Patrick McFadin. Regarding that, I had one query: If I need to store the weather station name also, should it be in the same table, say: create table test (wea_id int, wea_name text, wea_add text, eventday timeuuid,

Re: How to store weather station Details along with monitoring data efficiently?

2015-01-23 Thread Srinivasa T N
I forgot, my task at hand is to generate a report of all the weather station's along with the sum of temperatures measured each day. Regards, Seenu. On Fri, Jan 23, 2015 at 2:14 PM, Srinivasa T N seen...@gmail.com wrote: Hi All, I was following the TimeSeries data modelling in

ANN: Cassandra monitoring anomaly detection

2014-06-11 Thread Otis Gospodnetic
Hi, We've added Cassandra performance monitoring and anomaly detection to SPM http://sematext.com/spm/ recently. Here's the announcement with several screenshots: http://blog.sematext.com/2014/06/02/announcement-cassandra-performance-monitoring-in-spm/ Storm, Kafka, Elasticsearch, Hadoop

Re: cassandra monitoring

2014-01-08 Thread Nick Bailey
Install Errored: Failure installing agent on beta.jokefire.com. Error output: /var/lib/opscenter/ssl/agentKeyStore.pem: No such file or directory Exit code: 1 This indicates that there was a problem generating ssl files when OpsCenter first started up. I would check the log around the first

Re: cassandra monitoring

2013-12-30 Thread Aaron Morton
JMX is doing it's thing on the cassandra node and is running on port 8081 Have you set the JMX port for the cluster in Ops Centre ? The default JMX port has been 7199 for a while. Off the top of the my head it’s in the same area where you specify the initial nodes in the cluster, maybe behind

Re: cassandra monitoring

2013-12-30 Thread Timothy P. Dunphy
aa...@thelastpickle.com To: Cassandra User user@cassandra.apache.org Sent: Monday, December 30, 2013 9:19:05 PM Subject: Re: cassandra monitoring JMX is doing it's thing on the cassandra node and is running on port 8081 Have you set the JMX port for the cluster in Ops Centre ? The default

cassandra monitoring

2013-12-29 Thread Tim Dunphy
Hi all, I'm attempting to configure datastax agent so that opscenter can monitor cassandra. I am running cassandra 2.0.3 and opscenter-4.0.1-2.noarch running. Cassandra is running on a centos 5.9 host and the opscenter host is running on centos 6.5 A ps shows the agent running [root@beta:~] #ps

Re: Monitoring the number of client connections

2012-12-20 Thread Rob Coli
On Wed, Dec 19, 2012 at 4:20 PM, Hiller, Dean dean.hil...@nrel.gov wrote: What? I thought cassandra was using nio so thread per connection is not true? Here's the monkey test I used to verify my conjecture. 1) ps -eLf |grep jsvc |grep cassandra | wc -l # note number of threads 2) for name

Re: Monitoring the number of client connections

2012-12-20 Thread Rob Coli
On Thu, Dec 20, 2012 at 12:41 PM, Rob Coli rc...@palominodb.com wrote: So, by default Cassandra does in fact use one thread per thrift connection. Also of note is that even with hsha, an *active* connection (where synchronous storage backend is doing something) consumes a thread. Some more

Re: Monitoring the number of client connections

2012-12-19 Thread Edward Capriolo
In the TCP mib for SNMP (Simple Network Management Protocol) this information is available http://www.simpleweb.org/ietf/mibs/mibSynHiLite.php?category=IETFmodule=TCP-MIB On Wed, Dec 19, 2012 at 12:22 AM, Michael Kjellman mkjell...@barracuda.comwrote: netstat + cron is your friend at this

Re: Monitoring the number of client connections

2012-12-19 Thread Hiller, Dean
, December 19, 2012 4:49 PM To: user@cassandra.apache.orgmailto:user@cassandra.apache.org user@cassandra.apache.orgmailto:user@cassandra.apache.org Subject: Re: Monitoring the number of client connections On Tue, Dec 18, 2012 at 1:37 AM, Tomas Nunez tomas.nu...@groupalia.commailto:tomas.nu

Monitoring the number of client connections

2012-12-18 Thread Tomas Nunez
Hi! I want to know how many client connections has each one of my cluster nodes (to check if my load balancing is spreading in a balanced way, to check if increase in the cluster load can be related to an increase in the number of connections, and things like that). I was thinking about going

Re: Monitoring the number of client connections

2012-12-18 Thread aaron morton
AFAIK the count connections is not exposed. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/12/2012, at 10:37 PM, Tomas Nunez tomas.nu...@groupalia.com wrote: Hi! I want to know how many client connections

Re: Monitoring the number of client connections

2012-12-18 Thread Michael Kjellman
netstat + cron is your friend at this point in time On Dec 18, 2012, at 8:25 PM, aaron morton aa...@thelastpickle.commailto:aa...@thelastpickle.com wrote: AFAIK the count connections is not exposed. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton

Re: Suggestions for tuning and monitoring.

2012-09-15 Thread Henrik Schröder
I started digging in the logfiles, and here's the full log of a crash. We have 4GB of heap, and if you watch either OpsCenter or through a JMX console, used heap size is always below 3GB, and it swings between 1.5 to 3GB ever 5 minutes or so. So why would it suddenly run out of heap space? INFO

Suggestions for tuning and monitoring.

2012-09-10 Thread Henrik Schröder
Hi all, We're running a small Cassandra cluster (v1.0.10) serving data to our web application, and as our traffic grows, we're starting to see some weird issues. The biggest of these is that sometimes, a single node becomes unresponsive. It's impossible to start new connections, or impossible to

Re: Suggestions for tuning and monitoring.

2012-09-10 Thread aaron morton
It's impossible to start new connections, or impossible to send requests, or it just doesn't return anything when you've sent a request. If it's totally frozen it sounds like GC. How long does it freeze for? Despite that, we occasionally get OOM exceptions, and nodes crashing, maybe a few

Re: Monitoring replication lag/latency in multi DC setup

2012-09-06 Thread aaron morton
Is there a specific metric you can recommend? the not entirely correct but very lightweight approach would be to look at the size of the HintsColumnFamily in the system KS. If you want an exact number use the functions on the HH MBean

Monitoring replication lag/latency in multi DC setup

2012-09-05 Thread Venkat Rama
Hi, We have multi DC Cassandra ring with 2 DCs setup. We use LOCAL_QUORUM for writes and reads. The network we have seen between the DC is sometimes flaky lasting few minutes to few 10 of minutes. I wanted to know what is the best way to measure/monitor either the lag or replication latency

Re: Monitoring replication lag/latency in multi DC setup

2012-09-05 Thread Mohit Anchlia
As far as I know Cassandra doesn't use internal queueing mechanism specific to replication. Cassandra sends the write the remote DC and after that it's upto the tcp/ip stack to deal with buffering. If requests starts to timeout Cassandra would use HH upto certain time. For longer outage you would

Re: Monitoring replication lag/latency in multi DC setup

2012-09-05 Thread Venkat Rama
Thanks for the quick reply, Mohit.Can we measure/monitor the size of Hinted Handoffs? Would it be a good enough indicator of my back log? Although we know when a network is flaky, we are interested in knowing how much data is piling up in local DC that needs to be transferred. Greatly

Re: Monitoring replication lag/latency in multi DC setup

2012-09-05 Thread Mohit Anchlia
Cassandra exposes lot of metrics through Jconsole. You might be able to get some information from Jconsole. On Wed, Sep 5, 2012 at 8:47 PM, Venkat Rama venkata.s.r...@gmail.comwrote: Thanks for the quick reply, Mohit.Can we measure/monitor the size of Hinted Handoffs? Would it be a good

Re: Monitoring replication lag/latency in multi DC setup

2012-09-05 Thread Venkat Rama
Is there a specific metric you can recommend? VR On Wed, Sep 5, 2012 at 9:19 PM, Mohit Anchlia mohitanch...@gmail.comwrote: Cassandra exposes lot of metrics through Jconsole. You might be able to get some information from Jconsole. On Wed, Sep 5, 2012 at 8:47 PM, Venkat Rama

RE: Network, Compaction, Garbage collection and Cache monitoring in cassandra

2012-03-21 Thread Jeremiah Jordan
You can also use any network/server monitoring tool which can talk to JMX. We are currently using vFabric Hyperic's JMX plugin for this. IIRC there are some cacti and nagios scripts on github for getting the data into those. -Jeremiah From: R. Verlangen [ro

Re: Network, Compaction, Garbage collection and Cache monitoring in cassandra

2012-03-21 Thread Thomas van Neerijnen
Collectd with GenericJMX pushing data into Graphite is what we use. You can monitor the Graphite graphs directly instead of having an extra JMX interface on the Cassandra nodes for monitoring. On Wed, Mar 21, 2012 at 8:16 PM, Jeremiah Jordan jeremiah.jor...@morningstar.com wrote: You can also

Re: Monitoring move progress

2011-12-22 Thread aaron morton
My expectation is that after the compactions (which the project wiki refers to as anti-compactions), I would start to see outbound streaming activity in netstats. That is very old information. The compactions you saw may have been the result of flushing to disk before starting the move.

Monitoring move progress

2011-12-21 Thread Ethan Rowe
I've got some nodes in a moving state in a cluster (the nodes to which they stream shouldn't overlap), and I'm finding it difficult to determine if they're actually doing anything related to the move at this point, or if they're stuck in the state and not actually doing anything. In each case, I

RE: Monitoring your cluster

2011-11-28 Thread Michael Vaknine
[mailto:dmcne...@agentisenergy.com] Sent: Sunday, November 27, 2011 9:43 PM To: user@cassandra.apache.org Subject: Monitoring your cluster Hey folks, If anyone is using Nagios to do any of your network monitoring, I just finished the initial version of a Cassandra monitoring plugin that is a fork

RE: Monitoring your cluster

2011-11-28 Thread Michael Vaknine
[mailto:dmcne...@agentisenergy.com] Sent: Sunday, November 27, 2011 9:43 PM To: user@cassandra.apache.org Subject: Monitoring your cluster Hey folks, If anyone is using Nagios to do any of your network monitoring, I just finished the initial version of a Cassandra monitoring plugin that is a fork

RE: Monitoring your cluster

2011-11-28 Thread Michael Vaknine
[mailto:dmcne...@agentisenergy.com] Sent: Sunday, November 27, 2011 9:43 PM To: user@cassandra.apache.org Subject: Monitoring your cluster Hey folks, If anyone is using Nagios to do any of your network monitoring, I just finished the initial version of a Cassandra monitoring plugin that is a fork

Monitoring your cluster

2011-11-27 Thread David McNelis
Hey folks, If anyone is using Nagios to do any of your network monitoring, I just finished the initial version of a Cassandra monitoring plugin that is a fork of a much simpler version. Hope someone finds it useful. Right now I know it works with the 0.8 build of Cassandra, I'll update

Re: Issues with JMX monitoring -- v0.8.7

2011-11-23 Thread David McNelis
)? Ideally this would be as low cost an operation on the Cassandra node as possible, since it is just monitoring statuses (stati?). On Tue, Nov 22, 2011 at 1:15 PM, Nick Bailey n...@datastax.com wrote: There are quite a few attributes in the org.apace.cassandra.db.StorageServiceMBean that could serve

Re: Issues with JMX monitoring -- v0.8.7

2011-11-23 Thread Nick Bailey
using Hector)? Ideally this would be as low cost an operation on the Cassandra node as possible, since it is just monitoring statuses (stati?). On Tue, Nov 22, 2011 at 1:15 PM, Nick Bailey n...@datastax.com wrote: There are quite a few attributes

JMX monitoring

2011-11-23 Thread David McNelis
Ok. in that case I think the Docs are wrong. http://wiki.apache.org/cassandra/JmxInterface has StorageService as part of org.apache.cassandra.service. Also, once I executed a CLI command, I started getting the expected output (output being that it was able to return the live nodes). --

Issues with JMX monitoring -- v0.8.7

2011-11-23 Thread David McNelis
In that case, I think that the documentation is incorrect, as it has Service listed as the package related to the StorageService. I apologize for the lack of the rest of the thread, everything is getting bounced when I try to send it for some reason. -- *David McNelis* Lead Software Engineer

Re: Issues with JMX monitoring -- v0.8.7

2011-11-23 Thread Edward Capriolo
Wiki documentation will probably never be able to keep pace with the actual JMX objects. The tend to get renamed, move, properties get added removed, etc. It happens with active projects. Edward On Wed, Nov 23, 2011 at 12:22 PM, David McNelis dmcne...@agentisenergy.comwrote: In that case, I

Re: JMX monitoring

2011-11-23 Thread Jeremiah Jordan
jconsole is going to be the most up to date documentation for the JMX interface =(. -Jeremiah On 11/23/2011 10:49 AM, David McNelis wrote: Ok. in that case I think the Docs are wrong. http://wiki.apache.org/cassandra/JmxInterface has StorageService as part of org.apache.cassandra.service.

Issues with JMX monitoring -- v0.8.7

2011-11-22 Thread David McNelis
Good morning, I'm trying to set up a simple monitoring application (that is a plugin to Nagios), code can be found here: https://github.com/so-net-developer/Cassandra/blob/master/nagios/CheckNode.java However, when I try to run the CheckNode.java program I get an error that: Exception in thread

Re: Issues with JMX monitoring -- v0.8.7

2011-11-22 Thread Nick Bailey
The StorageServiceMBean is only created once some reads/writes actually go to that node. Do a couple reads/writes from the CLI and you should see the MBean afterwards. This also means your monitoring application should handle this error in the case of nodes restarting. On Tue, Nov 22, 2011 at 7

Re: Issues with JMX monitoring -- v0.8.7

2011-11-22 Thread David McNelis
/writes from the CLI and you should see the MBean afterwards. This also means your monitoring application should handle this error in the case of nodes restarting. On Tue, Nov 22, 2011 at 7:51 AM, David McNelis dmcne...@agentisenergy.com wrote: Good morning, I'm trying to set up a simple

Re: Issues with JMX monitoring -- v0.8.7

2011-11-22 Thread Nick Bailey
: The StorageServiceMBean is only created once some reads/writes actually go to that node. Do a couple reads/writes from the CLI and you should see the MBean afterwards. This also means your monitoring application should handle this error in the case of nodes restarting. On Tue, Nov 22, 2011 at 7:51 AM, David

Monitoring question for a multi DC (active/standby) configuration

2011-10-27 Thread Anand Somani
of doing active/standby with durability guarantees. Or is this not possible and I should use EACH_QUORUM I found a few emails on active/standby, but nothing about monitoring, so if this is already a discussed/solution suggested problem please forward the link. Thanks Anand

Monitoring....

2011-10-12 Thread Brian Fleming
Hi, Has anybody used any solutions for harvesting and storing Cassandra JMX metrics for monitoring, trend analysis, etc.? JConsole is useful for single node monitoring/etc but not scalable data obviously doesn't persist between sessions... Many thanks, Brian

Re: Monitoring....

2011-10-12 Thread David McNelis
for monitoring, trend analysis, etc.? ** ** **JConsole is useful for single node monitoring/etc but not scalable data obviously doesn't persist between sessions...** ** ** Many thanks, Brian -- *David McNelis* Lead Software Engineer Agentis Energy www.agentisenergy.com c: 219.384.5143

Re: Monitoring....

2011-10-12 Thread Stefan Reek
...@gmail.com mailto:bigbrianflem...@gmail.com wrote: Hi, Has anybody used any solutions for harvesting and storing Cassandra JMX metrics for monitoring, trend analysis, etc.? JConsole is useful for single node monitoring/etc but not scalable data obviously doesn't persist between

  1   2   >