Re: Timestamp Query

2015-12-20 Thread Jai Bheemsen Rao Dhanwada
https://datastax.github.io/java-driver/features/query_timestamps/ On Sun, Dec 20, 2015 at 9:48 PM, Harikrishnan A wrote: > Hello, > > How do I set a timestamp value with specific timezone in cassandra. I > understand that it captures the timezone of the co ordinator node

Re: Cassandra Cleanup and disk space

2015-11-26 Thread Jai Bheemsen Rao Dhanwada
Cleanup is specific to a node, may be cleanup was ran one node before and was ran another node the second time. On Thu, Nov 26, 2015 at 6:37 PM, sai krishnam raju potturi < pskraj...@gmail.com> wrote: > Could it have been that you expanded your cluster a while back, but did > not cleanup then. >

Re: Change authorization from AllowAllAuthorizer to CassandraAuthorizer

2016-06-08 Thread Jai Bheemsen Rao Dhanwada
>> >> Big DATA Team >> >> MTC 2250 >> >> For support, create a JIRA >> <https://portal.homedepot.com/sites/bigdata/Shared%20Documents/Jira%20Hadoop%20Support%20Workflow.pdf> >> >> >> >> *From:* Jai Bheemsen Rao Dhanwada [mailto:ja

Re: Change authorization from AllowAllAuthorizer to CassandraAuthorizer

2016-06-07 Thread Jai Bheemsen Rao Dhanwada
Hello Sean, Recently I tried to enable Authentication on a existing cluster, I have see the below behaviour. (Clients already have the credentials and 3 node C* cluster) cluster 1 - Enabled Authentication on node1 by adding iptable rules (so that client will not communicate to this node) and I

Re: Cassandra Authentication

2017-01-18 Thread Jai Bheemsen Rao Dhanwada
manage users, however that entails it's own set of challenges and > maintenance. > > For most users I would suggest 3 < RF <=5 is sufficient. Also make sure > you don't use the user "Cassandra" in production as authentication queries > are done at QUORUM. > > On We

Re: Cassandra Authentication

2017-01-18 Thread Jai Bheemsen Rao Dhanwada
hing that stops you > serving requests. > > On Wed, 18 Jan 2017 at 14:57 Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Thanks Ben, >> >> RF 3 isn't sufficient for system_auth? as we are using 3 RF for other >> production KS, do you se

Cassandra Authentication

2017-01-18 Thread Jai Bheemsen Rao Dhanwada
Hello, When enabling Authentication on cassandra, is it required to set the RF same as the no.of nodes( https://docs.datastax.com/en/cql/3.1/cql/cql_using/update_ks_rf_t.html)? or can I live with RF of 3 in each DC (other KS are using 3) If it has to be equal to the number of nodes then, every

Keyspace/CF creation Timeouts

2016-10-25 Thread Jai Bheemsen Rao Dhanwada
Hello All, I have recently started noticing timeouts while creating KS/CF. this is happening with increase in no.of keyspaces. Does anyone have an idea what to look for? as I don't see any error or exception in the logs. or is there some kind of parameter change required? C* Version: 2.1.16

Re: Keyspace/CF creation Timeouts

2016-10-25 Thread Jai Bheemsen Rao Dhanwada
ite consistency level u r using? > > > On 25 October 2016 at 13:18, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Hello All, >> >> I have recently started noticing timeouts while creating KS/CF. this is >> happening with increase in

Re: Keyspace/CF creation Timeouts

2016-10-25 Thread Jai Bheemsen Rao Dhanwada
the Local_QUORUM. >>> >>> On Tue, Oct 25, 2016 at 1:28 PM, Surbhi Gupta <surbhi.gupt...@gmail.com> >>> wrote: >>> >>>> 1. Make sure all nodes are up and running while you are trying to >>>> create the Keyspaces and Column Family. >>>

Re: Rebuild failing while adding new datacenter

2016-10-22 Thread Jai Bheemsen Rao Dhanwada
I have opened https://issues.apache.org/jira/browse/CASSANDRA-12816 On Thu, Oct 20, 2016 at 6:30 PM, Yabin Meng <yabinm...@gmail.com> wrote: > Sorry, I'm not aware of it > > On Thu, Oct 20, 2016 at 6:00 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wro

Rebuild failing while adding new datacenter

2016-10-20 Thread Jai Bheemsen Rao Dhanwada
Hello All, I have single datacenter with 3 C* nodes and we are trying to expand the cluster to another region/DC. I am seeing the below error while doing a "nodetool rebuild -- name_of_existing_data_center" . [user@machine ~]$ nodetool rebuild DC1 nodetool: Unable to find sufficient sources for

Re: Rebuild failing while adding new datacenter

2016-10-20 Thread Jai Bheemsen Rao Dhanwada
newly added datacenter was not able to communicate with the > existing datacenters on the port 7000(inter-node communication). Your's > might be a different issue, but just saying. > > > On Thu, Oct 20, 2016 at 4:12 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com>

Re: Rebuild failing while adding new datacenter

2016-10-20 Thread Jai Bheemsen Rao Dhanwada
; > I would say this is a benign bug. > > Yabin > > On Thu, Oct 20, 2016 at 4:41 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> thanks, >> >> This always works on 2.1.13 and 2.1.16 version but not on 3.0.8. >> definitely not a

Re: Cassandra reaper

2016-11-21 Thread Jai Bheemsen Rao Dhanwada
PM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > ok thank you, > I will try and update you. > > On Tue, Nov 1, 2016 at 10:57 AM, Alexander Dejanovski < > a...@thelastpickle.com> wrote: > >> Running reaper with INFO level logging (that can be

Re: Cassandra reaper

2016-11-21 Thread Jai Bheemsen Rao Dhanwada
I noticed that I am not able to add schedules, but I can run repairs. Is there some limitation on the opensource for adding the schedules? On Mon, Nov 21, 2016 at 4:25 PM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Hello Alexander, > > Thanks for the help, I coul

Re: Cassandra Encryption

2016-11-22 Thread Jai Bheemsen Rao Dhanwada
e > certificate for all nodes? > > Best regards, Vladimir Yudovin, > > *Winguzone <https://winguzone.com?from=list> - Hosted Cloud > CassandraLaunch your cluster in minutes.* > > > On Mon, 21 Nov 2016 17:25:11 -0500*Jai Bheemsen Rao Dhanwada > <jaibheem...@gm

Cassandra Encryption

2016-11-21 Thread Jai Bheemsen Rao Dhanwada
Hello, I am setting up encryption on one of my cassandra cluster using the below procedure. server_encryption_options: internode_encryption: all keystore: /etc/keystore keystore_password: x truststore: /etc/truststore truststore_password: x

Re: Cassandra Encryption

2016-11-22 Thread Jai Bheemsen Rao Dhanwada
d. > > Or, as Nate suggested, you can use trusted root certificate to issue > nodes' certificates. > > > Best regards, Vladimir Yudovin, > > *Winguzone <https://winguzone.com?from=list> - Hosted Cloud > CassandraLaunch your cluster in minutes.* > > >

Re: Cassandra reaper

2016-11-21 Thread Jai Bheemsen Rao Dhanwada
GitHub and provide both configuration and error > output (if any) ? >> https://github.com/thelastpickle/cassandra- > reaper/issues > > > Thanks, > > On Tue, Nov 22, 2016 at 1:59 AM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> I not

User creation issue

2016-11-17 Thread Jai Bheemsen Rao Dhanwada
Hello, I have a 5*5 node cluster which has Authentication enabled. I created a user and did a list user, but I don't see the user created command: CREATE USER test WITH PASSWORD 'xyz' SUPERUSER; replication : NetworkTopology dc1:5 and dc2:5 for the system_auth keyspace. C* version : 3.0.8

Re: User creation issue

2016-11-17 Thread Jai Bheemsen Rao Dhanwada
etool repair for system_auth keyspace? > > 2016-11-17 13:45 GMT-08:00 Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com>: > > Hello, > > > > I have a 5*5 node cluster which has Authentication enabled. > > > > I created a user and did a list user, but I don

Cassandra reaper

2016-10-31 Thread Jai Bheemsen Rao Dhanwada
Hello, Has anyone played around with the cassandra reaper ( https://github.com/spotify/cassandra-reaper)? if so can some please help me with the set-up, I can't get it working. I used the below steps: 1. create jar file using maven 2. java -jar cassandra-reaper-0.2.3-SNAPSHOT.jar server

Re: Cassandra reaper

2016-11-01 Thread Jai Bheemsen Rao Dhanwada
e which version of Cassandra you're using ? > > Thanks > > On Tue, Nov 1, 2016 at 6:15 PM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Thanks Alex, >> >> Forgot to mention but I did add the cluster. See the status below. It >>

Re: Cassandra reaper

2016-11-01 Thread Jai Bheemsen Rao Dhanwada
Worth mentioning that at The Last Pickle we maintain a fork of Reaper that > handles incremental repair, works with C* 2.x and 3.0, and bundles the UI : > https://github.com/thelastpickle/cassandra-reaper > We have a branch that allows using Cassandra as a storage backend instead > o

Re: Cassandra reaper

2016-11-01 Thread Jai Bheemsen Rao Dhanwada
pport. > > Cheers, > > Le mar. 1 nov. 2016 18:31, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> a écrit : > >> Cassandra version is 2.1.16 >> >> In my setup I don't see it is writting to any logs >> >> On Tue, Nov 1, 2016 at 10:25 AM,

Re: Internal Security - Authentication & Authorization

2017-03-14 Thread Jai Bheemsen Rao Dhanwada
I have similar question. when we create users or roles what is the consistency level used? I know, If NOT EXISTS will use SERIAL consistency. what consistency will be used if just use CREATE USER ? On Mon, Mar 13, 2017 at 7:09 PM, Jacob Shadix wrote: > I'm looking for a

Streaming errors during bootstrap

2017-04-11 Thread Jai Bheemsen Rao Dhanwada
Hello, I am seeing streaming errors while adding new nodes(in the same DC) to the cluster. ERROR [STREAM-IN-/x.x.x.x] 2017-04-11 23:09:29,318 StreamSession.java:512 - [Stream #a8d56c70-1f0b-11e7-921e-61bb8bdc19bb] Streaming error occurred java.io.IOException: CF

Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Jai Bheemsen Rao Dhanwada
change this on the fly (no bounce required), > but I don’t think it affects any current streaming from that node (only > future). You can use nodetool getstreamthroughput to see the current value. > > > > > > Sean Durity > > > > *From:* Jai Bheemsen Rao Dhanwada [mailt

Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Jai Bheemsen Rao Dhanwada
us, have you tried removenode force? > > > On Thursday, July 13, 2017, 8:35:38 AM PDT, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com > <javascript:_e(%7B%7D,'cvml','jaibheem...@gmail.com');>> wrote: > > > Thank you Sean, > > you mean setstreamthroughput t

Re: nodetool removenode causing the schema out of sync

2017-07-13 Thread Jai Bheemsen Rao Dhanwada
Also changing the compaction throughput on the fly while removing nodes is not scalable as we have 100s of nodes. I can try and test though On Thursday, July 13, 2017, Jai Bheemsen Rao Dhanwada <jaibheem...@gmail.com> wrote: > Yes i did removenode and removenode force, and ecnountered s

nodetool removenode causing the schema out of sync

2017-06-28 Thread Jai Bheemsen Rao Dhanwada
Hello, We are using C* version 2.1.6 and lately we are seeing an issue where, nodetool removenode causing the schema to go out of sync and causing client to fail for 2-3 minutes. C* cluster is in 8 Datacenters with RF=3 and has 50 nodes. We have 130 Keyspaces and 500 CF in the cluster. Here are

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jai Bheemsen Rao Dhanwada
in the logs). That doesn't really explain the schema change, > though - how confident are you that the schema was properly in sync prior > to the removenode? > > - Jeff > > On 2017-06-29 09:49 (-0700), Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jai Bheemsen Rao Dhanwada
Thanks Jeff, Can you please suggest what value to tweak from the Cassandra side? On Thu, Jun 29, 2017 at 2:53 PM, Jeff Jirsa <jji...@apache.org> wrote: > > > On 2017-06-29 13:45 (-0700), Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello Jeff,

Re: nodetool removenode causing the schema out of sync

2017-06-29 Thread Jai Bheemsen Rao Dhanwada
51 (-0700), Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello, > > > > We are using C* version 2.1.6 and lately we are seeing an issue where, > > nodetool removenode causing the schema to go out of sync and causing > client > > to fail for 2-3

Nodetool cleanup doesn't work

2017-05-10 Thread Jai Bheemsen Rao Dhanwada
Hello, I am running into an issue where *nodetool cleanup *fails to cleanup data. We are running 2.1.16 version of Cassandra. [user@host ~]$ nodetool cleanup Aborted cleaning up atleast one column family in keyspace user, check server logs for more information. Aborted cleaning up atleast one

Re: Nodetool cleanup doesn't work

2017-05-11 Thread Jai Bheemsen Rao Dhanwada
; On 2017-05-10 22:44 (-0700), Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello, > > > > I am running into an issue where *nodetool cleanup *fails to cleanup > data. > > We are running 2.1.16 version of Cassandra. > > > > > >

Re: Nodetool cleanup doesn't work

2017-05-11 Thread Jai Bheemsen Rao Dhanwada
e of the datacenters. You can work around this by running > 'nodetool cleanup ' on all of your other keyspaces individually, > skipping the one that isn't replicated to that datacenter. > > > > On Thu, May 11, 2017 at 11:19 AM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gma

Re: Nodetool cleanup doesn't work

2017-05-11 Thread Jai Bheemsen Rao Dhanwada
t;> >>>> Thanks Jeff, >>>> >>>> I have a C* cluster spread across multiple datacenter. >>>> reason for cleanup : I added multiple nodes to cluster and need to run >>>> cleanup on old nodes so that the redundant data is cleaned-up. >>>>

Check the status of rebuild_index

2017-06-07 Thread Jai Bheemsen Rao Dhanwada
Hello, I am using 2.1.13 version of Cassandra, and I am trying to run rebuild_index, but I am not seeing any status in the nodetool compactionstats. also all I see in the logs is User Requested secondary index re-build for kms/oauth_20_access_tokens indexes is there way to find if the secondary

Re: Debugging write timeouts on Cassandra 2.2.5

2017-09-20 Thread Jai Bheemsen Rao Dhanwada
Apologies for the typo, Mike On Wed, Sep 20, 2017 at 9:49 AM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Hello Nike, > > were you able to fix the issue? If so what change helped you? > > On Wed, Feb 24, 2016 at 5:36 PM, Jack Krupansky <jack.krup

Re: Debugging write timeouts on Cassandra 2.2.5

2017-09-20 Thread Jai Bheemsen Rao Dhanwada
Hello Nike, were you able to fix the issue? If so what change helped you? On Wed, Feb 24, 2016 at 5:36 PM, Jack Krupansky wrote: > Great that you found a specific release that triggers the problem - 2.1.x > has a huge number of changes. > > How many partitions and

Re: Cassandra snapshot restore with VNODES missing some data

2017-08-30 Thread Jai Bheemsen Rao Dhanwada
] 2017-08-30 17:17:22,902 MessagingService.java:734 - Waiting for messaging service to quiesce INFO [ACCEPT-/x <http://10.16.4.182/>.x.x.x] 2017-08-30 17:17:22,903 MessagingService.java:1020 - MessagingService has terminated the accept() thread On Wed, Aug 30, 2017 at 5:57 PM, Jai Bheems

Re: Unsuccessful back-up and restore with differing counts

2017-08-30 Thread Jai Bheemsen Rao Dhanwada
This is link gives me 404, can you please give me the correct link? On Sat, May 13, 2017 at 10:51 AM, Surbhi Gupta wrote: > Below link has the method u r looking for > http://datascale.io/cloning-cassandra-clusters-fast-way/ > > On Sat, May 13, 2017 at 9:49 AM

Re: Cassandra snapshot restore with VNODES missing some data

2017-08-30 Thread Jai Bheemsen Rao Dhanwada
yes source use the vnodes. I am restoring to a different cluster in different datacenter, so the rack and dc changes. does that matter? On Wed, Aug 30, 2017 at 5:55 PM, kurt greaves wrote: > Does the source cluster also use vnodes? You will need to ensure you use > the

Re: Cassandra snapshot restore with VNODES missing some data

2017-09-04 Thread Jai Bheemsen Rao Dhanwada
Hello Kurt, Thanks for the help :) On Fri, Sep 1, 2017 at 1:12 PM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > yes looks like I am missing that. > > Let me test on one node and try a full cluster restore. > > will update here once I complete my test > &g

Re: Cassandra snapshot restore with VNODES missing some data

2017-09-01 Thread Jai Bheemsen Rao Dhanwada
yes looks like I am missing that. Let me test on one node and try a full cluster restore. will update here once I complete my test On Fri, Sep 1, 2017 at 5:01 AM, kurt greaves wrote: > is num_tokens also set to 256? >

Re: Cassandra snapshot restore with VNODES missing some data

2017-08-31 Thread Jai Bheemsen Rao Dhanwada
I double checked that I am setting all 256 tokens, verified manually. When I start Cassandra with empty data directory is startsup fine. now if I restart the Cassandra without making any changes it won't start and give same error I captured the nodetool status and nodetool ring and compare the

Cassandra snapshot restore with VNODES missing some data

2017-08-30 Thread Jai Bheemsen Rao Dhanwada
Hello All, I am trying to restore a cluster with VNODE(s) to a new cluster using the snapshot. After the restore when I query data from cql I see some random data is missing. I used the below steps to restore 1. Snapshot on the source cluster 2. Setup new cluster(VNODEs) with the same schema as

Cassandra CF Level Metrics (Read, Write Count and Latency)

2017-08-31 Thread Jai Bheemsen Rao Dhanwada
Hello All, I am looking to capture the CF level Read, Write count and Latency. As of now I am using Telegraf plugin to capture the JMX metrics. What is the MBeans, scope and metric to look for the CF level metrics?

Re: Cassandra CF Level Metrics (Read, Write Count and Latency)

2017-08-31 Thread Jai Bheemsen Rao Dhanwada
cs:type=Table keyspace= scope= > name= > With MetricName set to ReadLatency and WriteLatency > > Cheers, > > Christophe > > > > On 1 September 2017 at 09:08, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Hello All, >> >> I a

Re: Cassandra CF Level Metrics (Read, Write Count and Latency)

2017-08-31 Thread Jai Bheemsen Rao Dhanwada
screenshot > > Cheers, > > Christophe > > On 1 September 2017 at 09:21, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> I did look at the document and tried setting up the metric as following, >> does this is not matching with th

Re: [EXTERNAL] Lot of hints piling up

2017-10-23 Thread Jai Bheemsen Rao Dhanwada
, WA > > Ph : 425-691-6417 (cell) > > Email : kishore.mohapa...@nuance.com > > > > > > *From:* Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] > *Sent:* Friday, October 20, 2017 9:44 AM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] Lot of hints p

Re: Reg:- CassandraRoleManager skipped default role setup Issue

2017-11-23 Thread Jai Bheemsen Rao Dhanwada
ng this WARN into my NODE1. > > > On Fri, Nov 24, 2017 at 7:03 AM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> I ran into similar issue before with 2.1.13 version of C*. and when I >> restart the node second time it actually created the defau

Re: Schema version mismatch with 3.0.8 and 3.0.14

2017-11-30 Thread Jai Bheemsen Rao Dhanwada
PM, Jeff Jirsa <jji...@gmail.com> wrote: > Yes, going to 3.0.14 or 3.0.15 should work correctly > > 3.0.15 will have important bug fixes not in 3.0.14 > > > -- > Jeff Jirsa > > > On Nov 29, 2017, at 4:52 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail

Re: Schema version mismatch with 3.0.8 and 3.0.14

2017-11-29 Thread Jai Bheemsen Rao Dhanwada
any schema > changes until the upgrade is complete (and be aware that having 2 schema > versions during the upgrade is normal and expected). > > - Jeff > > > On Wed, Nov 29, 2017 at 4:05 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> H

Schema version mismatch with 3.0.8 and 3.0.14

2017-11-29 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to upgrade the cassandra version from the 3.0.8 to 3.0.14. I am adding a new node with 3.0.14 version to 3.0.8. cluster and I see the schema disagreement between the nodes and the new node doesn't stream any data. I am looking at :

Re: Reg:- CassandraRoleManager skipped default role setup Issue

2017-11-22 Thread Jai Bheemsen Rao Dhanwada
Can you do a nodetool describecluster and check if the schema version is matching on all the nodes? On Tue, Nov 21, 2017 at 11:52 PM, @Nandan@ wrote: > Hi Team, > > Today I set up a test cluster with 4 nodes and using Apache Cassandra > 3.1.1 version. > After

Re: Reg:- CassandraRoleManager skipped default role setup Issue

2017-11-23 Thread Jai Bheemsen Rao Dhanwada
.DynamicEndpointSnitch > Partitioner: org.apache.cassandra.dht.Murmur3Partitioner > Schema versions: > 2e2ab56b-6639-394e-a1fe-4b35ba87473b: [10.0.0.2, 10.0.0.3, 10.0.0.4, > 10.0.0.1] > > > Thanks and best regards, > Nandan > > On Thu, Nov 23, 2017 at 5:37 AM, Jai Bheemsen Rao Dha

Re: Schema version mismatch with 3.0.8 and 3.0.14

2017-12-01 Thread Jai Bheemsen Rao Dhanwada
gt; > -- > Jeff Jirsa > > > On Nov 30, 2017, at 9:40 AM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello Jeff, > > I tried with 3.0.15 as well and I see the same issue. > > Here are the steps I followed. > > 1. I have a 3 no

Re: [EXTERNAL] Lot of hints piling up

2017-10-24 Thread Jai Bheemsen Rao Dhanwada
rror or HEAP error. > > > > Thanks > > > > *Kishore Mohapatra* > > Principal Operations DBA > > Seattle, WA > > Email : kishore.mohapa...@nuance.com > > > > > > *From:* Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] > *Sent:* Mo

Lot of hints piling up

2017-10-20 Thread Jai Bheemsen Rao Dhanwada
Hello, We have cassandra cluster in 3 regions with version 2.1.13, and all of a sudden we started seeing lot of hints accumulating on the nodes. We are pretty sure there is no issue with the network between the regions and all the nodes are up and running all the time. Is there any other reason

Cassandra Hints monitoring

2018-02-25 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to evaluate the JMX hints metrics for cassandra(TotalHints). However, when I am testing the metrics, the total hints accumulated count shows perfectly fine, but when the hints are replayed and the hints count(cql> SELECT * from system.hints; ) becomes zero on cql, and the JMX

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
urrently using the below query SELECT mean("TotalHints_Count") FROM "cassandraStorage" WHERE $timeFilter GROUP BY time(10s) On Mon, Feb 26, 2018 at 12:26 AM, Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > On Mon, Feb 26, 2018 at 8:21 AM, Jai Bheemsen Rao Dha

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
Thanks Alex, Let me try it. On Monday, February 26, 2018, Oleksandr Shulgin < oleksandr.shul...@zalando.de> wrote: > On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> Thank you Alex, >> >> I tried "To

Re: Bootstrap streaming issues

2018-08-30 Thread Jai Bheemsen Rao Dhanwada
in cassandra is > actually Amy's 2.1 tuning guide: > https://tobert.github.io/pages/als-cassandra-21-tuning-guide.html - it's > somewhat out of date as it's for 2.1, but since that's what you're running, > that works out in your favor. > > > > > > On Thu, Aug 30, 2018 at 10:53

Re: Bootstrap streaming issues

2018-08-30 Thread Jai Bheemsen Rao Dhanwada
Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > okay, thank you > > On Wed, Aug 29, 2018 at 11:04 PM Jeff Jirsa wrote: > >> You’re seeing an OOM, not a socket error / timeout. >> >> -- >> Jeff Jirsa >> >> >> On Aug 29, 2018, at 10

Re: Bootstrap streaming issues

2018-09-06 Thread Jai Bheemsen Rao Dhanwada
] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[na:1.8.0_151] at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_151] On Thu, Aug 30, 2018 at 12:51 PM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > thank you > > On Thu, Aug 30

Re: Bootstrap streaming issues

2018-08-29 Thread Jai Bheemsen Rao Dhanwada
d the stream throughput on the existing hosts? > > -- > Jeff Jirsa > > > On Aug 29, 2018, at 5:02 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Hello All, > > We are seeing some issue when we add more nodes to the cluster, where new > no

Bootstrap streaming issues

2018-08-29 Thread Jai Bheemsen Rao Dhanwada
Hello All, We are seeing some issue when we add more nodes to the cluster, where new node bootstrap is not able to stream the entire metadata and fails to bootstrap. Finally the process dies with OOM (java.lang.OutOfMemoryError: Java heap space) But if I remove few nodes from the cluster we

Re: Bootstrap streaming issues

2018-08-29 Thread Jai Bheemsen Rao Dhanwada
ime to get the schema and then heal the cluster so it can > bootstrap). > > Yea that’s awful. Hopefully either of the two above JIRAs lands to make > this less awful. > > > > -- > Jeff Jirsa > > > On Aug 29, 2018, at 6:29 PM, Jai Bheemsen Rao Dhanwada < > jaib

Re: Bootstrap streaming issues

2018-08-29 Thread Jai Bheemsen Rao Dhanwada
Jeff, any idea if this is somehow related to : https://issues.apache.org/jira/browse/CASSANDRA-11840? does increasing the value of streaming_socket_timeout_in_ms to a higher value helps? On Wed, Aug 29, 2018 at 10:52 PM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > I have

Re: Bootstrap streaming issues

2018-08-30 Thread Jai Bheemsen Rao Dhanwada
okay, thank you On Wed, Aug 29, 2018 at 11:04 PM Jeff Jirsa wrote: > You’re seeing an OOM, not a socket error / timeout. > > -- > Jeff Jirsa > > > On Aug 29, 2018, at 10:56 PM, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > > Jeff, >

Consistency level for the COPY command

2018-03-09 Thread Jai Bheemsen Rao Dhanwada
Hello, What is the consistency level used when performing COPY command using CQL interface? don't see anything in the documents https://docs.datastax.com/en/cql/3.1/cql/cql_reference/copy_r.html I am setting CONSISTENCY LEVEL at the cql level and then running a copy command, does that honor

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
ot;)) FROM "cassandraDroppedMessage" > groupby host* is valid when I check with nodetool over a period of time > > Not sure what is not working on your side > > On 26 February 2018 at 11:02, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> DIFFERENC

Re: Cassandra Hints monitoring

2018-02-26 Thread Jai Bheemsen Rao Dhanwada
DIFFERENCE may not work here, if the Hints count is 10 for few hours, the difference is always is zero. which is not the correct value. On Mon, Feb 26, 2018 at 1:18 AM, Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Thanks Alex, > > Let me try it. > > > On M

Re: Bootstrap streaming issues

2018-10-23 Thread Jai Bheemsen Rao Dhanwada
Did anyone run into similar issues? On Thu, Sep 6, 2018 at 10:27 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Here is the stacktrace from the failure, it looks like it's trying to > gather all the columfamily metrics and going OOM. Is this just for the J

How to measure the schema size

2018-10-25 Thread Jai Bheemsen Rao Dhanwada
Hello, I am running into a situation where huge schema (# of CF) causing OOM issues to the heap. is there a way to measure how much size each column family uses in the heap?

Re: How to measure the schema size

2018-10-26 Thread Jai Bheemsen Rao Dhanwada
anyone has any idea on this? On Thu, Oct 25, 2018 at 11:35 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Hello, > > I am running into a situation where huge schema (# of CF) causing OOM > issues to the heap. is there a way to measure how much size each co

Re: How to measure the schema size

2018-10-26 Thread Jai Bheemsen Rao Dhanwada
ion-15f868df73ed46488d1d159da20858d4.aspx?r=cc6bf9aa-c933-4d93-9501-904fd550e1ad=mainreglink=true> > > 20% Discount Code: estevez20 > > > On Fri, Oct 26, 2018 at 6:25 PM Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> wrote: > >> anyone has any idea on

Re: Bootstrap streaming issues

2018-10-23 Thread Jai Bheemsen Rao Dhanwada
Also, I see this issue only when I have more columnfamilies. looks like be number of vnodes * number of CF combination. does anyone have any idea on this? On Tue, Oct 23, 2018 at 9:48 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Did anyone run into similar issues? &

Datastax Java Driver compatibility

2019-01-22 Thread Jai Bheemsen Rao Dhanwada
Hello, I am looking for Datastax Driver compatibility vs apache cassandra 3.11.3 version. However the doc doesn't talk about the 3.11 version. https://docs.datastax.com/en/driver-matrix/doc/driver_matrix/javaDrivers.html Can someone please confirm if the Datastax Java Driver 3.2.0 version work

Re: Datastax Java Driver compatibility

2019-01-22 Thread Jai Bheemsen Rao Dhanwada
wrote: > Hi there- > > I checked with the team here (at DataStax) and this should work. Any > reason you need to stick with Java Driver 3.2, there is a 3.6 release. > > Thanks! > > Amanda > > On Tue, Jan 22, 2019 at 8:45 AM Jai Bheemsen Rao Dhanwada < > jaib

Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
Hello, Is it possible to disable truststore CA check for the cassandra internode_encyrption? if yes, is there a config property to do that?

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
I am trying to setup 1-way SSL, basically I am trying to use the SSL options only for the encrypt the data on the wire and trust everyone who is connecting to me. On Wed, Feb 27, 2019 at 4:18 PM Kenneth Brotman wrote: > Hello, > > > > Why would you want to do that? > > >

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
> > Is server encryption option ”require_client_auth: false” what you are > after? > > > Hannu > > > Jai Bheemsen Rao Dhanwada kirjoitti 28.2.2019 > kello 1.57: > > > Hello, > > > Is it possible

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
öger wrote: > > > > Is server encryption option ”require_client_auth: false” what you are > after? > > > > Hannu > > > >> Jai Bheemsen Rao Dhanwada kirjoitti 28.2.2019 > kello 1.57: > >> > >> Hello, > >> > >> Is it possi

Decommissioned nodes are in UNREACHABLE state

2019-06-12 Thread Jai Bheemsen Rao Dhanwada
Hello, I have a Cassandra cluster running with 2.1.16 version of Cassandra, where I have decommissioned few nodes from the cluster using "nodetool decommission", but I see the node IPs in UNREACHABLE state in "nodetool describecluster" output. I believe they appear only for 72 hours, but in my

Re: Cassandra loglevel in 3.11.x version

2019-09-06 Thread Jai Bheemsen Rao Dhanwada
andra.transport TRACE > > this will help you see all your queries in logs. > Just beware that this fills up logs really fast. > > Thanks, > Allen > > On Fri, 6 Sep, 2019, 10:57 AM Jai Bheemsen Rao Dhanwada, < > jaibheem...@gmail.com> wrote: > >> Hello, >>

Cassandra loglevel in 3.11.x version

2019-09-05 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to enable debug logs on the Cassandra cluster running with 3.11.3, I do see some debug logs but I don't see the same level of DEBUG logs I used to see with 2.1.16 version of cassandra. I am using the below command to set debug logging. $ nodetool setlogginglevel

Re: Cassandra loglevel in 3.11.x version

2019-09-06 Thread Jai Bheemsen Rao Dhanwada
DEBUG logs to debug.logs, only when I set the loglevel to DEBUG? Here is my logback.xml <https://pastebin.com/UD3hSTtr> Thanks in advance. On Fri, Sep 6, 2019 at 4:01 PM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > does anyone know if there is a documentation

Re: Cassandra loglevel in 3.11.x version

2019-09-06 Thread Jai Bheemsen Rao Dhanwada
does anyone know if there is a documentation that lists all the classes for logs? On Fri, Sep 6, 2019 at 9:28 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Thanks Allen, > > This works, is there any documentation that explain about all the > available logging

Re: Cassandra loglevel in 3.11.x version

2019-09-06 Thread Jai Bheemsen Rao Dhanwada
Thanks Allen, This works, is there any documentation that explain about all the available logging levels? On Fri, Sep 6, 2019 at 12:07 AM Jai Bheemsen Rao Dhanwada < jaibheem...@gmail.com> wrote: > Thanks, I will try that. > > Is this changed between 2.1.16 to 3.11.3? > > O

Apache Cassandra upgrade path

2019-07-26 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to upgrade Apache Cassandra from 2.1.16 to 3.11.3, the regular rolling upgrade process works fine without any issues. However, I am running into an issue where if there is a node with older version dies (hardware failure) and a new node comes up and tries to bootstrap, it's

Re: [EXTERNAL] Apache Cassandra upgrade path

2019-07-29 Thread Jai Bheemsen Rao Dhanwada
it might be useless > depending on your procedure.) > > Romain > > > > Le vendredi 26 juillet 2019 à 23:51:52 UTC+2, Jai Bheemsen Rao Dhanwada < > jaibheem...@gmail.com> a écrit : > > > yes correct, it doesn't work for the servers. trying to see if any had any

Re: [EXTERNAL] Apache Cassandra upgrade path

2019-07-26 Thread Jai Bheemsen Rao Dhanwada
Don’t stay in a mixed state very long. The cluster > will function fine in a mixed state – except for those streaming > operations. No repairs, no bootstraps. > > > > > > Sean Durity – Staff Systems Engineer, Cassandra > > > > *From:* Jai Bheemsen Rao

Re: [EXTERNAL] Apache Cassandra upgrade path

2019-07-26 Thread Jai Bheemsen Rao Dhanwada
ultant > > https://www.instaclustr.com/ > <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.instaclustr.com_=DwMFaQ=MtgQEAMQGqekjTjiAhkudQ=aC_gxC6z_4f9GLlbWiKzHm1vucZTtVYWDDvyLkh8IaQ=JUUAJpaOGj5fhLX2uWOwUVqUcHN3c24hEaDC1T8RZVQ=gQuE9u1lRiSA9uZsshvcKIuYih5Rvz3v6lhUOLZzvw4=>

Recommendations for Tuning BloomFilter values

2019-12-19 Thread Jai Bheemsen Rao Dhanwada
Hello, I am trying to understand pros and cons of tuning(increasing) the bloom filter value, to optimize the read performance. are there any guidelines on increasing the value. I am using LeveledCompactionStrategy, so the default bloom_filter_fp_chance is 0.1

Re: cassandra-cli on 3.x

2020-02-11 Thread Jai Bheemsen Rao Dhanwada
I am using astyanax client On Tuesday, February 11, 2020, Erick Ramirez wrote: > Jai, Thrift was deprecated years ago (maybe 5 or 6?) and COMPACT STORAGE > was dropped since the refactor of the storage engine in C* 3.0 so there > won't be support for any legacy CLI. In fact, you need to migrate

Re: [EXTERNAL] Re: Cassandra Encyrption between DC

2020-02-13 Thread Jai Bheemsen Rao Dhanwada
thank you On Thu, Feb 13, 2020 at 6:30 AM Durity, Sean R wrote: > I will just add-on that I usually reserve security changes as the primary > exception where app downtime may be necessary with Cassandra. (DSE has some > Transitional tools that are useful, though.) Sometimes a short outage is >

  1   2   >