Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
com<mailto:rajeswar...@thinkpalm.com>> wrote: Yes. I know that. My intension is to do an aggregate query on value field (in json). Will that be possible if I store the entire json as String? I will have to parse it according to my need right? Regards, Rajeswari From: Harikrishnan Pillai

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
You can use text type in Cassandra and store the full Json string . Sent from my iPhone On Feb 1, 2017, at 8:30 PM, Rajeswari Menon > wrote: Yes. Is there any way to define value to accept any data type as the json value data may

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
"datatype":"DOUBLE", "name":"Longitude", "attributes":{ "Id":"1" }, "category":"REAL", "value":1.390692, "timestamp":1485923271718, "quality&qu

Re: Error when running nodetool cleanup after adding a new node to a cluster

2017-02-08 Thread Harikrishnan Pillai
The cleanup has to run on other nodes Sent from my iPhone On Feb 8, 2017, at 9:14 PM, Srinath Reddy > wrote: Hi, Trying to re-balacne a Cassandra cluster after adding a new node and I'm getting this error when running nodetool cleanup. The

Re: Re : Decommissioned nodes show as DOWN in Cassandra versions 2.1.12 - 2.1.16

2017-01-27 Thread Harikrishnan Pillai
Please remove the ips from the system.peer table of all nodes or you can use unsafeassasinate from JMX. From: Agrawal, Pratik Sent: Friday, January 27, 2017 9:05:43 AM To: user@cassandra.apache.org; k...@instaclustr.com;

Re: compaction falling behind

2017-02-13 Thread Harikrishnan Pillai
If your compaction strategy is Leveled the number of sstables in each level is a good indication that compactions are keeping up. From: Ben Bromhead Sent: Monday, February 13, 2017 1:49:05 PM To: user Subject: Re: compaction falling behind

Node tool drain causing hint corruption

2016-10-26 Thread Harikrishnan Pillai
Changing the subject Sent from my iPhone On Oct 26, 2016, at 12:28 PM, Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>> wrote: i have created a Jira for Cassandra version 3.9.Anyone have seen this scenario before in any 3.X version. https://issue

Re: Cannot set TTL in COPY command

2016-10-26 Thread Harikrishnan Pillai
i have created a Jira for Cassandra version 3.9.Anyone have seen this scenario before in any 3.X version. https://issues.apache.org/jira/browse/CASSANDRA-12844 Regards Hari From: Lahiru Gamathige Sent: Wednesday, October 26, 2016 10:46:51

Re: Does anyone store larger values in Cassandra E.g. 500 KB?

2016-10-20 Thread Harikrishnan Pillai
We use Cassandra to store images .any data above 2 mb we chunk it and store.it works perfectly . Sent from my iPhone > On Oct 20, 2016, at 12:09 PM, Vikas Jaiman wrote: > > Hi, > > Normally people would like to store smaller values in Cassandra. Is there > anyone

Re: Java GC pauses, reality check

2016-11-25 Thread Harikrishnan Pillai
Zing jvm reduces the pause under 10ms for most use cases. Sent from my iPhone On Nov 25, 2016, at 2:44 PM, Kant Kodali > wrote: +1 Chris Lohfink response I would also restate the following sentence "java GC pauses are pretty much a fact of life" to

Re: Java GC pauses, reality check

2016-11-25 Thread Harikrishnan Pillai
We are running azul zing in prod with 1 million reads/s and 100 K writes/s with azul .we never had a major gc above 10 ms . Sent from my iPhone > On Nov 25, 2016, at 3:49 PM, Martin Schröder wrote: > > 2016-11-25 23:38 GMT+01:00 Kant Kodali : >> I would

Re: Java GC pauses, reality check

2016-11-28 Thread Harikrishnan Pillai
re you referring to here? Thanks, kant On Sun, Nov 27, 2016 at 9:57 PM, Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>> wrote: Hi @Kant Kodali, We have multiple clusters running zing . One cluster has 11/11 and another one also has 11/11.(190 GB mem,6TB har

Re: Java GC pauses, reality check

2016-11-27 Thread Harikrishnan Pillai
eality check @Harikrishnan Pillai: How many nodes you guys are running? and what is an approximate read size and an approximate write size? On Fri, Nov 25, 2016 at 7:32 PM, Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>> wrote: We are running azul zing in p

Re: Repair in Multi Datacenter - Should you use -dc Datacenter repair or repair with -pr

2016-10-12 Thread Harikrishnan Pillai
In my experience dc local repair node by node with Pr and par options is best .full repair increased sstables A lot and take days to compact it back or another Easy option for repair is use a spark job ,read all data with Consistency all and increase read repair chance to 100 % or use Netflix

Re: Cassandra Different cluster gossiping to each other

2016-12-14 Thread Harikrishnan Pillai
This is possible if some of the nodes are available in system peer table of the other cluster.this usually occurs when we decommission nodes from one cluster and add to another cluster.also make sure that before adding a node newly to a cluster all data in drives are properly wiped out . Sent

Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-07 Thread Harikrishnan Pillai
This can happen as part of node bootstrap,repair or rebuild node. From: Sotirios Delimanolis Sent: Wednesday, December 7, 2016 4:35:45 PM To: User Subject: Huge files in level 1 and level 0 of LeveledCompactionStrategy I have a couple of

Re: Which version is stable enough for production environment?

2016-11-30 Thread Harikrishnan Pillai
m currently investigating intensively. 2016-11-30 3:11 GMT+01:00 Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>>: 3.0 has "off the heap memtable" impl removed and if you have a requirement for this,its not available.If you don't have the requir

Re: Which version is stable enough for production environment?

2016-11-29 Thread Harikrishnan Pillai
ards Hari From: Discovery <wl_...@qq.com> Sent: Tuesday, November 29, 2016 5:59 PM To: user Subject: Re: Which version is stable enough for production environment? Why version 3.x is not recommended? Thanks. -- Original ------ From: "Harik

Re: Which version is stable enough for production environment?

2016-11-29 Thread Harikrishnan Pillai
Cassandra 2.1.16 From: Discovery Sent: Tuesday, November 29, 2016 5:42 PM To: user Subject: Which version is stable enough for production environment? Hi Cassandra Experts, We prepare to deploy Cassandra in production env, but

Re: Handling Leap second delay

2016-12-20 Thread Harikrishnan Pillai
http://www.datastax.com/dev/blog/preparing-for-the-leap-second-2017 [http://www.datastax.com/wp-content/themes/datastax-2013/images/common/logo.png] Preparing for the Leap Second, 2017 Jan 1 Edition |

Re: Has anyone deployed a production cluster with less than 6 nodes per DC?

2016-12-26 Thread Harikrishnan Pillai
1 million write per hour is around 250 writes per second .its easily achievable with 3 nodes .make sure that you have a good gc tuning and compaction tunings. Sent from my iPhone On Dec 26, 2016, at 1:27 PM, Ney, Richard > wrote: My

Re: EXT: Start Cassandra with Gossip disabled ?

2017-04-14 Thread Harikrishnan Pillai
Yes , you can disable gossip and disable binary to cut off All traffic but process like compactions can still continue . Sent from my iPhone > On Apr 11, 2017, at 9:21 AM, Biscuit Ninja wrote: > > We run an 8 node Cassandra v2.1.16 cluster (4 nodes in two discrete >

Re: Moving from DSE to Cassandra.

2017-07-18 Thread Harikrishnan Pillai
Moving away from DSE to apache cassandra is easy. If there are any keyspace with "EverywhereStrategy" strategies, change them to "NetworkTopologyStrategy" first. particularly DSE system. Start in opensource mode and run sstable upgrade if needed. Regards Hari

Re: Moving from DSE to Cassandra.

2017-07-18 Thread Harikrishnan Pillai
yes. From: Harikrishnan Pillai <hpil...@walmartlabs.com> Sent: Tuesday, July 18, 2017 12:30 PM To: user@cassandra.apache.org Subject: EXT: Re: Moving from DSE to Cassandra. Moving away from DSE to apache cassandra is easy. If there are any ke

Re: Re: Tuning bootstrap new node

2017-10-31 Thread Harikrishnan Pillai
There is no magic in speeding up the node addition other than increasing stream throughput and compaction throughput. it has been noticed that with heavy compactions the latency may go up if the node also start serving data. if you really don't want this node to service traffic till all

Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread Harikrishnan Pillai
I assume you are using open source cassandra and you can look at Prometheus grafana for cassandra monitoring and lot information available in internet regarding how to setup the Prometheus monitoring for cassandra . Sent from my iPhone > On May 25, 2018, at 9:23 AM, ANEESH KUMAR K.M