Re: EXT: Cassandra Monitoring tool

2018-05-25 Thread Harikrishnan Pillai
I assume you are using open source cassandra and you can look at Prometheus grafana for cassandra monitoring and lot information available in internet regarding how to setup the Prometheus monitoring for cassandra . Sent from my iPhone > On May 25, 2018, at 9:23 AM, ANEESH KUMAR K.M

Re: Re: Tuning bootstrap new node

2017-10-31 Thread Harikrishnan Pillai
There is no magic in speeding up the node addition other than increasing stream throughput and compaction throughput. it has been noticed that with heavy compactions the latency may go up if the node also start serving data. if you really don't want this node to service traffic till all

Re: cqlsh -e output - How to change the default delimiter '|' in the output

2017-08-15 Thread Harikrishnan A
Thank you all Regards,Hari On Tuesday, August 15, 2017 12:55 AM, Erick Ramirez wrote: +1 to Jim and Tobin. cqlsh wasn't designed for what you're trying to achieve. Cheers! On Tue, Aug 15, 2017 at 1:34 AM, Tobin Landricombe wrote: Can't

Re: cqlsh -e output - How to change the default delimiter '|' in the output

2017-08-14 Thread Harikrishnan A
I have column values with Pipe separator, hence unable to replace this default delimiter from the output. Thanks Hari On Monday, August 14, 2017 12:12 AM, algermissen1971 <algermissen1...@icloud.com> wrote: On 14.08.2017, at 07:49, Harikrishnan A <hari...@yahoo.com.INVAL

cqlsh -e output - How to change the default delimiter '|' in the output

2017-08-13 Thread Harikrishnan A
Hello, When I execute cqlsh -e "SELECT statement .."  , it gives the output with a pipe ('|') separator. Is there anyway I can change this default delimiter in the output of cqlsh -e " SELECT statement ..".  Thanks & Regards,Hari

Re: Moving from DSE to Cassandra.

2017-07-18 Thread Harikrishnan Pillai
yes. From: Harikrishnan Pillai <hpil...@walmartlabs.com> Sent: Tuesday, July 18, 2017 12:30 PM To: user@cassandra.apache.org Subject: EXT: Re: Moving from DSE to Cassandra. Moving away from DSE to apache cassandra is easy. If there are any ke

Re: Moving from DSE to Cassandra.

2017-07-18 Thread Harikrishnan Pillai
Moving away from DSE to apache cassandra is easy. If there are any keyspace with "EverywhereStrategy" strategies, change them to "NetworkTopologyStrategy" first. particularly DSE system. Start in opensource mode and run sstable upgrade if needed. Regards Hari

Re: EXT: Start Cassandra with Gossip disabled ?

2017-04-14 Thread Harikrishnan Pillai
Yes , you can disable gossip and disable binary to cut off All traffic but process like compactions can still continue . Sent from my iPhone > On Apr 11, 2017, at 9:21 AM, Biscuit Ninja wrote: > > We run an 8 node Cassandra v2.1.16 cluster (4 nodes in two discrete >

Re: compaction falling behind

2017-02-13 Thread Harikrishnan Pillai
If your compaction strategy is Leveled the number of sstables in each level is a good indication that compactions are keeping up. From: Ben Bromhead Sent: Monday, February 13, 2017 1:49:05 PM To: user Subject: Re: compaction falling behind

Re: Error when running nodetool cleanup after adding a new node to a cluster

2017-02-08 Thread Harikrishnan Pillai
The cleanup has to run on other nodes Sent from my iPhone On Feb 8, 2017, at 9:14 PM, Srinath Reddy > wrote: Hi, Trying to re-balacne a Cassandra cluster after adding a new node and I'm getting this error when running nodetool cleanup. The

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
"datatype":"DOUBLE", "name":"Longitude", "attributes":{ "Id":"1" }, "category":"REAL", "value":1.390692, "timestamp":1485923271718, "quality&qu

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
com<mailto:rajeswar...@thinkpalm.com>> wrote: Yes. I know that. My intension is to do an aggregate query on value field (in json). Will that be possible if I store the entire json as String? I will have to parse it according to my need right? Regards, Rajeswari From: Harikrishnan Pillai

Re: Is it possible to have a column which can hold any data type (for inserting as json)

2017-02-01 Thread Harikrishnan Pillai
You can use text type in Cassandra and store the full Json string . Sent from my iPhone On Feb 1, 2017, at 8:30 PM, Rajeswari Menon > wrote: Yes. Is there any way to define value to accept any data type as the json value data may

Re: Re : Decommissioned nodes show as DOWN in Cassandra versions 2.1.12 - 2.1.16

2017-01-27 Thread Harikrishnan Pillai
Please remove the ips from the system.peer table of all nodes or you can use unsafeassasinate from JMX. From: Agrawal, Pratik Sent: Friday, January 27, 2017 9:05:43 AM To: user@cassandra.apache.org; k...@instaclustr.com;

Re: Has anyone deployed a production cluster with less than 6 nodes per DC?

2016-12-26 Thread Harikrishnan Pillai
1 million write per hour is around 250 writes per second .its easily achievable with 3 nodes .make sure that you have a good gc tuning and compaction tunings. Sent from my iPhone On Dec 26, 2016, at 1:27 PM, Ney, Richard > wrote: My

Re: Handling Leap second delay

2016-12-20 Thread Harikrishnan Pillai
http://www.datastax.com/dev/blog/preparing-for-the-leap-second-2017 [http://www.datastax.com/wp-content/themes/datastax-2013/images/common/logo.png] Preparing for the Leap Second, 2017 Jan 1 Edition |

Re: Cassandra Different cluster gossiping to each other

2016-12-14 Thread Harikrishnan Pillai
This is possible if some of the nodes are available in system peer table of the other cluster.this usually occurs when we decommission nodes from one cluster and add to another cluster.also make sure that before adding a node newly to a cluster all data in drives are properly wiped out . Sent

Re: Huge files in level 1 and level 0 of LeveledCompactionStrategy

2016-12-07 Thread Harikrishnan Pillai
This can happen as part of node bootstrap,repair or rebuild node. From: Sotirios Delimanolis Sent: Wednesday, December 7, 2016 4:35:45 PM To: User Subject: Huge files in level 1 and level 0 of LeveledCompactionStrategy I have a couple of

Re: Which version is stable enough for production environment?

2016-11-30 Thread Harikrishnan Pillai
m currently investigating intensively. 2016-11-30 3:11 GMT+01:00 Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>>: 3.0 has "off the heap memtable" impl removed and if you have a requirement for this,its not available.If you don't have the requir

Re: Which version is stable enough for production environment?

2016-11-29 Thread Harikrishnan Pillai
ards Hari From: Discovery <wl_...@qq.com> Sent: Tuesday, November 29, 2016 5:59 PM To: user Subject: Re: Which version is stable enough for production environment? Why version 3.x is not recommended? Thanks. -- Original ------ From: "Harik

Re: Which version is stable enough for production environment?

2016-11-29 Thread Harikrishnan Pillai
Cassandra 2.1.16 From: Discovery Sent: Tuesday, November 29, 2016 5:42 PM To: user Subject: Which version is stable enough for production environment? Hi Cassandra Experts, We prepare to deploy Cassandra in production env, but

Re: Java GC pauses, reality check

2016-11-28 Thread Harikrishnan Pillai
re you referring to here? Thanks, kant On Sun, Nov 27, 2016 at 9:57 PM, Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>> wrote: Hi @Kant Kodali, We have multiple clusters running zing . One cluster has 11/11 and another one also has 11/11.(190 GB mem,6TB har

Re: Java GC pauses, reality check

2016-11-27 Thread Harikrishnan Pillai
eality check @Harikrishnan Pillai: How many nodes you guys are running? and what is an approximate read size and an approximate write size? On Fri, Nov 25, 2016 at 7:32 PM, Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>> wrote: We are running azul zing in p

Re: Java GC pauses, reality check

2016-11-25 Thread Harikrishnan Pillai
We are running azul zing in prod with 1 million reads/s and 100 K writes/s with azul .we never had a major gc above 10 ms . Sent from my iPhone > On Nov 25, 2016, at 3:49 PM, Martin Schröder wrote: > > 2016-11-25 23:38 GMT+01:00 Kant Kodali : >> I would

Re: Java GC pauses, reality check

2016-11-25 Thread Harikrishnan Pillai
Zing jvm reduces the pause under 10ms for most use cases. Sent from my iPhone On Nov 25, 2016, at 2:44 PM, Kant Kodali > wrote: +1 Chris Lohfink response I would also restate the following sentence "java GC pauses are pretty much a fact of life" to

Re: Cannot set TTL in COPY command

2016-10-26 Thread Harikrishnan Pillai
i have created a Jira for Cassandra version 3.9.Anyone have seen this scenario before in any 3.X version. https://issues.apache.org/jira/browse/CASSANDRA-12844 Regards Hari From: Lahiru Gamathige Sent: Wednesday, October 26, 2016 10:46:51

Node tool drain causing hint corruption

2016-10-26 Thread Harikrishnan Pillai
Changing the subject Sent from my iPhone On Oct 26, 2016, at 12:28 PM, Harikrishnan Pillai <hpil...@walmartlabs.com<mailto:hpil...@walmartlabs.com>> wrote: i have created a Jira for Cassandra version 3.9.Anyone have seen this scenario before in any 3.X version. https://issue

Hotspots / Load on Cassandra node

2016-10-25 Thread Harikrishnan A
Hello, When I am issuing nodetool status, I see the load ( in GB) on one of the node is high compare to the other nodes in my ring. I do not see any issues with the Data Modeling, and it looks like the Partition sizes are almost evenly sized and distributed across the nodes.  Repairs are

Re: Does anyone store larger values in Cassandra E.g. 500 KB?

2016-10-20 Thread Harikrishnan Pillai
We use Cassandra to store images .any data above 2 mb we chunk it and store.it works perfectly . Sent from my iPhone > On Oct 20, 2016, at 12:09 PM, Vikas Jaiman wrote: > > Hi, > > Normally people would like to store smaller values in Cassandra. Is there > anyone

Re: Repair in Multi Datacenter - Should you use -dc Datacenter repair or repair with -pr

2016-10-12 Thread Harikrishnan Pillai
In my experience dc local repair node by node with Pr and par options is best .full repair increased sstables A lot and take days to compact it back or another Easy option for repair is use a spark job ,read all data with Consistency all and increase read repair chance to 100 % or use Netflix

Consistency Level (QUORUM vs LOCAL_QUORUM)

2016-03-27 Thread Harikrishnan A
Hello, I have a question regarding consistency Level settings in a multi Data Center Environment.  What is the preferred CL settings in this scenario for an immediate consistency , QUORUM or LOCAL_QUORUM ? If the replication Factor is set to 3  each ( 2 Data Centers) , the QUORUM (

Modeling Master Tables in Cassandra

2016-02-12 Thread Harikrishnan A
Hello,I have a scenario where I need to create a customer master table in cassandra which has attributes like customerid, name, email, phonenr .etc ..What is the best way to model such table in cassandra keeping in mind that I will be using customer id to populate customer information from

Re: Modeling Master Tables in Cassandra

2016-02-12 Thread Harikrishnan A
email VARCHAR STATIC,  phonenr VARCHAR STATIC,  action VARCHAR,  time TIMESTAMP,  PRIMARY KEY(customerid, action, time)). This way, you avoid client side joins. Hope this helps! Carlos Alonso | Software Engineer | @calonso On 12 February 2016 at 09:25, Harikrishnan A <hari...@yahoo.com> wro

Re: Unable to locate Solr Configuration file ( Generated using dsetool )

2016-01-19 Thread Harikrishnan A
always-on, and predictably scalable to any size. With more than 500 customers in 45 countries, DataStax is the database technology and transactional backbone of choice for the worlds most innovative companies such as Netflix, Adobe, Intuit, and eBay. On Mon, Jan 18, 2016 at 12:29 PM, Harikrishnan A

Re: Unable to locate Solr Configuration file ( Generated using dsetool )

2016-01-18 Thread Harikrishnan A
generated Solr schema and solrconfig files:http://docs.datastax.com/en/datastax_enterprise/4.8/datastax_enterprise/tools/toolsDsetool.html You can also use the dsetool read_resource command to read any of the Solr resource "files". -- Jack Krupansky On Mon, Jan 18, 2016 at 12:47 AM, H

Timestamp Query

2015-12-20 Thread Harikrishnan A
Hello, How do I set a timestamp value with specific timezone in cassandra. I understand that it captures the timezone of the co ordinator node while inserting. What about if I want to insert and display the timezone that I preferred nstead of the default co ordinator timezone.  Thanks &

Re: Triggering Deletion/Updation

2015-11-23 Thread Harikrishnan A
Thanks Jon , Prem .. Regards,Hari From: Jon Haddad <jonathan.had...@gmail.com> To: user@cassandra.apache.org Cc: Harikrishnan A <hari...@yahoo.com> Sent: Sunday, November 22, 2015 10:57 AM Subject: Re: Triggering Deletion/Updation There's no built in way of doing casca

Re: Triggering Deletion/Updation

2015-11-22 Thread Harikrishnan A
Trying for second time to get some insights to my below query ...ThanksHari From: Harikrishnan A <hari...@yahoo.com> To: "user@cassandra.apache.org" <user@cassandra.apache.org> Sent: Friday, November 20, 2015 2:27 PM Subject: Triggering Deletion/Updation H

Triggering Deletion/Updation

2015-11-20 Thread Harikrishnan A
Hello, I have a generic question.  How can I initiate a triggering deletion in cassandra? I mean I need to delete few rows/Partition itself from other tables based on a status change in another table.   Thanks & Regards,Hari