RE: [EXTERNAL] Re: Question on changing node IP address

2019-02-27 Thread Durity, Sean R
I am not making a recommendation for anyone else – just sharing our experience and reasoning. It is why I argued for keeping PropertyFileSnitch in some JIRA that proposed dropping it completely. GPFS is the typical recommendation for production use. Just a hurdle not worth my time at the

Upgrade 3.11.1 to 3.11.4

2019-02-27 Thread Ioannis Zafiropoulos
Hi all, During a decommission on a production cluster (9 nodes) we have some issues on the remaining nodes regarding compaction, and I have some questions about that: One remaining node who has stopped compacting, due to some bug in 3.11.1,

RE: [EXTERNAL] Re: Question on changing node IP address

2019-02-27 Thread Durity, Sean R
We use the PropertyFileSnitch precisely because it is the same on every node. If each node has to have a different file (for GPFS) – deployment is more complicated. (And for any automated configuration you would have a list of hosts and DC/rack information to compile anyway) I do put UNKNOWN

Re: [EXTERNAL] Re: Question on changing node IP address

2019-02-27 Thread Alexander Dejanovski
It has to be balanced with the dangers related to the PropertyFileSnitch. I've seen such incidents happen twice in the last few months in different places and both times recovery was difficult and hazardous. I still strongly recommend against it. On Wed, Feb 27, 2019 at 3:11 PM Durity, Sean R

Re: [EXTERNAL] Re: Question on changing node IP address

2019-02-27 Thread Oleksandr Shulgin
On Wed, Feb 27, 2019 at 3:11 PM Durity, Sean R wrote: > We use the PropertyFileSnitch precisely because it is the same on every > node. If each node has to have a different file (for GPFS) – deployment is > more complicated. (And for any automated configuration you would have a > list of hosts

Re: Question on changing node IP address

2019-02-27 Thread wxn...@zjqunshuo.com
I'm using SimpleSnitch. I have only one DC. Is there any problem to follow the below procedure? -Simon From: Alexander Dejanovski Date: 2019-02-27 16:07 To: user Subject: Re: Question on changing node IP address I confirm what Oleksandr said. Just stop Cassandra, change the IP, and restart

Re: Question on changing node IP address

2019-02-27 Thread Alexander Dejanovski
Check "nodetool info" on each node to get its rack and DC, and put that information in *cassandra-rackdc.properties *(even if you have no rack defined, the nodes are assigned to a default rack and you'll want to use the same). Then as you said, change the snitch in the yaml and restart the node.

Re: Question on changing node IP address

2019-02-27 Thread shalom sagges
Thanks for the info Alex! I read https://docs.datastax.com/en/cassandra/3.0/cassandra/operations/opsSwitchSnitch.html but still have a few questions: Our clusters are comprised of 2 DCs with no rack configuration, RF=3 on each DC. In this scenario, if I wish to seamlessly change the snitch with

Re: Question on changing node IP address

2019-02-27 Thread Alexander Dejanovski
This snitch is easy to misconfigure. It allows some nodes to have a different view of the cluster if they are configured differently, which can result in data loss (or at least data that is very hard to recover). Also it has a nasty feature that allows to set a default DC/Rack. If one node isn't

Re: Question on changing node IP address

2019-02-27 Thread Alexander Dejanovski
You'll be fine with the SimpleSnitch (which shouldn't be used either because it doesn't allow a cluster to use multiple datacenters or racks). Just change the IP and upon restart the node will redeclare itself in the ring. If your node is a seed node, you'll need to update your seed list across

Re: [EXTERNAL] RE: SASI queries- cqlsh vs java driver

2019-02-27 Thread Jonathan Haddad
If the goal is arbitrary queries, I'd avoid Cassandra altogether. Don't use DSE Search or Ellesandra, they're two solutions designed to solve problems that are Cassandra first, search second. I'd go straight to elastic search for workloads that are primarily search driven, like you listed above.

Re: [EXTERNAL] RE: SASI queries- cqlsh vs java driver

2019-02-27 Thread Peter Heitman
I appreciate the thoughtful replies. We will have to evaluate whether cassandra is the right datastore for us. It was chosen because our primary requirement is to store lots of data about lots of devices at a high rate. The search requirements are very secondary but required for the management of

Re: Connection status on cluster exposed anywhere?

2019-02-27 Thread Rahul Singh
You can get statistics at a table level, and you can get some information at a keyspace level, but it's an approximation. Better to get tablelevel and aggregate up. Here are some pointers. https://blog.anant.us/resources-for-monitoring-datastax-cassandra-spark-solr-performance/ On Wed, Feb 27,

Re: [EXTERNAL] RE: SASI queries- cqlsh vs java driver

2019-02-27 Thread Rahul Singh
+1 on Datastax and could consider looking at Elassandra. On Thu, Feb 7, 2019 at 9:14 AM Durity, Sean R wrote: > Kenneth is right. Trying to port/support a relational model to a CQL model > the way you are doing it is not going to go well. You won’t be able to > scale or get the search

Re: High GC pauses leading to client seeing impact

2019-02-27 Thread Rahul Singh
There are a few factors: sometimes data that is in a fat partition clogs up the heap space / memtable space and tombstones don't help that much either. This is worsened by data skew . I agree , if CMS is working for now, continue using it and then upgrade to better versions of Java / C*. Few

Re: Connection status on cluster exposed anywhere?

2019-02-27 Thread Tom Wollert
Thanks for the link Unfortunately doesn't quite help me with what I need (or think I need). We only see the IP address who has connections open, but we have multiple applications running on the same server so can't tell which one (pg and sql server I think allow passing in an identifier as part of

Re: Question on changing node IP address

2019-02-27 Thread Alexander Dejanovski
I confirm what Oleksandr said. Just stop Cassandra, change the IP, and restart Cassandra. If you're using the GossipingPropertyFileSnitch, the node will redeclare its new IP through Gossip and that's it. If you're using the PropertyFileSnitch, well... you shouldn't as it's a rather dangerous and

Re: Question on changing node IP address

2019-02-27 Thread shalom sagges
If you're using the PropertyFileSnitch, well... you shouldn't as it's a rather dangerous and tedious snitch to use I inherited Cassandra clusters that use the PropertyFileSnitch. It's been working fine, but you've kinda scared me :-) Why is it dangerous to use? If I decide to change the snitch,

Connection status on cluster exposed anywhere?

2019-02-27 Thread Tom Wollert
Is it possible to get the current connection status out of Cassandra C# driver? In particular I'm looking at getting - connected hosts - whether the node is considered up by the driver Which I can get from the MetaData, as well as: - connected keyspaces - the number of connections open(per

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread Patrick Goliwas
Unsubscribe please Sent via mobile Call/Text: (612) 281-0702 On Feb 27, 2019, at 6:25 PM, Kenneth Brotman wrote: How about using a default value on the column? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Wednesday, February 27, 2019 4:23 PM To:

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread kumar bharath
Kenneth, I didn't see any such option for adding a default value on a column. Thanks, Bharath Kumar B On Wed, Feb 27, 2019 at 4:25 PM Kenneth Brotman wrote: > How about using a default value on the column? > > > > *From:* Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] > *Sent:*

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Who are Presto? From: Goutham reddy [mailto:goutham.chiru...@gmail.com] Sent: Wednesday, February 27, 2019 4:52 PM To: user@cassandra.apache.org Subject: Re: Insert constant value for all the rows for a given column Thanks Kenneth, writing Spark application is our last option and we are

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Here is the link to Presto: http://prestodb.github.io/ Yes, it’s definitely a distributed SQL query engine for big data. If you are expecting a lot of different values to come in, then you’re only trying to add a value to the existing records? I don’t understand where the data is

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Sounds like what’s called a “static column”. From: Goutham reddy [mailto:goutham.chiru...@gmail.com] Sent: Wednesday, February 27, 2019 4:06 PM To: user@cassandra.apache.org Subject: Insert constant value for all the rows for a given column Hi, We have a requirement to add constant value

Insert constant value for all the rows for a given column

2019-02-27 Thread Goutham reddy
Hi, We have a requirement to add constant value to all the rows for a particular column, and we could not find any solution. Can anybody provide standard procedure for the problem. Appreciate your help. Regards Goutham Reddy

RE: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Kenneth Brotman
Hello, Why would you want to do that? From: Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] Sent: Wednesday, February 27, 2019 3:57 PM To: user@cassandra.apache.org Subject: Disable Truststore CA check for internode_encryption Hello, Is it possible to disable truststore

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread Goutham reddy
Kenneth, I believe "static column" applies for one partition key. Correct me if my understanding is wrong. Regards Goutham Reddy On Wed, Feb 27, 2019 at 4:08 PM Kenneth Brotman wrote: > Sounds like what’s called a “static column”. > > > > *From:* Goutham reddy

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Good point. From: Goutham reddy [mailto:goutham.chiru...@gmail.com] Sent: Wednesday, February 27, 2019 4:11 PM To: user@cassandra.apache.org Subject: Re: Insert constant value for all the rows for a given column Kenneth, I believe "static column" applies for one partition key. Correct me

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
How about using a default value on the column? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Wednesday, February 27, 2019 4:23 PM To: user@cassandra.apache.org Subject: RE: Insert constant value for all the rows for a given column Good point. From: Goutham reddy

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread Goutham reddy
True Bharath, there is no option to add a default value in Cassandra for a column. Regards Goutham Reddy On Wed, Feb 27, 2019 at 4:31 PM kumar bharath wrote: > Kenneth, > > I didn't see any such option for adding a default value on a column. > > Thanks, > Bharath Kumar B > > On Wed, Feb 27,

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread Goutham reddy
Are you taking about SQL engine Presto ;) On Wed, Feb 27, 2019 at 4:59 PM Kenneth Brotman wrote: > Who are Presto? > > > > *From:* Goutham reddy [mailto:goutham.chiru...@gmail.com] > *Sent:* Wednesday, February 27, 2019 4:52 PM > *To:* user@cassandra.apache.org > *Subject:* Re: Insert constant

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Ouch! I was sure I saw it in some material I studied but no. It looks like you have to provide the value before Cassandra, maybe through your application or something in the stream before Cassandra, or add it after Cassandra or use something like Spark to process it. Kenneth Brotman

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
If you know the value already, why do you need to store it in every row of a table? Seems like something is wrong. Why do you need to do that, if you can share that information? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com] Sent: Wednesday, February 27, 2019 5:08 PM To:

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
I meant to say, what about using Presto? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Wednesday, February 27, 2019 4:59 PM To: user@cassandra.apache.org Subject: RE: Insert constant value for all the rows for a given column Who are Presto? From: Goutham reddy

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Yup From: Goutham reddy [mailto:goutham.chiru...@gmail.com] Sent: Wednesday, February 27, 2019 5:06 PM To: user@cassandra.apache.org Subject: Re: Insert constant value for all the rows for a given column Are you taking about SQL engine Presto ;) On Wed, Feb 27, 2019 at 4:59 PM Kenneth

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread Goutham reddy
The value is constant as of now but we are expecting lot many different values to come in future. Secondly, is Presto a distributed system ? Thanks and Regards, Goutham. On Wed, Feb 27, 2019 at 5:09 PM Kenneth Brotman wrote: > If you know the value already, why do you need to store it in

Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
Hello, Is it possible to disable truststore CA check for the cassandra internode_encyrption? if yes, is there a config property to do that?

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Here’s a DataStax article called Sharing a static column: https://docs.datastax.com/en/cql/3.3/cql/cql_using/refStaticCol.html From: Kenneth Brotman [mailto:kenbrot...@yahoo.com] Sent: Wednesday, February 27, 2019 4:08 PM To: 'user@cassandra.apache.org' Subject: RE: Insert constant value

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
I am trying to setup 1-way SSL, basically I am trying to use the SSL options only for the encrypt the data on the wire and trust everyone who is connecting to me. On Wed, Feb 27, 2019 at 4:18 PM Kenneth Brotman wrote: > Hello, > > > > Why would you want to do that? > > > > *From:* Jai Bheemsen

Re: Insert constant value for all the rows for a given column

2019-02-27 Thread Goutham reddy
Thanks Kenneth, writing Spark application is our last option and we are looking out for some hack way to update the column. On Wed, Feb 27, 2019 at 4:48 PM Kenneth Brotman wrote: > Ouch! I was sure I saw it in some material I studied but no. It looks > like you have to provide the value

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Dinesh Joshi
> On Feb 27, 2019, at 4:20 PM, Jai Bheemsen Rao Dhanwada > wrote: > > I am trying to setup 1-way SSL, basically I am trying to use the SSL options > only for the encrypt the data on the wire and trust everyone who is > connecting to me. > It *might* be possible with a custom truststore but

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
I see require_client_auth in the internode_encryption and the default value is false. but cassandra process expects a truststore and truststore password for the cassandra to startup. On Wed, Feb 27, 2019 at 11:25 PM Hannu Kröger wrote: > I was using this as reference: >

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Hannu Kröger
Is server encryption option ”require_client_auth: false” what you are after? Hannu > Jai Bheemsen Rao Dhanwada kirjoitti 28.2.2019 kello > 1.57: > > Hello, > > Is it possible to disable truststore CA check for the cassandra > internode_encyrption? if yes, is there a config property to do

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jeff Jirsa
That’s client to server - internode is different Don’t think it’s possible without code modifications - please opens JIRA -- Jeff Jirsa > On Feb 27, 2019, at 10:21 PM, Hannu Kröger wrote: > > Is server encryption option ”require_client_auth: false” what you are after? > > Hannu > >> Jai

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Hannu Kröger
I was using this as reference: https://docs.datastax.com/en/cassandra/3.0/cassandra/configuration/configCassandra_yaml.html#configCassandra_yaml__SecurityProps And there I see “require client authentication” also in server options ie. internode encryption. However I am not sure if this is what

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Jai Bheemsen Rao Dhanwada
sure, thanks On Wed, Feb 27, 2019 at 11:08 PM Jeff Jirsa wrote: > That’s client to server - internode is different > > Don’t think it’s possible without code modifications - please opens JIRA > > -- > Jeff Jirsa > > > > On Feb 27, 2019, at 10:21 PM, Hannu Kröger wrote: > > > > Is server