Re: WriteTimeoutException When only One Node is Down

2017-01-15 Thread Shalom Sagges
? Or is there something I'm missing... Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.docsend.com/view/8iiswfp> On Fri, Jan 1

Re: Can a Select Count(*) Affect Writes in Cassandra?

2016-11-10 Thread Shalom Sagges
the query in the code, thought it would be nice to limit the query results to 560,000,000. Perhaps the ridiculously high limit might have caused this? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.f

Re: Can a Select Count(*) Affect Writes in Cassandra?

2016-11-10 Thread Shalom Sagges
Thanks for the quick reply Vladimir. Is it really possible that ~12,500 writes per second (per node in a 12 nodes DC) are caused by memory flushes? Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://w

Re: Can a Select Count(*) Affect Writes in Cassandra?

2016-11-10 Thread Shalom Sagges
Yes, I know it's obsolete, but unfortunately this takes time. We're in the process of upgrading to 2.2.8 and 3.0.9 in our clusters. Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/Li

Can a Select Count(*) Affect Writes in Cassandra?

2016-11-10 Thread Shalom Sagges
particular table. Can anyone explain this behavior? Why would a Select query significantly increase write count in Cassandra? Thanks! Shalom Sagges <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create M

How to Choose a Version for Upgrade

2016-11-23 Thread Shalom Sagges
Hi Everyone, I was wondering how to choose the proper, most stable Cassandra version for a Production environment. Should I follow the version that's used in Datastax Enterprise (in this case 3.0.10) or is there a better way of figuring this out? Thanks! Shalom Sagges DBA T: +972-74-700-4035

Re: How to Choose a Version for Upgrade

2016-11-23 Thread Shalom Sagges
Thanks Vladimir! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://engage.liveperson.com/idc-mobile-first-consumer/?utm_medium=email

Re: OperationTimedOutException (NoHostAvailableException)

2016-11-24 Thread Shalom Sagges
Do you get this error on specific column families or on all of the environment? Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://

Max Capacity per Node

2016-11-24 Thread Shalom Sagges
Hi Everyone, I have a 24 node cluster (12 in each DC) with a capacity of 3.3 TB per node for the data directory. I'd like to increase the capacity per node. Can anyone tell what is the maximum recommended capacity a node can use? The disks we use are HDD, not SSD. Thanks! Shalom Sagges DBA T

Re: data not replicated on new node

2016-11-21 Thread Shalom Sagges
. https://docs.datastax.com/en/upgrade/doc/upgrade/cassandra/upgrdCassandra.html Hope this helps. Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful

Re: Some questions to updating and tombstone

2016-11-16 Thread Shalom Sagges
Hi Fabrice, Just a small (out of the topic) question I couldn't find an answer to. What is a slice in Cassandra? (e.g. Maximum tombstones per slice) Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://w

WriteTimeoutExceptions from Storm Topology

2016-11-17 Thread Shalom Sagges
onses.java:58) at com.datastax.driver.core.Responses$Error$1.decode(Responses.java:38) at com.datastax.driver.core.Message$ProtocolDecoder.decode(Message.java:168) at org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:66) ... 21 more Shalom Sagg

Is Centos 7 Supported for Version 3.0

2016-11-20 Thread Shalom Sagges
Hi Guys, A simple question for which I couldn't find an answer in the docs. Is Centos 7 supported on DataStax Community Edition v3.0.9? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.co

Re: Is Centos 7 Supported for Version 3.0

2016-11-20 Thread Shalom Sagges
Thanks Vladimir! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://engage.liveperson.com/idc-mobile-first-consumer/?utm_medium=email

Re: data not replicated on new node

2016-11-20 Thread Shalom Sagges
I believe the logs should show you what the issue is. Also, can the node "talk" with the others? (i.e. telnet to the other nodes on port 7000). Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.f

Cassandra Upgrade

2016-11-29 Thread Shalom Sagges
. Is this possible? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://engage.liveperson.com/idc-mobile-first-consumer/?ut

Re: Cassandra Upgrade

2016-11-29 Thread Shalom Sagges
not install everything anew? By the way, if I do take the longer way and add a new 2.2.8 node to the cluster, do I still need to perform upgradesstables on the new node? Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/livepers

Imprecise Repair

2016-12-08 Thread Shalom Sagges
17 but saw it was fixed on 2.0.9. The version I'm using is 2.0.14. Any ideas? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://e

WriteTimeoutException When only One Node is Down

2017-01-11 Thread Shalom Sagges
Any ideas? I'm quite at a loss here. Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections -- This message may contain confidential a

Re: Cassandra 2.x Stability

2016-12-01 Thread Shalom Sagges
Thanks a lot Kai! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://engage.liveperson.com/idc-mobile-first-consumer/?ut

Re: Cassandra 2.x Stability

2016-12-01 Thread Shalom Sagges
Hey Kai, Thanks for the info. Can you please elaborate on the reasons you'd pick 2.2.6 over 3.0? Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful

Re: Cassandra Upgrade

2016-11-29 Thread Shalom Sagges
Thanks for the info Kurt, I guess I'd go with the normal upgrade procedure then. Thanks again for the help everyone. Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We

Cassandra 2.x Stability

2016-11-30 Thread Shalom Sagges
the storage modifications (please correct me if I'm wrong). So my question is, if I need a 2.x version (can't upgrade to 3 due to client considerations), which one should I choose, 2.1.x or 2.2.x? (I'm don't require any new features available in 2.2). Thanks! Shalom Sagges DBA T: +972-74-700-4035 <h

Re: Openstack and Cassandra

2017-01-01 Thread Shalom Sagges
Thanks for the info Romain, Can you tell me please what are the implications of not using CPU Pinning? Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful

Re: About Tombstones and TTLs

2016-12-19 Thread Shalom Sagges
Thanks a lot Alain!! This really cleared a lot of things for me. Thanks again! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections On Mon,

Openstack and Cassandra

2016-12-21 Thread Shalom Sagges
machine that divide their capacity to various instances (not only Cassandra), will this affect performance, especially when the commitlog directory will probably reside with the data directory? I'm at a loss here and don't have any answers for that matter. Can anyone assist please? Thanks! Shalom

Re: Openstack and Cassandra

2016-12-27 Thread Shalom Sagges
;-) ) Regarding Trove, I doubt we'll use it in Production any time soon. Thanks again! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful

Re: Openstack and Cassandra

2016-12-22 Thread Shalom Sagges
Thanks Vladimir! I guess I'll just have to deploy and continue from there. Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://l

Re: Openstack and Cassandra

2016-12-22 Thread Shalom Sagges
Thanks for the info Aaron! I will test it in hope there will be no issues. If no issues will occur, this could actually be a good idea and would save a lot of resources. Have a great day! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://tw

About Tombstones and TTLs

2016-12-19 Thread Shalom Sagges
ce_seconds to be bigger than 0? Sorry for all those questions, I'm just really confused from all the TTL/tombstones subject (still a newbie). Thanks a lot! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.faceb

Re: About Tombstones and TTLs

2016-12-19 Thread Shalom Sagges
, but use updates as well, do I need gc_grace_seconds to be bigger than 0? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections On Mon,

Re: RemoveNode CPU Spike Question

2017-01-15 Thread Shalom Sagges
slowly enabled autocompaction (a few minutes between each enable) on the nodes one by one. This helped with the CPU increase you've mentioned. Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/Li

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-22 Thread Shalom Sagges
Upgrading to 3.0.12 solved the issue. Thanks a lot for the help Joel! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://livepe

A Single Dropped Node Fails Entire Read Queries

2017-03-09 Thread Shalom Sagges
Hi Cassandra Users, I hope someone could help me understand the following scenario: Version: 3.0.9 3 nodes per DC 3 DCs in the cluster. Consistency Local_Quorum. I did a small resiliency test and dropped a node to check the availability of the data. What I assumed would happen is nothing at

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-10 Thread Shalom Sagges
or of 3 you can loose one node and still satisfy the > query. > Ryan Svihla <r...@foundev.pro> schrieb am Do. 9. März 2017 um 18:09: > >> whats your keyspace replication settings and what's your query? >> >> On Thu, Mar 9, 2017 at 9:32 AM, Shalom Sagges <shal..

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-10 Thread Shalom Sagges
Hi daniel, I don't think that's a network issue, because ~10 seconds after the node stopped, the queries were successful again without any timeout issues. Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/livepers

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-13 Thread Shalom Sagges
ed. Could this be a bug in 3.0.9? Or some sort of misconfiguration I missed? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <http

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-12 Thread Shalom Sagges
Hi Michael, If a node suddenly fails, and there are other replicas that can still satisfy the consistency level, shouldn't the request succeed regardless of the failed node? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/l

Re: A Single Dropped Node Fails Entire Read Queries

2017-03-14 Thread Shalom Sagges
Thanks a lot Joel! I'll go ahead and upgrade. Thanks again! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.doc

Adding a New Node With The Same IP of an Old Node

2017-07-04 Thread Shalom Sagges
c07bf5c17a: [x.x.x.2] UNREACHABLE: [x.x.x.31, x.x.x.1, x.x.x.28, x.x.x.252, x.x.x.253, x.x.x.15, x.x.x.126, x.x.x.35, x.x.x.32] I'd really REALLY appreciate some guidance. Did I do something wrong? Is there a way to fix this? Thanks a lot! Shalom Sagges DBA <http://www.linkedin.co

Re: Adding a New Node With The Same IP of an Old Node

2017-07-05 Thread Shalom Sagges
Thanks Nitan! Eventually it was a firewall issue related to the Centos7 node. Once fixed, the rolling restart resolved the issue completely. Thanks again! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://w

Re: Bootstraping a Node With a Newer Version

2017-05-17 Thread Shalom Sagges
touching the data directory which is on a different vg? Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.docsend.com/view/8

Re: sstablesplit - status

2017-05-17 Thread Shalom Sagges
. Also, you can always play with the compaction threshold to suit your needs. Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://livepe

Re: Bootstraping a Node With a Newer Version

2017-05-17 Thread Shalom Sagges
riendly) or perform the backup recommendations shown on the Centos page (which sounds extremely agonizing as well). What do you think? Thanks! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/Li

Bootstraping a Node With a Newer Version

2017-05-16 Thread Shalom Sagges
the server with the new kernel, can I first install the upgraded Cassandra version and then bootstrap it to the cluster? Since there's already no data on the node, I wish to skip the agonizing sstable upgrade process. Does anyone know if this is doable? Thanks! Shalom Sagges DBA T: +972-74-700-4035

Re: Reaper v0.6.1 released

2017-06-15 Thread Shalom Sagges
That's awesome!! Thanks for contributing!  Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections On Thu, Jun 15, 2017 at 2:32 AM,

Re: User Defined Compaction Issue

2017-09-26 Thread shalom sagges
removed. If you just keep recompacting sstable 2 by itself, the row in > sstable A remains on disk. > > > > -- > Jeff Jirsa > > > On Sep 26, 2017, at 2:01 AM, shalom sagges <shalomsag...@gmail.com> wrote: > > Thanks Jeff! > > I'll try that. > I'm

User Defined Compaction Issue

2017-09-25 Thread shalom sagges
Hi Everyone, I'm running into an issue I can't seem to Solve. I execute force compaction in order to reclaim back storage. Everything was working fine for a time, but after a while I found that tombstones aren't being removed any longer. For example, I've compacted the following SSTable: *21G

Re: User Defined Compaction Issue

2017-09-26 Thread shalom sagges
best if you can be sure which > data is overlapping, but short of that you'll probably want to pick data > with approximately the same (or older) calendar timestamps. > > > > On Mon, Sep 25, 2017 at 11:10 AM, shalom sagges <shalomsag...@gmail.com> > wrote: > >> Hi Everyone

Working With Prepared Statements

2017-08-28 Thread Shalom Sagges
! Shalom Sagges DBA <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections -- This message may contain confidential and/or privileged information. If you are not the addressee or aut

Re: Working With Prepared Statements

2017-08-29 Thread Shalom Sagges
Insights, anyone? Shalom Sagges DBA <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections On Mon, Aug 28, 2017 at 10:43 AM, Shalom Sagges <shal...@liveperson.com> wrote: &

Re: old big tombstone data file occupy much disk space

2017-09-04 Thread Shalom Sagges
By the way, does anyone know what happens if I run a user defined compaction on an sstable that's already in compaction? On Sun, Sep 3, 2017 at 2:55 PM, Shalom Sagges <shal...@liveperson.com> wrote: > Try this blog by The Last Pickle: > > http://thelastpickle.com/blog/2016/10/

Re: old big tombstone data file occupy much disk space

2017-09-04 Thread Shalom Sagges
-compact > // something that was already being compacted earlier. > > On 4 September 2017 at 13:54, Nicolas Guyomar <nicolas.guyo...@gmail.com> > wrote: > >> You'll get the WARN "Will not compact {}: it is not an active sstable" >> :) >> >>

Re: Working With Prepared Statements

2017-08-29 Thread Shalom Sagges
Sounds great then. Thanks a lot guys!  Shalom Sagges DBA <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections On Tue, Aug 29, 2017 at 2:41 PM, Nicolas Guyomar <nicolas.guy

Re: Working With Prepared Statements

2017-08-30 Thread Shalom Sagges
Thanks guys for all the info! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.docsend.com/view/8iiswfp> On Wed,

Re: Working With Prepared Statements

2017-08-29 Thread Shalom Sagges
Hi Matija, I just wish to know if there are any disadvantages when using prepared statement or any warning signs I should look for. Queries will run multiple times so it fits the use case. Thanks! Shalom Sagges DBA <http://www.linkedin.com/company/164748> <http://twitter.com/livepers

Re: Working With Prepared Statements

2017-08-29 Thread Shalom Sagges
Thanks a lot! I'll make sure it'll be prepared once. Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.docsend.com/view/8

Re: old big tombstone data file occupy much disk space

2017-09-03 Thread Shalom Sagges
Try this blog by The Last Pickle: http://thelastpickle.com/blog/2016/10/18/user-defined-compaction.html Shalom Sagges DBA <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections O

Re: Working With Prepared Statements

2017-08-29 Thread Shalom Sagges
That's a good to know post. Thanks for the info Nicolas! Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.docsend.com/v

Adding a New Node

2017-10-24 Thread shalom sagges
Hi Everyone, I have 2 DCs (v2.0.14) with the following topology.properties: DC1: xxx11=DC1:RAC1 xxx12=DC1:RAC1 xxx13=DC1:RAC1 xxx14=DC1:RAC1 xxx15=DC1:RAC1 DC2: yyy11=DC2:RAC1 yyy12=DC2:RAC1 yyy13=DC2:RAC1 yyy14=DC2:RAC1 yyy15=DC2:RAC1 # default for unknown nodes default=DC1:RAC1 Now let's

Re: Adding a New Node

2017-10-24 Thread shalom sagges
t its own topology settings in > cassandra-rackdc.properties, so the problem you point out in 2 goes away, > as when adding a node you only need to specify its configuration and that > will be propagated to the rest of the cluster through gossip. > > On 24 October 2017 at 07:13, sh

Re: Does LOCAL_ONE still replicate data?

2018-05-08 Thread shalom sagges
It's advisable to set the RF to 3 regardless of the consistency level. If using RF=1, Read CL=LOCAL_ONE and a node goes down in the local DC, you will not be able to read data related to this node until it goes back up. For writes and CL=LOCAL_ONE, the write will fail (if it falls on the token

Re: 3.0.15 or 3.11.1

2018-01-07 Thread shalom sagges
Thanks Guys! Sorry for the late reply. I'm interested in TWCS where I understand is more stable in 3.11.1 than in 3.0.15, tombstone compaction and slow logs. I don't plan to use MVs and SASI in the near future, as I understand are not Production ready. Is it okay to use the above features?

Re: 3.0.15 or 3.11.1

2018-01-09 Thread shalom sagges
Thanks a lot for the info! Much appreciated. On Tue, Jan 9, 2018 at 2:33 AM, Mick Semb Wever wrote: > > >> Can you please provide dome JIRAs for superior fixes and performance >> improvements which are present in 3.11.1 but are missing in 3.0.15. >> > > > Some that come

C* Logs to Kibana

2018-01-10 Thread shalom sagges
Hi All, I want to push the Cassandra logs (version 3.x) to Kibana. Is there a way to configure the Cassandra logs to be in json format? If modifying the logs to json is not an option, I came across this blog post from about a year ago regarding that matter:

SSTableLoader Question

2018-02-18 Thread shalom sagges
Hi All, C* version 2.0.14. I was loading some data to another cluster using SSTableLoader. The streaming failed with the following error: Streaming error occurred java.lang.RuntimeException: java.io.*FileNotFoundException*: /data1/keyspace1/table1/keyspace1-table1-jb-65174-Data.db (No such

Re: SSTableLoader Question

2018-02-19 Thread shalom sagges
des, > the sstable that you are loading SHOULD not be live. If you at streaming a > life sstable, it means you are using sstableloader not as it is designed to > be used - which is with static files. > > -- > Rahul Singh > rahul.si...@anant.us > > Anant Corporation > &

Re: SSTableLoader Question

2018-02-18 Thread shalom sagges
! On Sun, Feb 18, 2018 at 3:58 PM, Rahul Singh <rahul.xavier.si...@gmail.com> wrote: > Check permissions maybe? Who owns the files vs. who is running > sstableloader. > > -- > Rahul Singh > rahul.si...@anant.us > > Anant Corporation > > On Feb 18, 2018, 4:2

3.0.15 or 3.11.1

2018-01-02 Thread shalom sagges
Hi All, I want to upgrade from 2.x to 3.x. I can definitely use the features in 3.11.1 but it's not a must. So my question is, is 3.11.1 stable and suitable for Production compared to 3.0.15? Thanks!

Re: saving distinct data in cassandra result in many tombstones

2018-06-19 Thread shalom sagges
1. How to use sharding partition key in a way that partitions end up in different nodes? You could, for example, create a table with a bucket column added to the partition key: Table distinct( hourNumber int, bucket int, //could be a 5 minute bucket for example key text, distinctValue long

User Defined Types?

2018-08-05 Thread shalom sagges
Hi All, Are there any known caveats for User Defined Types in Cassandra (version 3.0)? One of our teams wants to start using them. I wish to assess it and see if it'd be wise (or not) to refrain from using UDTs. Thanks!

Re: User Defined Types?

2018-08-07 Thread shalom sagges
you are on 3.0, > So you are affected by UDT behaviour (stored as BLOB) mentioned in the > JIRA. > > Cheers, > Anup > > On 5 August 2018 at 23:29, shalom sagges wrote: > >> Hi All, >> >> Are there any known caveats for User Defined Types in Cassandra (vers

Re: Cassandra didn't order data according to clustering order

2018-07-15 Thread shalom sagges
The clustering column is ordered per partition key. So if for example I create the following table: create table desc_test ( id text, name text, PRIMARY KEY (id,name) ) WITH CLUSTERING ORDER BY (name DESC ); I insert a few rows: insert into desc_test (id , name ) VALUES (

Re: Stumped By Cassandra delays

2018-07-22 Thread shalom sagges
Hi Gareth, If you're using batches for multiple partitions, this may be the root cause you've been looking for. https://inoio.de/blog/2016/01/13/cassandra-to-batch-or-not-to-batch/ If batches are optimally used and only one node is misbehaving, check if NTP on the node is properly synced. Hope

Re: Large sstables

2018-09-02 Thread shalom sagges
If there are a lot of droppable tombstones, you could also run User Defined Compaction on that (and on other) SSTable(s). This blog post explains it well: http://thelastpickle.com/blog/2016/10/18/user-defined-compaction.html On Fri, Aug 31, 2018 at 12:04 AM Mohamadreza Rostami <

Re: Text or....

2018-04-04 Thread shalom sagges
, DuyHai Doan <doanduy...@gmail.com> wrote: > Compress it and stores it as a blob. > Unless you ever need to index it but I guess even with SASI indexing a so > huge text block is not a good idea > > On Wed, Apr 4, 2018 at 2:25 PM, shalom sagges <shalomsag...@gmail.c

Text or....

2018-04-04 Thread shalom sagges
Hi All, A certain application is writing ~55,000 characters for a single row. Most of these characters are entered to one column with "text" data type. This looks insanely large for one row. Would you suggest to change the data type from "text" to BLOB or any other option that might fit this

Dropped Mutations

2018-04-18 Thread shalom sagges
Hi All, I have a 44 node cluster (22 nodes on each DC). Each node has 24 cores and 130 GB RAM, 3 TB HDDs. Version 2.0.14 (soon to be upgraded) ~10K writes per second per node. Heap size: 8 GB max, 2.4 GB newgen I deployed Reaper and GC started to increase rapidly. I'm not sure if it's because

Re: Dropped Mutations

2018-04-19 Thread Shalom Sagges
Thanks a lot Hitesh! I'll try to re-tune the heap to a lower level Shalom Sagges DBA T: +972-74-700-4035 <http://www.linkedin.com/company/164748> <http://twitter.com/liveperson> <http://www.facebook.com/LivePersonInc> We Create Meaningful Connections <https://liveperson.doc

Re: How to Protect Tracing Requests From Client Side

2018-03-25 Thread shalom sagges
Thanks Guys! This really helps! On Fri, Mar 23, 2018 at 7:10 AM, Mick Semb Wever wrote: > Is there a way to protect C* on the server side from tracing commands that >> are executed from clients? >> > > > If you really needed a way to completely disable all and any

Large Partitions

2018-04-02 Thread shalom sagges
Hi All, I ran nodetool cfstats (v2.0.14) on a keyspace and found that there are a few large partitions. I assume that since "Compacted partition maximum bytes": 802187438 (~800 MB) and since "Compacted partition mean bytes": 100465 (~100 KB), it means that most partitions are in okay size and

Re: Large Partitions

2018-04-02 Thread shalom sagges
y unauthorized person acting, or refraining from acting, > on any information contained in this message. For security purposes, staff > training, to assist in resolving complaints and to improve our customer > service, email communications may be monitored and telephone calls may be > recorde

Delete System_Traces Table

2018-03-19 Thread shalom sagges
Hi All, I accidentally created a test table on the system_traces keyspace. When I tried to drop the table with the Cassandra user, I got the following error: *Unauthorized: Error from server: code=2100 [Unauthorized] message="Cannot DROP "* Is there a way to drop this table permanently?

Re: Delete System_Traces Table

2018-03-19 Thread shalom sagges
ng in > debugging. > > Chris > > On Mar 19, 2018, at 7:52 AM, shalom sagges <shalomsag...@gmail.com> wrote: > > Hi All, > > I accidentally created a test table on the system_traces keyspace. > > When I tried to drop the table with the Cassandra user, I got the

Re: Delete System_Traces Table

2018-03-19 Thread shalom sagges
al, I see. > > With https://issues.apache.org/jira/browse/CASSANDRA-13813 you wont be > able to drop the table, but would be worth a ticket to prevent creation in > those keyspaces or allow some sort of override if allowing create. > > Chris > > > On Mar 19, 2018,

How to Protect Tracing Requests From Client Side

2018-03-22 Thread shalom sagges
Hi All, Is there a way to protect C* on the server side from tracing commands that are executed from clients? Thanks!

Re: Delete System_Traces Table

2018-03-19 Thread shalom sagges
gt; protecting users from themselves but it doesnt hurt anything to have the > table there. Just ignore it and its existence will not cause any issues. > > Chris > > > On Mar 19, 2018, at 10:27 AM, shalom sagges <shalomsag...@gmail.com> > wrote: > > Tha

Re: compaction stuck at 99.99%

2018-03-21 Thread shalom sagges
If the problem is recurring, then you might have a corrupted SSTable. Check the system log. If a certain file is corrupted, you'll find it. grep -i corrupt /system.log* On Wed, Mar 21, 2018 at 2:18 PM, Jerome Basa wrote: > hi, > > when i run `nodetool compactionstats`

Re: How to Protect Tracing Requests From Client Side

2018-03-22 Thread shalom sagges
ration > > On Mar 22, 2018, 11:10 AM -0500, shalom sagges <shalomsag...@gmail.com>, > wrote: > > Hi All, > > Is there a way to protect C* on the server side from tracing commands that > are executed from clients? > > Thanks! > >

Version Rollback

2018-02-27 Thread shalom sagges
Hi All, I'm planning to upgrade my C* cluster to version 3.x and was wondering what's the best way to perform a rollback if need be. If I used snapshot restoration, I would be facing data loss, depends when I took the snapshot (i.e. a rollback might be required after upgrading half the cluster

Re: Version Rollback

2018-02-28 Thread shalom sagges
o ensure the combined results are properly ordered. > > Writes will be slowed by the double-writes, reads you'll be bound by the > worse performing cluster. > > On Tue, Feb 27, 2018 at 8:23 AM, Kenneth Brotman < > kenbrot...@yahoo.com.invalid> wrote: > >> Could you tell

Re: Re: High CPU usage on some of the nodes due to message coalesce

2018-10-21 Thread shalom sagges
I guess the code experts could shed more light on org.apache.cassandra.util.coalesceInternal and SepWorker.run. I'll just add anything I can think of Any cron or other scheduler running on those nodes? Lots of Java processes running simultaneously? Heavy repair continuously running? Lots of

Re: Re: High CPU usage on some of the nodes due to message coalesce

2018-10-21 Thread shalom sagges
What takes the most CPU? System or User? Did you try removing a problematic node and installing a brand new one (instead of re-adding)? When you decommissioned these nodes, did the high CPU "move" to other nodes (probably data model/query issues) or was it completely gone? (server issues) On

Re: Query With Limit Clause

2018-11-07 Thread shalom sagges
rency Factor) > > > > On Tue, Nov 6, 2018 at 8:21 AM shalom sagges > wrote: > >> Hi All, >> >> If I run for example: >> select * from myTable limit 3; >> >> Does Cassandra do a full table scan regardless of the limit? >> >> Thanks! >> >

Query With Limit Clause

2018-11-05 Thread shalom sagges
Hi All, If I run for example: select * from myTable limit 3; Does Cassandra do a full table scan regardless of the limit? Thanks!

Upgrade to v3.11.3

2019-01-16 Thread shalom sagges
Hi All, I'm about to start a rolling upgrade process from version 2.0.14 to version 3.11.3. I have a few small questions: 1. The upgrade process that I know of is from 2.0.14 to 2.1.x (higher than 2.1.9 I think) and then from 2.1.x to 3.x. Do I need to upgrade first to 3.0.x or can I

Re: Upgrade to v3.11.3

2019-01-17 Thread shalom sagges
Disclaimer: The information provided in above response is my personal > opinion based on the best of my knowledge and experience. We do > not take any responsibility and we are not liable for any damage caused by > actions taken based on above information. > Thanks > Anuj > > &

Re: Read timeouts when performing rolling restart

2018-09-13 Thread shalom sagges
Hi Riccardo, Does this issue occur when performing a single restart or after several restarts during a rolling restart (as mentioned in your original post)? We have a cluster that when performing a rolling restart, we prefer to wait ~10-15 minutes between each restart because we see an increase

Re: Question on changing node IP address

2019-02-27 Thread shalom sagges
Thanks for the info Alex! I read https://docs.datastax.com/en/cassandra/3.0/cassandra/operations/opsSwitchSnitch.html but still have a few questions: Our clusters are comprised of 2 DCs with no rack configuration, RF=3 on each DC. In this scenario, if I wish to seamlessly change the snitch with

Re: A Question About Hints

2019-03-04 Thread shalom sagges
t; > > *From:* shalom sagges [mailto:shalomsag...@gmail.com] > *Sent:* Monday, March 04, 2019 7:22 AM > *To:* user@cassandra.apache.org > *Subject:* A Question About Hints > > > > Hi All, > > > > Does anyone know what is the most optimal hints configuration (multipl

  1   2   >