Re: ReadStage filling up and leading to Read Timeouts

2019-02-05 Thread Rajsekhar Mallick
Thank you Jeff for the link. Please do comment on the G1GC settings,if they are ok for the cluster. Also comment on reducing the concurrent reads to 32 on all nodes in the cluster. As has earlier lead to reads getting dropped. Will adding nodes to the cluster be helpful. Thanks, Rajsekhar Mallick

Re: ReadStage filling up and leading to Read Timeouts

2019-02-05 Thread Jeff Jirsa
https://docs.datastax.com/en/developer/java-driver/3.2/manual/paging/ -- Jeff Jirsa > On Feb 5, 2019, at 11:33 PM, Rajsekhar Mallick > wrote: > > Hello Jeff, > > Thanks for the reply. > We do have GC logs enabled. > We do observe gc pauses upto 2 seconds but quite often we see this issue

Re: ReadStage filling up and leading to Read Timeouts

2019-02-05 Thread Rajsekhar Mallick
Hello Jeff, Thanks for the reply. We do have GC logs enabled. We do observe gc pauses upto 2 seconds but quite often we see this issue even when the gc log reads good and clear. JVM Flags related to G1GC: Xms: 48G Xmx:48G Maxgcpausemillis=200 Parallels gc threads=32 Concurrent gc threads= 10

Re: ReadStage filling up and leading to Read Timeouts

2019-02-05 Thread Jeff Jirsa
What you're potentially seeing is the GC impact of reading a large partition - do you have GC logs or StatusLogger output indicating you're pausing? What are you actual JVM flags you're using? Given your heap size, the easiest mitigation may be significantly increasing your key cache size (up to

ReadStage filling up and leading to Read Timeouts

2019-02-05 Thread Rajsekhar Mallick
Hello Team, Cluster Details: 1. Number of Nodes in cluster : 7 2. Number of CPU cores: 48 3. Swap is enabled on all nodes 4. Memory available on all nodes : 120GB 5. Disk space available : 745GB 6. Cassandra version: 2.1 7. Active tables are using size-tiered compaction strategy 8. Read

Re: SASI queries- cqlsh vs java driver

2019-02-05 Thread Peter Heitman
The table and secondary indexes look generally like this. Note that I have changed the names of many of the columns to be generic since they aren't important to the question as far as I know. I left the actual names for those columns that I've created SASI indexes for. The query I use to try to

Cassandra 2.1.18 - NPE during startup

2019-02-05 Thread Steinmaurer, Thomas
Hello, at a particular customer location, we are seeing the following NPE during startup with Cassandra 2.1.18. INFO [SSTableBatchOpen:2] 2019-02-03 13:32:56,131 SSTableReader.java:475 - Opening

Re: datamodelling

2019-02-05 Thread Jonathan Haddad
We (The Last Pickle) wrote a blog post on scaling time series: http://thelastpickle.com/blog/2017/08/02/time-series-data-modeling-massive-scale.html Rather than an agent_type, you can use a application determined bucket, so that agents with more data use more buckets. That'll keep your partition

Re: datamodelling

2019-02-05 Thread Bobbie Haynes
even if i try to create a agent_type it will be same issue again because agent_id and agent_type have same values... On Tue, Feb 5, 2019 at 11:36 AM Bobbie Haynes wrote: > unfortunately i do not have different of agents(agent_type) .. i only have > agent_id which is also a UUID type. > > On

Re: datamodelling

2019-02-05 Thread Bobbie Haynes
unfortunately i do not have different of agents(agent_type) .. i only have agent_id which is also a UUID type. On Tue, Feb 5, 2019 at 11:34 AM Nitan Kainth wrote: > You could consider a sudo column like agent_type and make it a compound > partition key. It will limit break your partition into

Re: datamodelling

2019-02-05 Thread Nitan Kainth
You could consider a sudo column like agent_type and make it a compound partition key. It will limit break your partition into smaller ones but you will have to query with agent_id and agent_type in that case. On Tue, Feb 5, 2019 at 12:59 PM Bobbie Haynes wrote: > Hi Everyone, >

datamodelling

2019-02-05 Thread Bobbie Haynes
Hi Everyone, Could you please help me in modeling my table below.I'm stuck here. My Partition key is agent_id and clustering column is rowid. Each agent can have a minimum of 1000 rows to 10M depends on how busy the agent .I'm facing large partition issue for my busy agents.

DataStax Accelerate call for papers closing February 15

2019-02-05 Thread Patrick McFadin
*Hello my fellow Cassandra people!I’m not sure if you’ve heard, but DataStax is hosting a conference this year, DataStax Accelerate. I’m in charge of the speaker part of the conference, so I’m here to ask for some help. I want a ton of awesome Cassandra content! The best part of our community is

Re: coordinator failure handling

2019-02-05 Thread Eric Stevens
This will depend on what driver you're using at the client. The Java driver, for example, has ways to configure each of the things you mentioned, with a variety of implementations you can choose from. There are also ways to provide your own custom implementation if you don't like the options

Re: coordinator failure handling

2019-02-05 Thread Tom Wollert
All below AFAIK a) The query will only be retried after half the timeout has passed, if the query is idempotent (you have to set that on prepare statement, otherwise it will assume it isn't) b) Querytimeout can be set globally in the Cluster.Builder().WithQueryTimeout c) The LoadBalancingPolicy

coordinator failure handling

2019-02-05 Thread amit sehas
Sorry to bother you, i am just starting to look into Cassandra, and am confused about a lot of things. If a client sends a query to a coordinator, then if it does not receive a response from the co-ordinator then: a) is there a timeout at which client retries the query?b) is there somewhere we

Re: upgrading cassandra

2019-02-05 Thread Jeff Jirsa
The 3.0 branch is slightly different than the 3.11 branch For you, going to 3.0.18 would be a minor version upgrade while going to 3.11.4 would be a major version upgrade 3.11 would give you access to features like CDC, SASI and performance improvements like better large partition support and

upgrading cassandra

2019-02-05 Thread Adil
Hi, we have a cluster with cassandra 3.0.9 and we are going to upgrade it to the latest version which i think is 3.11.3 but a teamate told me that the latest version is 3.0.17. what is the latest stable version? thanks in advance.

Re: SASI queries- cqlsh vs java driver

2019-02-05 Thread Oleksandr Petrov
Could you post full table schema (names obfuscated, if required) with index creation statements and queries? On Mon, Feb 4, 2019 at 10:04 AM Jacques-Henri Berthemet < jacques-henri.berthe...@genesys.com> wrote: > I’m not sure why it`s not allowed by the Datastax driver, but maybe you > could try