RE: Tombstones in memtable

2019-02-23 Thread Kenneth Brotman
-patterns-queues-and-queue-like-datasets Kenneth Brotman From: Jeff Jirsa [mailto:jji...@gmail.com] Sent: Saturday, February 23, 2019 4:47 PM To: user@cassandra.apache.org Subject: Re: Tombstones in memtable Would also be good to see your schema (anonymized if needed) and the select

RE: Tombstones in memtable

2019-02-23 Thread Kenneth Brotman
compaction strategy are you using? You need a way to clear out those tombstones. There exist tombstone compaction sub properties that can help encourage compaction to grab sstables just because they’re full of tombstones which will probably help you. -- Jeff Jirsa On Feb 22, 2019, a

RE: Tombstones in memtable

2019-02-23 Thread Kenneth Brotman
l without using s TTL, you can probably drop your GCGS to 1 hour (or less). Which compaction strategy are you using? You need a way to clear out those tombstones. There exist tombstone compaction sub properties that can help encourage compaction to grab sstables just because they’re full of

RE: Determine disc space that will be freed after expansion cleanup

2019-02-25 Thread Kenneth Brotman
A real quick way to get an idea might be to run nodetool status and look at the imbalance of the data on each node assuming all the nodes have the same specs. From: Cameron Gandevia [mailto:cameron.gande...@globalrelay.net] Sent: Monday, February 25, 2019 3:00 PM To:

RE: Upgrade 3.11.1 to 3.11.4

2019-02-28 Thread Kenneth Brotman
Hi John, Was the cluster running ok before decommissioning the node? Why were you decommissioning the node? Were you upgrading from 3.11.1 to 3.11.4? From: Ioannis Zafiropoulos [mailto:john...@gmail.com] Sent: Wednesday, February 27, 2019 7:33 AM To: user@cassandra.apache.org

RE: MV's stuck in build state

2019-02-28 Thread Kenneth Brotman
gested in the stackoverflow.com post you cited? Kenneth Brotman From: Dipan Shah [mailto:dipan@hotmail.com] Sent: Thursday, February 28, 2019 2:23 AM To: Dipan Shah; user@cassandra.apache.org Subject: Re: MV's stuck in build state Forgot to add version info. This is on 3.7. [cqlsh 5.0.1 | Cassand

RE: MV's stuck in build state

2019-03-04 Thread Kenneth Brotman
Shah [mailto:dipan@hotmail.com] Sent: Monday, March 04, 2019 12:52 AM To: Kenneth Brotman; user@cassandra.apache.org Subject: Re: MV's stuck in build state Hello Kenneth, Apologies for the late reply. 1) On production the value of x was 67 MB and y was 16 MV as value

RE: AxonOps - Cassandra operational management tool

2019-03-02 Thread Kenneth Brotman
Sorry, Nitan was only making a comment about this post but the comments I’m making are to AxonOps. It appears we don’t have a name for anyone at AxonOps at all then! You guys are going to need to be more open. From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Saturday

RE: AxonOps - Cassandra operational management tool

2019-03-02 Thread Kenneth Brotman
will be able to do several of the things that you listed. How much added value are you providing with this product? It’s up to you to make the case. You’ll have to spend more time on the business side of things if you want to do any business. Kenneth Brotman From: AxonOps [mailto:axon

RE: A Question About Hints

2019-03-04 Thread Kenneth Brotman
max_hints_delivery_threads: 2 Thanks for your help! On Mon, Mar 4, 2019 at 6:44 PM Kenneth Brotman wrote: What is the concern? Why are you looking there? The casssandra.yml file has some notes about it. Did you read them? From: shalom sagges [mailto:shalomsag...@gmail.com] Sent

RE: A Question About Hints

2019-03-04 Thread Kenneth Brotman
What is the concern? Why are you looking there? The casssandra.yml file has some notes about it. Did you read them? From: shalom sagges [mailto:shalomsag...@gmail.com] Sent: Monday, March 04, 2019 7:22 AM To: user@cassandra.apache.org Subject: A Question About Hints Hi All, Does

RE: Tombstones in memtable

2019-02-22 Thread Kenneth Brotman
Can we see the histogram? Why wouldn’t you at times have that many tombstones? Makes sense. Kenneth Brotman From: Rahul Reddy [mailto:rahulreddy1...@gmail.com] Sent: Thursday, February 21, 2019 7:06 AM To: user@cassandra.apache.org Subject: Tombstones in memtable We have small

RE: tombstones threshold warning

2019-02-24 Thread Kenneth Brotman
--++---++--- Execute CQL3 query | 2019-02-21 21:41:04.629000 | 10.216.87.180 | 0 | 127.0.0.1 Parsing select *

RE: Looking for feedback on automated root-cause system

2019-02-24 Thread Kenneth Brotman
Sounds like a promising step forward. I’d certainly like to know when the blog posts are up. Kenneth Brotman From: Matt Stump [mailto:mrevilgn...@gmail.com] Sent: Friday, February 22, 2019 7:56 AM To: user Subject: Re: Looking for feedback on automated root-cause system For some

RE: Looking for feedback on automated root-cause system

2019-03-05 Thread Kenneth Brotman
are you able to get that much good quality data? Kenneth Brotman From: Kenneth Brotman [mailto:kenbrot...@yahoo.com] Sent: Tuesday, March 05, 2019 10:01 AM To: 'user@cassandra.apache.org' Subject: RE: Looking for feedback on automated root-cause system I see they have a website now at https

RE: Looking for feedback on automated root-cause system

2019-03-05 Thread Kenneth Brotman
everyone thought they knew about Cassandra thread pool tuning is wrong, nobody really knows how to tune Kafka for large messages, or that there are major issues with the Kubernetes charts that people are using. On Tue, Feb 19, 2019 at 4:40 PM Kenneth Brotman wrote: Any information you can

RE: AxonOps - Cassandra operational management tool

2019-03-05 Thread Kenneth Brotman
of answers already! Really very promising! Thanks, Kenneth Brotman From: AxonOps [mailto:axon...@digitalis.io] Sent: Sunday, March 03, 2019 7:51 AM To: user@cassandra.apache.org Subject: Re: AxonOps - Cassandra operational management tool Hi Kenneth, Thanks for your great feedback

RE: A Question About Hints

2019-03-04 Thread Kenneth Brotman
that has already experienced in this type of change. Thanks! On Mon, Mar 4, 2019 at 8:27 PM Kenneth Brotman wrote: It sounds like your use case might be appropriate for tuning those two settings some. How many nodes are in the cluster? Are both settings definitely on the default

RE: Looking for feedback on automated root-cause system

2019-03-05 Thread Kenneth Brotman
I found their YouTube video, Machine Learning & The future of DevOps – An Intro to Vorstella: https://www.youtube.com/watch?v=YZ5_LAXvUUo From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Tuesday, March 05, 2019 11:50 AM To: user@cassandra.apache.org Subject: RE: Loo

RE: data modelling

2019-03-05 Thread Kenneth Brotman
that in the query? If you could have tagid not be a collection, and make it part of the primary key, that would help a lot. From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Tuesday, March 05, 2019 4:33 PM To: user@cassandra.apache.org Subject: RE: data modelling Hi Bobbie

RE: data modelling

2019-03-05 Thread Kenneth Brotman
Hi Bobbie, You’re not giving enough information to model the data. With Cassandra it’s based on the queries you are going to need. This link to Jeffrey Carpenter’s book, Cassandra the Definitive Guide, Chapter 5, which is on how to do data modeling for Cassandra, should be of help to you:

RE: A Question About Hints

2019-03-04 Thread Kenneth Brotman
mentioned were really good. The entire article is very good, but I wonder if it's still valid since it was created around 4 years ago. Thanks! On Mon, Mar 4, 2019 at 9:37 PM Kenneth Brotman wrote: Makes sense If you have time and don’t mind, could you answer the following: Do

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
are looking out for some hack way to update the column. On Wed, Feb 27, 2019 at 4:48 PM Kenneth Brotman wrote: Ouch! I was sure I saw it in some material I studied but no. It looks like you have to provide the value before Cassandra, maybe through your application or something in the stream

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
is constant as of now but we are expecting lot many different values to come in future. Secondly, is Presto a distributed system ? Thanks and Regards, Goutham. On Wed, Feb 27, 2019 at 5:09 PM Kenneth Brotman wrote: If you know the value already, why do you need to store

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Sounds like what’s called a “static column”. From: Goutham reddy [mailto:goutham.chiru...@gmail.com] Sent: Wednesday, February 27, 2019 4:06 PM To: user@cassandra.apache.org Subject: Insert constant value for all the rows for a given column Hi, We have a requirement to add constant value

RE: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Kenneth Brotman
Hello, Why would you want to do that? From: Jai Bheemsen Rao Dhanwada [mailto:jaibheem...@gmail.com] Sent: Wednesday, February 27, 2019 3:57 PM To: user@cassandra.apache.org Subject: Disable Truststore CA check for internode_encryption Hello, Is it possible to disable truststore

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Correct me if my understanding is wrong. Regards Goutham Reddy On Wed, Feb 27, 2019 at 4:08 PM Kenneth Brotman wrote: Sounds like what’s called a “static column”. From: Goutham reddy [mailto:goutham.chiru...@gmail.com] Sent: Wednesday, February 27, 2019 4:06 P

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
How about using a default value on the column? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Wednesday, February 27, 2019 4:23 PM To: user@cassandra.apache.org Subject: RE: Insert constant value for all the rows for a given column Good point. From: Goutham reddy

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Ouch! I was sure I saw it in some material I studied but no. It looks like you have to provide the value before Cassandra, maybe through your application or something in the stream before Cassandra, or add it after Cassandra or use something like Spark to process it. Kenneth Brotman

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
If you know the value already, why do you need to store it in every row of a table? Seems like something is wrong. Why do you need to do that, if you can share that information? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com] Sent: Wednesday, February 27, 2019 5:08 PM To: 'user

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
I meant to say, what about using Presto? From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Wednesday, February 27, 2019 4:59 PM To: user@cassandra.apache.org Subject: RE: Insert constant value for all the rows for a given column Who are Presto? From: Goutham reddy

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
option and we are looking out for some hack way to update the column. On Wed, Feb 27, 2019 at 4:48 PM Kenneth Brotman wrote: Ouch! I was sure I saw it in some material I studied but no. It looks like you have to provide the value before Cassandra, maybe through your application

RE: Insert constant value for all the rows for a given column

2019-02-27 Thread Kenneth Brotman
Here’s a DataStax article called Sharing a static column: https://docs.datastax.com/en/cql/3.3/cql/cql_using/refStaticCol.html From: Kenneth Brotman [mailto:kenbrot...@yahoo.com] Sent: Wednesday, February 27, 2019 4:08 PM To: 'user@cassandra.apache.org' Subject: RE: Insert constant value

RE: MV's stuck in build state

2019-03-01 Thread Kenneth Brotman
d directly hitting the org.apache.cassandra.db:type=CompactionManager mbean's stopCompaction operation? From: Dipan Shah [mailto:dipan@hotmail.com] Sent: Friday, March 01, 2019 12:56 AM To: Kenneth Brotman; user@cassandra.apache.org Subject: Re: MV's stuck in build state Hel

RE: Cassandra config in table

2019-02-25 Thread Kenneth Brotman
Hi Abdul, system.local I believe has the info you would want. Here is a link about querying the system keyspace: https://docs.datastax.com/en/cql/3.3/cql/cql_using/useQuerySystem.html Kenneth Brotman From: Abdul Patel [mailto:abd786...@gmail.com] Sent: Monday, February 25, 2019 7

RE: Feedback wanted for Knowledge base for all things cassandra (cassandra.link)

2019-02-25 Thread Kenneth Brotman
, book, article, course, etc. Date of production Author/Presenter Publisher/Producer/Event Thank you for the continuing effort you have made on this project Rahul! Kenneth Brotman From: Rahul Singh [mailto:rahul.xavier.si...@gmail.com] Sent: Monday, February 25, 2019 7:05 AM

RE: Group By Does Not Follow Clustering Order

2019-02-21 Thread Kenneth Brotman
the primary key should have a compound partition key of (project_id, policy_id, device_id). From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Thursday, February 21, 2019 3:38 PM To: user@cassandra.apache.org Subject: RE: Group By Does Not Follow Clustering Order Joseph

RE: Group By Does Not Follow Clustering Order

2019-02-21 Thread Kenneth Brotman
doing “policy_id=7331 and device_id=’1234567890’” and returning one (limit 1)? Kenneth Brotman From: Joseph Wonesh [mailto:joseph.won...@sticknfind.com] Sent: Thursday, February 21, 2019 10:39 AM To: user@cassandra.apache.org Subject: Re: Group By Does Not Follow Clustering Order Hi all

RE: How to read the Index.db file

2019-02-07 Thread Kenneth Brotman
When you say you’re trying to get all the partition of a particular SSTable, I’m not sure what you mean. Do you want to make a copy of it? I don’t understand. Kenneth Brotman From: Pranay akula [mailto:pranay.akula2...@gmail.com] Sent: Wednesday, February 06, 2019 7:51 PM To: user

RE: range repairs multiple dc

2019-02-07 Thread Kenneth Brotman
to prevent an incomplete repair from being performed.” Give it a read. Kenneth Brotman From: CPC [mailto:acha...@gmail.com] Sent: Wednesday, February 06, 2019 11:59 PM To: user@cassandra.apache.org Subject: range repairs multiple dc Hi All, I searched over documentation but could

Re: Bootstrap keeps failing

2019-02-07 Thread Kenneth Brotman
Lots of things come to mind. We need more information from you to help us understand: How long have you had your cluster running? Is it generally working ok? Is it just one node that is misbehaving at a time? How many nodes do you need to replace? Are you doing rolling restarts instead of

RE: range repairs multiple dc

2019-02-07 Thread Kenneth Brotman
This webpage has relevant information on procedures you need to use: https://docs.datastax.com/en/cassandra/3.0/cassandra/operations/opsAddDCToCluster.html From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Thursday, February 07, 2019 1:31 PM To: user@cassandra.apache.org

RE: Bootstrap keeps failing

2019-02-08 Thread Kenneth Brotman
failing On Thu, Feb 7, 2019 at 10:11 PM Kenneth Brotman wrote: Lots of things come to mind. We need more information from you to help us understand: How long have you had your cluster running? A bit more than a year old. But it has been constantly growing (3 nodes to 6 nodes to 12 nodes

RE: SASI queries- cqlsh vs java driver

2019-02-06 Thread Kenneth Brotman
Isn’t that a lot of SASI indexes for one table. Could you denormalize more to reduce both columns per table and SASI indexes per table? Eight SASI indexes on one table seems like a lot. Kenneth Brotman From: Peter Heitman [mailto:pe...@heitman.us] Sent: Tuesday, February 05, 2019 6:59

RE: How to read the Index.db file

2019-02-08 Thread Kenneth Brotman
This link https://www.datastax.com/dev/blog/debugging-sstables-in-3-0-with-sstabledump explains how to read an SSTable with sstabledump for 3x and sstable2json for 2.x Kenneth Brotman From: Ben Slater [mailto:ben.sla...@instaclustr.com] Sent: Thursday, February 07, 2019 1:19 PM

RE: Bootstrap stuck in JOINING state?

2019-02-18 Thread Kenneth Brotman
https://stackoverflow.com/questions/39823972/cassandra-node-cant-complete-jo ining-operation https://stackoverflow.com/questions/27251504/cassandra-2-1-2-node-stuck-on-j oining-the-cluster -Original Message- From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Monday

RE: Bootstrap stuck in JOINING state?

2019-02-18 Thread Kenneth Brotman
-node-stuck-on-j oining-the-cluster Kenneth Brotman -Original Message- From: Troels Arvin [mailto:tro...@arvin.dk] Sent: Monday, February 18, 2019 2:54 AM To: user@cassandra.apache.org Subject: Bootstrap stuck in JOINING state? Hello, Nine days ago, I bootstrapped an Cassandra node, let's

Ansible scripts for Cassandra to help with automation needs

2019-02-13 Thread Kenneth Brotman
for the community. Maybe we'll end up with a download right on the Apache Cassandra web site or packaged with future releases of Cassandra. Kenneth Brotman P.S. Terraform is next!

RE: Bootstrap keeps failing

2019-02-14 Thread Kenneth Brotman
Those aren’t the same error messages so I think progress has been made. What version of C* are you running? How did you clear out the space? Kenneth Brotman From: Léo FERLIN SUTTON [mailto:lfer...@mailjet.com.INVALID] Sent: Thursday, February 14, 2019 7:54 AM To: user

RE: Maximum memory usage

2019-02-10 Thread Kenneth Brotman
Can we the see “nodetool tablestats” for the biggest table as well. From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] Sent: Sunday, February 10, 2019 7:21 AM To: user@cassandra.apache.org Subject: RE: Maximum memory usage Okay, that’s at the moment it was calculated. Still need

RE: Maximum memory usage

2019-02-10 Thread Kenneth Brotman
Rahul, Those partitions are tiny. Could you give us the table histograms for the biggest tables. Thanks, Kenneth Brotman From: Rahul Reddy [mailto:rahulreddy1...@gmail.com] Sent: Sunday, February 10, 2019 6:43 AM To: user@cassandra.apache.org Subject: Re: Maximum memory usage

RE: Maximum memory usage

2019-02-10 Thread Kenneth Brotman
in our db On Sun, Feb 10, 2019, 9:55 AM Kenneth Brotman wrote: Rahul, Those partitions are tiny. Could you give us the table histograms for the biggest tables. Thanks, Kenneth Brotman From: Rahul Reddy [mailto:rahulreddy1...@gmail.com] Sent: Sunday, February 10, 2019 6:43 AM

RE: Cassandra vnodes Streaming Reliability Calculator

2019-02-16 Thread Kenneth Brotman
/cassandra_availability/whitepaper/cassandra-availability-virtual.pdf Are the calculations consistent with your online calculator? Thanks again, Kenneth Brotman From: James Briggs [mailto:james.bri...@yahoo.com.INVALID] Sent: Friday, February 15, 2019 7:42 PM To: user@cassandra.apache.org Subject

RE: Maximum memory usage

2019-02-06 Thread Kenneth Brotman
Can you give us the “nodetool tablehistograms” Kenneth Brotman From: Rahul Reddy [mailto:rahulreddy1...@gmail.com] Sent: Wednesday, February 06, 2019 6:19 AM To: user@cassandra.apache.org Subject: Maximum memory usage Hello, I see maximum memory usage alerts in my system.log

RE: SASI queries- cqlsh vs java driver

2019-02-06 Thread Kenneth Brotman
Exactly. When you design your data model correctly you shouldn’t have to use ALLOW FILTERING in the queries. That is not recommended. Kenneth Brotman From: Peter Heitman [mailto:pe...@heitman.us] Sent: Wednesday, February 06, 2019 6:09 PM To: user@cassandra.apache.org Subject: Re: SASI

RE: Two datacenters with one cassandra node in each datacenter

2019-02-06 Thread Kenneth Brotman
Hi Kunal, The short answer is absolutely not; that’s not what Cassandra is for. Cassandra is a distributed database for when you have to much data for one machine. Kenneth Brotman From: Kunal [mailto:kunal.v...@gmail.com] Sent: Wednesday, February 06, 2019 3:47 PM To: user

RE: SASI queries- cqlsh vs java driver

2019-02-06 Thread Kenneth Brotman
=bl=58bUYyNM-J=ACfU3U22U58-QPlz6kzo0zziNF-bP30l4Q=en=X=2ahUKEwi0n-nWzajgAhXnHzQIHf6jBJIQ6AEwAXoECAgQAQ#v=onepage=jeff%20carpenter%20chapter%205=false> . Kenneth Brotman From: Peter Heitman [mailto:pe...@heitman.us] Sent: Wednesday, February 06, 2019 6:33 PM To: user@cassandra.apache.org S

RE: Bootstrap keeps failing

2019-02-06 Thread Kenneth Brotman
Not sure off hand why that is happening but could you try bootstrapping that node from scratch again or try a different new node? Kenneth Brotman From: Léo FERLIN SUTTON [mailto:lfer...@mailjet.com.INVALID] Sent: Wednesday, February 06, 2019 9:15 AM To: user@cassandra.apache.org Subject

RE: SASI queries- cqlsh vs java driver

2019-02-07 Thread Kenneth Brotman
before we decided to move to Cassandra On Thu, Feb 7, 2019, 8:21 AM Kenneth Brotman wrote: The problem is you’re not using a query first design. I would recommend first reading chapter 5 of Cassandra: The Definitive Guide by Jeff Carpenter and Eben Hewitt. It’s available free online at

RE: tombstones threshold warning

2019-02-19 Thread Kenneth Brotman
that in the last email too not CASSANDRA-8527. But it shouldn’t be this since you are on 3.11.3. I think number three above answers your questions based on your original post. See the article for the details. It’s really good. Kenneth Brotman From: Kenneth Brotman [mailto:kenbrot

RE: tombstones threshold warning

2019-02-19 Thread Kenneth Brotman
Undetectable tombstones in Apache Cassandra: http://thelastpickle.com/blog/2018/07/05/undetectable-tombstones-in-apache-cassandra.html . I thought that was resolved in 3.11.2 by CASSANDRA-8527; and you are running 3.11.3! Is there still an outstanding issue? Kenneth Brotman From: Ayub

RE: Looking for feedback on automated root-cause system

2019-02-19 Thread Kenneth Brotman
Any information you can share on the inputs it needs/uses would be helpful. Kenneth Brotman From: daemeon reiydelle [mailto:daeme...@gmail.com] Sent: Tuesday, February 19, 2019 4:27 PM To: user Subject: Re: Looking for feedback on automated root-cause system Welcome to the world

RE: Unable to track compaction completion

2019-02-19 Thread Kenneth Brotman
Hi Rajsekhar, I think monitoring the CompactionManagerMBean is what you need. Kenneth Brotman From: Rajsekhar Mallick [mailto:raj.mallic...@gmail.com] Sent: Friday, February 15, 2019 8:59 AM To: user@cassandra.apache.org Subject: Unable to track compaction completion Hello team

RE: Help with sudden spike in read requests

2019-02-01 Thread Kenneth Brotman
If you had a query that went across the partitions and especially if you had vNodes set high, that would do it. Kenneth Brotman From: Subroto Barua [mailto:sbarua...@yahoo.com.INVALID] Sent: Friday, February 01, 2019 8:45 AM To: User cassandra.apache.org Subject: Help with sudden spike

RE: Help with sudden spike in read requests

2019-02-01 Thread Kenneth Brotman
for monitoring and how did you find out it was happening? Is this a DSE cluster or OSS Cassandra cluster? Kenneth Brotman From: Subroto Barua [mailto:sbarua...@yahoo.com.INVALID] Sent: Friday, February 01, 2019 10:48 AM To: user@cassandra.apache.org Subject: Re: Help with sudden spike in read

RE: Help with sudden spike in read requests

2019-02-01 Thread Kenneth Brotman
Do you have that many queries? You could just review them and your data model to see if there was an error of some kind. How long has it been happening? What changed since it started happening? Kenneth Brotman From: Subroto Barua [mailto:sbarua...@yahoo.com.INVALID] Sent: Friday

<    1   2