Re: How to register cassandra custom codecs in spark? (https://github.com/datastax/spark-cassandra-connector/issues/1173)

2018-04-14 Thread Dinesh Joshi
Hi Revanth, How do you register the custom codec? Do you get any errors? Have you tried using a pre-existing codec? It would be helpful if you can give more information. DineshOn Saturday, April 14, 2018, 7:29:30 PM PDT, Revanth Reddy wrote: Hi Team , I want to write a custom cassand

Re: How to register cassandra custom codecs in spark? (https://github.com/datastax/spark-cassandra-connector/issues/1173)

2018-04-15 Thread Dinesh Joshi
tReddy/ http://34.230.100.5:8080/crazyusers/login                                                                                                  On Sun, Apr 15, 2018 at 11:36 AM, Dinesh Joshi wrote: Hi Revanth, How do you register the custom codec? Do you get any errors? Have you tried using a pre-existing codec? It would be

Re: bigger data density with Cassandra 4.0?

2018-08-27 Thread Dinesh Joshi
Although the extent of benefits depend on the specific use case, the cluster size is definitely not a limiting factor. Dinesh > On Aug 27, 2018, at 5:05 AM, kurt greaves wrote: > > I believe there are caveats that it will only really help if you're not using > vnodes, or you have a very small

Re: Using CDC Feature to Stream C* to Kafka (Design Proposal)

2018-09-10 Thread Dinesh Joshi
> On Sep 9, 2018, at 6:08 AM, Jonathan Haddad > wrote: > > There may be some use cases for it.. but I'm not sure what they are. It > might help if you shared the use cases where the extra complexity is > required? When does writing to Cassandra which then dedupes an

Re: nodetool rebuild

2018-09-16 Thread Dinesh Joshi
It would be helpful to describe your setup - specifically are you using vnodes? How is the keyspace setup? One option would be to copy SSTables from the replicas and running clean up. That might actually be faster. Since the SSTables are compressed you should use a tool that copies without compr

Re: [ANNOUNCE] StratIO's Lucene plugin fork

2018-10-30 Thread Dinesh Joshi
Pretty cool! Dinesh > On Oct 30, 2018, at 6:31 PM, Jonathan Haddad wrote: > > Very cool Ben, thanks for sharing! > >> On Tue, Oct 30, 2018 at 6:14 PM Ben Slater >> wrote: >> For anyone who is interested, we’ve published a blog with some more >> background on this and some more detail of o

Re:

2019-01-13 Thread Dinesh Joshi
You're sending the unsubscribe request to the wrong email alias. Please send email to user-unsubscr...@cassandra.apache.org Dinesh > On Jan 13, 2019, at 9:12 AM, Irtiza Ali wrote: > > Unsubscribe > > On Sun, 13 Jan 2019, 22:11 Osman YOZGATLIOĞL

Re: Disable Truststore CA check for internode_encryption

2019-02-27 Thread Dinesh Joshi
> On Feb 27, 2019, at 4:20 PM, Jai Bheemsen Rao Dhanwada > wrote: > > I am trying to setup 1-way SSL, basically I am trying to use the SSL options > only for the encrypt the data on the wire and trust everyone who is > connecting to me. > It *might* be possible with a custom truststore but t

Re: 3PP: C++14/17 standard support

2019-03-29 Thread Dinesh Joshi
The driver is actually maintained by DataStax and not the Cassandra community. Please look at the documentation here - https://github.com/datastax/cpp-driver Hopefully someone from their driver team can confirm. Dinesh > On Mar 29, 2019, at 2:54 AM, Dee

Re: Caused by: com.datastax.driver.core.exceptions.ReadTimeoutException:

2019-04-16 Thread Dinesh Joshi
More info with detailed explanation: https://www.instaclustr.com/apache-cassandra-scalability-allow-filtering-partition-keys/ Dinesh > On Apr 16, 2019, at 11:24 PM, Mahesh Daksha wrote: > > Hi, > > how much data you are trying to read in the single query? is it large in size > or normal tex

Re: ApacheCon Europe 2019

2019-05-13 Thread Dinesh Joshi
Hi Anuj, I don't think there are any plans to have a Cassandra track at AC EU. I encourage you to submit to it regardless. Thanks, Dinesh > On May 13, 2019, at 10:06 AM, Anuj Wadehra > wrote: > > Hi, > > Do we have any plans for dedicated Apache Cassandra track or sessions at > ApacheCon

Re: RMI TCP Connection threads

2019-07-28 Thread Dinesh Joshi
Try obtaining a thread dump. It will help debug. Anything that goes via JMX such as nodetool could be responsible for it. Dinesh > On Jul 28, 2019, at 10:57 PM, Vlad > wrote: > > Hi, > > suddenly I noticed that one of three nodes started consume CPU in RMI

Re: Repairs/compactions on tables with solr indexes

2019-08-08 Thread Dinesh Joshi
Hi Ayub, DSE is a DataStax product and this is the Apache Cassandra mailing list. Could you reach out to DataStax? Dinesh > On Aug 7, 2019, at 11:17 PM, Ayub M wrote: > > Hello, we are using DSE Search workload with Search and Cass running on same > nodes/jvm. > > 1. When repairs are run,

Re: overhead of empty tables

2018-02-15 Thread Dinesh Joshi
Each table in a keyspace is stored as a separate directory in the data directory. If you many tables you'll have a lot of files. Some file systems have issues dealing with a lot of files in a single directory. Other than that, there will likely be some book keeping overhead within the Cassandra

Re: Fast Writes to Cassandra Failing Through Python Script

2018-03-13 Thread Dinesh Joshi
What does your schema look like? Are you seeing any warnings or errors in the server log? Dinesh On Tuesday, March 13, 2018, 3:43:33 PM PDT, Faraz Mateen wrote: Hi everyone, I seem to have hit a problem in which writing to cassandra through a python script fails and also occasionally

Re: RE: What versions should the documentation support now?

2018-03-13 Thread Dinesh Joshi
Kenneth, The only 4.x docs should go in trunk. If you would like to contribute docs to the 2.x and/or 3.x releases, please make pull requests against branches for those versions. During normal development process, the docs should be updated in trunk. When a release is cut from trunk, any further

Re: RE: RE: What versions should the documentation support now?

2018-03-13 Thread Dinesh Joshi
34821 .yiv3841634821MsoChpDefault {font-size:10.0pt;} _filtered #yiv3841634821 {margin:1.0in 1.0in 1.0in 1.0in;}#yiv3841634821 div.yiv3841634821WordSection1 {}#yiv3841634821 I show a 3.0 and a 3.11 branch but no 4.0.  I’m at https://github.com/apache/cassandra .         From: Dinesh Joshi [mailto:dine

Re: 4.0 best feature/fix?

2021-05-07 Thread Dinesh Joshi
Those of y’all who have difficulty with Java 11, have you asked about it on the mailing list or filed a Jira? Dinesh > On May 7, 2021, at 8:14 AM, Joe Obernberger > wrote: > >  > I can retry Java 11. > > I am seeing this error a lot - still debugging, but I'll throw it out there - > using

Re: Does Open-Source Cassandra 4 support mutual-TLS ?

2021-09-21 Thread Dinesh Joshi
It sort of supports it. You still need to send in the username/password credentials along with the client certificate to authenticate. Cassandra will not derive the identity purely from the client certificate. Dinesh > On Sep 21, 2021, at 11:59 AM, S G wrote: > > Hello, > > Does anyone know

Re: Does Open-Source Cassandra 4 support mutual-TLS ?

2021-09-22 Thread Dinesh Joshi
d give you what you're looking for. If you'd like, you can go as far as ignoring the username/password passed down from the cilent and only rely on the identity encoded in the certificate as your source of truth. Dinesh > > On 21/09/2021 23:16, Dinesh Joshi wrote: >> It s

Re: Does Open-Source Cassandra 4 support mutual-TLS ?

2021-09-22 Thread Dinesh Joshi
Yes, that is one way of deriving an identity. The other "standard" mechanism is to use spiffe ids[1] to encode an identity and to derive your username/principal from it. Dinesh [1] https://github.com/spiffe/spiffe/blob/main/standards/X509-SVID.md#2-spiffe-id > On 22/09/2021 15:40, Din

Re: Incremental repairs getting stuck a lot

2021-11-26 Thread Dinesh Joshi
Could you file a jira with the details? Dinesh > On Nov 26, 2021, at 2:40 PM, James Brown wrote: > >  > We're on 4.0.1 and switched to incremental repairs a couple of months ago. > They work fine about 95% of the time, but once in a while a session will get > stuck and will have to be cancel

Re: TLS/SSL overhead

2022-02-06 Thread Dinesh Joshi
I wish there was an easy answer to this question. Like you pointed out it is hardware dependent but software stack plays a big part. For instance, the JVM you're running makes a difference too. Cassandra comes with netty and IIRC we include tcnative which accelerates TLS. You could also slip Ama

Re: sstables changing in snapshots

2022-03-18 Thread Dinesh Joshi
Do you have a repro that you can share with us? If so, please file a jira and we'll take a look. > On Mar 18, 2022, at 12:15 PM, James Brown wrote: > > This in 4.0.3 after running nodetool snapshot that we're seeing sstables > change, yes. > > James Brown > Infrastructure Architect @ easypost

Re: sstables changing in snapshots

2022-03-22 Thread Dinesh Joshi
pshotting >>> >>> - Yifan >>> >>> On Tue, Mar 22, 2022 at 9:41 AM Paul Chandler wrote: >>> Hi all, >>> >>> Was there any further progress made on this? Did a Jira get created? >>> >>> I have been debugging our backu

Re: Apache Cassandra Marketing Meeting

2022-04-29 Thread Dinesh Joshi
This sounds great. Thanks for taking time to do this! Please post back notes of the meeting on the dev list so those who couldn't attend are in the loop. > On Apr 29, 2022, at 3:16 PM, Patrick McFadin wrote: > > Hi everyone, > > There are several community members working on various marketing

Re: Bootstrap data streaming order

2022-09-09 Thread Dinesh Joshi
The data is requested asynchronously from peers. There is some logic to select the peers however there isn’t a set order for data delivery. Why do you ask? > > On Sep 8, 2022, at 11:35 PM, Marc Hoppins wrote: > > Hulloa all, > > Can anyone shed light on the order which nodes will deliver dat

Re: Using zstd compression on Cassandra 3.x

2022-09-12 Thread Dinesh Joshi
Is there something preventing you from upgrading to 4.0? It is backward compatible with 3.0 so clients don’t need to change. If you don’t want to absolutely upgrade you can extract the implementation from 4.0 and use it. I would advise against this path though as zstd implementation is nuanced.

Re: Help determining pending compactions

2022-10-30 Thread Dinesh Joshi
It would be helpful if you could tell us what version of Cassandra you’re using? Dinesh > On Oct 30, 2022, at 10:07 AM, Richard Hesse wrote: > >  > Hi, I'm hoping to get some help with a vexing issue with one of our > keyspaces. During Reaper repair sessions, one keyspace will end up with >

Re: Reactive DSE Java Driver seeing high response times from Cassandra

2023-06-02 Thread Dinesh Joshi
Hi Shaurya, I'm sorry but we don't maintain the DSE driver. Dinesh > On Jun 2, 2023, at 1:07 PM, Shaurya Gupta wrote: > > Hi > > We are seeing high response times on the application side from the Java > Reactive DSE driver. > Cassandra server side metrics show response times of 2 ms but the

Re: Big Data Question

2023-08-21 Thread Dinesh Joshi
Minor correction, zero copy streaming aka faster streaming also works for STCS.DineshOn Aug 21, 2023, at 8:01 AM, Jeff Jirsa wrote:There's a lot of questionable advice scattered in this thread. Set aside most of the guidance like 2TB/node, it's old and super nuanced.If you're bare metal, do what

Re: ssl certificate hot reloading test - cassandra 4.1

2024-04-15 Thread Dinesh Joshi
In addition to what Andy mentioned, I want to point out that for the vast majority of use-cases, we would like to _avoid_ interruptions when a certificate is updated so it is by design. If you're dealing with a situation where you want to ensure that the connections are cycled, you can follow Andy'

Re: Implement details of Protocol v5 framing

2024-08-14 Thread Dinesh Joshi
Hi Vincent, This is the Cassandra user's mailing list. You can engage the Cassandra developers on d...@cassandra.apache.org mailing list. I have bcc'd the user list and added the dev list. To answer your question, the spec may have drifted and may require a fix. Please feel free to raise a jira a