Re: [DISCUSS] Adding experimental vtables and rules around them

2024-05-29 Thread Abe Ratnofsky
I agree that ClientWarning is the best way to indicate the risk of using an experimental feature directly to the user. Presenting information in the client application's logs directly means that the person who wrote the query is most likely to see the warning, rather than an operator who sees

Re: [DISCUSS] ccm as a subproject

2024-05-15 Thread Abe Ratnofsky
Strong supporter for bringing ccm into the project as well. ccm is necessary test infrastructure for multiple subprojects, and Cassandra committers should be able to make the changes to ccm that are necessary for their patches. There's also the security angle: we should work to consolidate our

Re: Welcome Alexandre Dutra, Andrew Tolbert, Bret McGuire, Olivier Michallat as Cassandra Committers

2024-04-17 Thread Abe Ratnofsky
Congrats everyone! > On Apr 17, 2024, at 1:10 PM, Benjamin Lerer wrote: > > The Apache Cassandra PMC is pleased to announce that Alexandre Dutra, Andrew > Tolbert, Bret McGuire and Olivier Michallat have accepted the invitation to > become committers on the java driver sub-project. > >

Cassandra Code Coverage Reports

2024-04-11 Thread Abe Ratnofsky
Hey folks, Recently I put together per-suite and consolidated code coverage reports in advance of our upcoming releases. I’ve uploaded them to a static site on GitHub Pages so you can view them without downloading anything: https://aber.io/cassandra-coverage-reports Disclaimers: This is just

Re: [DISCUSS] Modeling JIRA fix version for subprojects

2024-04-04 Thread Abe Ratnofsky
CEP-8 proposes using separate Jira projects per Cassandra sub-project: https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-8%3A+DataStax+Drivers+Donation > We suggest distinct Jira projects, one per driver, all to be created. I don't see any discussion changing that from the [DISCUSS] or

Re: [DISCUSS] Fixing coverage reports for jvm-dtest-upgrade

2024-03-19 Thread Abe Ratnofsky
sad; in >> general this seems like it'd be a big help to debugging startup / env >> issues, assuming it doesn't break anything. :) >> >> On Fri, Mar 15, 2024, at 4:41 PM, Abe Ratnofsky wrote: >>> Hey folks, >>> >>> I'm working on gathering covera

[DISCUSS] Fixing coverage reports for jvm-dtest-upgrade

2024-03-15 Thread Abe Ratnofsky
Hey folks, I'm working on gathering coverage data across all of our test suites. The jvm-dtest-upgrade suite is currently unfriendly to Jacoco: it uses classes from multiple versions of Cassandra but with the same class names, so Jacoco's analysis fails due to "Can't add different class with

Re: [Discuss] Introducing Flexible Authentication in Cassandra via Feature Flag

2024-02-12 Thread Abe Ratnofsky
Hey Guarav, Thanks for your proposal. > disruptive, full-cluster restart, posing significant risks in live > environments For configuration that isn't hot-reloadable, like providing a new IAuthenticator implementation, a rolling restart is required. But rolling restarts are zero-downtime and

Re: [Discuss] CASSANDRA-16999 introduction of a column in system.peers_v2

2024-02-08 Thread Abe Ratnofsky
> Deprecating helps nothing for existing releases. We can’t/shouldn’t remove > the feature in existing releases. The deprecation I'm proposing is intended to push people to configure their servers in a way that is more secure and maximizes compatibility with clients. Deprecating can help for

Re: [Discuss] CASSANDRA-16999 introduction of a column in system.peers_v2

2024-02-07 Thread Abe Ratnofsky
> For existing versions what about having a “default ssl” or “default no SSL” > yaml setting which decides what port is advertised? Then someone could still > connect on the other port manually specifying. Then new column can be added > with the new table in trunk. I'm assuming

Re: [Discuss] CASSANDRA-16999 introduction of a column in system.peers_v2

2024-02-07 Thread Abe Ratnofsky
CASSANDRA-9590 (Support for both encrypted and unencrypted native transport connections) was implemented before CASSANDRA-10559 (Support encrypted and plain traffic on the same port), but both been available since 3.0. On 9590, STARTTLS was considered, but rejected due to the changes that would

Re: [Discuss] CASSANDRA-16999 introduction of a column in system.peers_v2

2024-02-07 Thread Abe Ratnofsky
What is the audience for dual-native-port operation? My understanding is that most users can use a single port for optional SSL, ever since CASSANDRA-10559 . Using a single port for both encrypted and unencrypted traffic also makes clients

Re: CASSANDRA-19268: Improve Cassandra compression performance using hardware accelerators

2024-01-22 Thread Abe Ratnofsky
Hardware acceleration for more things would be great, especially based on the success of ACCP (CASSANDRA-18624 ). But I think it would be ideal to use existing compressor names and use hardware acceleration if a given JAR is present on the

Re: Welcome Maxim Muzafarov as Cassandra Committer

2024-01-08 Thread Abe Ratnofsky
Congrats Maxim! > On Jan 8, 2024, at 1:28 PM, Ekaterina Dimitrova wrote: > > Congrats, Maxim! Well deserved! Thank you for everything! > > On Mon, 8 Jan 2024 at 13:26, Jeremiah Jordan > wrote: >> Congrats Maxim! Thanks for all of your contributions! >> >>

Re: [DISCUSSION] CEP-38: CQL Management API

2023-12-05 Thread Abe Ratnofsky
Adding to Hari's comments: > Any changes expected at client/driver side? While using JMX/nodetool, it is > clear that the command/operations are getting executed against which > Cassandra node. But a client can connect to multiple hosts and trigger > queries, then how can it ensure that

[DISCUSS] CASSANDRA-19113: Publishing dtest-shaded JARs on release

2023-11-28 Thread Abe Ratnofsky
Hey folks - wanted to raise a separate thread to discuss publishing of dtest-shaded JARs on release. Currently, adjacent projects that want to use the jvm-dtest framework need to build the shaded JARs themselves. This is a decent amount of work, and is duplicated across each project. This is

Re: Welcome Francisco Guerrero Hernandez as Cassandra Committer

2023-11-28 Thread Abe Ratnofsky
Congrats Francisco! > On Nov 28, 2023, at 1:56 PM, C. Scott Andreas wrote: > > Congratulations, Francisco! > > - Scott > >> On Nov 28, 2023, at 10:53 AM, Dinesh Joshi wrote: >> >> The PMC members are pleased to announce that Francisco Guerrero Hernandez >> has accepted >> the invitation

Re: [DISCUSS] Harry in-tree

2023-11-28 Thread Abe Ratnofsky
Another strong +1 to have Harry in-tree, and another +1 to building shaded dtest JARs on release. There are a number of projects that would benefit from having these JARs available in a central repository, like Sidecar, Driver, etc. I didn't see a ticket so created one:

Re: Development Dependencies documentation.

2023-11-01 Thread Abe Ratnofsky
Following back up here - patch has been updated and is ready for review: https://github.com/apache/cassandra-website/pull/170 > On Oct 25, 2023, at 8:07 AM, Ekaterina Dimitrova > wrote: > > Hi Claude, > You are not wrong. Unfortunately, it is outdated. Abe Ratnofsky has a work

Re: [DISCUSSION] Dependency management in our first alpha release

2023-08-23 Thread Abe Ratnofsky
> I also want to hear if Abe still has concerns about not following deprecation > process here. I support removing the library on an expedited schedule, rather than waiting for a full major of deprecation. We still have a large surface for metrics integrations, and users who depended on

Re: [DISCUSSION] CASSANDRA-18772 - removal of commons-codec on trunk

2023-08-17 Thread Abe Ratnofsky
If we're going to do bulk dependency pruning, we should minimize the number of deprecation plans that users need to prepare for. There will likely be a few more dependencies we clean up around 5.0, so sticking with 5.0 deprecation and 6.0 removal for all of them would likely make our users'

Re: [DISCUSS] CASSANDRA-18743 Deprecation of metrics-reporter-config

2023-08-16 Thread Abe Ratnofsky
r this proposed deprecation is that the upcoming 5.0 >>>> release is a good time to evaluate dependencies that are no longer >>>> receiving updates and will become risks in the future.” >>>> >>>> Thank you for raising it, I support your proposal

[DISCUSS] CASSANDRA-18743 Deprecation of metrics-reporter-config

2023-08-11 Thread Abe Ratnofsky
Hey folks, Opening a thread to get input on a proposed dependency deprecation in 5.0: metrics-reporter-config has been archived for 3 years and not updated in nearly 6 years. This project has a minor security issue with its usage of unsafe YAML loading via snakeyaml’s unprotected Constructor:

Re: [Discuss] ​​CEP-35: Add PIP support for CQLSH

2023-08-09 Thread Abe Ratnofsky
I think it would be good for the project to have an official PyPI distribution, and the signal from users (40K downloads per month) is a clear indication that this is useful. Timely releases would help us get future improvements to cqlsh out faster, and moving this to an official distribution

Re: [VOTE] CEP-34: mTLS based client and internode authenticators

2023-07-21 Thread Abe Ratnofsky
+1 (nb) > On Jul 21, 2023, at 3:03 PM, Jon Meredith wrote: > > +1 > > On Fri, Jul 21, 2023 at 2:33 PM Blake Eggleston > wrote: >> +1 >> >>> On Jul 21, 2023, at 9:57 AM, Jyothsna Konisa >> > wrote: >>> >>> Hi Everyone! >>> >>> I

Re: [DISCUSS] Using ACCP or tc-native by default

2023-07-20 Thread Abe Ratnofsky
This feels analogous to other past discussions around prioritizing a config that enables new users to clone + build + run as easily as possible, vs. having better prod recommendations out of the box. Both are important. I personally think we should default configuration to make it just work

Re: [VOTE] CEP 33 - CIDR filtering authorizer

2023-06-28 Thread Abe Ratnofsky
+1 (nb)On Jun 28, 2023, at 18:38, guo Maxwell wrote:+1 Nate McCall 于2023年6月29日 周四上午9:25写道:+1 On Wed, Jun 28, 2023 at 5:17 AM Shailaja Koppu wrote:Hi Team,(Starting a new thread for VOTE instead of reusing the DISCUSS thread, to follow usual

Re: [VOTE] CEP-8 Datastax Drivers Donation

2023-06-13 Thread Abe Ratnofsky
+1 (nb)On Jun 13, 2023, at 09:23, Andrés de la Peña wrote:+1On Tue, 13 Jun 2023 at 16:40, Yifan Cai wrote: +1 From: David Capwell Sent: Tuesday, June 13, 2023 8:37:10 AM To: dev Subject: Re: [VOTE] CEP-8 Datastax

Re: [DISCUSS] CEP-8 Drivers Donation - take 2

2023-05-26 Thread Abe Ratnofsky
Sharing the same sentiment. Thank you for all your efforts on getting this ready to contribute! > On May 26, 2023, at 9:59 AM, Francisco Guerrero wrote: > > I second Dinesh's sentiment. I'm looking forward to this contribution. > > On 2023/05/26 16:29:12 Dinesh Joshi wrote: >> This is

Re: [DISCUSS] Bring cassandra-harry in tree as a submodule

2023-05-25 Thread Abe Ratnofsky
is my major concern. >>>>>>>>>> >>>>>>>>>> What prompted this thread was harry being external to the core >>>>>>>>>> codebase and the lack of adoption and usage of it having led to >>>>>&g

Re: [DISCUSS] Bring cassandra-harry in tree as a submodule

2023-05-16 Thread Abe Ratnofsky
Just to make sure I'm understanding the details, this would mean apache/cassandra-harry maintains its status as a separate repository, apache/cassandra references it as a submodule, and clones and builds Harry locally, rather than pulling a released JAR. We can then reference Harry as a

Re: [DISCUSS] Introduce DATABASE as an alternative to KEYSPACE

2023-04-04 Thread Abe Ratnofsky
I agree with Bowen - I find Keyspace easier to communicate with. There are plenty of situations where the use of "database" is ambiguous (like "Could you help me connect to database x?"), but Keyspace refers to a single thing. I think more software is moving towards calling these things

Re: [DISCUSS] Enhanced Disk Error Handling

2023-03-09 Thread Abe Ratnofsky
mediately obvious "Correct" answer to where that point is regardless of > what mechanism we're using to hold a cluster-wide view of topology. > >> ...CEP-21 makes this sequencing safe... > For sure - I wouldn't advocate for any kind of "automated corrupt data > repair

Re: [DISCUSS] Enhanced Disk Error Handling

2023-03-09 Thread Abe Ratnofsky
y replicas with a mechanism to kick off a repair of those ranges > could be interesting. > > On Thu, Mar 9, 2023, at 1:45 PM, Abe Ratnofsky wrote: >> Thanks for proposing this discussion Bowen. I see a few different issues >> here: >> >> 1. How do we safely h

Re: [DISCUSS] Enhanced Disk Error Handling

2023-03-09 Thread Abe Ratnofsky
Thanks for proposing this discussion Bowen. I see a few different issues here: 1. How do we safely handle corruption of a handful of tokens without taking an entire instance offline for re-bootstrap? This includes refusal to serve read requests for the corrupted token(s), and correct repair of

Re: Downgradability

2023-02-21 Thread Abe Ratnofsky
Some interesting existing work on this subject is "Understanding and Detecting Software Upgrade Failures in Distributed Systems" - https://dl.acm.org/doi/10.1145/3477132.3483577, also summarized by Andrey Satarin here:

[DISCUSS] CEP-22: Drivers Donation Status

2023-01-12 Thread Abe Ratnofsky
What's the current status of CEP-22? It looks like the CEP draft on Confluence [1] hasn't been updated since Aug 2022 and mailing list search [2] shows no results, so it never made it to a vote. -- Abe [1]:

Re: [VOTE] Release Apache Cassandra 4.1.0 (take2)

2022-12-12 Thread Abe Ratnofsky
he repro). And I’d >> personally be a bit surprised if table count matters that much. >> >> It probably just requires high core count and enough data that the streams >> actually interact with the rate limiter >> >>> On Dec 11, 2022, at 10:32 AM, Mick

Re: [VOTE] Release Apache Cassandra 4.1.0 (take2)

2022-12-10 Thread Abe Ratnofsky
Sorry - responded on the take1 thread: Could we defer the close of this vote til Monday, December 12th after 6pm Pacific Time? Jon Meredith and I have been working thru an issue blocking streaming on 4.1 for the last couple months, and are now testing a promising fix. We're currently working

Re: [VOTE] Release Apache Cassandra 4.1.0 GA

2022-12-10 Thread Abe Ratnofsky
Could we defer the close of this vote til Monday, December 12th after 6pm Pacific Time? Jon Meredith and I have been working thru an issue blocking streaming on 4.1 for the last couple months, and are now testing a promising fix. We're currently working on a write-up, and we'd like to hold the

Re: Using bash instead of sh in generate.sh?

2022-11-01 Thread Abe Ratnofsky
I took a look through our scripts, and Bash is used in a handful of development tools. /bin/sh is used by everything under bin/ and tools/bin. I wouldn’t want to change a user-facing dependency unless there’s a solid reason, but I think it’s fine for CircleCI tooling to use Bash instead of

Re: [DISCUSS] CEP-23: Enhancement for Sparse Data Serialization

2022-09-05 Thread Abe Ratnofsky
Looking at this link: https://cwiki.apache.org/confluence/display/CASSANDRA/CEP-23%3A++Enhancement+for+Sparse+Data+Serialization Do you have any plans to include benchmarks in your test plan? It would be useful to include disk usage / read performance / write performance comparisons with the

Re: [DISCUSS] CASSANDRA-17750: Security migration away from Maven Ant Tasks

2022-07-20 Thread Abe Ratnofsky
Most of the discussion has happened in the PR: https://github.com/apache/cassandra/pull/1725 Leaving this thread open over the weekend to gather input. > On Jul 20, 2022, at 10:40 AM, emmanuel warreng > wrote: > > Unsubscribe > > On Tue, Jul 19, 2022, 21:20 Abe Ra

[DISCUSS] CASSANDRA-17750: Security migration away from Maven Ant Tasks

2022-07-19 Thread Abe Ratnofsky
Hello all, We currently depend on Maven Ant Tasks (MAT) during build, for declaring dependencies and generating POM files from within build.xml. MAT has long been retired (no commits since maintenance in 2015), has registered CVEs in its dependencies (CVE-2017-1000487), and encourages

Re: CEP-15 multi key transaction syntax

2022-06-30 Thread Abe Ratnofsky
The new syntax looks great, and I’m really excited to see this coming together. One piece of feedback on the proposed syntax is around the use of “=“ as a declaration in addition to its current use as an equality operator in a WHERE clause and an assignment operator in an UPDATE: BEGIN

Re: [DISCUSS] CASSANDRA-17024: Artificial Latency Injection

2021-11-19 Thread Abe Ratnofsky
I like the idea of adding this to the CQL Grammar, but would like to see it follow the ReplicationStrategy style of defining a map with a class and parameters. For example, something like this (names I’m not tied to): SELECT * FROM table WHERE pk = x WITH ARTIFICIAL LATENCY = { 'class':