Re: CDC usability and future development

2018-01-30 Thread Jeff Jirsa
Here's a deck of some proposed additions, discussed at one of the NGCC sessions last fall: https://github.com/ngcc/ngcc2017/blob/master/CassandraDataIngestion.pdf On Tue, Jan 30, 2018 at 5:10 PM, Andrew Prudhomme wrote: > Hi all, > > We are currently designing a system that

Re: URGENT: CASSANDRA-14092 causes Data Loss

2018-01-25 Thread Jeff Jirsa
, and voting window is 72 hours for members to review and approve or reject the candidate). -- Jeff Jirsa > On Jan 25, 2018, at 9:07 PM, Jeff Jirsa <jji...@gmail.com> wrote: > > Patches welcome. > > -- > Jeff Jirsa > > >> On Jan 25, 2018, at 8:15 PM, Anuj Wad

Re: URGENT: CASSANDRA-14092 causes Data Loss

2018-01-25 Thread Jeff Jirsa
Patches welcome. -- Jeff Jirsa > On Jan 25, 2018, at 8:15 PM, Anuj Wadehra <anujw_2...@yahoo.co.in.INVALID> > wrote: > > Hi Paulo, > > Thanks for looking into the issue on priority. I have serious concerns > regarding reducing the TTL to 15 yrs.The patch

Re: Getting partition min/max timestamp

2018-01-13 Thread Jeff Jirsa
time stamp column with an explicit “using timestamp” timestamp = 2^31-NOW, so that future writes won’t overwrite those values. That gives you a first write win behavior for that column, which gives you an effective min timestamp for the partition as a whole. -- Jeff Jirsa > On Jan 13, 2

Re: Question on submitting a patch

2018-01-05 Thread Jeff Jirsa
On Fri, Jan 5, 2018 at 12:44 PM, Tyagi, Preetika wrote: > Hi all, > > When I click on "Submit Patch" option, it pops up a new screen where it > asks for a bunch of details including Fix Version(s). IF you know it, the 'Fix Version' should be set to the branches the

Cassandra 2017 Wrapup

2017-12-22 Thread Jeff Jirsa
Happy holidays all, I imagine most people are about to disappear to celebrate holidays, so I wanted to try to summarize the state of Cassandra dev for 2017, as I see it. Standard disclaimers apply (this is my personal opinion, not that of my employer, not officially endorsed by the Apache

Re: CASSANDRA-8527

2017-12-21 Thread Jeff Jirsa
On Thu, Dec 21, 2017 at 12:33 PM, Qingcun Zhou wrote: > I brought up Mockito topic couple of months ago but some committers don't > think we should introduce more dependencies. > > I don't see any indication of this in the dev@ archives. There was a comment from a

Re: CASSANDRA-8527

2017-12-21 Thread Jeff Jirsa
On Tue, Dec 19, 2017 at 11:07 PM, Alexander Dejanovski < a...@thelastpickle.com> wrote: > Hi folks, > > I'm working on CASSANDRA-8527 > and would need to > discuss a few things. > > The ticket makes it visible in tracing and metrics that rows

Re: Proposal: github pull requests for all code changes

2017-12-20 Thread Jeff Jirsa
Inline -- Jeff Jirsa > On Dec 20, 2017, at 8:38 PM, kurt greaves <k...@instaclustr.com> wrote: > > It would definitely be nice if PR's were made against the actual repo. > Makes commenting/reviewing code a lot easier. I'd say as long as PR's are > kept permanently (aft

Re: duration based config settings

2017-12-04 Thread Jeff Jirsa
To be clear I’m not -1 on this, I just hope we think about upgrading users as we deprecate the old stuff out -- Jeff Jirsa > On Dec 4, 2017, at 4:24 PM, Jon Haddad <j...@jonhaddad.com> wrote: > > I ways back I had entire CASSANDRA-13976 out of sheer annoyance to change t

November Cassandra Dev Wrapup

2017-11-30 Thread Jeff Jirsa
Here's some stuff that happened in the past month in the Cassandra world: People first - The following developers had their first ever commit in the project since the last time I sent this email: Sergey Lapukhov Jordan Vaughan Michał Szczygieł (x2) Malcolm Taylor Varun Gupta Hashrajsinh Thakor

Re: Broken link in Cassandra homepage

2017-11-21 Thread Jeff Jirsa
a normal code update, and any committer can apply it. https://svn.apache.org/repos/asf/cassandra/site/ So as is the case with the rest of the project: patches welcome. -- Jeff Jirsa > On Nov 21, 2017, at 5:10 AM, Mahdi Mohammadi <mah...@gmail.com> wrote: > > Hello, > &

Re: custom validation before replication

2017-11-16 Thread Jeff Jirsa
What you're wanting really isn't supported/available, but you could probably extend cassandra to do this with some work. Doing this at replication time is the wrong point, though - you want to do it before the mutation is applied locally, so triggers are still the closest to the right point as

Re: custom validation before replication

2017-11-16 Thread Jeff Jirsa
Going to hate myself for this, but check out the trigger interface. https://github.com/apache/cassandra/blob/cassandra-3.0/src/java/org/apache/cassandra/triggers/ITrigger.java Pay attention to the note that says the API is in beta and subject to change. It's had that note for many years, which

Re: Possibly cassandra 3.0.9 bug?

2017-11-16 Thread Jeff Jirsa
1) There are a LOT of bugs in cassandra-3.0.9. Some of them are really bad, you should definitely consider upgrading to 3.0.15. 2) The GC profile changed between 2.0 and 3.0. It may be that you're generating a bit more garbage and causing GC pauses (especially likely since you're using thrift),

Flakey Dtests

2017-11-15 Thread Jeff Jirsa
In lieu of a weekly wrap-up, here's a pre-Thanksgiving call for help. If you haven't been paying attention to JIRA, you likely didn't notice that Josh went through and triage/categorized a bunch of issues by adding components, and Michael took the time to open a bunch of JIRAs for failing tests.

Re: exception during repair (3.11)

2017-11-13 Thread Jeff Jirsa
Can you open a JIRA with your stack trace? What exactly was the problem with the column being too big? How big was it? What did you do to “fix” it? -- Jeff Jirsa > On Nov 13, 2017, at 2:55 AM, Micha <mich...@fantasymail.de> wrote: > > Hi, > > I get the following ex

Re: Cassandra DTests deadlocks on random test

2017-10-21 Thread Jeff Jirsa
I THINK the ASF Jenkins boxes running dtests are 16gb or 32gb servers with some small number of cores (graciously donated by Datastax and Instaclustr). At least some of them are this config, as an example: https://www.online.net/en/dedicated-server/dedibox-xc -- Jeff Jirsa > On Oct

Re: Weekly Cassandra Wrap-Up: Oct 16 Edition

2017-10-16 Thread Jeff Jirsa
Also learned of https://github.com/aragozin/jvm-tools , which can generate flame graphs easily without requiring a restart with an agent, and works on openjdk+oracle. On Mon, Oct 16, 2017 at 8:37 AM, Jeff Jirsa <jji...@gmail.com> wrote: > > I got some feedback last week that

Weekly Cassandra Wrap-Up: Oct 16 Edition

2017-10-16 Thread Jeff Jirsa
I got some feedback last week that I should try this on Monday morning, so let's see if we can nudge a few people into action this week. 3.0.15 and 3.11.1 are released. This is a dev list, so that shouldn't be a surprise to anyone here - you should have seen the votes and release notifications.

Re: Do it need to run 'nodetool upgradesstables' when updating from 2.0.9 to 2.1.19?

2017-10-13 Thread Jeff Jirsa
Two people say I’m wrong, I’ll believe it - must be imagining restrictions that don’t exist. -- Jeff Jirsa > On Oct 12, 2017, at 10:55 PM, Per Otterström <per.otterst...@ericsson.com> > wrote: > > Hi! > > This was news to me. I had the impression that we a

Re: Do it need to run 'nodetool upgradesstables' when updating from 2.0.9 to 2.1.19?

2017-10-12 Thread Jeff Jirsa
You won't notice any issues (all versions of cassandra are backwards compatible at least 1 version), and sstables will be slowly migrated to the new format as you compact, but you should still run it (upgradesstables) explicitly because when it comes time to run repair/boostrap/decommission/etc,

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Jeff Jirsa
, Oct 9, 2017 at 8:26 AM, Jeff Jirsa <jji...@gmail.com> wrote: > As long as balanced is achieved, fewer vnodes the better > > -- > Jeff Jirsa > > > > On Oct 9, 2017, at 7:53 AM, Li, Guangxing <guangxing...@pearson.com> > wrote: > > > > Jeff, >

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Jeff Jirsa
As long as balanced is achieved, fewer vnodes the better -- Jeff Jirsa > On Oct 9, 2017, at 7:53 AM, Li, Guangxing <guangxing...@pearson.com> wrote: > > Jeff, > > so the key really is to keep nodes load balanced, and as long as that such > balance is achieved

Re: What would be the appropriate number of vnodes (num_tokens) to use?

2017-10-09 Thread Jeff Jirsa
256 was chosen because the original vnode allocation algorithm was random and fewer than 256 could lead to unbalanced nodes In 3.0 there’s a less naive algorithm to ensure more balanced distribution, and there 16 or 32 is probably preferable -- Jeff Jirsa > On Oct 9, 2017, at 7:38 AM,

Re: Proposal to retroactively mark materialized views experimental

2017-10-03 Thread Jeff Jirsa
Nobody debates that it's easier, the debate is over whether or not it's correct (and more importantly, whether or not people realize it's not strictly correct in all edge cases). Users expect correct results. People are literally betting their jobs on it. When you have to manually manage sync

Re: [VOTE] Release Apache Cassandra 3.11.1

2017-10-02 Thread Jeff Jirsa
se/CASSANDRA-13900 <https://issues.apache.org/ > jira/browse/CASSANDRA-13900> for the rest of the story. > > -Jeremiah > > > On Oct 2, 2017, at 4:47 PM, Jeff Jirsa <jji...@gmail.com> wrote: > > > > Thomas, did you see this on 3.11.0 as well, or have you not tr

Re: [VOTE] Release Apache Cassandra 3.11.1

2017-10-02 Thread Jeff Jirsa
ng restart every ~ 72hrs to be on the safe-side with -Xmx8G. Luckily > this is just a loadtest environment. We don't have 3.11 in production yet. > > > > I can offer to immediately deploy a snapshot build into our loadtest > environment, in case this issue gets attention

Re: [VOTE] Release Apache Cassandra 3.11.1

2017-10-02 Thread Jeff Jirsa
+1 ( Somewhat concerned that https://issues.apache.org/jira/browse/CASSANDRA-13754 may not be fixed, but it's not a strict regression ? ) On Mon, Oct 2, 2017 at 10:58 AM, Michael Shuler wrote: > I propose the following artifacts for release as 3.11.1. > > sha1:

Re: [VOTE] Release Apache Cassandra 3.0.15

2017-10-02 Thread Jeff Jirsa
+1 On Mon, Oct 2, 2017 at 10:18 AM, Michael Shuler wrote: > I propose the following artifacts for release as 3.0.15. > > sha1: b32a9e6452c78e6ad08e371314bf1ab7492d0773 > Git: > http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a= >

Re: Spawning nodes for testing

2017-10-01 Thread Jeff Jirsa
Check out CCM - it’s how the project writes distributed tests https://github.com/pcmanus/ccm -- Jeff Jirsa > On Oct 1, 2017, at 10:25 AM, m...@salih.xyz wrote: > > Hi there, > I am playing with Gossip classes and looking for a way to create nodes and > join to cluster

Re: Proposal to retroactively mark materialized views experimental

2017-10-01 Thread Jeff Jirsa
is probably the best bet there -- Jeff Jirsa > On Oct 1, 2017, at 3:12 AM, Marcus Eriksson <krum...@gmail.com> wrote: > > I was just thinking that we should try really hard to avoid adding > experimental features - they are experimental due to lack of testing right? > There s

Re: Proposal to retroactively mark materialized views experimental

2017-09-29 Thread Jeff Jirsa
Reviewers should be able to suggest when experimental is warranted, and conversation on dev+jira to justify when it’s transitioned from experimental to stable? We should remove the flag as soon as we’re (collectively) confident in a feature’s behavior - at least correctness, if not

Occasional Cassandra Status Wrapup

2017-09-29 Thread Jeff Jirsa
It's been a long time since I've remembered to write what used to be the weekly cassandra wrapup, but I wanted to try to summarize some of the recent events (especially NGCC) for those that couldn't attend / didn't know it was happening / don't have time to follow every conversation in the

Re: Proposal to retroactively mark materialized views experimental

2017-09-29 Thread Jeff Jirsa
+1, and as Ben said, we should be willing to consider other things that deserve experimental flags as well (SASI comes to mind as a potential example) On Fri, Sep 29, 2017 at 11:09 AM, Blake Eggleston wrote: > Hi dev@, > > I’d like to propose that we retroactively classify

Re: [VOTE] Release Apache Cassandra 2.2.11

2017-09-28 Thread Jeff Jirsa
+1 On Thu, Sep 28, 2017 at 11:40 AM, Michael Shuler wrote: > I propose the following artifacts for release as 2.2.11. > > sha1: c510e001481637e1f74d9ad176f8dc3ab7ebd1e3 > Git: > http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a= >

Re: Getting started with contribution

2017-09-26 Thread Jeff Jirsa
LHF tickets are the right place Also some info here: https://cassandra.apache.org/doc/latest/development/gettingstarted.html#initial-contributions -- Jeff Jirsa > On Sep 26, 2017, at 9:38 AM, Русак Максим <mak-ru...@yandex.ru> wrote: > > Look through issues with &quo

Re: Why Cassandra unit test run skips some of it?

2017-09-21 Thread Jeff Jirsa
There’s also at least one test we skip in circleci where we know the container memory is insufficient for the test - based on environment variables in that case. -- Jeff Jirsa > On Sep 21, 2017, at 10:14 AM, Josh McKenzie <jmcken...@apache.org> wrote: > > It at least skips

Re: Presubmit checks in github

2017-09-20 Thread Jeff Jirsa
friction for contributors (by making test builds trigger on pull requests), but it takes time to get all that sorted out. -- Jeff Jirsa > On Sep 20, 2017, at 5:38 AM, Corentin Chary <corentin.ch...@gmail.com> wrote: > > Hello, > Looks like currently we don't automatically

Re: question on assigning JIRA ticket

2017-09-19 Thread Jeff Jirsa
quest an access in order to be able to assign an > issue to myself? I cannot find an option to do that when I'm logged in. > > Preetika > > -Original Message- > From: Jeff Jirsa [mailto:jji...@gmail.com] > Sent: Tuesday, September 19, 2017 9:50 AM > To: Cassandra DEV &

Re: question on assigning JIRA ticket

2017-09-19 Thread Jeff Jirsa
If it's created by someone else but not assigned, you can assign it to yourself and begin work If it's created by someone else and assigned to someone else, you should post on the ticket and ask if they mind if you work on it instead. Sometimes people assign and then never work on it, and they

Re: Cassandra Compactions Speed increase

2017-09-15 Thread Jeff Jirsa
graphs or thread pool stats or something - there's a hundred or a thousand things to tune, and you've given almost no info for us to tell you which to look at first -- Jeff Jirsa > On Sep 15, 2017, at 9:29 PM, Ashish Pandey <apandey...@gmail.com> wrote: > > I haven't thro

Re: Cassandra Compactions Speed increase

2017-09-15 Thread Jeff Jirsa
Do you have compaction throttled now? What exactly takes 6-8 hours? Are you writing all the keys at one time, then reading, then deleting them all, or is it a constant stream of writes and reads? -- Jeff Jirsa > On Sep 15, 2017, at 8:40 PM, Ashish Pandey <apandey...@gmail.com&

Re: Review request: CASSANDRA-13799

2017-09-15 Thread Jeff Jirsa
On 2017-09-06 00:58, Malcolm Taylor wrote: > Can someone please review my patch on CASSANDRA-13799 ? The issue fixes > several alerts raised by lgtm.com, which runs a deep analysis of the code > in trunk. Some of the alerts refer to clear bugs, while others are >

Re: Do not use Cassandra 3.11.0+ or Cassandra 3.0.12+

2017-08-28 Thread Jeff Jirsa
I shouldn't actually say I don't think it can happen on 3.0 - I haven't seen this happen on 3.0 without some other code change to enable it, but like I said, we're still investigating. -- Jeff Jirsa > On Aug 28, 2017, at 8:30 PM, Jeff Jirsa <jji...@gmail.com> wrote: > > For

Re: Do not use Cassandra 3.11.0+ or Cassandra 3.0.12+

2017-08-28 Thread Jeff Jirsa
pre-13038 as well (would take some serious luck with your deletion time distribution though - the rounding in 13038 does make it more likely, but the race was already there). -- Jeff Jirsa > On Aug 28, 2017, at 8:24 PM, Jay Zhuang <jay.zhu...@yahoo.com.INVALID> wrote: > > We'

Re: 2017 NGCC CFP ends TOMORROW

2017-08-17 Thread Jeff Jirsa
Guess who can't read a calendar? August 19 is the right date, it's also Saturday, not tomorrow. On Thu, Aug 17, 2017 at 1:25 PM, Jeff Jirsa <jji...@gmail.com> wrote: > Friendly reminder that the CFP deadline for 2017 NGCC (Sept 26th in San > Antonio) is tomorrow - August 19th.

Re: rebuild constantly fails, 3.11

2017-08-10 Thread Jeff Jirsa
On 2017-08-08 01:00 (-0700), Micha wrote: > Hi, > > it seems I'm not able to add add 3 node dc to a 3 node dc. After > starting the rebuild on a new node, nodetool netstats show it will > receive 1200 files from node-1 and 5000 from node-2. The stream from > node-1

Re: TWCS High Disk Space Usage Troubleshooting - Looking for suggestions

2017-08-09 Thread Jeff Jirsa
Looks a lot like read repair but impossible to tell for sure -- Jeff Jirsa > On Aug 9, 2017, at 4:34 PM, Sumanth Pasupuleti > <sumanth.pasupuleti...@gmail.com> wrote: > > My final try on pushing the attachment over. > > > ​ > >> On Wed, Aug 9,

Re: TWCS High Disk Space Usage Troubleshooting - Looking for suggestions

2017-08-08 Thread Jeff Jirsa
The most likely cause is read repairs due to consistency level repairs (digest mismatch). The only way to actually eliminate read repair is to read with CL:ONE, which almost nobody does (at least in time series use cases, because it implies you probably write with ALL, or run repair which - as

Re: CASSANDRA-9472 Reintroduce off heap memtables - patch to 3.0

2017-07-31 Thread Jeff Jirsa
On 2017-07-29 10:02 (-0700), Jay Zhuang wrote: > Should we consider back-porting it to 3.0 for the community? I think > this is a performance regression instead of new feature. And we have the > feature in 2.1, 2.2. > Personally / individually, I'd much rather

Re: [RESULT][VOTE] Ask Infra to move github notification emails to pr@

2017-07-28 Thread Jeff Jirsa
I'll open an infra ticket. -- Jeff Jirsa > On Jul 28, 2017, at 7:28 AM, Aleksey Yeschenko <alek...@apache.org> wrote: > > +1 > > — > AY > > On 28 July 2017 at 11:47:29, Stefan Podkowinski (s...@apache.org) wrote: > > Can we forward notificati

Re: CASSANDRA-9472 Reintroduce off heap memtables - patch to 3.0

2017-07-27 Thread Jeff Jirsa
This is after you backported 9472 to 3.0? -- Jeff Jirsa > On Jul 27, 2017, at 10:33 PM, Andrew Whang <andrewgwh...@gmail.com> wrote: > > Jay, > > We see ~20% write latency improvement on 3.0.13 in a write-heavy workload, > using offheap_objects. offheap_buff

Re: Customize Cassandra to execute a query multiple times

2017-07-26 Thread Jeff Jirsa
On 2017-07-26 22:19 (-0700), Ke Wang wrote: > Hello all, > > Is there a way to customize Cassandra to execute a query multiple times? > There's always a way... > My use case is the following. When the Cassandra server receives queries > from remote clients, besides

Re: jira rights

2017-07-21 Thread Jeff Jirsa
It's probably the case that you could have self-assigned after creation, but I've added you just to be safe. On Fri, Jul 21, 2017 at 9:45 AM, Malcolm Taylor wrote: > Hi Jason, > When I start to create a JIRA issue for Cassandra, I don't see the > "Assignee" field. That

Re: State of Materialized Views

2017-07-19 Thread Jeff Jirsa
On 2017-07-16 21:22 (-0700), kurt greaves wrote: > wall of text inc. > *tl;dr: *Aiming to come to some conclusions about what we are doing with > MV's and how we are going to make them stable in production. But really > just trying to raise awareness/involvement for MV's.

Re: Cassandra did not start listening for CQL clients

2017-06-29 Thread Jeff Jirsa
Open a jira for it and lets change it? -- Jeff Jirsa > On Jun 29, 2017, at 8:04 AM, Mike Adamson <madam...@datastax.com> wrote: > > I've honestly no idea but it is still defaulting to false in Config.java. > I'm assuming it will change to defaulting to true when thrift is

Re: [VOTE] Release Apache Cassandra 2.2.10

2017-06-21 Thread Jeff Jirsa
+1 On Wed, Jun 21, 2017 at 1:20 PM, Michael Shuler wrote: > I propose the following artifacts for release as 2.2.10. > > sha1: 83f28ce3c4eeff75ce70855a56b6155047ce8e9a > Git: > http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a= >

Re: [DISCUSS] Should we do a 2.2 release?

2017-06-20 Thread Jeff Jirsa
Site says: - Apache Cassandra 2.1 is supported until 4.0 release (date TBD) with critical fixes only. Since we don't know when 4.0 goes out, we shouldn't be in a hurry to do a final 2.1.18 cut. There's not much in that branch (a few 2i fixes, some build fixes, a cqlsh fix, and a logging

Re: [VOTE] Release Apache Cassandra 3.11.0

2017-06-20 Thread Jeff Jirsa
+1 On Mon, Jun 19, 2017 at 4:10 PM, Michael Shuler wrote: > I propose the following artifacts for release as 3.11.0. > > sha1: 88dee7e9d515ad94ecf8f2309f1e6138ec79e1a2 > Git: > http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a= >

Re: Contributing to code

2017-06-19 Thread Jeff Jirsa
At http://cassandra.apache.org/doc/latest/development/patches.html#patches There's a link to "low hanging fruit" tickets Look for one that seems contained and give it a shot. If you get stuck, send a link back here and ask for help. -- Jeff Jirsa > On Jun 19, 2017, at 5:48 PM

Re: Contributing to code

2017-06-19 Thread Jeff Jirsa
Also http://cassandra.apache.org/doc/latest/development/patches.html#patches -- Jeff Jirsa > On Jun 19, 2017, at 6:03 PM, Ben Slater <ben.sla...@instaclustr.com> wrote: > > Hi Salih > > If you haven’t already see it, there is a section in the doco about getting > s

Re: [VOTE] Release Apache Cassandra 3.0.14

2017-06-19 Thread Jeff Jirsa
+1 On Mon, Jun 19, 2017 at 1:37 PM, Michael Shuler wrote: > I propose the following artifacts for release as 3.0.14. > > sha1: f3e38cb638113c2a23855a104d6082da5bc10ddb > Git: > http://git-wip-us.apache.org/repos/asf?p=cassandra.git;a= >

Re: Understanding an off-heap memory allocation

2017-06-19 Thread Jeff Jirsa
The 2 largest users of offheap memory are bloom filters (a probabilistic data structure that lets cassandra skip some sstables on the read path) and compression metadata chunks (data structure that helps us track / use offsets in compressed files). Bloom filters you can tune by changing the false

Re: New contribution - Burst Hour Compaction Strategy

2017-06-14 Thread Jeff Jirsa
Hi Pedro, I did a quick read through of your strategy, and have a few personal thoughts: First, writing a compaction strategy is a lot of work, and it's great to see new contributors take on ambitious projects. There are even a handful of ideas in here that may be useful to other strategies.

Re: NGCC Proposal (Was Re: NGCC?)

2017-06-13 Thread Jeff Jirsa
I win! -- Jeff Jirsa > On Jun 13, 2017, at 12:30 PM, Jason Brown <jasedbr...@gmail.com> wrote: > > Bah! Jeff beat me to responding with essentially the same message. +1 for > Tuesday and the venue. > >> On Tue, Jun 13, 2017 at 11:44 AM, Jeff Jirsa <jji...@gm

Re: NGCC Proposal (Was Re: NGCC?)

2017-06-13 Thread Jeff Jirsa
Looks great to me - especially the venue. Date wise, Tuesday (19th) lets people fly in on Monday instead of costing a weekend, so selfishly that seems better to me. On Mon, Jun 12, 2017 at 1:30 PM, Gary Dusbabek wrote: > ## Cassandra list email > > Hi everybody, > > Here

Re: AutoBoxing overhead in lambda expressions

2017-06-12 Thread Jeff Jirsa
Generally speaking, Patches that decrease boxing/unboxing overhead are great, and we've made a point of committing some of those in the past ( such as in CASSANDRA-12199 and CASSANDRA-8019 ) , though there are also some examples where we've decided not to apply boxing changes to critical code

Re: Definition of QUORUM consistency level

2017-06-08 Thread Jeff Jirsa
Short of actually making ConsistencyLevel pluggable or adding/changing one of the existing levels, an alternative approach would be to divide up the cluster into either real or pseudo-datacenters (with RF=2 in each DC), and then write with QUORUM (which would be 3 nodes, across any combination of

Re: Definition of QUORUM consistency level

2017-06-08 Thread Jeff Jirsa
Would love to see real pluggable consistency levels. Sorta sad it got wont-fixed - may be time to revisit that, perhaps it's more feasible now. https://issues.apache.org/jira/browse/CASSANDRA-8119 is also semi-related, but a different approach (CL-as-UDF) On Thu, Jun 8, 2017 at 9:26 PM, Brandon

Re: Status on new nodes for builds.apache.org

2017-06-05 Thread Jeff Jirsa
Ariel was working on making dtests work reliably in circle - I don't want to speak for him, but I think he was pretty close. In the mean time, email me directly or tag me on jira and I'll queue up dtests for you on the asf Jenkins -- Jeff Jirsa > On Jun 5, 2017, at 10:15 PM, Jay Zhu

Re: NGCC?

2017-06-01 Thread Jeff Jirsa
We should do our best to plan around Cassandra Summit Tokyo - NGCC in September seems like a good idea. On Thu, Jun 1, 2017 at 10:09 AM, K.Tomita wrote: > I'm organizer for Cassandra Summit Tokyo. > we are Cassandra user's group of Japan. > We're planning to hold a

Re: Potential block issue for 3.0.13: schema version id mismatch while upgrading

2017-05-31 Thread Jeff Jirsa
bigger problem, but I don't see why (without testing this myself first) why it would fail to start on the minor version upgrade. Can someone explain why we get unknown cfid just be changing the digest order? -- Jeff Jirsa > On May 31, 2017, at 12:34 AM, Stefania Alborghetti > <stefania

Re: strange issue with Tuple in Cassandra 3.0

2017-05-27 Thread Jeff Jirsa
Can you upload the trace somewhere ? -- Jeff Jirsa > On May 27, 2017, at 5:34 PM, Subroto Barua <sbarua...@yahoo.com.INVALID> > wrote: > > > i have a table with one of the column as Tuple datatype. > > when I insert rows with "using timestamp", I see

Re: Integrating vendor-specific code and developing plugins

2017-05-18 Thread Jeff Jirsa
On Thu, May 18, 2017 at 10:28 AM, Jeff Jirsa <jji...@gmail.com> wrote: > > > On Mon, May 15, 2017 at 5:25 PM, Jeremiah D Jordan < > jeremiah.jor...@gmail.com> wrote: > >> >> >> To me testable means that we can run the tests at the very least for &g

Re: Integrating vendor-specific code and developing plugins

2017-05-18 Thread Jeff Jirsa
On Mon, May 15, 2017 at 5:25 PM, Jeremiah D Jordan < jeremiah.jor...@gmail.com> wrote: > > > To me testable means that we can run the tests at the very least for every > release, but ideally they would be run more often than that. Especially > with the push to not release unless the test board

Re: Integrating vendor-specific code and developing plugins

2017-05-17 Thread Jeff Jirsa
On Mon, May 15, 2017 at 4:54 AM, Jonathan Haddad wrote: > There's a handful of issues I can think of with shipping everything > in-tree. I'll try to brain dump them here. > > * What's included when shipped in tree? > > Does every idea get merged in? Do we need 30 different

Re: Integrating vendor-specific code and developing plugins

2017-05-14 Thread Jeff Jirsa
On Fri, May 12, 2017 at 9:31 PM, J. D. Jordan wrote: > In tree would foster more committers which is a good thing. Definitely. But I also agree that not being able to actually run unit tests is a bad > thing. What if we asked people who want to contribute these

Re: Integrating vendor-specific code and developing plugins

2017-05-12 Thread Jeff Jirsa
r pointing? -- Jeff Jirsa > On May 12, 2017, at 12:25 PM, Jason Brown <jasedbr...@gmail.com> wrote: > > I agree the plugins route is the safest and best. However, we already have > platform-specific code in-tree that is semi-unmaintained: the Windows > support. To

Semi-weekly Cassandra wrap-up

2017-05-05 Thread Jeff Jirsa
Few things to point out for people not actively paying attention every day: https://issues.apache.org/jira/browse/CASSANDRA-13486 : Amitkumar Ghatwal and Rei Odaira from IBM have contributed some changes to make Cassandra work properly on PPC hardware, including a new Row Cache implementation

Re: A (drop-in) replacement for ColumnFamilyRecordReader in C*3?

2017-05-03 Thread Jeff Jirsa
Changing your code to wrap org.apache.cassandra.hadoop.cql3.CqlRecordReader is probably easier than trying to bring the old thrift based record reader into the 3.0 world, but I don't have any concrete code examples. -- Jeff Jirsa > On May 2, 2017, at 6:02 PM, kedar mhaswade <kedar

Re: Way to unsubscribe from mailing lists

2017-04-25 Thread Jeff Jirsa
+1 vote to add it -- Jeff Jirsa > On Apr 25, 2017, at 6:26 PM, Michael Shuler <mich...@pbandjelly.org> wrote: > >> On 04/25/2017 12:52 PM, Mark Thomas wrote: >>> On 25/04/17 16:11, Michael Shuler wrote: >>> Many lists include a footer that have unsub

Almost sorta weekly cassandra wrapup

2017-04-21 Thread Jeff Jirsa
Few things worth mentioning in the cassandra world this week: 1) If you somehow missed the cassandra-on-the-rocks(db) thread, you should check it out: https://lists.apache.org/thread.html/6860e04d6ff58fb0f65fdaa6e9b53aedf0d432a88bed32107e7ccec8@%3Cdev.cassandra.apache.org%3E . FB/Instagram are

Re: Cassandra on RocksDB experiment result

2017-04-20 Thread Jeff Jirsa
Let's try to make this actionable. Long time contributors/committers/members of the PMC (especially you guys who have been working on internals for 4-8 years): Setting aside details of the implementation, does anyone feel that pluggable storage in itself is inherently a bad idea (so much so that

Re: [VOTE] Release Apache Cassandra 3.0.13

2017-04-11 Thread Jeff Jirsa
+1 -- Jeff Jirsa > On Apr 11, 2017, at 11:59 AM, Michael Shuler <mich...@pbandjelly.org> wrote: > > I propose the following artifacts for release as 3.0.13. > > sha1: 91661ec296c6d089e3238e1a72f3861c449326aa > Git: > http://git-wip-us.apache.org/repos/asf?p=cass

Weekly Cassandra Wrapup

2017-04-07 Thread Jeff Jirsa
First, check out this graph: http://i.imgur.com/cEx3jOo.png More issues were marked resolved in the past 30 days than were opened, which is a testament to the fact that a lot of people are doing a lot of work. Some of those are features, some are bugs, some are JIRA cleanup, but green is over

Re: Weekly Cassandra Wrap-up

2017-04-04 Thread Jeff Jirsa
On Sun, Apr 2, 2017 at 7:53 PM, Jeff Jirsa <jji...@gmail.com> wrote: > 3) As a follow-up to #2, I proposed pushing up some CircleCI and Travis > YML files into the active branches to make testing easier - ( > https://lists.apache.org/thread.html/48e73ff0d2aff5a

Re: Weekly Cassandra Wrap-up

2017-04-03 Thread Jeff Jirsa
a more comprehensive list of these third party tools and include them in the docs - are there any tools you find useful in using Cassandra that should be listed? On Sun, Apr 2, 2017 at 7:53 PM, Jeff Jirsa <jji...@gmail.com> wrote: > From the email list: > > 1) Some grad students

Re: [VOTE] self-assignment of jira tickets

2017-03-29 Thread Jeff Jirsa
+1 -- Jeff Jirsa > On Mar 29, 2017, at 6:21 AM, Jason Brown <jasedbr...@gmail.com> wrote: > > Hey all, > > Following up my thread from a week or two ago ( > https://lists.apache.org/thread.html/0665f40c7213654e99817141972c003a2131aba7a1c63d6765db75c5@%3Cdev.cassand

Proposal: push TravisCI and CircleCI yaml files into the active branches

2017-03-28 Thread Jeff Jirsa
To further our recent conversations on testing, I've opened the following JIRA: https://issues.apache.org/jira/browse/CASSANDRA-13388 This should allow us to do SOME amount of automated testing for developers without jumping through a ton of hoops. If the free plans prove to be insufficient, we

Weekly Cassandra Status

2017-03-26 Thread Jeff Jirsa
Email stuff: - We've moved github pull requests notifications from dev@ to pr@ - if you want to see when github issues are opened or updated, subscribe to the new list (send email to pr-subscr...@cassandra.apache.org ), or check out the archives at

[RESULT][VOTE] Ask Infra to move github notification emails to pr@

2017-03-24 Thread Jeff Jirsa
With 6 binding +1s, 6 non-binding +1s, and no -1s of any kind, the vote passes, I'll ask for a new mailing list and get this transitioned. - Jeff On 2017-03-20 15:32 (-0700), Jeff Jirsa <jji...@gmail.com> wrote: > There's no reason for the dev list to get spammed everytime there's a

Re: SSTable Ancestors information in Cassandra 3.0.x

2017-03-23 Thread Jeff Jirsa
nal tasks and the compaction tasks move to a > timestamp-based approach? > > Regards, > Rajath > > > Rajath Subramanyam > > > On Thu, Mar 23, 2017 at 2:12 PM, Jeff Jirsa <jji...@gmail.com> wrote: > > > That information was removed, beca

Re: SSTable Ancestors information in Cassandra 3.0.x

2017-03-23 Thread Jeff Jirsa
That information was removed, because it was really meant to be used for a handful of internal tasks, most of which were no longer used. The remaining use was cleaning up compaction leftovers, and the compaction leftover code was rewritten in 3.0 / CASSANDRA-7066 (note, though, that it's somewhat

Re: DataStax Client List

2017-03-23 Thread Jeff Jirsa
The original email and this reply are totally inappropriate. At best, this is a wholly invalid use of the list to peddle fake contact lists. At worst, it's inappropriately disseminating a list that's likely covered under NDA. I'll be unsubscribing any user who continues to humor this poster

Re: thread architecture of Cassandra

2017-03-22 Thread Jeff Jirsa
Hi Suli, Attachments to mailing lists often get filtered - can you paste it online and send a link? - Jeff On Wed, Mar 22, 2017 at 1:10 PM, 杨苏立 Yang Su Li wrote: > Hi, > > I am a graduate student working on scheduling on storage systems, and we > are interested in how

Re: [VOTE] Ask Infra to move github notification emails to commits@

2017-03-20 Thread Jeff Jirsa
t; there? I don't subscribe to commits@ because it's too much email, I > >> would be interested in being notified when a PR is opened though. > >> > >> On March 20, 2017 at 3:00:47 PM, Jeff Jirsa (jji...@gmail.com) wrote: > >> > >> There's no reason

[VOTE] Ask Infra to move github notification emails to pr@

2017-03-20 Thread Jeff Jirsa
There's no reason for the dev list to get spammed everytime there's a github PR. We know most of the time we prefer JIRAs for real code PRs, but with docs being in tree and low barrier to entry, we may want to accept docs through PRs ( see https://issues.apache.org/jira/browse/CASSANDRA-13256 ,

[VOTE] Ask Infra to move github notification emails to commits@

2017-03-20 Thread Jeff Jirsa
There's no reason for the dev list to get spammed everytime there's a github PR. We know most of the time we prefer JIRAs for real code PRs, but with docs being in tree and low barrier to entry, we may want to accept docs through PRs ( see https://issues.apache.org/jira/browse/CASSANDRA-13256 ,

Weekly Cassandra Topics Of Interest Thread

2017-03-18 Thread Jeff Jirsa
Another week, another quick summary of topics of interest (to me) as we close out the Feast of Saint Patrick. As before, if you feel you have something that you feel needs more eyeballs, please reply and add it. Don't be shy. A few significant mailing list threads: - We've talked a lot about

<    1   2   3   >