Re: Seed nodes and bootstrap (was: Re: Initializing a multiple node cluster (multiple datacenters))

[Oleksandr Shulgin]

On Mon, Feb 26, 2018 at 7:05 PM, Jeff Jirsa  wrote:

>
> I'll happily click the re-open button (you could have, too), but I'm not
> sure what the 'right' fix is. Feel free to move discussion to 5836.
>

Thanks, Jeff.   Somehow, I don't see any control elements to change issue
status, even though I'm logged in, so I assume only project members / devs
can do that.

--
Alex

Re: Data Deleted After a few days of being off

[Oleksandr Shulgin]

On Tue, Feb 27, 2018 at 7:37 AM, A  wrote:

>
> I started going through the logs and haven't noticed anything yet... Very
> unexpected behavior.
>

Maybe I'm asking the obvious, but were your inserts *without* a TTL?

--
Alex

Re: Data Deleted After a few days of being off

[@Nandan@]

Please check your error.log file once. As you checked it means Your data is
not coming into Data file. I will suggest you to check your error.log file
once.

On Tue, Feb 27, 2018 at 2:37 PM, A  wrote:

> Hey there. Thanks for your response.
>
> Yes.  I absolutely inserted the data correctly and queried it many times
> through cqlsh> as well as through node.js.
>
> I started going through the logs and haven't noticed anything yet... Very
> unexpected behavior.
>
> Thanks.
> A
>
>
> Sent from Yahoo Mail for iPad 
>
>
> On Monday, February 26, 2018, 9:23 PM, @Nandan@ <
> nandanpriyadarshi...@gmail.com> wrote:
>
> Hi A,
> As I am able to  understand your question :-
> 1) You inserted some data into your table and that was inserted
> successfully.
> 2) Then you stop the cassandra servie.
> 3) After few days you started your service and you checked your Table and
> there were no data.
> Did you cross verified once you inserted data that , data is inserted
> correctly or not. and Did you check system.log file , In case you got some
> message there.
> Please cross check once.
>
> On Tue, Feb 27, 2018 at 1:16 PM, A  wrote:
>
> I'm new to Cassandra.  Trying it out to see if it will work for my
> upcoming project.  I created a test keyspace and table on my dev laptop.
> Loaded it with some data on a Friday and closed her down.  Returned on
> Monday and looked up the data and it was gone.  The keyspace and table was
> there, but table was empty.  This has happened twice so far.
>
> Help...
>
> Thanks,
> Angel
>
>
>

Re: Data Deleted After a few days of being off

[Justin Cameron]

Cassandra data files are located at /var/lib/cassandra/data (
http://cassandra.apache.org/doc/latest/configuration/cassandra_config_file.html#data-file-directories
)

Can you double check that the Cassandra process has write access to this
directory? There should be a number of SSTable files in the directory if
Cassandra has written the data to disk. When you start Cassandra the system
log will also show each SSTable being loaded.

It could be possible that something is stopping the memtables from being
flushed to disk or being read by Cassandra.

On Tue, 27 Feb 2018 at 17:37 A  wrote:

> Hey there. Thanks for your response.
>
> Yes.  I absolutely inserted the data correctly and queried it many times
> through cqlsh> as well as through node.js.
>
> I started going through the logs and haven't noticed anything yet... Very
> unexpected behavior.
>
> Thanks.
> A
>
>
> Sent from Yahoo Mail for iPad 
>
>
> On Monday, February 26, 2018, 9:23 PM, @Nandan@ <
> nandanpriyadarshi...@gmail.com> wrote:
>
> Hi A,
> As I am able to  understand your question :-
> 1) You inserted some data into your table and that was inserted
> successfully.
> 2) Then you stop the cassandra servie.
> 3) After few days you started your service and you checked your Table and
> there were no data.
> Did you cross verified once you inserted data that , data is inserted
> correctly or not. and Did you check system.log file , In case you got some
> message there.
> Please cross check once.
>
> On Tue, Feb 27, 2018 at 1:16 PM, A  wrote:
>
> I'm new to Cassandra.  Trying it out to see if it will work for my
> upcoming project.  I created a test keyspace and table on my dev laptop.
> Loaded it with some data on a Friday and closed her down.  Returned on
> Monday and looked up the data and it was gone.  The keyspace and table was
> there, but table was empty.  This has happened twice so far.
>
> Help...
>
> Thanks,
> Angel
>
>
> --


*Justin Cameron*Senior Software Engineer





This email has been sent on behalf of Instaclustr Pty. Limited (Australia)
and Instaclustr Inc (USA).

This email and any attachments may contain confidential and legally
privileged information.  If you are not the intended recipient, do not copy
or disclose its content, but please reply to this email immediately and
highlight the error to the sender and then immediately delete the message.

Re: Data Deleted After a few days of being off

[A]

 blockquote, div.yahoo_quoted { margin-left: 0 !important; border-left:1px 
#715FFA solid !important; padding-left:1ex !important; background-color:white 
!important; } Hey there. Thanks for your response.
Yes.  I absolutely inserted the data correctly and queried it many times 
through cqlsh> as well as through node.js. 
I started going through the logs and haven't noticed anything yet... Very 
unexpected behavior.
Thanks.A

Sent from Yahoo Mail for iPad


On Monday, February 26, 2018, 9:23 PM, @Nandan@ 
 wrote:

Hi A,As I am able to  understand your question :-1) You inserted some data into 
your table and that was inserted successfully. 2) Then you stop the cassandra 
servie. 3) After few days you started your service and you checked your Table 
and there were no data. Did you cross verified once you inserted data that , 
data is inserted correctly or not. and Did you check system.log file , In case 
you got some message there. Please cross check once. 
On Tue, Feb 27, 2018 at 1:16 PM, A  wrote:

I'm new to Cassandra.  Trying it out to see if it will work for my upcoming 
project.  I created a test keyspace and table on my dev laptop.  Loaded it with 
some data on a Friday and closed her down.  Returned on Monday and looked up 
the data and it was gone.  The keyspace and table was there, but table was 
empty.  This has happened twice so far.
Help...
Thanks,Angel

Re: Cassandra Summit 2019 / Cassandra Summit 2018

[Jeff Jirsa]

Instaclustr sponsored the 2017 NGCC (Next Gen Cassandra Conference), which
was developer/development focused (vs user focused).

For 2018, we're looking at options for both a developer conference and a
user conference. There's a lot of logistics involved, and I think it's
fairly obvious that most of the PMC members aren't professional event
planners, so it's possible that either/both conferences may not happen, but
we're doing our best to try to put something together.


On Mon, Feb 26, 2018 at 3:00 PM, Rahul Singh 
wrote:

> I think some of the Instaclustr folks had done one last year which I
> really wanted to go to.. Distributed / Async both would be easier to get
> people to write papers, make slides, do youtube videos with.. and then we
> could do a virtual web conf of the best submissions.
>
> On Feb 26, 2018, 1:04 PM -0600, Kenneth Brotman
> , wrote:
>
> Is there any planning yet for a Cassandra Summit 2019 or Cassandra Summit
> 2018 (probably too late)?
>
>
>
> Is there a planning committee?
>
>
>
> Who wants there to be a Cassandra Summit 2019 and who thinks there is a
> better way?
>
>
>
> We could try a Cassandra Distributed Summit 2019 where we meet virtually
> and perhaps asynchronously, but there would be a lot more energy and
> bonding if it’s not virtual.  I’m up for any of these.
>
>
>
> Kenneth Brotman
>
>
>
>
>
>

Re: Data Deleted After a few days of being off

[@Nandan@]

Hi A,
As I am able to  understand your question :-
1) You inserted some data into your table and that was inserted
successfully.
2) Then you stop the cassandra servie.
3) After few days you started your service and you checked your Table and
there were no data.
Did you cross verified once you inserted data that , data is inserted
correctly or not. and Did you check system.log file , In case you got some
message there.
Please cross check once.

On Tue, Feb 27, 2018 at 1:16 PM, A  wrote:

> I'm new to Cassandra.  Trying it out to see if it will work for my
> upcoming project.  I created a test keyspace and table on my dev laptop.
> Loaded it with some data on a Friday and closed her down.  Returned on
> Monday and looked up the data and it was gone.  The keyspace and table was
> there, but table was empty.  This has happened twice so far.
>
> Help...
>
> Thanks,
> Angel
>

Data Deleted After a few days of being off

[A]

I'm new to Cassandra.  Trying it out to see if it will work for my upcoming 
project.  I created a test keyspace and table on my dev laptop.  Loaded it with 
some data on a Friday and closed her down.  Returned on Monday and looked up 
the data and it was gone.  The keyspace and table was there, but table was 
empty.  This has happened twice so far.
Help...
Thanks,Angel

Re: Cassandra Summit 2019 / Cassandra Summit 2018

[Rahul Singh]

I think some of the Instaclustr folks had done one last year which I really 
wanted to go to.. Distributed / Async both would be easier to get people to 
write papers, make slides, do youtube videos with.. and then we could do a 
virtual web conf of the best submissions.

On Feb 26, 2018, 1:04 PM -0600, Kenneth Brotman , 
wrote:
> Is there any planning yet for a Cassandra Summit 2019 or Cassandra Summit 
> 2018 (probably too late)?
>
> Is there a planning committee?
>
> Who wants there to be a Cassandra Summit 2019 and who thinks there is a 
> better way?
>
> We could try a Cassandra Distributed Summit 2019 where we meet virtually and 
> perhaps asynchronously, but there would be a lot more energy and bonding if 
> it’s not virtual.  I’m up for any of these.
>
> Kenneth Brotman
>
>

RE: Filling in the blank To Do sections on the Apache Cassandra web site

[Kenneth Brotman]

Here are the related JIRA’s.  Please add content even if It’s not well formed 
compositionally.  Myself or someone else will take it from there.

 

https://issues.apache.org/jira/browse/CASSANDRA-14274  The troubleshooting 
section of the web site is empty

https://issues.apache.org/jira/browse/CASSANDRA-14273  The Bulk Loading web 
page on the web site is empty

https://issues.apache.org/jira/browse/CASSANDRA-14272  The Backups web page on 
the web site is empty

https://issues.apache.org/jira/browse/CASSANDRA-14271  The Hints web page in 
the web site is empty

https://issues.apache.org/jira/browse/CASSANDRA-14270  The Read repair web page 
is empty

https://issues.apache.org/jira/browse/CASSANDRA-14269  The Data Modeling 
section of the web site is empty

https://issues.apache.org/jira/browse/CASSANDRA-14268  The 
Architecture:Guarantees web page is empty

https://issues.apache.org/jira/browse/CASSANDRA-14267  The Dynamo web page on 
the Apache Cassandra site is missing content

https://issues.apache.org/jira/browse/CASSANDRA-14266  The Architecture 
Overview web page on the Apache Cassandra site is empty

 

Thanks for pitching in.  

 

Kenneth Brotman

 

From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] 
Sent: Monday, February 26, 2018 1:54 PM
To: user@cassandra.apache.org
Subject: RE: Filling in the blank To Do sections on the Apache Cassandra web 
site

 

Nice!  Thanks for the help Oliver!

 

Kenneth Brotman

 

From: Oliver Ruebenacker [mailto:cur...@gmail.com] 
Sent: Sunday, February 25, 2018 7:12 AM
To: user@cassandra.apache.org
Cc: d...@cassandra.apache.org
Subject: Re: Filling in the blank To Do sections on the Apache Cassandra web 
site

 

 

 Hello,

  I have some slides about Cassandra 

 , feel free to borrow.

 Best, Oliver

 

On Fri, Feb 23, 2018 at 7:28 PM, Kenneth Brotman  
wrote:

These nine web pages on the Apache Cassandra web site have blank To Do 
sections.  Most of the web pages are completely blank.  Mind you there is a lot 
of hard work already done on the documentation.  I’ll make JIRA’s for any of 
the blank sections where there is not already a JIRA.  Then it will be on to 
writing up those sections.  If you have any text to help me get started for any 
of these sections that would be really cool. 

 

http://cassandra.apache.org/doc/latest/architecture/overview.html

 

http://cassandra.apache.org/doc/latest/architecture/dynamo.html

 

http://cassandra.apache.org/doc/latest/architecture/guarantees.html

 

http://cassandra.apache.org/doc/latest/data_modeling/index.html

 

http://cassandra.apache.org/doc/latest/operating/read_repair.html

 

http://cassandra.apache.org/doc/latest/operating/hints.html

 

http://cassandra.apache.org/doc/latest/operating/backups.html

 

http://cassandra.apache.org/doc/latest/operating/bulk_loading.html

 

http://cassandra.apache.org/doc/latest/troubleshooting/index.html

 

Kenneth Brotman

 




-- 

Oliver Ruebenacker

Senior Software Engineer, Diabetes Portal 
 , Broad Institute 
 

 

RE: Filling in the blank To Do sections on the Apache Cassandra web site

[Kenneth Brotman]

Nice!  Thanks for the help Oliver!

 

Kenneth Brotman

 

From: Oliver Ruebenacker [mailto:cur...@gmail.com] 
Sent: Sunday, February 25, 2018 7:12 AM
To: user@cassandra.apache.org
Cc: d...@cassandra.apache.org
Subject: Re: Filling in the blank To Do sections on the Apache Cassandra web 
site

 

 

 Hello,

  I have some slides about Cassandra 

 , feel free to borrow.

 Best, Oliver

 

On Fri, Feb 23, 2018 at 7:28 PM, Kenneth Brotman  
wrote:

These nine web pages on the Apache Cassandra web site have blank To Do 
sections.  Most of the web pages are completely blank.  Mind you there is a lot 
of hard work already done on the documentation.  I’ll make JIRA’s for any of 
the blank sections where there is not already a JIRA.  Then it will be on to 
writing up those sections.  If you have any text to help me get started for any 
of these sections that would be really cool. 

 

http://cassandra.apache.org/doc/latest/architecture/overview.html

 

http://cassandra.apache.org/doc/latest/architecture/dynamo.html

 

http://cassandra.apache.org/doc/latest/architecture/guarantees.html

 

http://cassandra.apache.org/doc/latest/data_modeling/index.html

 

http://cassandra.apache.org/doc/latest/operating/read_repair.html

 

http://cassandra.apache.org/doc/latest/operating/hints.html

 

http://cassandra.apache.org/doc/latest/operating/backups.html

 

http://cassandra.apache.org/doc/latest/operating/bulk_loading.html

 

http://cassandra.apache.org/doc/latest/troubleshooting/index.html

 

Kenneth Brotman

 




-- 

Oliver Ruebenacker

Senior Software Engineer, Diabetes Portal 
 , Broad Institute 
 

 

Add explaination of vNodes to online documentation

[Kenneth Brotman]

JIRA 14265

Add explanation of vNodes to online documentation:

https://issues.apache.org/jira/browse/CASSANDRA-14265

 

A lot of inquiries on the mailing list about how vNodes work and how to set
configuration properly.  We should add and explanation to the documentation.

 

Kenneth Brotman

RE: Gathering / Curating / Organizing Cassandra Best Practices & Patterns

[Kenneth Brotman]

Eric,

 

My tone changed as I studied in more detail the thread.  He begin with a 
well-intended but ill-advised inquiry, very public inquiry at that which itself 
was problematic.  It’s not a board member’s place to push their weight around 
like that.  That’s board member training 101.  Not his job.  He stepped in it.  
Go through staff.  Very poorly handled.  I’ll give him the benefit of the doubt 
that he meant well.  We have a problem.  It must be fixed.

 

As to getting caught in the middle I will let you ponder that.  I have to help 
get Cassandra out of Document Hell!!!

 

Kenneth Brotman

  

 

From: Eric Plowe [mailto:eric.pl...@gmail.com] 
Sent: Monday, February 26, 2018 1:14 PM
To: user@cassandra.apache.org
Subject: Re: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns

 

Kenneth, 

 

How did you get "caught in the middle" of this "stuff"? You are the one 
bringing it up? Also, your tone switched between calling Chris a "well intended 
ASF" board member, to calling him an "idiot". He asked a perfectly reasonable 
question, and then other questions followed as a result. If you want to 
contribute to the community, please start by being respectful to all members of 
the community. 

 

Regards,

 

Eric Plowe

 

On Mon, Feb 26, 2018 at 12:35 PM Kenneth Brotman  
wrote:

I got caught in  the middle of this stuff.  I feel for everyone.  I said my two 
cents.  I had to vent.   I’m back to concentrating on helping the group.

 

Kenneth Brotman

 

From: Eric Evans [mailto:john.eric.ev...@gmail.com] 
Sent: Monday, February 26, 2018 9:16 AM
To: user@cassandra.apache.org
Subject: Re: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns

 

 

 

On Sun, Feb 25, 2018 at 8:45 AM, Kenneth Brotman  
wrote:

Chris Mattmann acted without authority and completely improperly as an Apache 
Software Foundation board member as a board member on their own has no 
authority.  Their authority is to participate and vote at board meetings.  They 
are not allowed to transact business, they are not supposed to force themselves 
on anyone or order anyone around.  The one that was acting controlling was this 
idiot board member that has caused this situation between DataStax and the rest 
of our community.

 

Furthermore, when he instructed Cassandra legend Jonathan Ellis, the Cassandra 
PMC Chair to include certain information in a report to the Apache Software 
Foundation board that escalated the matter to something that was before the 
board.  

 

I am not an attorney and this should not be taken as legal advice!

 

It is clear to me as one someone who is experienced and trained as a board 
member that Chris Mattmann and the ASF itself probably will find themselves in 
court over this.  I think a lot of folks should raise this matter with their 
legal counsel.

 

What happened is not trivial.  It is news worthy.  I suggest people talk to the 
media about this story  Ask them to investigate and report the story.  

 

Is APC interfering with other communities?

 

Kenneth, I really think you need to pump the brakes here.  You're leveling some 
pretty serious accusations, and have now resorted to personal attacks; This is 
not constructive.

 

From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] 
Sent: Saturday, February 24, 2018 3:29 PM
To: user@cassandra.apache.org
Subject: RE: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns
Importance: High

 

If you read the email message, the first link below, you’ll see that it’s a 
well intending Apache Foundation board member who could not grasp how our 
community functioned.  Apache Foundation messed up our community by the way 
they handled a routine inquiry, leaving no option for DataStax but to seek 
legal counsel.  I’ve been there.  Your own legal counsel deal the final blow. 
They tell you all communication has to go through them.  They tell you there 
has to be clear separation.  They say you have to take their advice or they 
will not keep defending you and you will not any personal protection.  Anyone 
can be sued and you will be liable for defending yourself.  Sound familiar!  

 

Everyone kept saying that everything was good.  That the community, our 
community liked the way things worked.  

 

I call on Apache Foundation to reach out to DataStax and fix the mess 
forthwith!  Report openly on your efforts.  You can fix your mess Apache 
Foundation.   This email says it all.  A total miscall: 
https://www.mail-archive.com/dev@cassandra.apache.org/msg09090.html.  And the 
guy has a PhD!

 

Kenneth Brotman

 

From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] 
Sent: Saturday, February 24, 2018 12:58 PM
To: user@cassandra.apache.org
Subject: RE: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns

 

Jon,

 

This is considered the start of the problem: 

Re: Gathering / Curating / Organizing Cassandra Best Practices & Patterns

[Eric Plowe]

*Kenneth, *

How did you get "caught in the middle" of this "stuff"? You are the one
bringing it up? Also, your tone switched between calling Chris a "well
intended ASF" board member, to calling him an "idiot". He asked a perfectly
reasonable question, and then other questions followed as a result. If you
want to contribute to the community, please start by being respectful to
all members of the community.

Regards,

Eric Plowe

On Mon, Feb 26, 2018 at 12:35 PM Kenneth Brotman
 wrote:

> I got caught in  the middle of this stuff.  I feel for everyone.  I said
> my two cents.  I had to vent.   I’m back to concentrating on helping the
> group.
>
>
>
> Kenneth Brotman
>
>
>
> *From:* Eric Evans [mailto:john.eric.ev...@gmail.com]
> *Sent:* Monday, February 26, 2018 9:16 AM
> *To:* user@cassandra.apache.org
> *Subject:* Re: Gathering / Curating / Organizing Cassandra Best Practices
> & Patterns
>
>
>
>
>
>
>
> On Sun, Feb 25, 2018 at 8:45 AM, Kenneth Brotman <
> kenbrot...@yahoo.com.invalid> wrote:
>
> Chris Mattmann acted without authority and completely improperly as an
> Apache Software Foundation board member as a board member on their own has
> no authority.  Their authority is to participate and vote at board
> meetings.  They are not allowed to transact business, they are not supposed
> to force themselves on anyone or order anyone around.  The one that was
> acting controlling was this idiot board member that has caused this
> situation between DataStax and the rest of our community.
>
>
>
> Furthermore, when he instructed Cassandra legend Jonathan Ellis, the
> Cassandra PMC Chair to include certain information in a report to the
> Apache Software Foundation board that escalated the matter to something
> that was before the board.
>
>
>
> I am not an attorney and this should not be taken as legal advice!
>
>
>
> It is clear to me as one someone who is experienced and trained as a board
> member that Chris Mattmann and the ASF itself probably will find themselves
> in court over this.  I think a lot of folks should raise this matter with
> their legal counsel.
>
>
>
> What happened is not trivial.  It is news worthy.  I suggest people talk
> to the media about this story  Ask them to investigate and report the
> story.
>
>
>
> Is APC interfering with other communities?
>
>
>
> Kenneth, I really think you need to pump the brakes here.  You're leveling
> some pretty serious accusations, and have now resorted to personal attacks;
> This is not constructive.
>
>
>
> *From:* Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID]
> *Sent:* Saturday, February 24, 2018 3:29 PM
> *To:* user@cassandra.apache.org
> *Subject:* RE: Gathering / Curating / Organizing Cassandra Best Practices
> & Patterns
> *Importance:* High
>
>
>
> If you read the email message, the first link below, you’ll see that it’s
> a well intending Apache Foundation board member who could not grasp how our
> community functioned.  Apache Foundation messed up our community by the way
> they handled a routine inquiry, leaving no option for DataStax but to seek
> legal counsel.  I’ve been there.  Your own legal counsel deal the final
> blow. They tell you all communication has to go through them.  They tell
> you there has to be clear separation.  They say you have to take their
> advice or they will not keep defending you and you will not any personal
> protection.  Anyone can be sued and you will be liable for defending
> yourself.  Sound familiar!
>
>
>
> Everyone kept saying that everything was good.  That the community, our
> community liked the way things worked.
>
>
>
> I call on Apache Foundation to reach out to DataStax and fix the mess
> forthwith!  Report openly on your efforts.  You can fix your mess Apache
> Foundation.   This email says it all.  A total miscall:
> https://www.mail-archive.com/dev@cassandra.apache.org/msg09090.html.  And
> the guy has a PhD!
>
>
>
> Kenneth Brotman
>
>
>
> *From:* Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID
> ]
> *Sent:* Saturday, February 24, 2018 12:58 PM
> *To:* user@cassandra.apache.org
> *Subject:* RE: Gathering / Curating / Organizing Cassandra Best Practices
> & Patterns
>
>
>
> Jon,
>
>
>
> This is considered the start of the problem:
> https://www.mail-archive.com/dev@cassandra.apache.org/msg09050.html
>
>
>
> That’s according to this well sourced article called “Fear of Staxit: What
> next for ASF’s Cassandra as biggest donor cuts back”
> https://www.theregister.co.uk/2016/11/14/datastax_versus_asf_staxeit/
> 
>
>
>
> I am one of the people who didn’t know the history and is now as this
> article describes, caught between “A Rock and a hard place…:
>
>
> http://www.zdnet.com/article/a-rock-and-a-hard-place-between-scylladb-and-cassandra/
>
>
>
> I bet it’s been painful for everyone.  It’s really said.
>
>
>
> Kenneth Brotman
>
>
>
>
> --
>
> Eric Evans
> 

The home page of Cassandra is mobile friendly but the link to the third parties is not

[Kenneth Brotman]

The home page of Cassandra is mobile friendly but the link to the third
parties from that web page is not.  Any suggestions?  

 

I made a JIRA for it: https://issues.apache.org/jira/browse/CASSANDRA-14263

 

Should posts about JIRA's be on this list or the dev list?

 

Kenneth Brotman

 

 

Cassandra Summit 2019 / Cassandra Summit 2018

[Kenneth Brotman]

Is there any planning yet for a Cassandra Summit 2019 or Cassandra Summit
2018 (probably too late)?

 

Is there a planning committee?

 

Who wants there to be a Cassandra Summit 2019 and who thinks there is a
better way?

 

We could try a Cassandra Distributed Summit 2019 where we meet virtually and
perhaps asynchronously, but there would be a lot more energy and bonding if
it's not virtual.  I'm up for any of these.

 

Kenneth Brotman

 

 

Re: Seed nodes and bootstrap (was: Re: Initializing a multiple node cluster (multiple datacenters))

[Jeff Jirsa]

That ticket was before I was really active contributing, but I tend to
agree with your assessment: clearly there's pain point there, and we can do
better than the status quo.

The problem (as Jonathan notes) is that its a complicated subsystem, and
the "obvious" fix probably isn't as obvious as it seems.

I'll happily click the re-open button (you could have, too), but I'm not
sure what the 'right' fix is. Feel free to move discussion to 5836.




On Mon, Feb 26, 2018 at 12:51 AM, Oleksandr Shulgin <
oleksandr.shul...@zalando.de> wrote:

> On Fri, Feb 23, 2018 at 7:35 PM, Jeff Jirsa  wrote:
>
>> It comes up from time to time.  Rob Coli spent years arguing that this
>> behavior was confusing ( https://issues.apache.org/jira
>> /browse/CASSANDRA-5836 ) , especially in the "I'm replacing a failed
>> seed" sense. It also comes up when you're adding the first few hosts to a
>> new DC (where they're new, but they're definitely going to be the seeds for
>> the new DC).
>>
>
> Jeff,
>
> I find the response on this ticket quite terrible: a number of independent
> reports of significant problems caused by this behavior doesn't justify the
> "Won't Fix" status, IMO.
>
> We were also hit by this one time when the expected location of data
> directory has changed in our Docker image.  We were performing a rolling
> update of the cluster and the first two nodes that we've updated happened
> to be seeds.  They started happily with blank data directory and were
> serving read requests.  Ouch.  We only realized there was a problem then
> the next node that we've updated failed to start.  The only reason is that
> it *did* try to bootstrap and failed.
>
> People use to repeat "seed nodes are not different from non-seeds" and
> it's true from the perspective of a client application.  The same people
> would repeat "seeds don't bootstrap" as some kind of magical incantation,
> so seeds *are* different and in a subtle way for the operator.  But I don't
> believe that this difference is justified.  When creating a brand new
> cluster there is no practical difference as to using auto_bootstrap=true or
> false, because there is no data or clients, so the seed nodes behave
> exactly the same way as non-seeds.  When adding a new DC you are supposed
> to set auto_boostrap=false explicitly, so again no difference.
>
> Where it matters however, is node behavior in *unexpected* circumstances.
> If seeds nodes were truly not different from non-seeds in this regard,
> there would be less surprises, because of the total node uniformity within
> the cluster.
>
> Therefore, I argue that the ticket should be reopened.
>
> Regards,
> --
> Alex
>
>

Re: How to Parse raw CQL text?

[Jon Haddad]

Yes ideally.  I’ve been spending a bit of time in the parser the last week.  
There’s a lot of internals which are still using old terminology and are pretty 
damn confusing.  I’m doing a little investigation into exposing some of the 
information while also modernizing it.  


> On Feb 26, 2018, at 10:02 AM, Hannu Kröger  wrote:
> 
> If this is needed functionality, shouldn’t that be available as a public 
> method or something? Maybe write a patch etc. ?
> 
> Ariel Weisberg > kirjoitti 
> 26.2.2018 kello 18.47:
> 
>> Hi,
>> 
>> I took a similar approach and it worked fine. I was able to build a tool 
>> that parsed production query logs.
>> 
>> I used a helper method that would just grab a private field out of an object 
>> by name using reflection.
>> 
>> Ariel
>> 
>> On Sun, Feb 25, 2018, at 11:58 PM, Jonathan Haddad wrote:
>>> I had to do something similar recently.  Take a look at 
>>> org.apache.cassandra.cql3.QueryProcessor.parseStatement().  I've got some 
>>> sample code here [1] as well as a blog post [2] that explains how to access 
>>> the private variables, since there's no access provided.  It wasn't really 
>>> designed to be used as a library, so YMMV with future changes.  
>>> 
>>> [1] 
>>> https://github.com/rustyrazorblade/rustyrazorblade-examples/blob/master/privatevaraccess/src/main/kotlin/com/rustyrazorblade/privatevaraccess/CreateTableParser.kt
>>>  
>>> 
>>> [2] 
>>> http://rustyrazorblade.com/post/2018/2018-02-25-accessing-private-variables-in-jvm/
>>>  
>>> 
>>> 
>>> On Mon, Feb 5, 2018 at 2:27 PM Kant Kodali >> > wrote:
>>> I just did some trial and error. Looks like this would work
>>> 
>>> public class Test {
>>> 
>>> 
>>> 
>>> public static void main(String[] args) throws Exception {
>>> 
>>> String stmt = "create table if not exists test_keyspace.my_table 
>>> (field1 text, field2 int, field3 set, field4 map, 
>>> primary key (field1) );";
>>> 
>>> ANTLRStringStream stringStream = new ANTLRStringStream(stmt);
>>> 
>>> CqlLexer cqlLexer = new CqlLexer(stringStream);
>>> 
>>> CommonTokenStream token = new CommonTokenStream(cqlLexer);
>>> 
>>> CqlParser parser = new CqlParser(token);
>>> 
>>> ParsedStatement query = parser.cqlStatement();
>>> 
>>> 
>>> if (query.getClass().getDeclaringClass() == 
>>> CreateTableStatement.class) {
>>> 
>>> CreateTableStatement.RawStatement cts = 
>>> (CreateTableStatement.RawStatement) query;
>>> 
>>> CFMetaData
>>> 
>>> .compile(stmt, cts.keyspace())
>>> 
>>> 
>>> 
>>> .getColumnMetadata()
>>> 
>>> .values()
>>> 
>>> .stream()
>>> 
>>> .forEach(cd -> System.out.println(cd));
>>> 
>>> 
>>> }
>>>}
>>> }
>>> 
>>> On Mon, Feb 5, 2018 at 2:13 PM, Kant Kodali >> > wrote:
>>> Hi Anant,
>>> 
>>> I just have CQL create table statement as a string I want to extract all 
>>> the parts like, tableName, KeySpaceName, regular Columns,  partitionKey, 
>>> ClusteringKey, Clustering Order and so on. Thats really  it!
>>> 
>>> Thanks!
>>> 
>>> On Mon, Feb 5, 2018 at 1:50 PM, Rahul Singh >> > wrote:
>>> I think I understand what you are trying to do … but what is your goal? 
>>> What do you mean “use it for different” queries… Maybe you want to do an 
>>> event and have an event processor? Seems like you are trying to basically 
>>> by pass that pattern and parse a query and split it into several actions? 
>>> 
>>> Did you look into this unit test folder? 
>>> 
>>> https://github.com/apache/cassandra/blob/trunk/test/unit/org/apache/cassandra/cql3/CQLTester.java
>>>  
>>> 
>>> 
>>> --
>>> Rahul Singh
>>> rahul.si...@anant.us 
>>> 
>>> Anant Corporation
>>> 
>>> On Feb 5, 2018, 4:06 PM -0500, Kant Kodali >> >, wrote:
>>> 
 Hi All,
 
 I have a need where I get a raw CQL create table statement as a String and 
 I need to parse the keyspace, tablename, columns and so on..so I can use 
 it for various queries and send it to C*. I used the example below from 
 this link . I get the 
 following error.  And I thought maybe someone in this mailing list will be 
 more familiar with internals.  
 
 Exception in thread "main" 
 

Re: How to Parse raw CQL text?

[Hannu Kröger]

If this is needed functionality, shouldn’t that be available as a public method 
or something? Maybe write a patch etc. ?

> Ariel Weisberg  kirjoitti 26.2.2018 kello 18.47:
> 
> Hi,
> 
> I took a similar approach and it worked fine. I was able to build a tool that 
> parsed production query logs.
> 
> I used a helper method that would just grab a private field out of an object 
> by name using reflection.
> 
> Ariel
> 
>> On Sun, Feb 25, 2018, at 11:58 PM, Jonathan Haddad wrote:
>> I had to do something similar recently.  Take a look at 
>> org.apache.cassandra.cql3.QueryProcessor.parseStatement().  I've got some 
>> sample code here [1] as well as a blog post [2] that explains how to access 
>> the private variables, since there's no access provided.  It wasn't really 
>> designed to be used as a library, so YMMV with future changes.  
>> 
>> [1] 
>> https://github.com/rustyrazorblade/rustyrazorblade-examples/blob/master/privatevaraccess/src/main/kotlin/com/rustyrazorblade/privatevaraccess/CreateTableParser.kt
>> [2] 
>> http://rustyrazorblade.com/post/2018/2018-02-25-accessing-private-variables-in-jvm/
>> 
>> On Mon, Feb 5, 2018 at 2:27 PM Kant Kodali  wrote:
>> I just did some trial and error. Looks like this would work
>> 
>> public class Test {
>> 
>> 
>> 
>> public static void main(String[] args) throws Exception {
>> 
>> String stmt = "create table if not exists test_keyspace.my_table 
>> (field1 text, field2 int, field3 set, field4 map, 
>> primary key (field1) );";
>> 
>> ANTLRStringStream stringStream = new ANTLRStringStream(stmt);
>> 
>> CqlLexer cqlLexer = new CqlLexer(stringStream);
>> 
>> CommonTokenStream token = new CommonTokenStream(cqlLexer);
>> 
>> CqlParser parser = new CqlParser(token);
>> 
>> ParsedStatement query = parser.cqlStatement();
>> 
>> 
>> if (query.getClass().getDeclaringClass() == 
>> CreateTableStatement.class) {
>> 
>> CreateTableStatement.RawStatement cts = 
>> (CreateTableStatement.RawStatement) query;
>> 
>> CFMetaData
>> 
>> .compile(stmt, cts.keyspace())
>> 
>> 
>> 
>> .getColumnMetadata()
>> 
>> .values()
>> 
>> .stream()
>> 
>> .forEach(cd -> System.out.println(cd));
>> 
>> 
>> }
>>}
>> }
>> 
>> On Mon, Feb 5, 2018 at 2:13 PM, Kant Kodali  wrote:
>> Hi Anant,
>> 
>> I just have CQL create table statement as a string I want to extract all the 
>> parts like, tableName, KeySpaceName, regular Columns,  partitionKey, 
>> ClusteringKey, Clustering Order and so on. Thats really  it!
>> 
>> Thanks!
>> 
>> On Mon, Feb 5, 2018 at 1:50 PM, Rahul Singh  
>> wrote:
>> I think I understand what you are trying to do … but what is your goal? What 
>> do you mean “use it for different” queries… Maybe you want to do an event 
>> and have an event processor? Seems like you are trying to basically by pass 
>> that pattern and parse a query and split it into several actions? 
>> 
>> Did you look into this unit test folder? 
>> 
>> https://github.com/apache/cassandra/blob/trunk/test/unit/org/apache/cassandra/cql3/CQLTester.java
>> 
>> --
>> Rahul Singh
>> rahul.si...@anant.us
>> 
>> Anant Corporation
>> 
>> On Feb 5, 2018, 4:06 PM -0500, Kant Kodali , wrote:
>> 
>>> Hi All,
>>> 
>>> I have a need where I get a raw CQL create table statement as a String and 
>>> I need to parse the keyspace, tablename, columns and so on..so I can use it 
>>> for various queries and send it to C*. I used the example below from this 
>>> link. I get the following error.  And I thought maybe someone in this 
>>> mailing list will be more familiar with internals.  
>>> 
>>> Exception in thread "main" 
>>> org.apache.cassandra.exceptions.ConfigurationException: Keyspace 
>>> test_keyspace doesn't exist
>>> at 
>>> org.apache.cassandra.cql3.statements.CreateTableStatement$RawStatement.prepare(CreateTableStatement.java:200)
>>> at com.hello.world.Test.main(Test.java:23)
>>> 
>>> 
>>> Here is my code.
>>> 
>>> package com.hello.world;
>>> 
>>> 
>>> 
>>> import org.antlr.runtime.ANTLRStringStream;
>>> 
>>> import org.antlr.runtime.CommonTokenStream;
>>> 
>>> import org.apache.cassandra.cql3.CqlLexer;
>>> 
>>> import org.apache.cassandra.cql3.CqlParser;
>>> 
>>> import org.apache.cassandra.cql3.statements.CreateTableStatement;
>>> 
>>> import org.apache.cassandra.cql3.statements.ParsedStatement;
>>> 
>>> 
>>> 
>>> public class Test {
>>> 
>>> 
>>> 
>>> public static void main(String[] args) throws Exception {
>>> 
>>> String stmt = "create table if not exists test_keyspace.my_table 
>>> (field1 text, field2 int, field3 set, field4 map, 
>>> primary key (field1) );";
>>> 
>>> ANTLRStringStream stringStream = new ANTLRStringStream(stmt);
>>> 
>>> CqlLexer cqlLexer = new 

Re: How to Parse raw CQL text?

[Kant Kodali]

wouldn't it make sense to expose the parser at some point?

On Mon, Feb 26, 2018 at 9:47 AM, Ariel Weisberg  wrote:

> Hi,
>
> I took a similar approach and it worked fine. I was able to build a tool
> that parsed production query logs.
>
> I used a helper method that would just grab a private field out of an
> object by name using reflection.
>
> Ariel
>
> On Sun, Feb 25, 2018, at 11:58 PM, Jonathan Haddad wrote:
>
> I had to do something similar recently.  Take a look at
> org.apache.cassandra.cql3.QueryProcessor.parseStatement().  I've got some
> sample code here [1] as well as a blog post [2] that explains how to access
> the private variables, since there's no access provided.  It wasn't really
> designed to be used as a library, so YMMV with future changes.
>
> [1] https://github.com/rustyrazorblade/rustyrazorblade-examples/blob/
> master/privatevaraccess/src/main/kotlin/com/rustyrazorblade/
> privatevaraccess/CreateTableParser.kt
> [2] http://rustyrazorblade.com/post/2018/2018-02-25-
> accessing-private-variables-in-jvm/
>
> On Mon, Feb 5, 2018 at 2:27 PM Kant Kodali  wrote:
>
> I just did some trial and error. Looks like this would work
>
> *public class *Test {
>
> *public static void *main(String[] args) *throws *Exception {
>
> String stmt = *"create table if not exists test_keyspace.my_table 
> (field1 text, field2 int, field3 set, field4 map, primary 
> key (field1) );"*;
> ANTLRStringStream stringStream = *new *ANTLRStringStream(stmt);
> CqlLexer cqlLexer = *new *CqlLexer(stringStream);
> CommonTokenStream token = *new *CommonTokenStream(cqlLexer);
> CqlParser parser = *new *CqlParser(token);
>
> ParsedStatement query = parser.cqlStatement();
>
>
> *if *(query.getClass().getDeclaringClass() == 
> CreateTableStatement.*class*) {
> CreateTableStatement.RawStatement cts = 
> (CreateTableStatement.RawStatement) query;
>
> CFMetaData
> .*compile*(stmt, cts.keyspace())
>
>
> .getColumnMetadata()
> .values()
> .stream()
> .forEach(cd -> System.*out*.println(cd));
>
>
> }
>
>}
>
> }
>
>
> On Mon, Feb 5, 2018 at 2:13 PM, Kant Kodali  wrote:
>
> Hi Anant,
>
> I just have CQL create table statement as a string I want to extract all
> the parts like, tableName, KeySpaceName, regular Columns,  partitionKey,
> ClusteringKey, Clustering Order and so on. Thats really  it!
>
> Thanks!
>
> On Mon, Feb 5, 2018 at 1:50 PM, Rahul Singh 
> wrote:
>
> I think I understand what you are trying to do … but what is your goal?
> What do you mean “use it for different” queries… Maybe you want to do an
> event and have an event processor? Seems like you are trying to basically
> by pass that pattern and parse a query and split it into several actions?
>
> Did you look into this unit test folder?
>
> https://github.com/apache/cassandra/blob/trunk/test/
> unit/org/apache/cassandra/cql3/CQLTester.java
>
> --
> Rahul Singh
> rahul.si...@anant.us
>
> Anant Corporation
>
> On Feb 5, 2018, 4:06 PM -0500, Kant Kodali , wrote:
>
> Hi All,
>
> I have a need where I get a raw CQL create table statement as a String and
> I need to parse the keyspace, tablename, columns and so on..so I can use it
> for various queries and send it to C*. I used the example below from this
> link . I get the
> following error.  And I thought maybe someone in this mailing list will be
> more familiar with internals.
>
> Exception in thread "main" 
> org.apache.cassandra.exceptions.ConfigurationException:
> Keyspace test_keyspace doesn't exist
> at org.apache.cassandra.cql3.statements.CreateTableStatement$
> RawStatement.prepare(CreateTableStatement.java:200)
> at com.hello.world.Test.main(Test.java:23)
>
>
> Here is my code.
>
> *package *com.hello.world;
>
> *import *org.antlr.runtime.ANTLRStringStream;
> *import *org.antlr.runtime.CommonTokenStream;
> *import *org.apache.cassandra.cql3.CqlLexer;
> *import *org.apache.cassandra.cql3.CqlParser;
> *import *org.apache.cassandra.cql3.statements.CreateTableStatement;
> *import *org.apache.cassandra.cql3.statements.ParsedStatement;
>
> *public class *Test {
>
> *public static void *main(String[] args) *throws *Exception {
> String stmt = *"create table if not exists test_keyspace**.my_table 
> (field1 text, field2 int, field3 set, field4 map, primary 
> key (field1) );"*;
> ANTLRStringStream stringStream = *new *ANTLRStringStream(stmt);
> CqlLexer cqlLexer = *new *CqlLexer(stringStream);
> CommonTokenStream token = *new *CommonTokenStream(cqlLexer);
> CqlParser parser = *new *CqlParser(token);
> ParsedStatement query = parser.query();
> *if *(query.getClass().getDeclaringClass() == 
> 

Re: How to Parse raw CQL text?

[Ariel Weisberg]

Hi,

I took a similar approach and it worked fine. I was able to build a tool
that parsed production query logs.
I used a helper method that would just grab a private field out of an
object by name using reflection.
Ariel

On Sun, Feb 25, 2018, at 11:58 PM, Jonathan Haddad wrote:
> I had to do something similar recently.  Take a look at
> org.apache.cassandra.cql3.QueryProcessor.parseStatement().  I've got
> some sample code here [1] as well as a blog post [2] that explains how
> to access the private variables, since there's no access provided.  It
> wasn't really designed to be used as a library, so YMMV with future
> changes.> 
> [1] 
> https://github.com/rustyrazorblade/rustyrazorblade-examples/blob/master/privatevaraccess/src/main/kotlin/com/rustyrazorblade/privatevaraccess/CreateTableParser.kt>
>  [2] 
> http://rustyrazorblade.com/post/2018/2018-02-25-accessing-private-variables-in-jvm/>
>  
> On Mon, Feb 5, 2018 at 2:27 PM Kant Kodali  wrote:>> I 
> just did some trial and error. Looks like this would work
>> 
>> *public class *Test {
>> 
>> 
>> 
>> *public static void *main(String[] args) *throws *Exception {
 String stmt = *"create table if not exists
>> test_keyspace.my_table (field1 text, field2 int, field3
>> set, field4 map, primary key (field1)
>> );"*;
 ANTLRStringStream stringStream = *new
>> *ANTLRStringStream(stmt);
 CqlLexer cqlLexer = *new *CqlLexer(stringStream);
>> 
>> CommonTokenStream token = *new *CommonTokenStream(cqlLexer);
 CqlParser parser = *new *CqlParser(token);
>> 
>> ParsedStatement query = parser.cqlStatement();
>> 
>> 
>> *if *(query.getClass().getDeclaringClass() ==
>>  CreateTableStatement.*class*) {
 CreateTableStatement.RawStatement cts =
>> (CreateTableStatement.RawStatement) query;
 CFMetaData
>> 
>> .*compile*(stmt, cts.keyspace())
>> 
>> 
>> 
>> .getColumnMetadata()
>> 
>> .values()
>> 
>> .stream()
>> 
>> .forEach(cd -> System.**out**.println(cd));
>> 
>> 
>> }
>>}
>> }
>> 
>> On Mon, Feb 5, 2018 at 2:13 PM, Kant Kodali
>>  wrote:>>> Hi Anant,
>>> 
>>> I just have CQL create table statement as a string I want to extract
>>> all the parts like, tableName, KeySpaceName, regular Columns,
>>> partitionKey, ClusteringKey, Clustering Order and so on. Thats
>>> really  it!>>> 
>>> Thanks!
>>> 
>>> On Mon, Feb 5, 2018 at 1:50 PM, Rahul Singh
>>>  wrote: I think I understand what you are 
>>> trying to do … but what is your
 goal? What do you mean “use it for different” queries… Maybe you
 want to do an event and have an event processor? Seems like you are
 trying to basically by pass that pattern and parse a query and
 split it into several actions? 
 Did you look into this unit test folder? 
 
 https://github.com/apache/cassandra/blob/trunk/test/unit/org/apache/cassandra/cql3/CQLTester.java
  
 --
  Rahul Singh
 rahul.si...@anant.us
 
  Anant Corporation
 
 On Feb 5, 2018, 4:06 PM -0500, Kant Kodali ,
 wrote: 
> Hi All,
> 
> I have a need where I get a raw CQL create table statement as a
> String and I need to parse the keyspace, tablename, columns and so
> on..so I can use it for various queries and send it to C*. I used
> the example below from this link[1]. I get the following error.
> And I thought maybe someone in this mailing list will be more
> familiar with internals.> 
> Exception in thread "main"
> org.apache.cassandra.exceptions.ConfigurationException: Keyspace
> test_keyspace doesn't exist> at 
> org.apache.cassandra.cql3.statements.CreateTableStatement$RawS-
> tatement.prepare(CreateTableStatement.java:200)> at 
> com.hello.world.Test.main(Test.java:23)
> 
> 
> Here is my code.
> 
> *package *com.hello.world;
> 
> 
> 
> *import *org.antlr.runtime.ANTLRStringStream;
> 
> *import *org.antlr.runtime.CommonTokenStream;
> 
> *import *org.apache.cassandra.cql3.CqlLexer;
> 
> *import *org.apache.cassandra.cql3.CqlParser;
> 
> *import
> *org.apache.cassandra.cql3.statements.CreateTableStatement;
>> *import *org.apache.cassandra.cql3.statements.ParsedStatement;
>> 
> 
> *public class *Test {
> 
> 
> 
> *public static void *main(String[] args) *throws *Exception {
>> String stmt = *"create table if not exists
> test_keyspace**.my_table (field1 text, field2 int, field3
> set, field4 map, primary key (field1)
> );"*;
>> ANTLRStringStream stringStream = *new
> 

RE: Gathering / Curating / Organizing Cassandra Best Practices & Patterns

[Kenneth Brotman]

I got caught in  the middle of this stuff.  I feel for everyone.  I said my two 
cents.  I had to vent.   I’m back to concentrating on helping the group.

 

Kenneth Brotman

 

From: Eric Evans [mailto:john.eric.ev...@gmail.com] 
Sent: Monday, February 26, 2018 9:16 AM
To: user@cassandra.apache.org
Subject: Re: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns

 

 

 

On Sun, Feb 25, 2018 at 8:45 AM, Kenneth Brotman  
wrote:

Chris Mattmann acted without authority and completely improperly as an Apache 
Software Foundation board member as a board member on their own has no 
authority.  Their authority is to participate and vote at board meetings.  They 
are not allowed to transact business, they are not supposed to force themselves 
on anyone or order anyone around.  The one that was acting controlling was this 
idiot board member that has caused this situation between DataStax and the rest 
of our community.

 

Furthermore, when he instructed Cassandra legend Jonathan Ellis, the Cassandra 
PMC Chair to include certain information in a report to the Apache Software 
Foundation board that escalated the matter to something that was before the 
board.  

 

I am not an attorney and this should not be taken as legal advice!

 

It is clear to me as one someone who is experienced and trained as a board 
member that Chris Mattmann and the ASF itself probably will find themselves in 
court over this.  I think a lot of folks should raise this matter with their 
legal counsel.

 

What happened is not trivial.  It is news worthy.  I suggest people talk to the 
media about this story  Ask them to investigate and report the story.  

 

Is APC interfering with other communities?

 

Kenneth, I really think you need to pump the brakes here.  You're leveling some 
pretty serious accusations, and have now resorted to personal attacks; This is 
not constructive.

 

From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] 
Sent: Saturday, February 24, 2018 3:29 PM
To: user@cassandra.apache.org
Subject: RE: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns
Importance: High

 

If you read the email message, the first link below, you’ll see that it’s a 
well intending Apache Foundation board member who could not grasp how our 
community functioned.  Apache Foundation messed up our community by the way 
they handled a routine inquiry, leaving no option for DataStax but to seek 
legal counsel.  I’ve been there.  Your own legal counsel deal the final blow. 
They tell you all communication has to go through them.  They tell you there 
has to be clear separation.  They say you have to take their advice or they 
will not keep defending you and you will not any personal protection.  Anyone 
can be sued and you will be liable for defending yourself.  Sound familiar!  

 

Everyone kept saying that everything was good.  That the community, our 
community liked the way things worked.  

 

I call on Apache Foundation to reach out to DataStax and fix the mess 
forthwith!  Report openly on your efforts.  You can fix your mess Apache 
Foundation.   This email says it all.  A total miscall: 
https://www.mail-archive.com/dev@cassandra.apache.org/msg09090.html.  And the 
guy has a PhD!

 

Kenneth Brotman

 

From: Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID] 
Sent: Saturday, February 24, 2018 12:58 PM
To: user@cassandra.apache.org
Subject: RE: Gathering / Curating / Organizing Cassandra Best Practices & 
Patterns

 

Jon,

 

This is considered the start of the problem: 
https://www.mail-archive.com/dev@cassandra.apache.org/msg09050.html

 

That’s according to this well sourced article called “Fear of Staxit: What next 
for ASF’s Cassandra as biggest donor cuts back” 
https://www.theregister.co.uk/2016/11/14/datastax_versus_asf_staxeit/ 
 

 

I am one of the people who didn’t know the history and is now as this article 
describes, caught between “A Rock and a hard place…: 

http://www.zdnet.com/article/a-rock-and-a-hard-place-between-scylladb-and-cassandra/

 

I bet it’s been painful for everyone.  It’s really said.

 

Kenneth Brotman




-- 

Eric Evans
john.eric.ev...@gmail.com

Re: Gathering / Curating / Organizing Cassandra Best Practices & Patterns

[Eric Evans]

On Sun, Feb 25, 2018 at 8:45 AM, Kenneth Brotman <
kenbrot...@yahoo.com.invalid> wrote:

> Chris Mattmann acted without authority and completely improperly as an
> Apache Software Foundation board member as a board member on their own has
> no authority.  Their authority is to participate and vote at board
> meetings.  They are not allowed to transact business, they are not supposed
> to force themselves on anyone or order anyone around.  The one that was
> acting controlling was this idiot board member that has caused this
> situation between DataStax and the rest of our community.
>
>
>
> Furthermore, when he instructed Cassandra legend Jonathan Ellis, the
> Cassandra PMC Chair to include certain information in a report to the
> Apache Software Foundation board that escalated the matter to something
> that was before the board.
>
>
>
> I am not an attorney and this should not be taken as legal advice!
>
>
>
> It is clear to me as one someone who is experienced and trained as a board
> member that Chris Mattmann and the ASF itself probably will find themselves
> in court over this.  I think a lot of folks should raise this matter with
> their legal counsel.
>
>
>
> What happened is not trivial.  It is news worthy.  I suggest people talk
> to the media about this story.  Ask them to investigate and report the
> story.
>
>
>
> Is APC interfering with other communities?
>

Kenneth, I really think you need to pump the brakes here.  You're leveling
some pretty serious accusations, and have now resorted to personal attacks;
This is not constructive.


*From:* Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID]
> *Sent:* Saturday, February 24, 2018 3:29 PM
> *To:* user@cassandra.apache.org
> *Subject:* RE: Gathering / Curating / Organizing Cassandra Best Practices
> & Patterns
> *Importance:* High
>
>
>
> If you read the email message, the first link below, you’ll see that it’s
> a well intending Apache Foundation board member who could not grasp how our
> community functioned.  Apache Foundation messed up our community by the way
> they handled a routine inquiry, leaving no option for DataStax but to seek
> legal counsel.  I’ve been there.  Your own legal counsel deal the final
> blow. They tell you all communication has to go through them.  They tell
> you there has to be clear separation.  They say you have to take their
> advice or they will not keep defending you and you will not any personal
> protection.  Anyone can be sued and you will be liable for defending
> yourself.  Sound familiar!
>
>
>
> Everyone kept saying that everything was good.  That the community, our
> community liked the way things worked.
>
>
>
> I call on Apache Foundation to reach out to DataStax and fix the mess
> forthwith!  Report openly on your efforts.  You can fix your mess Apache
> Foundation.   This email says it all.  A total miscall:
> https://www.mail-archive.com/dev@cassandra.apache.org/msg09090.html.  And
> the guy has a PhD!
>
>
>
> Kenneth Brotman
>
>
>
> *From:* Kenneth Brotman [mailto:kenbrot...@yahoo.com.INVALID
> ]
> *Sent:* Saturday, February 24, 2018 12:58 PM
> *To:* user@cassandra.apache.org
> *Subject:* RE: Gathering / Curating / Organizing Cassandra Best Practices
> & Patterns
>
>
>
> Jon,
>
>
>
> This is considered the start of the problem: https://www.mail-archive.com/
> d...@cassandra.apache.org/msg09050.html
>
>
>
> That’s according to this well sourced article called “Fear of Staxit: What
> next for ASF’s Cassandra as biggest donor cuts back”
> https://www.theregister.co.uk/2016/11/14/datastax_versus_asf_staxeit/
>
>
>
> I am one of the people who didn’t know the history and is now as this
> article describes, caught between “A Rock and a hard place…:
>
> http://www.zdnet.com/article/a-rock-and-a-hard-place-between-scylladb-and-
> cassandra/
>
>
>
> I bet it’s been painful for everyone.  It’s really said.
>
>
>
> Kenneth Brotman
>



-- 
Eric Evans
john.eric.ev...@gmail.com

Re: vnodes status verification

[Hannu Kröger]

Hello,

you can always run “nodetool ring” to see all tokens.

Hannu

> On 26 Feb 2018, at 12:32, Ivan Iliev  wrote:
> 
> Hello C* Gurus,
> 
> I am quite new to cassandra so I am struggling over the concent of vnodes and 
> how to verify if those are properly enabled on my cluster.
> 
> I have the num_tokens in yaml set to 256 across all nodes and initial_token 
> is commented out of the config.
> 
> Apart from that I cannot find any other configuration needed to be applied 
> for this to work, but I'm also not sure how to verify if this is OK apart 
> from doing "nodetool status" which shows this:
> 
> Status=Up/Down 
> |/ State=Normal/Leaving/Joining/Moving 
> --  AddressLoad   Tokens   OwnsHost ID
>Rack 
> DN  10.32.16.48125.08 GiB  256  ?   
> 0c90ef09-097f-4e24-80ca-fc87e3c44e3c  RAC1 
> UN  10.32.16.194   116.3 GiB  256  ?   
> 59e194df-dc44-4a82-a95c-2aac3d5292dc  RAC1 
> UN  10.32.17.4 38.89 GiB  256  ?   
> 87745b2e-3be9-4dc9-a39d-298830657d05  RAC1 
> UN  10.32.16.31111.93 GiB  256  ?   
> a4666251-816a-424b-a374-63da2b9a3dab  RAC1
> 
> Is there anything else I can check to verify if vnodes are "created" ?
> 
> Also is there a way to get a list of the vnodes in a cluster or any other 
> info about it that may be valuable for managing those ?
> 
> Or is the concept I have about vnodes wrong and there are no such 
> representations as seperate nodes in the cluster for example?
> 
> Thank you,
> Ivan
> -- 
> Best regards
> Ivan I. Iliev
> System Administrator
> 
> Melexis Bulgaria Ltd.
> 2 Samokovsko shose Blvd.
> 1138 Sofia
> Bulgaria
> 
> Mobile:+359 88 9221923
> E-mail: iai @melexis.com 
> Website: www.melexis.com 
> 
> The contents of this e-mail are CONFIDENTIAL AND PROPRIETARY. Please read our 
> disclaimer at http://www.melexis.com/mailpolicy 
> .

vnodes status verification

[Ivan Iliev]

Hello C* Gurus,

I am quite new to cassandra so I am struggling over the concent of vnodes
and how to verify if those are properly enabled on my cluster.

I have the num_tokens in yaml set to 256 across all nodes and initial_token
is commented out of the config.

Apart from that I cannot find any other configuration needed to be applied
for this to work, but I'm also not sure how to verify if this is OK apart
from doing "nodetool status" which shows this:

Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
--  AddressLoad   Tokens   OwnsHost ID
  Rack
DN  10.32.16.48125.08 GiB  256  ?
  0c90ef09-097f-4e24-80ca-fc87e3c44e3c  RAC1
UN  10.32.16.194   116.3 GiB  256  ?
  59e194df-dc44-4a82-a95c-2aac3d5292dc  RAC1
UN  10.32.17.4 38.89 GiB  256  ?
  87745b2e-3be9-4dc9-a39d-298830657d05  RAC1
UN  10.32.16.31111.93 GiB  256  ?
  a4666251-816a-424b-a374-63da2b9a3dab  RAC1

Is there anything else I can check to verify if vnodes are "created" ?

Also is there a way to get a list of the vnodes in a cluster or any other
info about it that may be valuable for managing those ?

Or is the concept I have about vnodes wrong and there are no such
representations as seperate nodes in the cluster for example?

Thank you,
Ivan
-- 
*Best regards*
Ivan I. Iliev
System Administrator

Melexis Bulgaria Ltd.
2 Samokovsko shose Blvd.
1138 Sofia
Bulgaria

Mobile:+359 88 9221923
E-mail: iai @melexis.com 
Website: www.melexis.com

The contents of this e-mail are CONFIDENTIAL AND PROPRIETARY. Please read
our disclaimer at http://www.melexis.com/mailpolicy.

Re: Cassandra Hints monitoring

[Jai Bheemsen Rao Dhanwada]

This works when the count value is changing/increasing.

In my case if the Hints total value is 10 for 2 hours, the
difference(sum("TotalHints_Count")) is going to be 10 for that 10 seconds
time period and then it will be 0 later on. where as the value should be
constantly 10 until there is a change in number for the count.

On Mon, Feb 26, 2018 at 2:18 AM, Nicolas Guyomar 
wrote:

> I find DIFFERENCE to be working for dropped mutation, which IMHO works
> the same way as Hint metrics
> *select difference(sum("Dropped_Count")) FROM "cassandraDroppedMessage"
> groupby host*  is valid when I check with nodetool  over a period of time
>
> Not sure what is not working on your side
>
> On 26 February 2018 at 11:02, Jai Bheemsen Rao Dhanwada <
> jaibheem...@gmail.com> wrote:
>
>> DIFFERENCE may not work here, if the Hints count is 10 for few hours, the
>> difference is always is zero. which is not the correct value.
>>
>> On Mon, Feb 26, 2018 at 1:18 AM, Jai Bheemsen Rao Dhanwada <
>> jaibheem...@gmail.com> wrote:
>>
>>> Thanks Alex,
>>>
>>> Let me try it.
>>>
>>>
>>> On Monday, February 26, 2018, Oleksandr Shulgin <
>>> oleksandr.shul...@zalando.de> wrote:
>>>
 On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada <
 jaibheem...@gmail.com> wrote:

> Thank you Alex,
>
> I tried "TotalHintsInProgress" already, and I don't see it sending
> the correct metrics. I used mean("TotalHintsInProgress") and I see 0
> always on grafana.
> Do you know what is the correct way to do rate or diff for hints using
> "TotalHints"? I am currently using the below query
>
> SELECT mean("TotalHints_Count") FROM "cassandraStorage"
> WHERE $timeFilter GROUP BY time(10s)
>

 I've never really used InfluxDB, but it seems that DIFFERENCE is what
 you're looking for: https://docs.influxdata.c
 om/influxdb/v1.4/query_language/functions/#difference

 --
 Alex


>>
>

Re: Cassandra Hints monitoring

[Nicolas Guyomar]

I find DIFFERENCE to be working for dropped mutation, which IMHO works the
same way as Hint metrics
*select difference(sum("Dropped_Count")) FROM "cassandraDroppedMessage"
groupby host*  is valid when I check with nodetool  over a period of time

Not sure what is not working on your side

On 26 February 2018 at 11:02, Jai Bheemsen Rao Dhanwada <
jaibheem...@gmail.com> wrote:

> DIFFERENCE may not work here, if the Hints count is 10 for few hours, the
> difference is always is zero. which is not the correct value.
>
> On Mon, Feb 26, 2018 at 1:18 AM, Jai Bheemsen Rao Dhanwada <
> jaibheem...@gmail.com> wrote:
>
>> Thanks Alex,
>>
>> Let me try it.
>>
>>
>> On Monday, February 26, 2018, Oleksandr Shulgin <
>> oleksandr.shul...@zalando.de> wrote:
>>
>>> On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada <
>>> jaibheem...@gmail.com> wrote:
>>>
 Thank you Alex,

 I tried "TotalHintsInProgress" already, and I don't see it sending the
 correct metrics. I used mean("TotalHintsInProgress") and I see 0
 always on grafana.
 Do you know what is the correct way to do rate or diff for hints using 
 "TotalHints"?
 I am currently using the below query

 SELECT mean("TotalHints_Count") FROM "cassandraStorage"
 WHERE $timeFilter GROUP BY time(10s)

>>>
>>> I've never really used InfluxDB, but it seems that DIFFERENCE is what
>>> you're looking for: https://docs.influxdata.c
>>> om/influxdb/v1.4/query_language/functions/#difference
>>>
>>> --
>>> Alex
>>>
>>>
>

Re: Cassandra Hints monitoring

[Jai Bheemsen Rao Dhanwada]

DIFFERENCE may not work here, if the Hints count is 10 for few hours, the
difference is always is zero. which is not the correct value.

On Mon, Feb 26, 2018 at 1:18 AM, Jai Bheemsen Rao Dhanwada <
jaibheem...@gmail.com> wrote:

> Thanks Alex,
>
> Let me try it.
>
>
> On Monday, February 26, 2018, Oleksandr Shulgin <
> oleksandr.shul...@zalando.de> wrote:
>
>> On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada <
>> jaibheem...@gmail.com> wrote:
>>
>>> Thank you Alex,
>>>
>>> I tried "TotalHintsInProgress" already, and I don't see it sending the
>>> correct metrics. I used mean("TotalHintsInProgress") and I see 0 always
>>> on grafana.
>>> Do you know what is the correct way to do rate or diff for hints using 
>>> "TotalHints"?
>>> I am currently using the below query
>>>
>>> SELECT mean("TotalHints_Count") FROM "cassandraStorage"
>>> WHERE $timeFilter GROUP BY time(10s)
>>>
>>
>> I've never really used InfluxDB, but it seems that DIFFERENCE is what
>> you're looking for: https://docs.influxdata.c
>> om/influxdb/v1.4/query_language/functions/#difference
>>
>> --
>> Alex
>>
>>

Re: hardware sizing for insert only scenarios

[Nicolas Guyomar]

Hi,

Before looking for a sizing, have you try looking for application side
compression before inserting you data (this paper is really interresting
https://aaltodoc.aalto.fi/bitstream/handle/123456789/29099/master_Burman_
Michael_2017.pdf?sequence=1 ) ? For timeseries use case this is a major
storage cost saving !

IMHO active data are the one that might be involved in a compaction, so it
might be every data in your table if you are using STCS/LCS, but TWCS will
stop looking at old sstable once their time window is considered close ("An
SSTable from a bucket can never be compacted with an SSTable from another
bucket" => http://thelastpickle.com/blog/2016/12/08/TWCS-part1.html




On 26 February 2018 at 09:58, onmstester onmstester 
wrote:

> Another Question on node density, in this scenario:
> 1. we should keep time series data of some years for a heavy write system
> in Cassandra (> 10K Ops in seconds)
> 2. the system is insert only and inserted data would never be updated
> 3. in partition key, we used number of months since 1970, so data for
> every month would be on separate partitions
> 4. because of rule 2, after the end of month previous partitions would
> never be accessed for write requests
> 5. more than 90% of read requests would concern current month partitions,
> so we merely access Old data, we should just keep them for that 10% of
> reports!
> 6. The overall read in comparison to writes are so small (like 0.0001 % of
> overall time)
>
> So, finally the question:
> Even in this scenario would the active data be the whole data (this month
> + all previous months)? or the one which would be accessed for most reads
> and writes (only the past two months)?
> Could i use more than 3TB  per node for this scenario?
> something like:
> CPU: 5 Core
> RAM: 32 GB
> Disk: 5 TB
>
> Sent using Zoho Mail 
>
>
>

Re: Cassandra Hints monitoring

[Jai Bheemsen Rao Dhanwada]

Thanks Alex,

Let me try it.

On Monday, February 26, 2018, Oleksandr Shulgin <
oleksandr.shul...@zalando.de> wrote:

> On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada <
> jaibheem...@gmail.com> wrote:
>
>> Thank you Alex,
>>
>> I tried "TotalHintsInProgress" already, and I don't see it sending the
>> correct metrics. I used mean("TotalHintsInProgress") and I see 0 always
>> on grafana.
>> Do you know what is the correct way to do rate or diff for hints using 
>> "TotalHints"?
>> I am currently using the below query
>>
>> SELECT mean("TotalHints_Count") FROM "cassandraStorage" WHERE $timeFilter
>> GROUP BY time(10s)
>>
>
> I've never really used InfluxDB, but it seems that DIFFERENCE is what
> you're looking for: https://docs.influxdata.com/influxdb/v1.4/query_
> language/functions/#difference
>
> --
> Alex
>
>

Re: Cassandra Hints monitoring

[Oleksandr Shulgin]

On Mon, Feb 26, 2018 at 10:02 AM, Jai Bheemsen Rao Dhanwada <
jaibheem...@gmail.com> wrote:

> Thank you Alex,
>
> I tried "TotalHintsInProgress" already, and I don't see it sending the
> correct metrics. I used mean("TotalHintsInProgress") and I see 0 always
> on grafana.
> Do you know what is the correct way to do rate or diff for hints using 
> "TotalHints"?
> I am currently using the below query
>
> SELECT mean("TotalHints_Count") FROM "cassandraStorage" WHERE $timeFilter
> GROUP BY time(10s)
>

I've never really used InfluxDB, but it seems that DIFFERENCE is what
you're looking for:
https://docs.influxdata.com/influxdb/v1.4/query_language/functions/#difference

--
Alex

Re: Cassandra Hints monitoring

[Jai Bheemsen Rao Dhanwada]

Thank you Alex,

I tried "TotalHintsInProgress" already, and I don't see it sending the
correct metrics. I used mean("TotalHintsInProgress") and I see 0 always on
grafana.
Do you know what is the correct way to do rate or diff for hints using
"TotalHints"?
I am currently using the below query

SELECT mean("TotalHints_Count") FROM "cassandraStorage" WHERE $timeFilter
GROUP BY time(10s)

On Mon, Feb 26, 2018 at 12:26 AM, Oleksandr Shulgin <
oleksandr.shul...@zalando.de> wrote:

> On Mon, Feb 26, 2018 at 8:21 AM, Jai Bheemsen Rao Dhanwada <
> jaibheem...@gmail.com> wrote:
>
>>
>> I am trying to evaluate the JMX hints metrics for cassandra(TotalHints).
>> However, when I am testing the metrics, the total hints accumulated count
>> shows perfectly fine, but when the hints are replayed and the hints
>> count(cql> SELECT * from system.hints; ) becomes zero on cql, and the JMX
>> metrics counter doesn't reset to zero and stays at the last known non-zero
>> value(eg: 6). when new hints are created the total get added to the last
>> non-zero count(e.g 6+2). Any idea if there is a way to get the active count
>> during the given time period?
>>
>
> That's correct.  The "TotalHints" metric gives you a running total since
> the last startup of the node.  In Grafana you can use rate() or diff()
> aggregation on top of that, with a caveat that it produces a huge negative
> when the node is actually restarted and the next reading is less than the
> previous.
>
> There is also "TotalHintsInProgress" which might be what you're looking
> for, this one is reset back to 0 by the node once the hints are processed.
>
> Cheers,
> --
> Alex
>
>

hardware sizing for insert only scenarios

[onmstester onmstester]

Another Question on node density, in this scenario: 

1. we should keep time series data of some years for a heavy write system in 
Cassandra ( 10K Ops in seconds) 

2. the system is insert only and inserted data would never be updated 

3. in partition key, we used number of months since 1970, so data for every 
month would be on separate partitions 

4. because of rule 2, after the end of month previous partitions would never be 
accessed for write requests 

5. more than 90% of read requests would concern current month partitions, so we 
merely access Old data, we should just keep them for that 10% of reports! 

6. The overall read in comparison to writes are so small (like 0.0001 % of 
overall time) 



So, finally the question: 

Even in this scenario would the active data be the whole data (this month + all 
previous months)? or the one which would be accessed for most reads and writes 
(only the past two months)?  

Could i use more than 3TB  per node for this scenario? 

something like:

CPU: 5 Core

RAM: 32 GB

Disk: 5 TB 



 


Sent using Zoho Mail

Seed nodes and bootstrap (was: Re: Initializing a multiple node cluster (multiple datacenters))

[Oleksandr Shulgin]

On Fri, Feb 23, 2018 at 7:35 PM, Jeff Jirsa  wrote:

> It comes up from time to time.  Rob Coli spent years arguing that this
> behavior was confusing ( https://issues.apache.org/
> jira/browse/CASSANDRA-5836 ) , especially in the "I'm replacing a failed
> seed" sense. It also comes up when you're adding the first few hosts to a
> new DC (where they're new, but they're definitely going to be the seeds for
> the new DC).
>

Jeff,

I find the response on this ticket quite terrible: a number of independent
reports of significant problems caused by this behavior doesn't justify the
"Won't Fix" status, IMO.

We were also hit by this one time when the expected location of data
directory has changed in our Docker image.  We were performing a rolling
update of the cluster and the first two nodes that we've updated happened
to be seeds.  They started happily with blank data directory and were
serving read requests.  Ouch.  We only realized there was a problem then
the next node that we've updated failed to start.  The only reason is that
it *did* try to bootstrap and failed.

People use to repeat "seed nodes are not different from non-seeds" and it's
true from the perspective of a client application.  The same people would
repeat "seeds don't bootstrap" as some kind of magical incantation, so
seeds *are* different and in a subtle way for the operator.  But I don't
believe that this difference is justified.  When creating a brand new
cluster there is no practical difference as to using auto_bootstrap=true or
false, because there is no data or clients, so the seed nodes behave
exactly the same way as non-seeds.  When adding a new DC you are supposed
to set auto_boostrap=false explicitly, so again no difference.

Where it matters however, is node behavior in *unexpected* circumstances.
If seeds nodes were truly not different from non-seeds in this regard,
there would be less surprises, because of the total node uniformity within
the cluster.

Therefore, I argue that the ticket should be reopened.

Regards,
--
Alex

Re: Cassandra Hints monitoring

[Oleksandr Shulgin]

On Mon, Feb 26, 2018 at 8:21 AM, Jai Bheemsen Rao Dhanwada <
jaibheem...@gmail.com> wrote:

>
> I am trying to evaluate the JMX hints metrics for cassandra(TotalHints).
> However, when I am testing the metrics, the total hints accumulated count
> shows perfectly fine, but when the hints are replayed and the hints
> count(cql> SELECT * from system.hints; ) becomes zero on cql, and the JMX
> metrics counter doesn't reset to zero and stays at the last known non-zero
> value(eg: 6). when new hints are created the total get added to the last
> non-zero count(e.g 6+2). Any idea if there is a way to get the active count
> during the given time period?
>

That's correct.  The "TotalHints" metric gives you a running total since
the last startup of the node.  In Grafana you can use rate() or diff()
aggregation on top of that, with a caveat that it produces a huge negative
when the node is actually restarted and the next reading is less than the
previous.

There is also "TotalHintsInProgress" which might be what you're looking
for, this one is reset back to 0 by the node once the hints are processed.

Cheers,
--
Alex