Simple upgrade for outdated cluster

2018-08-03 Thread Joel Samuelsson
Hi, We have a pretty outdated Cassandra cluster running version 2.0.x. Instead of doing step by step upgrades (2.0 -> 2.1, 2.1 -> 2.2, 2.2 -> 3.0, 3.0 -> 3.11.x), would it be possible to add new nodes with a recent version (say 3.11.x) and start decommissioning the old ones until we have a cluster

Re: Simple upgrade for outdated cluster

2018-08-03 Thread Joel Samuelsson
3.0.17 as an intermediary step (I > would do), but don't upgrade to 2.2. Also make sure to read carefully > https://github.com/apache/cassandra/blob/cassandra-3.11/NEWS.txt It's a > long read but it's important. There are lots of changes between all these > ve

Upgrade old cluster

2018-12-05 Thread Joel Samuelsson
Hi, I'd like to update a small cluster running 2.0.17 (on virtual private servers with ssh access) to a new version of Cassandra and in the process, I'd like to make it easier to update/add nodes/run maintenance in the future. What tools are common to use to automate such tasks? RIght now everythi

Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
Our nodes go down periodically, around 1-2 times each day. Downtime is from <1 second to 30 or so seconds. INFO [GossipTasks:1] 2016-02-22 10:05:14,896 Gossiper.java (line 992) InetAddress /109.74.13.67 is now DOWN INFO [RequestResponseStage:8844] 2016-02-22 10:05:38,331 Gossiper.java (line 978)

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
ised if they make sense. > > http://blog.mikiobraun.de/2010/08/cassandra-gc-tuning.html > > Hannu > > > On 23 Feb 2016, at 16:08, Joel Samuelsson > wrote: > > Our nodes go down periodically, around 1-2 times each day. Downtime is > from <1 second to 30 or so se

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
behavior. > > > > > > Sean Durity > > > > *From:* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] > *Sent:* Tuesday, February 23, 2016 9:41 AM > *To:* user@cassandra.apache.org > *Subject:* Re: Nodes go down periodically > > > > Hi, > > > > Th

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
If you see a lapse of connectivity no more than once or twice a day, >> consider yourselves lucky. >> >> Is it only one node at a time that goes down, and at widely dispersed >> times? >> >> How many nodes? >> >> -- Jack Krupansky >> >> On T

How to know if bootstrap is still running

2017-11-12 Thread Joel Samuelsson
I'm trying to add a new node to a small existing cluster. During the bootstrap one of the nodes went down. I'm not sure at what point in the process the node went down, all files may have been sent before that happened. Currently: nodetool netstats says that all files are received 100% nodetool sta

Safe to run cleanup before repair?

2017-11-12 Thread Joel Samuelsson
So, I have a cluster which grew too large data-wise so that compactions no longer worked (because of full disk). I have now added new nodes so that data is spread more thin. However, I know there are incosistencies in the cluster and I need to run a repair but those also fail because of out of disk

Re: Safe to run cleanup before repair?

2017-11-12 Thread Joel Samuelsson
Yeah, sounds right. What I'm worried about is the following: I used to have only 2 nodes with RF 2 so both nodes had a copy of all data. There were incosistencies since I was unable to run repair, so some parts of the data may only exist on one node. I have now added two nodes, thus changing which

Re: Safe to run cleanup before repair?

2017-11-12 Thread Joel Samuelsson
bootstrap will stream from the primary replica of the range it > is taking ownership of. So Node 3 would have to stream from Node 2 if it > was taking ownership of Node 2's tokens. > On 13 Nov. 2017 05:00, "Joel Samuelsson" > wrote: > >> Yeah, sounds right. What I

Alter composite column

2018-01-12 Thread Joel Samuelsson
Hi, I have an older system (C* 2.1) using Thrift tables on which I want to alter a column composite. Right now it looks like (int, int, string) but I want it to be (int, int, string, string). Is it possible to do this on a live cluster without deleting the old data? Can you point me to some docume

Re: Alter composite column

2018-01-18 Thread Joel Samuelsson
REATE TABLE events ( key text, column1 int, column2 int, column3 text, column4 text, value text, PRIMARY KEY(key, column1, column2, column3, column4) ) WITH COMPACT STORAGE Is this possible? Best regards, Joel 2018-01-12 16:53 GMT+01:00

Re: Alter composite column

2018-01-18 Thread Joel Samuelsson
n however alter your existing table to only add column4 using cqlsh > and cql, even if this table as created back with C* 1.X for instance > > On 18 January 2018 at 11:14, Joel Samuelsson > wrote: > >> So to rephrase that in CQL terms I have a table like this: >&g

Re: Alter composite column

2018-01-18 Thread Joel Samuelsson
_using/use_alter_add.html > > But I'm worried that your initial requirement was to change the clustering > key, as Alexander stated, you need to create a new table and transfer your > data in it > > On 18 January 2018 at 12:03, Joel Samuelsson > wrote: > >> It was indeed create

Recurring actions with 4 hour interval

2013-12-10 Thread Joel Samuelsson
. Is there anything specific happening within Cassandra with a 4 hour interval? Any help is much appreciated, Joel Samuelsson

Extremely long GC

2014-01-22 Thread Joel Samuelsson
(it's been running for a week or so). Just to be clear, another test on Amazon EC2 mentioned above (without the Datastax AMI) shows the GC freezes. If any other information is needed, just let me know. Best regards, Joel Samuelsson

Re: Extremely long GC

2014-01-22 Thread Joel Samuelsson
; Can you share the GC logs for the systems you are running problems into? > > Yogi > > > On Wed, Jan 22, 2014 at 6:50 AM, Joel Samuelsson < > samuelsson.j...@gmail.com> wrote: > >> Hello, >> >> We've been having problems with long GC pauses and can&

Weird GC

2014-01-29 Thread Joel Samuelsson
antly afterwards. Any ideas of why this might be happening? We have swap disabled, JNA enabled, no CPU spikes at the time, no disk I/O spikes at the time. What else could be causing this? /Joel Samuelsson

Re: Weird GC

2014-01-31 Thread Joel Samuelsson
; > -XX:+PrintSafepointStatistics -XX:PrintSafepointStatisticsCount=1 > > > On 29 January 2014 16:23, Joel Samuelsson wrote: > >> Hi, >> >> We've been trying to figure out why we have so long and frequent >> stop-the-world GC even though we have basically

Re: Intermittent long application pauses on nodes

2014-02-13 Thread Joel Samuelsson
We have had similar issues and upgrading C* to 2.0.x and Java to 1.7 seems to have helped our issues. 2014-02-13 Keith Wright : > Frank did you ever file a ticket for this issue or find the root cause? I > believe we are seeing the same issues when attempting to bootstrap. > > Thanks > > From:

Re: Intermittent long application pauses on nodes

2014-02-20 Thread Joel Samuelsson
IncCollectionPause [ 111 0 >>>>0] [ 0 0 0 0 27586] 0 >>>> >>>> And the total thime for which application threads were stopped is 27.58 >>>> seconds. >>>> >>>>

Re: Intermittent long application pauses on nodes

2014-02-21 Thread Joel Samuelsson
What happens if a ParNew is triggered while CMS is running? Will it wait for the CMS to finish? If so, that would be the eplanation of our long ParNew above. Regards, Joel 2014-02-20 16:29 GMT+01:00 Joel Samuelsson : > Hi Frank, > > We got a (quite) long GC pause today on 2.0.5

Weird timeouts

2014-03-07 Thread Joel Samuelsson
I try to fetch all the row keys from a column family (there should only be a couple of hundred in that CF) in several different ways but I get timeouts whichever way I try: Through the cassandra cli: Fetching 45 rows is fine: list cf limit 46 columns 0; . . . 45 Rows Returned. Elapsed time: 298 ms

Re: Weird timeouts

2014-03-10 Thread Joel Samuelsson
I am on Cassandra 2.0.5. How can I use the trace functionality? I did not check for exceptions. I will rerun and check. Thanks for suggestions. /Joel 2014-03-07 17:54 GMT+01:00 Duncan Sands : > Hi Joel, > > > On 07/03/14 15:22, Joel Samuelsson wrote: > >> I try to fetch

Tombstones on secondary indexes

2014-05-16 Thread Joel Samuelsson
e not removed. https://issues.apache.org/jira/browse/CASSANDRA-4314 seems to say that tombstones on secondary indexes are not removed by a compaction. Do I need to do it manually? Best regards, Joel Samuelsson

Logging of triggers

2014-06-03 Thread Joel Samuelsson
I'm testing triggers as part of a project and would like to add some logging to it. I'm using the same log structure as in the trigger example InvertedIndex but can't seem to find any logs. Where would I find the logging? In the system logs or somewhere else? /Joel

Re: Logging of triggers

2014-06-03 Thread Joel Samuelsson
I found now that i logged with a too low log level set so it was filtered from the system log. Logging with a more critical log level made the log messages appear in the system log. /Joel 2014-06-03 16:30 GMT+02:00 Joel Samuelsson : > I'm testing triggers as part of a project and would

Re: Cassandra freezes

2013-03-22 Thread Joel Samuelsson
Thanks for the GC suggestion. It seems we didn't have enough CPU power to handle both the data and GC. Increasing the number of CPU cores made everything run smoothly at the same load. 2013/3/21 Andras Szerdahelyi > Neat! > Thanks. > > From: Sylvain Lebresne > Reply-To: "user@cassandra.apac

Clearing tombstones

2013-03-25 Thread Joel Samuelsson
Hi, I've deleted a range of keys in my one node test-cluster and want to re-add them with an older creation time. How can I make sure all tombstones are gone so that they can be re-added properly? I've tried nodetool compact but it seems some tombstones remain. Best regards, Joel Samuelsson

Re: Clearing tombstones

2013-03-26 Thread Joel Samuelsson
Hobbs > You'll need to temporarily lower gc_grace_seconds for that column family, > run compaction, and then restore gc_grace_seconds to its original value. > See http://wiki.apache.org/cassandra/DistributedDeletes for more info. > > > On Mon, Mar 25, 2013 at 7:40 AM, Joel

Re: Clearing tombstones

2013-03-27 Thread Joel Samuelsson
I see. The cleanup operation took several minutes though. This doesn't seem normal then? My replication settings should be very normal (simple strategy and replication factor 1). 2013/3/26 Tyler Hobbs > > On Tue, Mar 26, 2013 at 5:39 AM, Joel Samuelsson < > samuelsson.j...

Re: Clearing tombstones

2013-03-28 Thread Joel Samuelsson
Strategy and RF 3, even if they dont > have multiple DC's. > > Cheers > > - > Aaron Morton > Freelance Cassandra Consultant > New Zealand > > @aaronmorton > http://www.thelastpickle.com > > On 28/03/2013, at 3:34 AM, Joel Samuelsson > wrote: &

Re: Cassandra freezes

2013-04-03 Thread Joel Samuelsson
g with consistency level ONE. What are the values for these settings in cassandra.yaml memtable_total_space_in_mb: No value set in cassandra.yaml, so 1/3 of heap according to documentation (2gb / 3) memtable_flush_writers: No value set in cassandra.yaml, but only one data directory so I assume it is 1. mem

Reduce Cassandra GC

2013-04-16 Thread Joel Samuelsson
r a few seconds but having them for several minutes doesn't work. Any other suggestions to remove them? Best regards, Joel Samuelsson

Re: Reduce Cassandra GC

2013-04-16 Thread Joel Samuelsson
opy, print or rely on this e-mail. If you have > received this message in error, please contact the sender immediately and > irrevocably delete this message and any copies. > > *From:* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] > *Sent:* Tuesday, April 16, 2013 10:47 > *

Re: Reduce Cassandra GC

2013-04-17 Thread Joel Samuelsson
bute, copy, print or rely on this e-mail. If you have > received this message in error, please contact the sender immediately and > irrevocably delete this message and any copies. > > *From:* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] > *Sent:* Tuesday, April 16, 2013 12:52 >

Re: Reduce Cassandra GC

2013-06-07 Thread Joel Samuelsson
> > An older discussion about memory use, not that in 1.2 the bloom filters > (and compression data) are off heap now. > http://www.mail-archive.com/user@cassandra.apache.org/msg25762.html > > Hope that helps. > > - > Aaron Morton > Freelance Cassandra Consultant >

Re: Reduce Cassandra GC

2013-06-17 Thread Joel Samuelsson
> If you are talking about 1.2.x then I also have memory problems on the idle cluster: java memory constantly slow grows up to limit, then spend long time for GC. I never seen such behaviour for 1.0.x and 1.1.x, where on idle cluster java memory stay on the same value. No I am running Cassandra 1

Re: Reduce Cassandra GC

2013-06-17 Thread Joel Samuelsson
Just got a very long GC again. What am I to look for in the logging I just enabled? 2013/6/17 Joel Samuelsson > > If you are talking about 1.2.x then I also have memory problems on the > idle cluster: java memory constantly slow grows up to limit, then spend > long time for GC.

Re: Reduce Cassandra GC

2013-06-18 Thread Joel Samuelsson
t; > On Mon, Jun 17, 2013 at 5:51 PM, Joel Samuelsson < > samuelsson.j...@gmail.com> wrote: > >> Just got a very long GC again. What am I to look for in the logging I >> just enabled? >> >> >> 2013/6/17 Joel Samuelsson >> >>> > If you are t

Re: Reduce Cassandra GC

2013-06-18 Thread Joel Samuelsson
/log/cassandra/gc-`date +%s`.log" > > > At least, no GC logs are shown in your post. > > > On Tue, Jun 18, 2013 at 5:05 PM, Joel Samuelsson < > samuelsson.j...@gmail.com> wrote: > >> Can't find any promotion failure. >> >> In system.

Re: Reduce Cassandra GC

2013-06-19 Thread Joel Samuelsson
My Cassandra ps info: root 26791 1 0 07:14 ?00:00:00 /usr/bin/jsvc -user cassandra -home /opt/java/64/jre1.6.0_32/bin/../ -pidfile /var/run/cassandra.pid -errfile &1 -outfile /var/log/cassandra/output.log -cp /usr/share/cassandra/lib/antlr-3.2.jar:/usr/share/cassandra/lib/avro-1.4

Re: Reduce Cassandra GC

2013-06-19 Thread Joel Samuelsson
c:/var/log/cassandra/gc-1371603607.log > > > Is it normal to have two processes like this? > > No. You are running two processes. > > > On Wed, Jun 19, 2013 at 4:16 PM, Joel Samuelsson < > samuelsson.j...@gmail.com> wrote: > >> My Cassandra ps info: >> >

Re: Reduce Cassandra GC

2013-06-20 Thread Joel Samuelsson
2013/6/19 Mohit Anchlia > How much data do you have per node? > How much RAM per node? > How much CPU per node? > What is the avg CPU and memory usage? > > On Wed, Jun 19, 2013 at 12:16 AM, Joel Samuelsson < > samuelsson.j...@gmail.com> wrote: > >> My Cassandr