Upgrade old cluster

2018-12-05 Thread Joel Samuelsson
Hi, I'd like to update a small cluster running 2.0.17 (on virtual private servers with ssh access) to a new version of Cassandra and in the process, I'd like to make it easier to update/add nodes/run maintenance in the future. What tools are common to use to automate such tasks? RIght now

Re: Simple upgrade for outdated cluster

2018-08-03 Thread Joel Samuelsson
p (I > would do), but don't upgrade to 2.2. Also make sure to read carefully > https://github.com/apache/cassandra/blob/cassandra-3.11/NEWS.txt It's a > long read but it's important. There are lots of changes between all these > versions. > > Best, > > Romain >

Simple upgrade for outdated cluster

2018-08-03 Thread Joel Samuelsson
Hi, We have a pretty outdated Cassandra cluster running version 2.0.x. Instead of doing step by step upgrades (2.0 -> 2.1, 2.1 -> 2.2, 2.2 -> 3.0, 3.0 -> 3.11.x), would it be possible to add new nodes with a recent version (say 3.11.x) and start decommissioning the old ones until we have a

Re: Alter composite column

2018-01-18 Thread Joel Samuelsson
; en/cql/3.1/cql/cql_using/use_alter_add.html > > But I'm worried that your initial requirement was to change the clustering > key, as Alexander stated, you need to create a new table and transfer your > data in it > > On 18 January 2018 at 12:03, Joel Samuelsson <s

Re: Alter composite column

2018-01-18 Thread Joel Samuelsson
ry key. > > You can however alter your existing table to only add column4 using cqlsh > and cql, even if this table as created back with C* 1.X for instance > > On 18 January 2018 at 11:14, Joel Samuelsson <samuelsson.j...@gmail.com> > wrote: > >> So t

Re: Alter composite column

2018-01-18 Thread Joel Samuelsson
TABLE events ( key text, column1 int, column2 int, column3 text, column4 text, value text, PRIMARY KEY(key, column1, column2, column3, column4) ) WITH COMPACT STORAGE Is this possible? Best regards, Joel 2018-01-12 16:53 GMT+01:00 Joel

Alter composite column

2018-01-12 Thread Joel Samuelsson
Hi, I have an older system (C* 2.1) using Thrift tables on which I want to alter a column composite. Right now it looks like (int, int, string) but I want it to be (int, int, string, string). Is it possible to do this on a live cluster without deleting the old data? Can you point me to some

Re: Safe to run cleanup before repair?

2017-11-12 Thread Joel Samuelsson
s <k...@instaclustr.com> wrote: > > By default, bootstrap will stream from the primary replica of the range it > is taking ownership of. So Node 3 would have to stream from Node 2 if it > was taking ownership of Node 2's tokens. > On 13 Nov. 2017 05:00, "Joel Samuelsson" <samue

Re: Safe to run cleanup before repair?

2017-11-12 Thread Joel Samuelsson
Yeah, sounds right. What I'm worried about is the following: I used to have only 2 nodes with RF 2 so both nodes had a copy of all data. There were incosistencies since I was unable to run repair, so some parts of the data may only exist on one node. I have now added two nodes, thus changing which

Safe to run cleanup before repair?

2017-11-12 Thread Joel Samuelsson
So, I have a cluster which grew too large data-wise so that compactions no longer worked (because of full disk). I have now added new nodes so that data is spread more thin. However, I know there are incosistencies in the cluster and I need to run a repair but those also fail because of out of

How to know if bootstrap is still running

2017-11-12 Thread Joel Samuelsson
I'm trying to add a new node to a small existing cluster. During the bootstrap one of the nodes went down. I'm not sure at what point in the process the node went down, all files may have been sent before that happened. Currently: nodetool netstats says that all files are received 100% nodetool

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
n a node would be clearly logged on that >> node. If you see a lapse of connectivity no more than once or twice a day, >> consider yourselves lucky. >> >> Is it only one node at a time that goes down, and at widely dispersed >> times? >> >> How many nodes? >>

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
P/DOWN flapping behavior. > > > > > > Sean Durity > > > > *From:* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] > *Sent:* Tuesday, February 23, 2016 9:41 AM > *To:* user@cassandra.apache.org > *Subject:* Re: Nodes go down periodically > > > > Hi, &

Re: Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
t you already have customised if they make sense. > > http://blog.mikiobraun.de/2010/08/cassandra-gc-tuning.html > > Hannu > > > On 23 Feb 2016, at 16:08, Joel Samuelsson <samuelsson.j...@gmail.com> > wrote: > > Our nodes go down periodically, around 1-2 ti

Nodes go down periodically

2016-02-23 Thread Joel Samuelsson
Our nodes go down periodically, around 1-2 times each day. Downtime is from <1 second to 30 or so seconds. INFO [GossipTasks:1] 2016-02-22 10:05:14,896 Gossiper.java (line 992) InetAddress /109.74.13.67 is now DOWN INFO [RequestResponseStage:8844] 2016-02-22 10:05:38,331 Gossiper.java (line 978)

Logging of triggers

2014-06-03 Thread Joel Samuelsson
I'm testing triggers as part of a project and would like to add some logging to it. I'm using the same log structure as in the trigger example InvertedIndex but can't seem to find any logs. Where would I find the logging? In the system logs or somewhere else? /Joel

Re: Logging of triggers

2014-06-03 Thread Joel Samuelsson
I found now that i logged with a too low log level set so it was filtered from the system log. Logging with a more critical log level made the log messages appear in the system log. /Joel 2014-06-03 16:30 GMT+02:00 Joel Samuelsson samuelsson.j...@gmail.com: I'm testing triggers as part

Tombstones on secondary indexes

2014-05-16 Thread Joel Samuelsson
are not removed. https://issues.apache.org/jira/browse/CASSANDRA-4314 seems to say that tombstones on secondary indexes are not removed by a compaction. Do I need to do it manually? Best regards, Joel Samuelsson

Re: Weird timeouts

2014-03-10 Thread Joel Samuelsson
I am on Cassandra 2.0.5. How can I use the trace functionality? I did not check for exceptions. I will rerun and check. Thanks for suggestions. /Joel 2014-03-07 17:54 GMT+01:00 Duncan Sands duncan.sa...@gmail.com: Hi Joel, On 07/03/14 15:22, Joel Samuelsson wrote: I try to fetch all

Weird timeouts

2014-03-07 Thread Joel Samuelsson
I try to fetch all the row keys from a column family (there should only be a couple of hundred in that CF) in several different ways but I get timeouts whichever way I try: Through the cassandra cli: Fetching 45 rows is fine: list cf limit 46 columns 0; . . . 45 Rows Returned. Elapsed time: 298

Re: Intermittent long application pauses on nodes

2014-02-21 Thread Joel Samuelsson
What happens if a ParNew is triggered while CMS is running? Will it wait for the CMS to finish? If so, that would be the eplanation of our long ParNew above. Regards, Joel 2014-02-20 16:29 GMT+01:00 Joel Samuelsson samuelsson.j...@gmail.com: Hi Frank, We got a (quite) long GC pause today

Re: Intermittent long application pauses on nodes

2014-02-20 Thread Joel Samuelsson
On Thu, Feb 13, 2014 at 12:40 PM, Keith Wright kwri...@nanigans.comwrote: You’re running 2.0.* in production? May I ask what C* version and OS? Any hardware details would be appreciated as well. Thx! From: Joel Samuelsson samuelsson.j...@gmail.com Reply-To: user@cassandra.apache.org user

Re: Intermittent long application pauses on nodes

2014-02-13 Thread Joel Samuelsson
We have had similar issues and upgrading C* to 2.0.x and Java to 1.7 seems to have helped our issues. 2014-02-13 Keith Wright kwri...@nanigans.com: Frank did you ever file a ticket for this issue or find the root cause? I believe we are seeing the same issues when attempting to bootstrap.

Re: Weird GC

2014-01-31 Thread Joel Samuelsson
:+PrintSafepointStatistics -XX:PrintSafepointStatisticsCount=1 On 29 January 2014 16:23, Joel Samuelsson samuelsson.j...@gmail.comwrote: Hi, We've been trying to figure out why we have so long and frequent stop-the-world GC even though we have basically no load. Today we got a log of a weird GC that I

Weird GC

2014-01-29 Thread Joel Samuelsson
afterwards. Any ideas of why this might be happening? We have swap disabled, JNA enabled, no CPU spikes at the time, no disk I/O spikes at the time. What else could be causing this? /Joel Samuelsson

Re: Extremely long GC

2014-01-22 Thread Joel Samuelsson
Hi, Can you share the GC logs for the systems you are running problems into? Yogi On Wed, Jan 22, 2014 at 6:50 AM, Joel Samuelsson samuelsson.j...@gmail.com wrote: Hello, We've been having problems with long GC pauses and can't seem to get rid of them. Our latest test is on a clean

Recurring actions with 4 hour interval

2013-12-10 Thread Joel Samuelsson
. Is there anything specific happening within Cassandra with a 4 hour interval? Any help is much appreciated, Joel Samuelsson

Re: Reduce Cassandra GC

2013-06-20 Thread Joel Samuelsson
Mohit Anchlia mohitanch...@gmail.com How much data do you have per node? How much RAM per node? How much CPU per node? What is the avg CPU and memory usage? On Wed, Jun 19, 2013 at 12:16 AM, Joel Samuelsson samuelsson.j...@gmail.com wrote: My Cassandra ps info: root 26791 1 0 07

Re: Reduce Cassandra GC

2013-06-19 Thread Joel Samuelsson
My Cassandra ps info: root 26791 1 0 07:14 ?00:00:00 /usr/bin/jsvc -user cassandra -home /opt/java/64/jre1.6.0_32/bin/../ -pidfile /var/run/cassandra.pid -errfile 1 -outfile /var/log/cassandra/output.log -cp

Re: Reduce Cassandra GC

2013-06-19 Thread Joel Samuelsson
.log Is it normal to have two processes like this? No. You are running two processes. On Wed, Jun 19, 2013 at 4:16 PM, Joel Samuelsson samuelsson.j...@gmail.com wrote: My Cassandra ps info: root 26791 1 0 07:14 ?00:00:00 /usr/bin/jsvc -user cassandra -home /opt/java

Re: Reduce Cassandra GC

2013-06-18 Thread Joel Samuelsson
PM, Joel Samuelsson samuelsson.j...@gmail.com wrote: Just got a very long GC again. What am I to look for in the logging I just enabled? 2013/6/17 Joel Samuelsson samuelsson.j...@gmail.com If you are talking about 1.2.x then I also have memory problems on the idle cluster: java memory

Re: Reduce Cassandra GC

2013-06-18 Thread Joel Samuelsson
/cassandra/gc-`date +%s`.log At least, no GC logs are shown in your post. On Tue, Jun 18, 2013 at 5:05 PM, Joel Samuelsson samuelsson.j...@gmail.com wrote: Can't find any promotion failure. In system.log this is what I get: INFO [ScheduledTasks:1] 2013-06-17 08:13:47,490 GCInspector.java

Re: Reduce Cassandra GC

2013-06-17 Thread Joel Samuelsson
If you are talking about 1.2.x then I also have memory problems on the idle cluster: java memory constantly slow grows up to limit, then spend long time for GC. I never seen such behaviour for 1.0.x and 1.1.x, where on idle cluster java memory stay on the same value. No I am running Cassandra

Re: Reduce Cassandra GC

2013-06-17 Thread Joel Samuelsson
Just got a very long GC again. What am I to look for in the logging I just enabled? 2013/6/17 Joel Samuelsson samuelsson.j...@gmail.com If you are talking about 1.2.x then I also have memory problems on the idle cluster: java memory constantly slow grows up to limit, then spend long time

Re: Reduce Cassandra GC

2013-06-07 Thread Joel Samuelsson
Hope that helps. - Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 17/04/2013, at 11:06 PM, Joel Samuelsson samuelsson.j...@gmail.com wrote: You're right, it's probably hard. I should have provided more data

Re: Reduce Cassandra GC

2013-04-17 Thread Joel Samuelsson
that the information remains the property of the sender. You must not use, disclose, distribute, copy, print or rely on this e-mail. If you have received this message in error, please contact the sender immediately and irrevocably delete this message and any copies. *From:* Joel Samuelsson

Re: Reduce Cassandra GC

2013-04-16 Thread Joel Samuelsson
the sender immediately and irrevocably delete this message and any copies. *From:* Joel Samuelsson [mailto:samuelsson.j...@gmail.com] *Sent:* Tuesday, April 16, 2013 10:47 *To:* user@cassandra.apache.org *Subject:* Reduce Cassandra GC ** ** Hi, ** ** We have a small production

Re: Clearing tombstones

2013-03-28 Thread Joel Samuelsson
- Aaron Morton Freelance Cassandra Consultant New Zealand @aaronmorton http://www.thelastpickle.com On 28/03/2013, at 3:34 AM, Joel Samuelsson samuelsson.j...@gmail.com wrote: I see. The cleanup operation took several minutes though. This doesn't seem normal then? My

Re: Clearing tombstones

2013-03-27 Thread Joel Samuelsson
I see. The cleanup operation took several minutes though. This doesn't seem normal then? My replication settings should be very normal (simple strategy and replication factor 1). 2013/3/26 Tyler Hobbs ty...@datastax.com On Tue, Mar 26, 2013 at 5:39 AM, Joel Samuelsson samuelsson.j

Re: Clearing tombstones

2013-03-26 Thread Joel Samuelsson
...@datastax.com You'll need to temporarily lower gc_grace_seconds for that column family, run compaction, and then restore gc_grace_seconds to its original value. See http://wiki.apache.org/cassandra/DistributedDeletes for more info. On Mon, Mar 25, 2013 at 7:40 AM, Joel Samuelsson

Clearing tombstones

2013-03-25 Thread Joel Samuelsson
Hi, I've deleted a range of keys in my one node test-cluster and want to re-add them with an older creation time. How can I make sure all tombstones are gone so that they can be re-added properly? I've tried nodetool compact but it seems some tombstones remain. Best regards, Joel Samuelsson

Re: Cassandra freezes

2013-03-22 Thread Joel Samuelsson
Thanks for the GC suggestion. It seems we didn't have enough CPU power to handle both the data and GC. Increasing the number of CPU cores made everything run smoothly at the same load. 2013/3/21 Andras Szerdahelyi andras.szerdahe...@ignitionone.com Neat! Thanks. From: Sylvain Lebresne