Re: Help on Cassandra Limitaions

2013-09-05 Thread Hannu Kröger
I asked the same thing earlier and this is what patrick mcfadin replied: It's not worded well. Essentially it's saying there is a 2B limit on a row. It should be worded a 'CQL row' I hope helps. Cheers, Hannu On 6.9.2013, at 8.20, J Ramesh Kumar rameshj1...@gmail.com wrote: Hi,

Re: Help on Cassandra Limitaions

2013-09-06 Thread Hannu Kröger
) cannot have more that 2 billions thrift columns'. -- Sylvain On Fri, Sep 6, 2013 at 7:55 AM, Hannu Kröger hkro...@gmail.com wrote: I asked the same thing earlier and this is what patrick mcfadin replied: It's not worded well. Essentially it's saying there is a 2B limit on a row. It should

Re: Add a new node

2013-10-10 Thread Hannu Kröger
Hello, No you don't need to. Check this out: http://www.datastax.com/documentation/cassandra/2.0/webhelp/index.html#cassandra/operations/ops_add_node_to_cluster_t.html Cheers, Hannu 2013/10/10 juwg j...@jnshangjie.com ** Hi all, I want to ask a basic question: To add a new node to

Re: Re: Add a new node

2013-10-10 Thread Hannu Kröger
keyspace, can I change the number of replicas in it's REPLICATION option? If so, do I need to restart the whole cluster? Thanaks in advance. ju wenguang *From:* Hannu Kröger hkro...@gmail.com *Date:* 2013-10-10 16:10 *To:* user user@cassandra.apache.org; juwg j...@jnshangjie.com *Subject

Re: Bad Request: No indexed columns present in by-columns clause with Equal operator?

2013-11-03 Thread Hannu Kröger
Hi, You cannot query using a field that is not indexed in CQL. You have to create either secondary index or create index tables and manage those indexes by yourself and query using those. Since those keys are of high cardinality, usually the recommendation for this kind of use cases is that you

Re: Bad Request: No indexed columns present in by-columns clause with Equal operator?

2013-11-04 Thread Hannu Kröger
'); But it doesn't run and I always get error as - Bad Request: No indexed columns present in by-columns clause with Equal operator Any thoughts what wrong I am doing here? On Sun, Nov 3, 2013 at 12:43 PM, Hannu Kröger hkro...@gmail.com wrote: Hi, You cannot query using a field

Re: Uneven effective ownership

2013-11-13 Thread Hannu Kröger
Hello Katriel, Are you using replication factor 3? So it seems that in us-east it's all fine with each machine having 100% of the data. The problem is in eu-west where you have unbalanced nodes. You should rearrange the tokens in that eu-west DC. Check e.g. this token calculator to calculate

Re: Stack trace from a node during a repair

2013-12-03 Thread Hannu Kröger
Hi, Are you running nodetool or cassandra as root? I think it doesn't really matter what user is running the nodetool. Those directories should be writable by the user who is running the actual cassandra process. Hannu 2013/12/3 John Pyeatt john.pye...@singlewire.com Then my issue must be

Re: help on backup muiltinode cluster

2013-12-07 Thread Hannu Kröger
One typical reason is to protect against human error. On 7.12.2013, at 11.09, Jason Wee peich...@gmail.com wrote: Hmm... cassandra fundamental key features like fault tolerant, durable and replication. Just out of curiousity, why would you want to do backup? /Jason On Sat, Dec 7,

Re: Upgrading 1.1 to 1.2 in-place

2013-12-30 Thread Hannu Kröger
Hi, Random Partitioner + VNodes are a supported combo based on DataStax documentation: http://www.datastax.com/documentation/cassandra/1.2/webhelp/cassandra/architecture/architecturePartitionerAbout_c.html How else would you even migrate from 1.1 to Vnodes since migration from one partitioner to

Re: Cassandra client alternatives to mimic Couchbase sharding ???

2013-12-31 Thread Hannu Kröger
Hi, DataStax Cassandra Java Driver has the possibility to choose the coordinator node based on the partition key (TokenAwarePolicy), however that probably does not solve the consistency problem you are thinking about: http://www.datastax.com/dev/blog/ideology-and-testing-of-a-resilient-driver If

Re: Cassandra client alternatives to mimic Couchbase sharding ???

2013-12-31 Thread Hannu Kröger
for request 1 and then written to replication node 2 for request 2. This normally isn’t an issue unless the time drift across the cluster the time between 2 writes for the same row key. Brent From: Hannu Kröger hkro...@gmail.com Reply-To: user@cassandra.apache.org user@cassandra.apache.org Date

Re: Help on Designing Cassandra table for my usecase

2014-01-09 Thread Hannu Kröger
To my eye that looks something what the traditional analytics systems do. You can check out e.g. Acunu Analytics which uses Cassandra as a backend. Cheers, Hannu 2014/1/9 Naresh Yadav nyadav@gmail.com Hi all, I have a use case with huge data which i am not able to design in cassandra.

Re: Opscenter Entreprise work without licence ?

2014-01-25 Thread Hannu Kröger
Hi, It should work without license code or anything of that sort but of course you need a license in production. Hannu On 24.1.2014, at 16.25, Bonnet Jonathan. jonathan.bon...@externe.bnpparibas.com wrote: Nobody to give an answear ?, perhaps i said something stupid :). I Want just a

Re: Help with batch renaming legacy sstable files

2014-06-26 Thread Hannu Kröger
Also, did you get to upgrade first to 1.1.x and and then to 1.2.x? That might smoothen the process. Hannu On 26.6.2014, at 9.04, Jens Rantil jens.ran...@tink.se wrote: Hi Todd, Maybe the rename command line utility could help you? Cheers, Jens — Sent from Mailbox On Thu, Jun

Cassandra JBOD disk configuration

2014-09-04 Thread Hannu Kröger
Hi, Let's imagine that I have one keyspace with one big table configured with size tiered compaction strategy and nothing else. The disk configuration would to have 10x 500GB disks, each mounted to separate directory. Each directory would then be configured as a separate entry in cassandra.yaml.

Re: Indexes Fragmentation

2014-09-28 Thread Hannu Kröger
Hi, I think more information is needed before this question can be answered. In many cases you manage the indexes by yourself. If that breaks, then you have a consistency problem or a bug in your own code. Consistency is tunable (trade off with performance and availability) and bugs can be fixed.

Timestamp with empty string as a value

2014-10-03 Thread Hannu Kröger
Tested on cassandra 2.0.8: I did some minor testing on timestamp field. It seems that you can give an empty string as a value. Honestly I have no clue what should I think of that. I kind of understand that you can give a string with seconds since epoch and null of course. But empty string? cqlsh

Re: Anyone know when DSE will support Cassandra 2.1?

2014-10-15 Thread Hannu Kröger
Based on history, there is typically a 6 month delay between Cassandra release and related DSE release. Hannu 2014-10-14 22:20 GMT+03:00 Jason Lewis jle...@packetnexus.com: I can't find any info related to dates anywhere. jas

Re: Commissioning failure

2014-10-31 Thread Hannu Kröger
Hi, I think only LevelledCompactionStrategy makes sense on JBOD because that can distribute data more evenly. Although I don't know what is the exact strategy where each compaction strategy will store sstables. If you use SizeTieredCompactionStrategy you might run into problems when sstables get

Re: Commissioning failure

2014-10-31 Thread Hannu Kröger
You can change it on the fly. That will just compact all the data that you have so it will take a long time and cause some io load. Hannu On 31.10.2014, at 14.07, venkat sam samvenkat...@outlook.com wrote: Yes Hannu, Initially for one month we didn't face any problem. But once tables

Re: how wide can wide rows get?

2014-11-13 Thread Hannu Kröger
The theoretical limit is maybe 2 billion but recommended max is around 10-20 thousand. Br, Hannu On 14.11.2014, at 8.10, Adaryl Bob Wakefield, MBA adaryl.wakefi...@hotmail.com wrote: I’m struggling with this wide row business. Is there an upward limit on the number of columns you can

Re: Is it possible to flush memtable in one virtual center?

2014-12-15 Thread Hannu Kröger
Hi, You have memtables on each machine. So 1) Yes 2) Yes, in any case you have to run nodetool flush for each node that you want to flush. In this case you run flush each node in your analytics DC. Hannu 2014-12-16 1:20 GMT+02:00 Benyi Wang bewang.t...@gmail.com: We have one ring and two

Re: Any problem mounting a keyspace directory in ram memory?

2015-02-02 Thread Hannu Kröger
At least I cannot think of any reason why it wouldn't work. As you said, you might lose the data but if you can live with that then why not. Hannu On 02.02.2015, at 14:21 , Gabriel Menegatti gabr...@s1mbi0se.com.br wrote: Hi Colin, Yes, we don't want to use the C* in-memory, we just want

Re: [RELEASE] Apache Cassandra 3.1 released

2015-12-09 Thread Hannu Kröger
Hi, I feel the same as well. Would you skip 3.2 when you release another round of bug fixes after one round of bug fixes? Or would 3.2 be released after 3.3.? :P BR, Hannu > On 09 Dec 2015, at 16:05, Kai Wang wrote: > > Janne, > > You are not alone. I am also confused by

Re: Nodes go down periodically

2016-02-23 Thread Hannu Kröger
Hi, Those are probably GC pauses. Memory tuning is probably needed. Check the parameters that you already have customised if they make sense. http://blog.mikiobraun.de/2010/08/cassandra-gc-tuning.html Hannu > On 23 Feb 2016, at

Re: opscenter doesn't work with cassandra 3.0

2016-01-26 Thread Hannu Kröger
Is it really like that? Where does this info come from? I haven’t seen anything “official" yet. Hannu > On 26 Jan 2016, at 15:07, > wrote: > > This is a very strange move considering how well DataStax has supported open > source

Re: Data modelling, including cleanup

2016-03-19 Thread Hannu Kröger
Hi, That’s how I have done it in many occasions. Nowadays there is the possibility use Cassandra 3.0 and materialised views so that you don’t need to keep two tables up to date manually: http://www.datastax.com/dev/blog/new-in-cassandra-3-0-materialized-views

Scenarios when a node can be missing writes

2016-03-22 Thread Hannu Kröger
isk if "commitlog_sync" is "periodic" (which it is by default) and "commitlog_sync_period_in_ms" is 10 seconds. Can this be a cause of node missing writes if the server has stayed on for the whole time and only cassandra has restarted? Any other scenarios? Cheers, Hannu Kröger

Re: DATA replication from Oracle DB to Cassandra

2016-03-02 Thread Hannu Kröger
Hi, I have implemented once one way replication from a RDBMS to Cassandra using triggers in the source database side. If you timestamp the changes from the source, it’s possible to timestamp them on the cassandra side as well and that takes care of a lot of ordering of the changes. Assuming

Re: Query regarding spark on cassandra

2016-04-28 Thread Hannu Kröger
Hi, could it be consistency level issue? If you use ONE for reads and writes, might be that sometimes you don't get what you are writing. See: https://docs.datastax.com/en/cassandra/2.0/cassandra/dml/dml_config_consistency_c.html Br, Hannu 2016-04-27 20:41 GMT+03:00 Siddharth Verma

Re: Query regarding spark on cassandra

2016-04-28 Thread Hannu Kröger
saw the stdout from web-ui of spark, and the query along with true was > printed for both the queries.". > The statements were correct as seen on the UI. > Thanks, > Siddharth Verma > > > > On Thu, Apr 28, 2016 at 1:22 PM, Hannu Kröger <hkro...@gmail.com > <m

Current data density limits with Open Source Cassandra

2017-02-08 Thread Hannu Kröger
Hello, Back in the day it was recommended that max disk density per node for Cassandra 1.2 was at around 3-5TB of uncompressed data. IIRC it was mostly because of heap memory limitations? Now that off-heap support is there for certain data and 3.x has different data storage format, is that

Re: Is it safe to change RF in this situation?

2016-09-08 Thread Hannu Kröger
anging RF from 2 to 3, and did see the empty > result rate is going higher. I assume that "If the LOCAL_ONE read hit the > new replica which is not there yet, the CQL query will return nothing." Is my > assumption correct? > > On Thu, Sep 8, 2016 at 11:49 AM, H

Re: Is it safe to change RF in this situation?

2016-09-08 Thread Hannu Kröger
epair is trying to fix as > RF=2 or still trying to fix like RF=3? > > On Thu, Sep 8, 2016 at 2:53 PM, Hannu Kröger <hkro...@gmail.com > <mailto:hkro...@gmail.com>> wrote: > Yep, you can fix it by running repair or even faster by changing the > consistency le

Re: Is it safe to change RF in this situation?

2016-09-08 Thread Hannu Kröger
Hi, If you change RF=2 -> 3 first, the LOCAL_ONE reads might hit the new replica which is not there yet. So I would change LOCAL_ONE -> LOCAL_QUORUM first and then change the RF and then run the repair. LOCAL_QUORUM is effectively ALL in your case (RF=2) if you have just one DC, so you can

Re: Maximum number of columns in a table

2016-09-15 Thread Hannu Kröger
Hi, The ‘old-fashioned’ secondary indexes do support index of collection values: https://docs.datastax.com/en/cql/3.1/cql/ddl/ddlIndexColl.html Br, Hannu > On 15 Sep 2016, at 15:59, DuyHai Doan wrote: > >

Re: Maximum number of columns in a table

2016-09-15 Thread Hannu Kröger
I do agree on that. > On 15 Sep 2016, at 16:23, DuyHai Doan <doanduy...@gmail.com> wrote: > > I'd advise anyone against using the old native secondary index ... You'll get > poor performance (that's the main reason why some people developed SASI). > > On Thu, Sep 15,

Re: Row cache not working

2016-10-03 Thread Hannu Kröger
If I remember correctly row cache caches only N rows from the beginning of the partition. N being some configurable number. See this link which is suggesting that: http://www.datastax.com/dev/blog/row-caching-in-cassandra-2-1 Br, Hannu > On 4 Oct 2016, at 1.32, Edward Capriolo

Re: Improving performance where a lot of updates and deletes are required?

2016-11-08 Thread Hannu Kröger
Also in they are being read before compaction: http://docs.datastax.com/en/cql/3.1/cql/cql_using/use_expire_c.html Hannu > On 8 Nov 2016, at 16.36, DuyHai Doan wrote: > > "Does TTL also cause

Re: Transparent Fail-Over for Java Driver to survive Cluster Rolling

2016-10-24 Thread Hannu Kröger
Hi, Once the client is connected, it will automatically connect to many nodes in the cluster. Therefore once the app is running the amount of contact points doesn’t matter and if you have consistency level < ALL (or QUORUM where replication factor is <= 2), your app should tolerate rolling

Re: Transparent Fail-Over for Java Driver to survive Cluster Rolling

2016-10-24 Thread Hannu Kröger
update the cluster? I would assume that QUORUM (replication > of 3) might not always go through? > > > > On Mon, Oct 24, 2016 at 2:09 PM, Hannu Kröger <hkro...@gmail.com > <mailto:hkro...@gmail.com>> wrote: > Hi, > > Once the client is connected, it wil

Re: cassandra documentation (Multiple datacenter write requests) question

2016-11-22 Thread Hannu Kröger
Looks like the graph is wrong. Hannu > On 22 Nov 2016, at 15.43, CHAUMIER, RAPHAËL > wrote: > > Hello everyone, > > I don’t know if you have access to DataStax documentation. I don’t understand > the example about Multiple datacenter write requests >

Re: Is this normal!?

2017-01-11 Thread Hannu Kröger
Just to understand: What exactly is the problem? Cheers, Hannu > On 11 Jan 2017, at 16.07, Cogumelos Maravilha > wrote: > > Cassandra 3.9. > > nodetool status > Datacenter: dc1 > === > Status=Up/Down > |/ State=Normal/Leaving/Joining/Moving > --

Re: Strange issue wherein cassandra not being started from cron

2017-01-11 Thread Hannu Kröger
One possible reason is that cassandra process gets different user when run differently. Check who owns the data files and check also what gets written into the /var/log/cassandra/system.log (or whatever that was). Hannu > On 11 Jan 2017, at 16.42, Ajay Garg wrote: > >

Point in time restore

2017-01-10 Thread Hannu Kröger
Hello, Are there any guides how to do a point-in-time restore for Cassandra? All I have seen is this: http://docs.datastax.com/en/archived/cassandra/2.0/cassandra/configuration/configLogArchive_t.html

Re: Making a Cassandra node cluster unique

2017-04-05 Thread Hannu Kröger
Hi, Cluster name should be unique because with misconfiguration you might make the nodes connect to either of the cluster and then you will have nodes is wrong clusters. Theoretically it can work with same names as well but to be on the safe side, make the cluster names unique. Hannu On Wed, 5

Re: Slow writes and Frequent timeouts

2017-04-17 Thread Hannu Kröger
It would help to know what kind queries are slow. Hannu > On 17 Apr 2017, at 18:42, Akshay Suresh wrote: > > Hi > > I have set up a cassandra cluster of 8 nodes. > > I am using Apache Cassandra 3.9 > > While using cassandra-stress tool for load testing, I am

Re: Can I do point in time recover using nodetool

2017-03-08 Thread Hannu Kröger
Yes, It's possible. I haven't seen good instructions online though. The Cassandra docs are quite bad as well. I think I asked about it in this list and therefore I suggest you check the mailing list archive as Mr. Roth suggested. Hannu On Wed, 8 Mar 2017 at 10.50, benjamin roth

Re: Any way to control/limit off-heap memory?

2017-03-05 Thread Hannu Kröger
If bloom filters are taking too much memory, you can adjust bloom filters: https://docs.datastax.com/en/cassandra/2.1/cassandra/operations/ops_tuning_bloom_filters_c.html Hannu > On 4 Mar 2017, at

Re: Exceptions when upgrade from 2.1.14 to 2.2.5

2017-04-18 Thread Hannu Kröger
Hello, It seems that commit log is broken. One way to fix this would be to remove commit logs and then restart. This will cause you to lose the writes that were in the commit log but hopefully the data is in other nodes. In the future to avoid this: before you kill Cassandra, run “nodetool

Re: Repair on system_auth

2017-07-06 Thread Hannu Kröger
You can also stop repair using JMX without restarting. There are scripts to do that. Hannu > On 6 Jul 2017, at 23.24, ­Fay Hou [Storage Service] > wrote: > > There is a bug on repair system_auth keyspace. We just skip the repair on > system_auth. Yes. it is ok to kill

Corrupted commit log prevents Cassandra start

2017-07-07 Thread Hannu Kröger
Hello, We had a test server crashing for some reason (not related to Cassandra probably) and now when trying to start cassandra, it gives following error: ERROR [main] 2017-07-06 09:29:56,140 JVMStabilityInspector.java:82 - Exiting due to error while processing commit log during initialization.

Re: Corrupted commit log prevents Cassandra start

2017-07-07 Thread Hannu Kröger
quick fix, I'd recommend: - Delete the affected log file - Start the node - Run a full-range (not -pr) repair on that node 2017-07-07 10:57 GMT+02:00 Hannu Kröger <hkro...@gmail.com>: > Hello, > > We had a test server crashing for some reason (not related to Cassandra > probably)

Re: sstablesplit - status

2017-05-17 Thread Hannu Kröger
Basically meaning that if you run major compaction (=nodetool compact), you will end up with even bigger file and that is likely to never get compacted without running major compaction again. And therefore not recommended for production system. Hannu > On 17 May 2017, at 19:46, Nitan Kainth

Re: Decommissioned node cluster shows as down

2017-05-16 Thread Hannu Kröger
That’s weird. I thought decommission would ultimately remove the node from the cluster because the token(s) should be removed from the ring and data should be streamed to new owners. “DN” is IMHO not a state where the node should end up in. Hannu > On 16 May 2017, at 19:05, suraj pasuparthy

Re: Range deletes, wide partitions, and reverse iterators

2017-05-16 Thread Hannu Kröger
> > Sent from my iPhone > >> On May 16, 2017, at 9:20 AM, Hannu Kröger <hkro...@gmail.com> wrote: >> >> Well, I’m guessing that Cassandra doesn't really know if the range tombstone >> is useful for this or not. >> >> In many cases it might be t

Re: Range deletes, wide partitions, and reverse iterators

2017-05-16 Thread Hannu Kröger
ORDER BY timeid DESC; > > > > On Tue, May 16, 2017 at 5:17 PM, Stefano Ortolani <ostef...@gmail.com > <mailto:ostef...@gmail.com>> wrote: > Yes, that was my intention but I wanted to cross-check with the ML and the > devs keeping an eye on it first. > > On

Re: Range deletes, wide partitions, and reverse iterators

2017-05-16 Thread Hannu Kröger
e records since they are sorted. My understanding > would be something like: > > 1) read sstable 2 > 2) read the range tombstone > 3) skip records from sstable2 and sstable1 within the range boundaries > 4) read remaining records from sstable1 > 5) no records, return > > On

Re: Range deletes, wide partitions, and reverse iterators

2017-05-16 Thread Hannu Kröger
formation re the clustering key ranges, and the > data is clustering key sorted, I would expect a linear scan not to be > necessary. > > On Tue, May 16, 2017 at 3:46 PM, Hannu Kröger <hkro...@gmail.com > <mailto:hkro...@gmail.com>> wrote: > Well, as mentioned, probabl

Re: Reg:- DSE 5.1.0 Issue

2017-05-16 Thread Hannu Kröger
Hello, DataStax is probably more than happy answer your particaly DataStax Enterprise related questions here (I don’t know if that is 100% right place but…): https://support.datastax.com/hc/en-us This mailing list is for open source Cassandra and DSE

Re: SASI index on datetime column does not filter on minutes

2017-06-19 Thread Hannu Kröger
Hello, I tried the same thing with 3.10 which I happened to have at hand and that seems to work. cqlsh:test> select lastname,firstname,dateofbirth from individuals where dateofbirth < '2001-01-01T10:00:00' and dateofbirth > '2000-11-18 17:59:18'; lastname | firstname | dateofbirth

Re: Linux version update on DSE

2017-06-26 Thread Hannu Kröger
Looks Ok. Step 1.5 would be to stop cassandra on existing node but apart from that looks fine. Assuming you are using same configs and if you have hard coded the token(s), you use the same. Hannu > On 26 Jun 2017, at 23.24, Nitan Kainth wrote: > > Hi, > > We are

Re: Linux version update on DSE

2017-06-26 Thread Hannu Kröger
need to take a node down, upgrade the C* version, then start it back up. Jon On Mon, Jun 26, 2017 at 3:56 PM Nitan Kainth <ni...@bamlabs.com> wrote: > It's vnodes. We will add to replace new ip in yaml as well. > > Thank you. > > Sent from my iPhone > > > On Jun 26,

Re: Incorrect quorum count in driver error logs

2017-06-26 Thread Hannu Kröger
Just to be sure: you have only one datacenter configured in Cassandra? Hannu > On 27 Jun 2017, at 0.02, Rutvij Bhatt wrote: > > Hi guys, > > I observed some odd behaviour with our Cassandra cluster the other day while > doing some maintenance operation and was wondering if

Re: Hints files are not getting truncated

2017-06-27 Thread Hannu Kröger
Hi, First of all, I don’t know why they get delivered so slowly. However, if your gc grace seconds is the default 10 days then those hints from May are not needed and could/should be truncated. If the hint delivery is causing problems, then one option is that you could just disable it and rely

Re: Linux version update on DSE

2017-06-27 Thread Hannu Kröger
:56 AM, Nitan Kainth <ni...@bamlabs.com> wrote: Right, we are just upgrading Linux on AWS. C* will remain at same version. On Jun 26, 2017, at 6:05 PM, Hannu Kröger <hkro...@gmail.com> wrote: I understood he is updating linux, not C* Hannu On 27 June 2017 at 02:04:34, Jonath

Weirdest problem on this mailing list

2017-05-22 Thread Hannu Kröger
Hello, For some reason the emails I sent to this Cassandra email list end up to PayPal support email. Can some list admin check if there is something weird in the list configuration or if some funny person added PayPal support address to mailing list? Cheers, Hannu

Re: Cassandra Server 3.10 unable to Start after crash - commitlog needs to be removed

2017-05-19 Thread Hannu Kröger
I have seen this happen as well. Deleting commit logs helps to Cassandra start but of course if you are very unlucky you might lose some data. Hannu > On 19 May 2017, at 18.13, Haris Altaf wrote: > > Hi All, > I am using Cassandra 3.10 for my project and whenever my

Re: Range deletes, wide partitions, and reverse iterators

2017-05-16 Thread Hannu Kröger
Well, I’m guessing that Cassandra doesn't really know if the range tombstone is useful for this or not. In many cases it might be that the partition contains data that is within the range of the tombstone but is newer than the tombstone and therefore it might be still be returned. Scanning

Re: Range deletes, wide partitions, and reverse iterators

2017-05-16 Thread Hannu Kröger
w can you read a partition in reverse? > > Sent from my iPhone > > > On May 16, 2017, at 9:20 AM, Hannu Kröger <hkro...@gmail.com > > <mailto:hkro...@gmail.com>> wrote: > > > > Well, I’m guessing that Cassandra doesn't really know if the range > > tomb

Re: Is DataStax's DSE better than cassandra's free open source for a newbie developer's good start for cassandra?

2017-05-30 Thread Hannu Kröger
Hello, DSE is commercial and costs money to use in production. More info from DataStax: http://www.datastax.com/products/subscriptions RPMs are currently not available for the latest version. There is 3.0.13 but newer than that are not available

Re: Node replacement strategy with AWS EBS

2017-06-14 Thread Hannu Kröger
'm replacing the >> old node? >> >> As for the plan I outlined earlier, is this more for DR scenarios where I >> have lost a node due to hardware failure and I need to recover the data in >> a safe manner by requesting a stream from the other replicas? Am I >>

Re: Node replacement strategy with AWS EBS

2017-06-13 Thread Hannu Kröger
, "Cassandra automatically realizes that have just effectively changed IP address” —> are you sure C* will take care of IP change as is? How will it know which token range to be assigned to this new IP address? On Jun 13, 2017, at 10:51 AM, Hannu Kröger <hkro...@gmail.com> wrote: Cassandra

Re: Node replacement strategy with AWS EBS

2017-06-13 Thread Hannu Kröger
Hello, I think that’s not the optimal way to handle it. If you are just attaching the same EBS volume to a new node you can do like this: 1) nodetool drain on old 2) stop cassandra on old 3) Attach EBS to new node 4) Start Cassandra on new node Cassandra automatically realizes that have just

Re: network down between DCs

2017-09-21 Thread Hannu Kröger
Hi, That’s correct. You need to run repairs only after a node/DC/connection is down for more then max_hint_window_in_ms. Cheers, Hannu On 21 September 2017 at 11:30:44, Peng Xiao (2535...@qq.com) wrote: Hi there, We have two DCs for a Cassandra Cluster,if the network is down less than 3

Re: Materialized views stability

2017-10-04 Thread Hannu Kröger
gt; you're probably better off not using them. > > Thanks, > > Blake > > On October 2, 2017 at 6:55:52 AM, Hannu Kröger (hkro...@gmail.com) wrote: > > Hello, > > I have seen some discussions around Materialized Views and stability of > that functionality. > > There are

Re: [RELEASE] Apache Cassandra 3.11.1 released

2017-10-11 Thread Hannu Kröger
Hi, Isn’t that already here: http://dl.bintray.com/apache/cassandra/dists/311x/main/binary-amd64/ ? Hannu On 11 October 2017 at 16:33:27, Lucas Benevides (lu...@maurobenevides.com.br) wrote: Hello Michael Schuler, When will this version become available for upgrade from apt-get? I visited the

Re: Historical data movement to other cluster

2017-09-13 Thread Hannu Kröger
Hi, If you have that data in different tables, then it’s relatively straight forward operations of loading only certain tables with sstableloader. If not, then you could use spark to read and filter data from one cluster and store that into another cluster. Hannu On 13 September 2017 at

Re: Rebalance a cassandra cluster

2017-09-13 Thread Hannu Kröger
Hi, you should make sure that token range is evenly distributed if you have a single token configured per node. You can use e.g. this tool to calculate tokens: https://www.geroba.com/cassandra/cassandra-token-calculator/ Also, make sure that none of the partitions in your data model are hotspots

Materialized views stability

2017-10-02 Thread Hannu Kröger
Hello, I have seen some discussions around Materialized Views and stability of that functionality. There are some open issues around repairs:

Do not use Cassandra 3.11.0+ or Cassandra 3.0.12+

2017-08-28 Thread Hannu Kröger
Hello, Current latest Cassandra version (3.11.0, possibly also 3.0.12+) has a race condition that causes Cassandra to create broken sstables (stats file in sstables to be precise). Bug described here: https://issues.apache.org/jira/browse/CASSANDRA-13752 This change might be causing it (but not

Re: Best approach to prepare to shutdown a cassandra node

2017-10-12 Thread Hannu Kröger
Hi, Drain should be enough. It stops accepting writes and after that cassandra can be safely shut down. Hannu On 12 October 2017 at 20:24:41, Javier Canillas (javier.canil...@gmail.com) wrote: Hello everyone, I have some time working with Cassandra, but every time I need to shutdown a node

TWCS on partitions spanning multiple time windows

2017-12-14 Thread Hannu Kröger
Hi, I have been reading a bit about TWCS to understand how it functions. Current assumption: TWCS uses same tombstone checks as any other compaction strategy to make sure that it doesn’t remove tombstones unless it is safe to do so. Scenario 1: So let’s assume that I have a tables like this:

Nodetool compactionstats hangs

2017-12-19 Thread Hannu Kröger
Hi, I opened a ticket about nodetool compactionstats hanging: https://issues.apache.org/jira/browse/CASSANDRA-14130 The root cause seems to be JMX metric fetching hanging. I was able to replicate it on this problematic like this: Welcome to JMX terminal. Type "help" for available commands.

Re: Nodetool compactionstats hangs

2017-12-19 Thread Hannu Kröger
Hi, Sure! I attached the jstack dumps on the ticket. Hannu On 19 December 2017 at 14:38:45, Jeff Jirsa (jji...@gmail.com) wrote: Can you grab a thread dump with jstack as well? -- Jeff Jirsa On Dec 19, 2017, at 3:32 AM, Hannu Kröger <hkro...@gmail.com> wrote: Hi, I opened a ticket

Re: Upgrade using rebuild

2017-12-14 Thread Hannu Kröger
If you want to do a version upgrade, you need to basically do follow node by node: 0) stop repairs 1) make sure your sstables are at the latest version (nodetool upgradesstables can do it) 2) stop cassandra 3) update cassandra software and update cassandra.yaml and cassandra-env.sh files 4) start

Re: Does LOCAL_ONE still replicate data?

2018-05-08 Thread Hannu Kröger
Writes are always replicated to all nodes (if they are online). LOCAL_ONE in writes just means that client will get an “OK” for the write only after at least node in local datacenter has acknowledged that the write is done. If all local replicas are offline, then the write will fail even if it

Re: Error after 3.1.0 to 3.11.2 upgrade

2018-05-11 Thread Hannu Kröger
Hi, Did you check replication strategy and amounts of replicas of system_auth keyspace? Hannu > Abdul Patel kirjoitti 12.5.2018 kello 5.21: > > No applicatiom isnt impacted ..no complains .. > Also its an 4 node cluster in lower non production and all are on same >

Re: Client ID logging

2018-05-21 Thread Hannu Kröger
Hmm, I think that by default not but you can create a hook to log that. Create a wrapper for PasswordAuthenticator class for example and use that. Or if you don’t use authentication you can create your own query handler. Hannu > James Lovato kirjoitti 21.5.2018 kello

Re: Problem with dropped mutations

2018-07-02 Thread Hannu Kröger
s not upto mark! > > You can also check if network isn't dropping packets (ifconfig -a tool) + > storage (dstat tool) isn't reporting too slow disks. > > Cheers/Asad > > > -----Original Message- > From: Hannu Kröger [mailto:hkro...@gmail.com] > Sent: Tuesday

Problem with dropped mutations

2018-06-26 Thread Hannu Kröger
Hello, We have a cluster with somewhat heavy load and we are seeing dropped mutations (variable amount and not all nodes have those). Are there some clear trigger which cause those? What would be the best pragmatic approach to start debugging those? We have already added more memory which

Re: GUI clients for Cassandra

2018-05-02 Thread Hannu Kröger
Ah, you are correct! However, it’s not being updated anymore AFAIK. Do you know if it support the latest 3.x features? SASI, MV, etc. ? Hannu > On 24 Apr 2018, at 03:45, Christophe Schmitz > wrote: > > Hi Hannu ;) > > > >>> I have been asked many times that

Re: upgrade from 3.9 to 3.11.2

2018-05-03 Thread Hannu Kröger
Hello, it never hurts to run “nodetool upgradesstables" after the upgrade. It’s a no-op if there is nothing to upgrade. Hannu > On 3 May 2018, at 09:57, Xiangfei Ni wrote: > > Hi Community > I have a question regarding upgrading Cassandra from 3.9 to 3.11.2, > Do I

Re: upgrade from 3.9 to 3.11.2

2018-05-03 Thread Hannu Kröger
; 倪项菲/ David Ni > 中移德电网络科技有限公司 > Virtue Intelligent Network Ltd, co. > > Add: 2003,20F No.35 Luojia creative city,Luoyu Road,Wuhan,HuBei > Mob: +86 13797007811|Tel: + 86 27 5024 2516 > > 发件人: Hannu Kröger <hkro...@gmail.com> > 发送时间: 2018年5月3日 15:00 > 收件人:

Re: Repair fails for unknown reason

2018-01-09 Thread Hannu Kröger
We have run restarts on the cluster and that doesn’t seem to help at all. We ran repair separately for each table that seems to go through usually but running a repair on a keyspace doesn’t. Anything anyone? Hannu > On 3 Jan 2018, at 23:24, Hannu Kröger <hkro...@gmail.com> wrote: &

Re: Setting min_index_interval to 1?

2018-02-02 Thread Hannu Kröger
Wouldn’t that still try to read the index on the disk? So you would just potentially have all keys on the memory and on the disk and reading would first happen in memory and then on the disk and only after that you would read the sstable. So you wouldn’t gain much, right? Hannu > On 2 Feb

Re: Repair fails for unknown reason

2018-01-03 Thread Hannu Kröger
il.com> > wrote: > > hi Hannu, > > I think some of the repairs are hanging there. please restart all the nodes > in the cluster and start the repair > > > Thanks > Nanda > > On Wed, Jan 3, 2018 at 9:35 AM, Hannu Kröger <hkro...@gmail.com > <mailto

Repair fails for unknown reason

2018-01-03 Thread Hannu Kröger
Hello, Situation is as follows: Repair was started on node X on this keyspace with —full —pr. Repair fails on node Y. Node Y has debug logging on (DEBUG on org.apache.cassandra) and I’m looking at the debug.log. I see following messages related to this repair request: --- DEBUG

Re: Repair fails for unknown reason

2018-01-03 Thread Hannu Kröger
Additional notes: 1) If I run the repair just on those tables, it works fine 2) Those tables are empty Hannu > On 3 Jan 2018, at 18:23, Hannu Kröger <hkro...@gmail.com> wrote: > > Hello, > > Situation is as follows: > > Repair was started on node X on this keys

  1   2   >