Re: sstable loader

2015-03-30 Thread Rahul Bhardwaj
Hi Amila , I tried your code. In which we made some modification accordingly like: public class DataImportExample { static String filename; public static void main(String[] args) throws IOException { filename = /root/perl_work/abc.csv; BufferedReader reader = new

Re: Replication to second data center with different number of nodes

2015-03-30 Thread Carlos Rolo
Sharing my experience here. 1) Never had any issues with different size DCs. If the hardware is the same, keep the # to 256. 2) In most of the cases I keep the 256 vnodes and no performance problems (when they are triggered, the cause is not the vnodes #) Regards, Carlos Juzarte Rolo Cassandra

Re: sstable loader

2015-03-30 Thread Vanessa Gligor
Hi, I used this https://github.com/yukim/cassandra-bulkload-example/ (I have modified BulkLoad.java for my needs) for the sstable loader and it works ok. You can take a look, maybe it will help you. Regards, Vanessa. On Mon, Mar 30, 2015 at 10:04 AM, Rahul Bhardwaj rahul.bhard...@indiamart.com

SSTable structure

2015-03-30 Thread Pierre
Hi, Does anyone know if there is a more complete and up to date documentation about the sstable files structure (data, index, stats etc.) than this one : http://wiki.apache.org/cassandra/ArchitectureSSTable I'm looking for a full specification, with schema of the structure if possible.

Re: sstable loader

2015-03-30 Thread Amila Paranawithana
Hi Rahul, By just seeing the error I guess the file name you have given need to be changed to to format file:/// .Not sure anyway. Cheers! Amila On Mon, Mar 30, 2015 at 1:46 PM, Rahul Bhardwaj rahul.bhard...@indiamart.com wrote: Hi Venessa, Thanks for sharing. But when after

Cassandra 2.1.3: OOM during bootstrap

2015-03-30 Thread Nathan Bijnens
We are getting a OOM when adding a new node to an existing cluster. In the heapdump we found that this thread caused the OutOfMemory exception: SharedPool-Worker-10 daemon prio=5 tid=440 RUNNABLE at java.lang.OutOfMemoryError.init(OutOfMemoryError.java:48) at

Re: sstable loader

2015-03-30 Thread Rahul Bhardwaj
Hi Venessa, Thanks for sharing. But when after compiling BulkLoad.java, on executing it is returning Exception in thread main java.lang.NoClassDefFoundError: BulkLoad (wrong name: bulkload/BulkLoad) had you also seen this. Regards: Rahul Bhardwaj On Mon, Mar 30, 2015 at 12:57 PM, Vanessa

Re: SSTable structure

2015-03-30 Thread ssiv...@gmail.com
+1 On 03/30/2015 11:38 AM, Pierre wrote: Hi, Does anyone know if there is a more complete and up to date documentation about the sstable files structure (data, index, stats etc.) than this one : http://wiki.apache.org/cassandra/ArchitectureSSTable I'm looking for a full specification,

Re: sstable writer and creating bytebuffers

2015-03-30 Thread Sylvain Lebresne
No, it's not a bug. In a composite every elements start by a 2 short indicating the size of the element, plus an extra byte that is used for sorting purposes. A little bit more details can be found in the CompositeType class javadoc if you're interested. It's not the most compact format there is

sstable writer and creating bytebuffers

2015-03-30 Thread Peer, Oded
I am writing code to bulk load data into Cassandra using SSTableSimpleUnsortedWriter I changed my partition key from a composite key (long, int) to a single column key (long). For creating the composite key I used a CompositeType, and I kept using it after changing the key to a single column.

importing files into cassandra, and feauture enhancements in cassandra

2015-03-30 Thread Divya Divs
hi everyone.. I'm a m-tech student. my academic project is cassandra. I have run the source code of cassandra in eclipse juno using ant build. https://github.com/apache/cassandra. i have to do some feature enhancement in cassandra. After enhancing i hav to import crime datasets into the cassandra

nodetool cleanup error

2015-03-30 Thread Amlan Roy
Hi, I have added new nodes to an existing cluster and ran the “nodetool cleanup”. I am getting the following error. Wanted to know if there is any solution to it. Regards, Amlan Error occurred during cleanup java.util.concurrent.ExecutionException: java.lang.AssertionError: Memory was freed

Re: nodetool cleanup error

2015-03-30 Thread Duncan Sands
Hi Amlan, On 30/03/15 22:12, Amlan Roy wrote: Hi, I have added new nodes to an existing cluster and ran the “nodetool cleanup”. I am getting the following error. Wanted to know if there is any solution to it. Regards, Amlan Error occurred during cleanup

Re: nodetool cleanup error

2015-03-30 Thread Jeff Ferland
Code problem that was patched in https://issues.apache.org/jira/browse/CASSANDRA-8716 https://issues.apache.org/jira/browse/CASSANDRA-8716. Upgrade to 2.0.13 On Mar 30, 2015, at 1:12 PM, Amlan Roy amlan@cleartrip.com wrote: Hi, I have added new nodes to an existing cluster and ran

Why select returns tombstoned results?

2015-03-30 Thread Benyi Wang
Create table tomb_test ( guid text, content text, range text, rank int, id text, cnt int primary key (guid, content, range, rank) ) Sometime I delete the rows using cassandra java driver using this query DELETE FROM tomb_test WHERE guid=? and content=? and range=? in Batch

Re: Why select returns tombstoned results?

2015-03-30 Thread Prem Yadav
Increase the read CL to quorum and you should get correct results. How many nodes do you have in the cluster and what is the replication factor for the keyspace? On Mon, Mar 30, 2015 at 7:41 PM, Benyi Wang bewang.t...@gmail.com wrote: Create table tomb_test ( guid text, content text,

Re: Issue with removing a node and adding it back

2015-03-30 Thread Robert Coli
On Fri, Mar 27, 2015 at 4:27 PM, Shiwen Cheng cheng.shiwen...@gmail.com wrote: Thanks Robert! Yes I tried what you said: clean the data and re-bootstrap. But still it failed, once at the point of 600GB transferred and once at 1.1TB :( 1) figure out what is making your streams die (usually

Re: upgrade from 1.0.12 to 1.1.12

2015-03-30 Thread Robert Coli
On Fri, Mar 27, 2015 at 4:01 AM, Jason Wee peich...@gmail.com wrote: Rob, the cluster now upgraded to cassandra 1.0.12 (default hd version, in Descriptor.java) and I ensure all sstables in current cluster are hd version before upgrade to cassandra 1.1. I have also checked in cassandra 1.1.12

Re: Cassandra 2.1.3: OOM during bootstrap

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 2:08 AM, Nathan Bijnens nat...@nathan.gs wrote: We are getting a OOM when adding a new node to an existing cluster. In the heapdump we found that this thread caused the OutOfMemory exception: SharedPool-Worker-10 daemon prio=5 tid=440 RUNNABLE This type of post is

Re: nodetool cleanup error

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 4:21 PM, Amlan Roy amlan@cleartrip.com wrote: Thanks for the reply. I have upgraded to 2.0.13. Now I get the following error. If cleanup is still excepting for you on 2.0.13 with some sstables you have, I would strongly consider : 1) file a JIRA

Re: nodetool cleanup error

2015-03-30 Thread Amlan Roy
Hi, Thanks for the reply. I have upgraded to 2.0.13. Now I get the following error. Regards, Amlan Exception in thread main java.lang.AssertionError: [SSTableReader(path='/data/1/cassandra/data/xxx/xxx/xxx.db'), SSTableReader(path='/data/1/cassandra/data/xxx/xxx/xxx.db')] at

Re: Why select returns tombstoned results?

2015-03-30 Thread Benyi Wang
Thanks for replying. In cqlsh, if I change to Quorum (Consistency quorum), sometime the select return the deleted row, sometime not. I have two virtual data centers: service (3 nodes) and analytics(4 nodes collocate with Hadoop data nodes).The table has 3 replicas in service and 2 in analytics.

Re: upgrade from 1.0.12 to 1.1.12

2015-03-30 Thread Robert Coli
On Fri, Mar 27, 2015 at 7:20 AM, Jonathan Haddad j...@jonhaddad.com wrote: Running upgrade is a noop if the tables don't need to be upgraded. I consider the cost of this to be less than the cost of missing an upgrade. Oh, right! This optimization was added, which means I totally and

Re: nodetool cleanup error

2015-03-30 Thread Yuki Morishita
Looks like the issue is https://issues.apache.org/jira/browse/CASSANDRA-9070. On Mon, Mar 30, 2015 at 6:25 PM, Robert Coli rc...@eventbrite.com wrote: On Mon, Mar 30, 2015 at 4:21 PM, Amlan Roy amlan@cleartrip.com wrote: Thanks for the reply. I have upgraded to 2.0.13. Now I get the

Re: SSTable structure

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 1:38 AM, Pierre pierredev...@gmail.com wrote: Does anyone know if there is a more complete and up to date documentation about the sstable files structure (data, index, stats etc.) than this one : http://wiki.apache.org/cassandra/ArchitectureSSTable No, there isn't.

Re: SSTable structure

2015-03-30 Thread daemeon reiydelle
why? Then there are 2 places 2 maintain or get jira'ed for a discrepancy. On Mar 30, 2015 4:46 PM, Robert Coli rc...@eventbrite.com wrote: On Mon, Mar 30, 2015 at 1:38 AM, Pierre pierredev...@gmail.com wrote: Does anyone know if there is a more complete and up to date documentation about the

Re: SSTable structure

2015-03-30 Thread Kirk True
The tricky thing with documenting the SS tables is that there are a lot of conditionals in the structure, so it makes for twisty reading. Just for fun, here's a terrible start I made once: https://github.com/mustardgrain/cassandra-notes/blob/master/SSTables.md On Mon, Mar 30, 2015, at 05:12 PM,

Re: SSTable structure

2015-03-30 Thread Robert Coli
On Mon, Mar 30, 2015 at 5:07 PM, daemeon reiydelle daeme...@gmail.com wrote: why? Then there are 2 places 2 maintain or get jira'ed for a discrepancy. If you are asserting that code is capable of documenting itself, we will just have to agree to disagree. =Rob

Re: SSTable structure

2015-03-30 Thread Jacob Rhoden
Yes updating code and documentation can sometimes be annoying, you would only ever maintain both if it were important. It comes down or is having the format of the data files documented for everyone to understand an important thing? __ Sent from iPhone On 31 Mar

RE: sstable writer and creating bytebuffers

2015-03-30 Thread Peer, Oded
Thanks Sylvain. Is there any way to create a composite key with only one column in Cassandra when creating a table, or should creating a CompositeType instance with a single column be prohibited? From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: Monday, March 30, 2015 1:57 PM To:

RE: Saving a file using cassandra

2015-03-30 Thread Peer, Oded
Try this http://stackoverflow.com/a/17208343/248656 From: jean paul [mailto:researche...@gmail.com] Sent: Wednesday, March 18, 2015 7:06 PM To: user@cassandra.apache.org Subject: Saving a file using cassandra Hello, Finally, i have created my ring using cassandra. Please, i'd like to store a