Re: is this correct, thrift unportable to CQL3Š.

2013-09-25 Thread Sylvain Lebresne
On Tue, Sep 24, 2013 at 7:24 PM, Hiller, Dean dean.hil...@nrel.gov wrote: Java has Integer as opposed to int which is what I represent golf scores with so to speak in my example. In this case, Integer can be null but of course maps to empty just fine. What about querying for all golf scores

Mystery PIG issue with 1.2.10

2013-09-25 Thread Janne Jalkanen
Heya! I am seeing something rather strange in the way Cass 1.2 + Pig seem to handle integer values. Setup: Cassandra 1.2.10, OSX 10.8, JDK 1.7u40, Pig 0.11.1. Single node for testing this. First a table: CREATE TABLE testc ( key text PRIMARY KEY, ivalue int, svalue text, value

Re: Migration LCS from 1.2.X to 2.0.x exception

2013-09-25 Thread Marcus Eriksson
this is the issue: https://issues.apache.org/jira/browse/CASSANDRA-5383 guess it fell between chairs, will poke around On Tue, Sep 24, 2013 at 4:26 PM, Nate McCall n...@thelastpickle.com wrote: What version of 1.2.x? Unfortunately, you must go through 1.2.9 first. See

Re: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Marcus Eriksson
this is most likely a bug, filed https://issues.apache.org/jira/browse/CASSANDRA-6093 and will try to have a look today. On Wed, Sep 25, 2013 at 1:48 AM, Christopher Wirt chris.w...@struq.comwrote: Hi, ** ** Just had a go at upgrading a node to the latest stable c* 2 release and think

Re: is this correct, thrift unportable to CQL3Š.

2013-09-25 Thread Alex Popescu
On Wed, Sep 25, 2013 at 12:22 AM, Sylvain Lebresne sylv...@datastax.comwrote: On Tue, Sep 24, 2013 at 7:24 PM, Hiller, Dean dean.hil...@nrel.govwrote: Java has Integer as opposed to int which is what I represent golf scores with so to speak in my example. In this case, Integer can be null

Re: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Marcus Eriksson
cant really reproduce, could you update the ticket with a bit more info about your setup? do you have multiple .json files in your data dirs? On Wed, Sep 25, 2013 at 10:07 AM, Marcus Eriksson krum...@gmail.com wrote: this is most likely a bug, filed

Re: is this correct, thrift unportable to CQL3Š.

2013-09-25 Thread Sylvain Lebresne
Nulls should definitely stay null (that's an old DB debate), but if this is a generic case, we might consider adding an emptyValue() helper method. Would that be possible Sylvain? As said previously, debating this is outside the scope of this mailing list, but to make it short, using empty

Re: Bad Request: Invalid null value for clustering key part

2013-09-25 Thread Petter von Dolwitz (Hem)
I am generating the CSV file by other means than the COPY ... TO command and I thought that the NULL option did not apply to the COPY ... FROM command but, as it turns out, it does! This solved my problem. The documentation here (

Extracting throughput-heavy Cassandra operations to different process

2013-09-25 Thread André Cruz
Hello. I have been looking into the memory patterns of Cassandra (1.1.5), and I have a suggestion that I haven't seen discussed here. Cassandra is configured by default with a GC tailored for pauseless operation instead of throughput, and this makes sense since it needs to answer client

Re: Bad Request: Invalid null value for clustering key part

2013-09-25 Thread Petter von Dolwitz (Hem)
In fact, the blog post on the subject ( http://www.datastax.com/dev/blog/simple-data-importing-and-exporting-with-cassandra) also states that the NULL option only is used by the COPY ... TO command but it also states that this might change in the future and the future seems to be here now.

RE: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Christopher Wirt
Hi Marcus, Thanks for having a look at this. Just noticed this in the NEWS.txt For leveled compaction users, 2.0 must be atleast started before upgrading to 2.1 due to the fact that the old JSON leveled manifest is migrated into the sstable metadata files on startup in

FW: Migration LCS from 1.2.X to 2.0.x exception

2013-09-25 Thread Desimpel, Ignace
Same is true if started from 1.2.9 version to 2.0.x Seems like Cassandra-5383 is the related issue. The code in the function mutateLevel (from 1.2.5 to 1.2.9 and later ) is indirectly using the java file::renameTo function. And that will not work on Windows if the file already exists. Don't

Re: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Marcus Eriksson
you are probably reading trunk NEWS.txt read the ticket for explanation of what the issue was (it is a proper bug) On Wed, Sep 25, 2013 at 12:59 PM, Christopher Wirt chris.w...@struq.comwrote: Hi Marcus, Thanks for having a look at this. ** ** Just noticed this in the NEWS.txt

Re: Query about class org.apache.cassandra.io.sstable.SSTableSimpleWriter

2013-09-25 Thread Jayadev Jayaraman
Can someone answer this doubt reg. SSTableSimpleWriter ? I'd asked about this earlier but it probably missed. Apologies for repeating the question (with minor additions) : Let's say I've initialized a *SSTableSimpleWriter* instance and a new column with TTL set :

RE: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Christopher Wirt
Hi Marcus, I've seen your patch. This works with what I'm seeing. The first data directory only contained the JSON manifest at that time. As a workaround I've made sure that each of the snapshot directories now exist before starting up. I still end up with the second exception I posted

RE: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Christopher Wirt
Should also say. I have managed to move one node from 1.2.10 to 2.0.0. I'm seeing this error on the machine I tried to migrate earlier to 2.0.1 Thanks From: Christopher Wirt [mailto:chris.w...@struq.com] Sent: 25 September 2013 14:04 To: 'user@cassandra.apache.org' Subject: RE: 1.2.10 -

Re: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Marcus Eriksson
you probably have to remove the old snapshots before trying to restart On Wed, Sep 25, 2013 at 3:05 PM, Christopher Wirt chris.w...@struq.comwrote: Should also say. I have managed to move one node from 1.2.10 to 2.0.0. I’m seeing this error on the machine I tried to migrate earlier to

FW: Migration LCS from 1.2.X to 2.0.x exception

2013-09-25 Thread Desimpel, Ignace
Did a test for File::rename on Ubuntu and windows. Seems that on Ubuntu the File::renameTo(FROM, TO) is actually replacing the existing (same as TO) file and content with the new (same as FROM) file and content. So that would make it a problem only on Windows. Adding a File::delete before the

Re: Mystery PIG issue with 1.2.10

2013-09-25 Thread Chad Johnston
As an FYI, creating the table without the WITH COMPACT STORAGE and using CqlStorage works just fine in 1.2.10. I know that CqlStorage and AbstractCassandraStorage got changed for 1.2.10 - maybe there's a regression with the existing CassandraStorage? Chad On Wed, Sep 25, 2013 at 1:51 AM, Janne

Re: Bad Request: Invalid null value for clustering key part

2013-09-25 Thread Tyler Hobbs
On Wed, Sep 25, 2013 at 5:00 AM, Petter von Dolwitz (Hem) petter.von.dolw...@gmail.com wrote: I am generating the CSV file by other means than the COPY ... TO command and I thought that the NULL option did not apply to the COPY ... FROM command but, as it turns out, it does! This solved my

Re: 1.2.10 - 2.0.1 migration issue

2013-09-25 Thread Robert Coli
On Wed, Sep 25, 2013 at 6:05 AM, Christopher Wirt chris.w...@struq.comwrote: Should also say. I have managed to move one node from 1.2.10 to 2.0.0. I’m seeing this error on the machine I tried to migrate earlier to 2.0.1 I'm confused... for the record : 1) you tried to upgrade from 1.2.10 to

Nodes not added to existing cluster

2013-09-25 Thread Skye Book
Hi all, I have a three node cluster using the EC2 Multi-Region Snitch currently operating only in US-EAST. On having a node go down this morning, I started a new node with an identical configuration, except for the seed list, the listen address and the rpc address. The new node comes up and

Re: Nodes not added to existing cluster

2013-09-25 Thread Robert Coli
On Wed, Sep 25, 2013 at 12:41 PM, Skye Book skye.b...@gmail.com wrote: I have a three node cluster using the EC2 Multi-Region Snitch currently operating only in US-EAST. On having a node go down this morning, I started a new node with an identical configuration, except for the seed list, the

Re: Nodes not added to existing cluster

2013-09-25 Thread Laing, Michael
Check your security groups to be sure you have appropriate access. If in a VPC check both IN and OUT; if using ACLs check those. On Wed, Sep 25, 2013 at 3:41 PM, Skye Book skye.b...@gmail.com wrote: Hi all, I have a three node cluster using the EC2 Multi-Region Snitch currently operating

Re: Nodes not added to existing cluster

2013-09-25 Thread Skye Book
Thank you, both Michael and Robert for your suggestions. I actually saw 5760, but we were running on 2.0.0, which it seems like this was fixed in. That said, I noticed that my Chef scripts were failing to set the broadcast_address correctly, which I'm guessing is the cause of the problem,

[Cassandra] Initial Setup - VMs for Research

2013-09-25 Thread shathawa
Request some initial setup guidance for Cassandra deployment I expect to mentor a project at the Oregon State University computer science department for a senior engineering student project. I am trying to pre-configure one or more VMware virtual machines to hold an initial Cassandra database

RE: [Cassandra] Initial Setup - VMs for Research

2013-09-25 Thread Kanwar Sangha
What help are u looking for ? http://www.datastax.com/docs/datastax_enterprise3.1/install/install_deb_pkg -Original Message- From: shath...@e-z.net [mailto:shath...@e-z.net] Sent: 25 September 2013 15:27 To: user@cassandra.apache.org Subject: [Cassandra] Initial Setup - VMs for

Re: [Cassandra] Initial Setup - VMs for Research

2013-09-25 Thread Aaron Morton
There is also Debian for the standard Apache Cassandra build http://wiki.apache.org/cassandra/DebianPackaging Or you can use DS Community which is a totally free distro of Apache Cassandra http://www.datastax.com/documentation/cassandra/2.0/webhelp/index.html#cassandra/install/installDeb_t.html

Re: Nodes not added to existing cluster

2013-09-25 Thread Aaron Morton
I am curious, though, how any of this worked in the first place spread across three AZ's without that being set? boradcast_address is only needed when you are going cross region (IIRC it's the EC2MultiRegionSnitch) that sets it. As rob said, make sure the seed list includes on of the other

Re: Mystery PIG issue with 1.2.10

2013-09-25 Thread Aaron Morton
(testc = LOAD 'cassandra://keyspace/testc' USING CassandraStorage(); dump testc foo,{(ivalue, ),(svalue,bar),(value,A)}) If the CQL 3 data ye wish to read, CqlStorage be the driver of your success. (btw there is a ticket out to update the example if you get excited

Re: Nodes not added to existing cluster

2013-09-25 Thread Skye Book
Hi Aaron, thanks for the clarification. As might be expected, having the broadcast_address fixed hasn't fixed anything. What I did find after writing my last email is that output.log is littered with these: INFO 05:03:49,015 Cannot handshake version with /aa.bb.cc.dd INFO 05:03:49,017