Re: select count(*) returns 10000

2012-06-13 Thread Tamar Fraenkel
Add limit N and it will count more than 1. Of course it will be slow when you increase N. *Tamar Fraenkel * Senior Software Engineer, TOK Media [image: Inline image 1] ta...@tok-media.com Tel: +972 2 6409736 Mob: +972 54 8356490 Fax: +972 2 5612956 On Tue, Jun 12, 2012 at 10:07

portability between enterprise and community version

2012-06-13 Thread Abhijit Chanda
Hi All, Is it possible to communicate from a datastax enterprise edition to datastax community edition. Actually i want to set one of my node in linux box and other in windows. Please suggest. With Regards, -- Abhijit Chanda VeHere Interactive Pvt. Ltd. +91-974395

RE: Hector code not running when replication factor set to 2

2012-06-13 Thread Prakrati Agrawal
The error stack is as follows: Exception in thread main java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at

RE: portability between enterprise and community version

2012-06-13 Thread Viktor Jevdokimov
Do not mix Linux and Windows nodes. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.commailto:viktor.jevdoki...@adform.com Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow us on Twitter:

Re: portability between enterprise and community version

2012-06-13 Thread R. Verlangen
@Viktor: I've read/heard this many times before, however I've never seen a real explanation. Java is cross platform. If Cassandra runs properly on both Linux as Windows clusters: why would it be impossible to communicate? Of course I understand the disadvantages of having a combined cluster.

How commitlog_sync affect the performance??

2012-06-13 Thread mich.hph
Hi All?? Is there anybody has ever done some testing about the commitlog_sync mode? and how it affect the performance??

Re: portability between enterprise and community version

2012-06-13 Thread Abhijit Chanda
Hi Viktor Jevadokimov, May i know what are the issues i may face if i mix windows cluster along with linux cluster. Regards, -- Abhijit Chanda VeHere Interactive Pvt. Ltd. +91-974395

RE: portability between enterprise and community version

2012-06-13 Thread Viktor Jevdokimov
Repair (streaming) will not work. Probably schema update will not work also, it was long time ago, don't remember. Migration of the cluster between Windows and Linux also not an easy task, a lot of manual work. Finally, mixed Cassandra environments are not supported as by DataStax as by

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Jason Tang
We suppose the cached memory will be released by OS, but from /proc/meminfo , the cached memory is in Active status, so I am not sure if it will be release by OS. And for low memory, because we found Unable to reduce heap usage since there are no dirty column families in system.log, and then

Re: Dead node still being pinged

2012-06-13 Thread aaron morton
Here is what I *think* is going on, if Brandon is around he may be able to help out. The old nodes are being included in the Gossip rounds, because Gossiper.doGossipToUnreachableMember() just looks at the nodes that are unreachable. It does not check if they have been removed from the

Re: Odd problem with cli and display of value types

2012-06-13 Thread aaron morton
The set with the type casts updates the client side column meta data with the type (just like assume does). So after the first set the client will act as if you said assume users validator as long; In this case it's not particularly helpful. Can you add a trivial ticket to

Re: Disappearing keyspaces in Cassandra 1.1

2012-06-13 Thread aaron morton
Can you supply the error logs ? Thanks - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 13/06/2012, at 6:54 AM, Oleg Dulin wrote: I am using cassandra 1.1.0 on a 3 node environment. I just truncated a few column families then restarted the

Re: portability between enterprise and community version

2012-06-13 Thread Sasha Dolgy
I consistently move keyspaces from linux machines onto windows machines for development purposes. I've had no issues ... but would probably be hesitant in rolling this out into a productive instance. Depends on the level of risk you want to take. : ) Run some tests ... mix things up and share

Re: Hector code not running when replication factor set to 2

2012-06-13 Thread aaron morton
It looks like the request used a CL higher than ONE. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 13/06/2012, at 6:49 PM, Prakrati Agrawal wrote: The error stack is as follows: Exception in thread main

RE: Hector code not running when replication factor set to 2

2012-06-13 Thread Prakrati Agrawal
How do I verify that I am using a wrong consistency level? Thanks and Regards Prakrati Agrawal | Developer - Big Data(ID)| 9731648376 | www.mu-sigma.com From: aaron morton [mailto:aa...@thelastpickle.com] Sent: Wednesday, June 13, 2012 2:38 PM To: user@cassandra.apache.org Subject: Re: Hector

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread aaron morton
Low OS memory Low OS memory is not the same as low JVM memory. Normally the JVM allocates and locks all the memory is needs at start up. impact by our configuration: memtable_flush_writers=32, memtable_flush_queue_size=12 increasing flush writers will impact on IO, increasing the queue size

RE: portability between enterprise and community version

2012-06-13 Thread Viktor Jevdokimov
I remember that join and decommission didn’t worked since using streaming. All problems was due to paths differences between Windows and Linux styles. So how do you move keyspaces? Using streaming (join/decommission), or manually? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer

Re: portability between enterprise and community version

2012-06-13 Thread Abhijit Chanda
Hi Sasha, Viktor, In my case i have a project in which both java and .NET modules are there. For Java i m using Astyanax API and for .NET Fluent Cassandra. I am using DSE 2.1 for development purpose as i need partial searching in some of queries, which i m doing with the help of solr which is

RE: portability between enterprise and community version

2012-06-13 Thread Viktor Jevdokimov
Clients are clients, servers are servers. Why do you need mixed environment Cassandra cluster? Isn't enough mixed clients? Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.commailto:viktor.jevdoki...@adform.com Phone: +370 5 212 3063, Fax +370 5 261

Re: portability between enterprise and community version

2012-06-13 Thread Abhijit Chanda
Viktor, For .NET currently i am using Datastax Community version as DSE can't be installed in windows. And due to absence of DSE i m not able to use solr as an integrated part of Datastax. Thats why i was looking for the mixed environment so that i can use the features of DSE. Thanks, --

how to reduce latency?

2012-06-13 Thread Yan Chunlu
I have three nodes running cassandra 0.7.4 about two years, as showed below: 10.x.x.x Up Normal 138.07 GB 33.33% 0 10.x.x.x Up Normal 143.97 GB 33.33% 56713727820156410577229101238628035242 10.x.x.x Up Normal 137.33 GB 33.33%

Re: portability between enterprise and community version

2012-06-13 Thread Radim Kolar
Dne 13.6.2012 11:29, Viktor Jevdokimov napsal(a): I remember that join and decommission didn’t worked since using streaming. All problems was due to paths differences between Windows and Linux styles. what about to use unix style File.separator in streaming protocol to make it

Re: Dead node still being pinged

2012-06-13 Thread Nicolas Lalevée
Le 13 juin 2012 à 10:30, aaron morton a écrit : Here is what I *think* is going on, if Brandon is around he may be able to help out. The old nodes are being included in the Gossip rounds, because Gossiper.doGossipToUnreachableMember() just looks at the nodes that are unreachable. It

Cassandra out of Heap memory

2012-06-13 Thread rohit bhatia
Hi My cassandra node went out of heap memory with this message GCInspector.java(line 88): Heap is .9934 full. Is this expected? or should I adjust my flush_largest_memtable_at variable. Also one change I did in my cluster was add 5 Column Families which are empty Should empty ColumnFamilies

Re: Cassandra out of Heap memory

2012-06-13 Thread rohit bhatia
To clarify things Our setup contains of 8 nodes of 32 gb ram... with a heap_max size of 12gb and heap new size of 1.6 gb The load on our nodes is write/read ratio of 10 with 6 main Column Families. Although the flushes of column families occur every hour with sstables sizes of around 50-100 mb.

Re: Snapshot failing on JSON files in 1.1.0

2012-06-13 Thread Alain RODRIGUEZ
Hi Aaron, We are using Ubuntu (AMI Datastax 1.0.9 as I said). Release:10.10 Codename: maverick ERROR [RMI TCP Connection(37732)-10.248.10.94] 2012-06-13 15:00:17,157 CLibrary.java (line 153) Unable to create hard link com.sun.jna.LastErrorException: errno was 1 at

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
I have experienced the same issue. The Java heap seems fine but eventually the OS runs out of heap. In my case it renders the entire box unusable without a hard reboot. Console shows: is there a way to limit the native heap usage? xfs invoked oom-killer: gfp_mask=0x201d2, order=0,

Re: Snapshot failing on JSON files in 1.1.0

2012-06-13 Thread Alain RODRIGUEZ
if I do : locate jna /opt/java/64/jdk1.6.0_31/db/docs/html/ref/rrefsqljnaturaljoin.html /root/.m2/repository/net/java/dev/jna /root/.m2/repository/net/java/dev/jna/jna /root/.m2/repository/net/java/dev/jna/jna/3.2.7 /root/.m2/repository/net/java/dev/jna/jna/3.2.7/jna-3.2.7-sources.jar

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
Seems like my only recourse is to remove jna.jar and just take the performance/swapping pain? Obviously can't have the entire box lock up. I can provide a pmap etc. if needed. From: Poziombka, Wade L [mailto:wade.l.poziom...@intel.com] Sent: Wednesday, June 13, 2012 10:28 AM To:

Distinct Counter Proposal for Cassandra

2012-06-13 Thread Utku Can Topçu
Hi All, Let's assume we have a use case where we need to count the number of columns for a given key. Let's say the key is the URL and the column-name is the IP address or any cardinality identifier. The straight forward implementation seems to be simple, just inserting the IP Adresses as

Release: OpsCenter 2.1

2012-06-13 Thread Nick Bailey
Hey Everyone, Today we released version 2.1 of OpsCenter. The main theme of the release was around bug fixes, although there are a few small features that have been added. Some highlights: * Data Browser improvements * Online feedback form. * Optional HTTPS support. * Cross platform agent

Re: Distinct Counter Proposal for Cassandra

2012-06-13 Thread Yuki Morishita
You can open JIRA ticket at https://issues.apache.org/jira/browse/CASSANDRA with your proposal. Just for the input: I had once implemented HyperLogLog counter to use internally in Cassandra, but it turned out I didn't need it so I just put it to gist. You can find it here:

Re: Errors with Cassandra 1.0.10, 1.1.0, 1.1.1-SNAPSHOT and 1.2.0-SNAPSHOT

2012-06-13 Thread Horacio G. de Oro
Hi! I've found that in all cases, the errors happened when running the tests cases of the application. Before running each tests case, a test keyspace is created, then the tests are executed, and the keyspace is removed. The repeated creation, use and removal of a keyspace causes that kind of

Re: Distinct Counter Proposal for Cassandra

2012-06-13 Thread Utku Can Topçu
Hi Yuki, I think I should have used the word discussion instead of proposal for the mailing subject. I have quite some of a design in my mind but I think it's not yet ripe enough to formalize. I'll try to simplify it and open a Jira ticket. But first I'm wondering if there would be any excitement

Re: kswapd0 causing read timeouts

2012-06-13 Thread Gurpreet Singh
Alright, here it goes again... Even with mmap_index_only, once the RES memory hit 15 gigs, the read latency went berserk. This happens in 12 hours if diskaccessmode is mmap, abt 48 hrs if its mmap_index_only. only reads happening at 50 reads/second row cache size: 730 mb, row cache hit ratio:

RE: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Poziombka, Wade L
actually, this is without jna.jar. I will add and see if still have same issue From: Poziombka, Wade L Sent: Wednesday, June 13, 2012 10:53 AM To: user@cassandra.apache.org Subject: RE: Much more native memory used by Cassandra then the configured JVM heap size Seems like my only recourse is

Re: kswapd0 causing read timeouts

2012-06-13 Thread ruslan usifov
Hm, it's very strange what amount of you data? You linux kernel version? Java version? PS: i can suggest switch diskaccessmode to standart in you case PS:PS also upgrade you linux to latest, and javahotspot to 1.6.32 (from oracle site) 2012/6/13 Gurpreet Singh gurpreet.si...@gmail.com: Alright,

Cassandra upgrade to 1.1.1 resulted in slow query issue

2012-06-13 Thread Ganza, Ivan
Greetings, We have recently introduced Cassandra at the Globe and Mail here in Toronto, Canada. We are processing and storing the North American stock-market feed. We have found it to work very quickly and things have been looking very good. Recently we upgraded to version 1.1.1 and then we

Help with configuring replication

2012-06-13 Thread Leonid Ilyevsky
Before going into complex clustering topologies, I would like to try the most simple configuration: just set up two nodes that will completely replicate each other. Could somebody tell me how to configure it? Thanks! This email, along with any attachments, is

Re: Snapshot failing on JSON files in 1.1.0

2012-06-13 Thread Joaquin Casares
Hello Alain, Yes, the AMI is geared to working out of the box for most dev purposes. We recently spotted an issue with JNA 3.2.7 on Ubuntu 10.10 not being picked up. You can try running `apt-get install libjna-java` but in order for the change to be activated, you must restart your Cassandra

Supercolumn behavior on writes

2012-06-13 Thread Oleg Dulin
Does a write to a sub column involve deserialization of the entire super column ? Thanks, Oleg

Re: Supercolumn behavior on writes

2012-06-13 Thread Greg Fausak
That's a good question. I just went to a class, Ben was saying that any action on a super column requires de-re-serialization. But, it would be nice if a write had this sort of efficiency. I have been playing with the 1.1.1 version, in that one there are 'composite' columns, which I think are

Re: Supercolumn behavior on writes

2012-06-13 Thread Dave Brosius
You can create composite columns on the fly. On 06/13/2012 09:58 PM, Greg Fausak wrote: That's a good question. I just went to a class, Ben was saying that any action on a super column requires de-re-serialization. But, it would be nice if a write had this sort of efficiency. I have been

Re: Supercolumn behavior on writes

2012-06-13 Thread samal
You can't 'invent' columns on the fly, everything has to be declared when you declare the column family. That' s incorrect. You can define name on fly. Validation must be define when declaring CF

Re: Supercolumn behavior on writes

2012-06-13 Thread Greg Fausak
Interesting. How do you do it? I have a version 2 CF, that works fine. A version 3 table won't let me invent columns that don't exist yet. (for composite tables). What's the trick? cqlsh -3 cas1 use onplus; cqlsh:onplus select * from at_event where ac_event_id = 7690254; ac_event_id |

Re: Supercolumn behavior on writes

2012-06-13 Thread Dave Brosius
Via thrift, or a high level client on thrift, see as an example http://www.datastax.com/dev/blog/introduction-to-composite-columns-part-1 On 06/13/2012 11:08 PM, Greg Fausak wrote: Interesting. How do you do it? I have a version 2 CF, that works fine. A version 3 table won't let me invent

Re: kswapd0 causing read timeouts

2012-06-13 Thread Al Tobey
I would check /etc/sysctl.conf and get the values of /proc/sys/vm/swappiness and /proc/sys/vm/vfs_cache_pressure. If you don't have JNA enabled (which Cassandra uses to fadvise) and swappiness is at its default of 60, the Linux kernel will happily swap out your heap for cache space. Set

Re: Much more native memory used by Cassandra then the configured JVM heap size

2012-06-13 Thread Al Tobey
Linux's default on busy IO boxes is to use all available memory for cache. Try echo 1 /proc/sys/vm/drop_caches and see if your memory comes back (this will drop vfs caches, and in my experience is safe, but YMMV). If your memory comes back, everything is normal and you should leave it alone. It

Re: Supercolumn behavior on writes

2012-06-13 Thread samal
I have just check on datastax blog, CQL3 does not support, I am not aware. But as a whole we can via client lib using cql. On Thu, Jun 14, 2012 at 9:12 AM, Dave Brosius dbros...@mebigfatguy.comwrote: Via thrift, or a high level client on thrift, see as an example

Re: Supercolumn behavior on writes

2012-06-13 Thread Derek Williams
On Wed, Jun 13, 2012 at 9:08 PM, Greg Fausak g...@named.com wrote: Interesting. How do you do it? I have a version 2 CF, that works fine. A version 3 table won't let me invent columns that don't exist yet. (for composite tables). What's the trick? You are able to get the same behaviour

Re: cassandra still tried to join old ring nodes

2012-06-13 Thread aaron morton
but on the cassandra -f process, It keeps sending every 5 seconds Your explanation is a bit confusing. WARN 16:01:44,042 ClusterName mismatch from /123.123.123.123 big cluster!=Test Cluster The .123 machine is contacting this machine and asking to join the ring. Possibly because the 123