Re: Consolidating records and TTL

2014-06-05 Thread Aaron Morton
then delete ledger entries if needed. Don’t forget to ensure that only one client thread is doing this at a time. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 5/06/2014

Re: Increased Cassandra connection latency

2014-05-29 Thread Aaron Morton
running ParNew ? (it only logs when it’s longer than 200ms) Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 23/05/2014, at 10:35 pm, Alexey Sverdelov alexey.sverde...@googlemail.com

Re: What % of cassandra developers are employed by Datastax?

2014-05-29 Thread Aaron Morton
to contribute to the health of the project. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 24/05/2014, at 7:28 am, Michael Shuler mich...@pbandjelly.org wrote: On 05/23/2014 01:23 PM, Peter

Re: Memory issue

2014-05-29 Thread Aaron Morton
of the JVM being swapped out, especially with mmapped I/O enabled. Increase RLIMIT_MEMLOCK or run Cassandra as root. Is there anything in the system logs ? Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-28 Thread Aaron Morton
will tell you the compression ratio. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 23/05/2014, at 9:46 am, Phil Luckhurst phil.luckhu...@powerassure.com wrote: Hi Andreas

Re: Cassandra token range support for Hadoop (ColumnFamilyInputFormat)

2014-05-20 Thread Aaron Morton
to “working” to mean. The token ranges are handled the same, it’s the row in them that changes. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/05/2014, at 11:37 am, Anton

Re: CQL 3 and wide rows

2014-05-20 Thread Aaron Morton
) are more prevalent in CQL3 than thrift models. But still - I do not see Iteration, so it looks to me that CQL 3 is limited when compared to CLI/Hector. Now days you can do pretty much everything you can in cli. Provide an example and we may be able to help. Cheers Aaron - Aaron

Re: idempotent counters

2014-05-19 Thread Aaron Morton
design. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/05/2014, at 1:07 am, Jabbar Azam aja...@gmail.com wrote: Hello, Do people use counters when they want to have

Re: Effect of number of keyspaces on write-throughput....

2014-05-19 Thread Aaron Morton
by having more client threads hitting more machines. You can expect 3,000 to 4,000 non counter writes per code per node. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13

Re: Schema errors when bootstrapping / restarting node

2014-05-19 Thread Aaron Morton
as “column1” which is not a valid hex value. You should be able to fix this by dropping the index or dropping the CF. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 14

Re: Query returns incomplete result

2014-05-19 Thread Aaron Morton
Calling execute the second time runs the query a second time, and it looks like the query mutates instance state during the pagination. What happens if you only call execute() once ? Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: Datacenter understanding question

2014-05-19 Thread Aaron Morton
. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/05/2014, at 3:55 am, Mark Farnan devm...@petrolink.com wrote: Yes they will From: ng [mailto:pipeli...@gmail.com

Re: Cassandra counter column family performance

2014-05-19 Thread Aaron Morton
I get a lot of TExceptions What are the exceptions ? In general counters are slower than writes, but that does not lead them to fail like that. Check the logs for errors and/or messages from the GCInspector saying the garbage collection is going on. Cheers A - Aaron Morton

Re: Question about READS in a multi DC environment.

2014-05-19 Thread Aaron Morton
In this case I was not thinking about what was happening synchronous to client request, only that the request was hitting all nodes. You are right, when reading at LOCAL_ONE the coordinator will only be blocking for one response (the data response). Cheers Aaron - Aaron

Re: Cassandra token range support for Hadoop (ColumnFamilyInputFormat)

2014-05-19 Thread Aaron Morton
is predictable (like 5% of entire dataset)? if you suppled a token range is that is 5% of the possible range of values for the token that should be close to a random 5% sample. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: Disable reads during node rebuild

2014-05-15 Thread Aaron Morton
As of 2.0.7, driftx has added this long-requested feature. Thanks A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/05/2014, at 9:36 am, Robert Coli rc...@eventbrite.com wrote: On Mon, May

Re: How long are expired values actually returned?

2014-05-15 Thread Aaron Morton
Is this normal or am I doing something wrong?. probably this one. But the TTL is set based on the system clock on the server, first through would be to check the times are correct. If that fails, send over the schema and the insert. Cheers Aaron - Aaron Morton New Zealand

Re: How to balance this cluster out ?

2014-05-15 Thread Aaron Morton
is distributed. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/05/2014, at 11:58 pm, Oleg Dulin oleg.du...@gmail.com wrote: I have a cluster that looks like this: Datacenter

Re: Disable reads during node rebuild

2014-05-13 Thread Aaron Morton
want to rebuild. If you have read repair enabled it will still get some traffic. * Do rebuild * Reset severity to 0 Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13

Re: Question about READS in a multi DC environment.

2014-05-12 Thread Aaron Morton
. Setting this to 1.0 will mean it’s active across the entire cluster for each read. Change read_repair_chance to 0 and set dclocal_read_repair_chance to 0.1 so that read repair will only happen local to the DC you are connected to. Hope that helps. A - Aaron Morton New Zealand

Re: Effect of number of keyspaces on write-throughput....

2014-05-12 Thread Aaron Morton
to increase the write throughput? You should expect to get 3,000 to 4,000 writes per core per node. What are you getting now? Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 11/05

Re: Cassandra MapReduce/Storm/ etc

2014-05-12 Thread Aaron Morton
not a recommended access pattern in Cassandra. The Hadoop integration is token aware, it splits the tasks to run local on the node. The tasks then scan over the token range local to the node. Hope that helps. A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal

Re: Really need some advices on large data considerations

2014-05-12 Thread Aaron Morton
cluster, say 12 nodes, with a high load per node 3TB. cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/05/2014, at 12:09 pm, Yatong Zhang bluefl...@gmail.com wrote: Hi

Re: Understanding about Cassandra read repair with QUORUM

2014-01-16 Thread Aaron Morton
read_repair_chance=0 dclocal_read_repair_chance=0 in column family definition. It’s safe, read repair does not affect consistency. It’s designed to reduce the chance that the server will need to repair an inconsistency during a read for a client. Cheers - Aaron Morton New

Re: Problem in running cassandra-2.0.4 trigger example

2014-01-16 Thread Aaron Morton
But i am getting error: Bad Request: Key may not be empty My guess is the trigger is trying to create a row with an empty key. Add some logging to the trigger to see what it’s doing. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: Need ur expertise on Cassandra issue!!

2014-01-16 Thread Aaron Morton
. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/01/2014, at 3:53 pm, Arun toarun...@gmail.com wrote: Hi , I need your help suggestions for our production issue. Details: -- we have 40 CF's

Re: upgrade from cassandra 1.2.3 - 1.2.13 + start using SSL

2014-01-16 Thread Aaron Morton
to use the same file version, file versions are here https://github.com/apache/cassandra/blob/cassandra-1.2/src/java/org/apache/cassandra/io/sstable/Descriptor.java#L52 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting

Re: various Cassandra performance problems when CQL3 is really used

2014-01-16 Thread Aaron Morton
would normally say make a new table to store the data you want to read, or change the layout of a table to me more flexible. Can you provide the table definition and the query you are using ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant

Re: Cassandra mad GC

2014-01-16 Thread Aaron Morton
1000% Is this all from cassandra ? try jvmtop (https://code.google.com/p/jvmtop/) to see what cassandra threads are doing. It’s a lot easier to tune a system with fewer non default settings. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant

Re: Nodetool ring

2014-01-09 Thread Aaron Morton
Owns is how much of the entire, cluster wide, data set the node has. In both your examples every node has a full copy of the data. If you have 6 nodes and RF 3 they would have 50%. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: Cassandra consuming too much memory in ubuntu as compared to within windows, same machine.

2014-01-09 Thread Aaron Morton
. Try 2Gb so there is room for other things. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 7/01/2014, at 9:03 am, Erik Forkalsud eforkals...@cj.com wrote: On 01/04/2014 08:04 AM, Ertio

Re: massive spikes in read latency

2014-01-09 Thread Aaron Morton
about the number tombstones touched in a read. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/01/2014, at 2:15 am, Jason Wee peich...@gmail.com wrote: /** * Verbs

Re: nodetool cleanup / TTL

2014-01-09 Thread Aaron Morton
/CASSANDRA-3442 They cannot be forced, but if there is nothing else to compact they will look for single sstables to compact. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/01/2014

Re: upgrade from cassandra 1.2.3 - 1.2.13 + start using SSL

2014-01-09 Thread Aaron Morton
and use repair to fix the data on disk. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/01/2014, at 7:24 am, Robert Coli rc...@eventbrite.com wrote: On Wed, Jan 8, 2014 at 1:17

Re: MUTATION messages dropped

2013-12-30 Thread Aaron Morton
of CF’s and/or secondary indexes. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 21/12/2013, at 6:03 am, Ken Hancock ken.hanc...@schange.com wrote: I ended up changing

Re: Astyanax - multiple key search with pagination

2013-12-30 Thread Aaron Morton
You will need to paginate the list of keys to read in your app. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 21/12/2013, at 12:58 pm, Parag Patel parag.pa...@fusionts.com wrote

Re: Broken pipe with Thrift

2013-12-30 Thread Aaron Morton
as the one in the cassandra lib on the server. Can you do some simple tests using cqlsh from the client machine? That would eliminate the client driver. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: querying time series from hadoop

2013-12-30 Thread Aaron Morton
provide some more info on what you are doing ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 26/12/2013, at 9:56 pm, mete efk...@gmail.com wrote: Hello folks, i have come up

Re: Offline migration: Random-Murmur

2013-12-30 Thread Aaron Morton
them into the destination system.This will be much faster. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 29/12/2013, at 6:26 am, Edward Capriolo edlinuxg...@gmail.com wrote

Re: cassandra monitoring

2013-12-30 Thread Aaron Morton
an “Advanced” button. The Ops Centre agent talks to the server to find out what JMX port it should use to talk to the local Cassandra install. Also check the logs in /var/log/datastax Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: Cleanup and old files

2013-12-30 Thread Aaron Morton
about the file. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 30/12/2013, at 1:28 pm, David McNelis dmcne...@gmail.com wrote: I am currently running a cluster with 1.2.8. One of my

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-23 Thread Aaron Morton
reproduce this in a simple way please create a ticket at https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 19/12/2013, at 2:42 am, Desimpel

Re: Writes during schema migration

2013-12-23 Thread Aaron Morton
It depends a little on the nature of the change, but you need some coordination between the schema change and your code. e.g. add new column, change code to write to it or add new column, change code to use new column and not old column, remove old column. Cheers - Aaron

Re: How to tune cassandra to avoid OOM

2013-12-23 Thread Aaron Morton
heap use get’s to after CMS. JVM_OPTS=$JVM_OPTS -XX:SurvivorRatio=4 JVM_OPTS=$JVM_OPTS -XX:MaxTenuringThreshold=2 JVM_OPTS=$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=50” Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: Best way to measure write throughput...

2013-12-23 Thread Aaron Morton
nodetool proxyhistograms shows the throughput for the node, nodetool cfhistograms shows it for a single node. If you want to get an overview install something like Ops Centre http://www.datastax.com/what-we-offer/products-services/datastax-opscenter Cheers - Aaron Morton New

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
First approach: Sounds good. Second approach ( I used in production ): If the row gets big enough this will have bad performance. A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 19/12

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
- Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 7:22 am, Kumar Ranjan winnerd...@gmail.com wrote: Rob - I got a question following your advice. This is how, I define my column

Re: WriteTimeoutException instead of UnavailableException

2013-12-23 Thread Aaron Morton
knowing it is down. If you stop gossip (nodetool disablegossip) the node will cancel the gossip thread (without interrupting), wait two seconds, then inform other nodes it’s leaving gossip. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache

Re: WriteTimeoutException on Lightweight transactions

2013-12-23 Thread Aaron Morton
not get to start the write. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 10:05 am, Demian Berjman dberj...@despegar.com wrote: Hi. I am using Cassandra 2.0.3 with Datastax

Re: Issue upgrading from 1.2 to 2.0.3

2013-12-23 Thread Aaron Morton
If this is still a concern can you post the output from nodetool gossipinfo ? It will give the details of the nodes think of the other ones. A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: Improving write performance in Cassandra and a few related issues...

2013-12-19 Thread Aaron Morton
? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/12/2013, at 5:02 pm, Krishna Chaitanya bnsk1990r...@gmail.com wrote: Thanks for the reply. By packet drops I mean, the client

Re: Unable to create collection inside collection

2013-12-17 Thread Aaron Morton
Could anybody suggest me how do I achieve it in Cassandra. It’s not supported. You may want to model the feeschedule as a table. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12

Re: Cassandra pytho pagination

2013-12-17 Thread Aaron Morton
like, What client are you using ? xget is not a standard cassandra function. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/12/2013, at 4:56 am, Kumar Ranjan winnerd...@gmail.com wrote

Re: Cassandra data update for a row

2013-12-17 Thread Aaron Morton
is a string, to cassandra that’s an opaque typer we do not make partial updates to. If you need to update the values individually they need to be stored in columns. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Get all the data for x number of seconds from CQL?

2013-12-17 Thread Aaron Morton
text, record_valueblob, PRIMARY KEY (day, timestamp, record_name) ) Store the day as MMDD and the timestamp as before, you can then do queries like select * from test1 where day = 20131218 and timestamp X and timestamp y; Cheers - Aaron Morton

Re: Write performance with 1.2.12

2013-12-17 Thread Aaron Morton
it’s wait time + network time. As a general rule you should get around 3k to 4k writes per second per core. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/12/2013, at 8:06 pm, Rahul

Re: Bulkoutputformat

2013-12-17 Thread Aaron Morton
Request did not complete within rpc_timeout. The node is overloaded and did not return in time. Check the logs for errors or excessive JVM GC and try selecting less data. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra

Re: Improving write performance in Cassandra and a few related issues...

2013-12-17 Thread Aaron Morton
or the client. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/12/2013, at 7:51 pm, Krishna Chaitanya bnsk1990r...@gmail.com wrote: Hello, I am a newbie

Re: Cassandra 1.2 : OutOfMemoryError: unable to create new native thread

2013-12-17 Thread Aaron Morton
Try using jstack to see if there are a lot of threads there. Are you using vNodea and Hadoop ? https://issues.apache.org/jira/browse/CASSANDRA-6169 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-17 Thread Aaron Morton
-tmp- files will sit in the data dir, if there was an error creating them during compaction or flushing to disk they will sit around until a restart. Check the logs for errors to see if compaction was failing on something. Cheers - Aaron Morton New Zealand @aaronmorton Co

Re: various Cassandra performance problems when CQL3 is really used

2013-12-17 Thread Aaron Morton
be handled by denormlaising the data during writes. It sounds like your data model was too relational, you need to denormalise and read rows by primary key. Secondary indexes are useful when you have a query pattern that is used infrequently. Hope that helps. - Aaron Morton New

Re: AddContractPoint /VIP

2013-12-11 Thread Aaron Morton
nodes. Too complicated. 2) Is that problem if i use multiple Data centers in future ? You only need to give the client the local seeds, it will discover all the nodes. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting

Re: Write performance with 1.2.12

2013-12-11 Thread Aaron Morton
performance is 2x more than when I send traffic to all the nodes. What are you measuring, request latency or local read/write latency ? If it’s write latency it’s probably GC, if it’s read is probably IO or data model. Hope that helps. - Aaron Morton New Zealand @aaronmorton

Re: OOMs during high (read?) load in Cassandra 1.2.11

2013-12-11 Thread Aaron Morton
Do you have the back trace for from the heap dump so we can see what the array was and what was using it ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 10/12/2013, at 4:41 am, Klaus

Re: Data Modelling Information

2013-12-11 Thread Aaron Morton
://planetcassandra.org/Learn/CassandraCommunityWebinars Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 10/12/2013, at 8:57 am, Shrikar archak shrika...@gmail.com wrote: Hi Data Model Experts, I have

Re: Nodetool repair exceptions in Cassandra 2.0.2

2013-12-11 Thread Aaron Morton
. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 10/12/2013, at 12:57 pm, Laing, Michael michael.la...@nytimes.com wrote: My experience is that you must upgrade to 2.0.3 ASAP to fix this. Michael On Mon

Re: setting PIG_INPUT_INITIAL_ADDRESS environment . variable in Oozie for cassandra ...¿?

2013-12-11 Thread Aaron Morton
(CassandraStorage.java:358) at org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:151) ... 35 more Have you checked these are set ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Exactly one wide row per node for a given CF?

2013-12-11 Thread Aaron Morton
- Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 11/12/2013, at 2:41 am, Robert Wille rwi...@fold3.com wrote: I have a question about this statement: When rows get above a few 10’s of MB things can

Re:

2013-12-11 Thread Aaron Morton
://pycassa.github.io/pycassa/assorted/composite_types.html?highlight=compositetype Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 6:15 am, Kumar Ranjan winnerd...@gmail.com wrote

Re: Cyclop - CQL3 web based editor

2013-12-11 Thread Aaron Morton
thanks, looks handy. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 6:16 am, Parth Patil parthpa...@gmail.com wrote: Hi Maciej, This looks great! Thanks for building

Re: CLUSTERING ORDER CQL3

2013-12-11 Thread Aaron Morton
You need to specify all the clustering key components in the CLUSTERING ORDER BY clause create table demo(oid int,cid int,ts timeuuid,PRIMARY KEY (oid,cid,ts)) WITH CLUSTERING ORDER BY (cid ASC, ts DESC); cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal

Re: Bulkoutputformat

2013-12-11 Thread Aaron Morton
/hadoop_integration Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 11:27 am, varun allampalli vshoori.off...@gmail.com wrote: Hi All, I want to bulk insert data

Re: efficient way to store 8-bit or 16-bit value?

2013-12-11 Thread Aaron Morton
What do people recommend I do to store a small binary value in a column? I’d rather not simply use a 32-bit int for a single byte value. blob is a byte array or you could use the varint, a variable length integer, but you probably want the blob. cheers - Aaron Morton New

Re: Write performance with 1.2.12

2013-12-11 Thread Aaron Morton
nodes the latency drops again, I checked, this is not node specific it happens to any node. Is this the local write latency or the cluster wide write request latency ? What sort of numbers are you seeing ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal

Re: user / password authentication advice

2013-12-11 Thread Aaron Morton
/securityTOC.html Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 4:31 pm, onlinespending onlinespend...@gmail.com wrote: Hi, I’m using Cassandra in an environment where

Re: Repair hangs - Cassandra 1.2.10

2013-12-09 Thread Aaron Morton
to see if streams are being exchanged, then check the logs on those machines. cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 10:24 pm, Tamar Rosen ta...@correlor.com wrote

Re: Murmur Long.MIN_VALUE token allowed?

2013-12-09 Thread Aaron Morton
AFAIK any value that is a valid output from murmor3 is a valid token. The Murmur3Partitioner set’s min and max to long min and max… public static final LongToken MINIMUM = new LongToken(Long.MIN_VALUE); public static final long MAXIMUM = Long.MAX_VALUE; Cheers - Aaron

Re: Exactly one wide row per node for a given CF?

2013-12-09 Thread Aaron Morton
model. If you have to do it, you can try the ByteOrderedPartitioner which uses the row key as a token, given you total control of the row placement. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Exactly one wide row per node for a given CF?

2013-12-09 Thread Aaron Morton
Basically this desire all stems from wanting efficient use of memory. Do you have any real latency numbers you are trying to tune ? Otherwise this sounds a little like premature optimisation. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant

Re: Raid Issue on EC2 Datastax ami, 1.2.11

2013-12-09 Thread Aaron Morton
- Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 6/12/2013, at 4:42 am, Philippe Dupont pdup...@teads.tv wrote: Hi again, I have much more in formations on this case : We did further

Re: Unable to run hadoop_cql3_word_count examples

2013-12-08 Thread Aaron Morton
, did you make a change? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 3/12/2013, at 10:03 pm, Parth Patil parthpa...@gmail.com wrote: Hi, I am new to Cassandra and I am exploring

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-08 Thread Aaron Morton
Do you have the logs from after the restart ? Did it include a Drop Keyspace…” INFO level message ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 2:44 am, Desimpel

Re: CQL workaround for modifying a primary key

2013-12-08 Thread Aaron Morton
I just tested this with 1.2.9 and DROP TABLE took a snapshot and moved the existing files out of the dir. Do you have some more steps to reproduce ? Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: While inserting data into Cassandra using Hector client

2013-11-28 Thread Aaron Morton
Hector is designed to use Column Families created via the thrift interface, e.g. using cassandra-cli Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 25/11/2013, at 8:51 pm, Santosh

Re: Multiple writers writing to a cassandra node...

2013-11-28 Thread Aaron Morton
. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 26/11/2013, at 4:42 am, Krishna Chaitanya bnsk1990r...@gmail.com wrote: Hello, I am a newbie to the Cassandra world. I would like

Re: Nodetool cleanup

2013-11-28 Thread Aaron Morton
. Cleanup is less intensive than repair, but it’s still a good idea to stagger it. If you need to run it on all machines (or you have very powerful machines) it’s probably going to be OK. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal

Re: Intermittent connection error

2013-11-26 Thread Aaron Morton
output: Looks like a node is getting evicted from the pool, try turning the logging level up to DEBUG see if it says anything. For DS driver specific questions you may have better luck using the mail list here https://github.com/datastax/java-driver Cheers - Aaron Morton New

Re: 1.1.11: system keyspace is filling up

2013-11-26 Thread Aaron Morton
-ordinator starts the writes, remote nodes process the request (no dropped messages), but the response is lost. These are tracked as timeouts on the MessagingServiceMBean. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting

Re: Large system.Migration CF after upgrade to 1.1

2013-11-26 Thread Aaron Morton
) and index_interval (yaml). My talk called “In case of emergency break glass” at the summit in SF this year talks about this http://thelastpickle.com/speaking/2013/06/11/Speaking-Cassandra-Summit-SF-2013.html Long term moving to 1.2 will help. Hope that helps. - Aaron Morton New Zealand

Re: How to set Cassandra config directory path

2013-11-25 Thread Aaron Morton
them know. What I really want to do is to give the cassandra-topology.properties path to Cassandra. Set the CASSANDRA_CONF env var in cassandra-in.sh Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Cannot TRUNCATE

2013-11-25 Thread Aaron Morton
If it’s just a test system nuke it and try again :) Was there more than one node at any time ? Does nodetool status show only one node ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: Config changes to leverage new hardware

2013-11-25 Thread Aaron Morton
. Another interesting thing is that the linux disk cache doesn’t seem to be growing in spite of a lot of free memory available. Things will only get paged in when they are accessed. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra

Re: Is there any open source software for automatized deploy C* in PRD?

2013-11-25 Thread Aaron Morton
Thanks, But I suppose it’s just for Debian? Am I right? There are debian and rpm packages, and people deploy them or the binary packages with with chef and similar tools. It may be easier to answer your question if you describe the specific platform / needs. cheers - Aaron

Re: Migration Cassandra 2.0 to Cassandra 2.0.2

2013-11-25 Thread Aaron Morton
package it creates the directory locations, installs the init scripts and makes it a lot easier to start and stop cassandra. I recommend using them. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http

Re: Error: Unable to search across multiple secondary index types

2013-11-20 Thread Aaron Morton
- Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/11/2013, at 10:22 pm, sielski siel...@man.poznan.pl wrote: Hello, I’ve installed Cassandra 2.0.2 and I’m trying to query a cassandra table using a SELECT

Re: DESIGN QUESTION: Need to update only older data in cassandra

2013-11-20 Thread Aaron Morton
it increases it’s fine. You can specify the timestamp for a column via either thrift or cql3. When the updates come in during the day if they have the older time stamp just send the write and it will be ignored. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder

Re: Disaster recovery question

2013-11-20 Thread Aaron Morton
problems, then deleting data (subsets if we can see partial corruption) and re-adding is much safer (but our cluster is VERY fast). You should not need to do this, what sort of corruptions ? Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant

Re: Nodes not added to existing cluster

2013-11-20 Thread Aaron Morton
that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/11/2013, at 8:36 pm, Skye Book skye.b...@gmail.com wrote: Hi there, I’m bringing this thread back as its something that I

Re: Read inconsistency after backup and restore to different cluster

2013-11-19 Thread Aaron Morton
if you backup the system data it will bring along the tokens. This can be a pain if you want to change the cluster name. cheers - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/11/2013, at 10

Re: making sense of output from Eclipse Memory Analyzer tool taken from .hprof file

2013-11-19 Thread Aaron Morton
%) bytes. •java.lang.Thread @ 0x71b357e70 MutationStage:11 - 444,931,288 (5.26%) bytes. maybe very big rows and/or very big mutations. hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

  1   2   3   4   5   6   7   8   9   10   >