Re: Consolidating records and TTL

2014-06-05 Thread Aaron Morton
can then delete ledger entries if needed. Don’t forget to ensure that only one client thread is doing this at a time. Hope that helps. Aaron ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: Memory issue

2014-05-29 Thread Aaron Morton
sult in part of the JVM being swapped out, especially with mmapped > I/O enabled. > Increase RLIMIT_MEMLOCK or run Cassandra as root. Is there anything in the system logs ? Cheers Aaron ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cas

Re: What % of cassandra developers are employed by Datastax?

2014-05-29 Thread Aaron Morton
do to contribute to the health of the project. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 24/05/2014, at 7:28 am, Michael Shuler wrote: > On 05/23/2014 01:23 PM, Peter Li

Re: Increased Cassandra connection latency

2014-05-29 Thread Aaron Morton
running ParNew ? (it only logs when it’s longer than 200ms) Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 23/05/2014, at 10:35 pm, Alexey Sverdelov wrote: > Hi all, &g

Re: Can SSTables overlap with SizeTieredCompactionStrategy?

2014-05-28 Thread Aaron Morton
tell you the compression ratio. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 23/05/2014, at 9:46 am, Phil Luckhurst wrote: > Hi Andreas, > > So does

Re: CQL 3 and wide rows

2014-05-20 Thread Aaron Morton
an example and we may be able to help. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/05/2014, at 8:18 am, Maciej Miklas wrote: > Hi James, > > Clustering is based on r

Re: Cassandra token range support for Hadoop (ColumnFamilyInputFormat)

2014-05-19 Thread Aaron Morton
ce is probably what you consider to “working” to mean. The token ranges are handled the same, it’s the row in them that changes. Cheers Aaron ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: Cassandra token range support for Hadoop (ColumnFamilyInputFormat)

2014-05-19 Thread Aaron Morton
> so that this amount is predictable (like 5% of entire dataset)? if you suppled a token range is that is 5% of the possible range of values for the token that should be close to a random 5% sample. Hope that helps. Aaron ----- Aaron Morton New Zealand @aaronmorton Co-Founder &

Re: Question about READS in a multi DC environment.

2014-05-19 Thread Aaron Morton
In this case I was not thinking about what was happening synchronous to client request, only that the request was hitting all nodes. You are right, when reading at LOCAL_ONE the coordinator will only be blocking for one response (the data response). Cheers Aaron - Aaron

Re: Cassandra counter column family performance

2014-05-19 Thread Aaron Morton
> I get a lot of TExceptions What are the exceptions ? In general counters are slower than writes, but that does not lead them to fail like that. Check the logs for errors and/or messages from the GCInspector saying the garbage collection is going on. Cheers A ----- Aa

Re: Datacenter understanding question

2014-05-19 Thread Aaron Morton
. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/05/2014, at 3:55 am, Mark Farnan wrote: > Yes they will > > From: ng [mailto:pipeli...@gmail.com] &g

Re: Query returns incomplete result

2014-05-19 Thread Aaron Morton
Calling execute the second time runs the query a second time, and it looks like the query mutates instance state during the pagination. What happens if you only call execute() once ? Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consul

Re: Schema errors when bootstrapping / restarting node

2014-05-19 Thread Aaron Morton
pe and you have defined an index on a column and specified the column name as “column1” which is not a valid hex value. You should be able to fix this by dropping the index or dropping the CF. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-

Re: Effect of number of keyspaces on write-throughput....

2014-05-19 Thread Aaron Morton
rticular row. In general you can improve throughput by having more client threads hitting more machines. You can expect 3,000 to 4,000 non counter writes per code per node. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Princip

Re: idempotent counters

2014-05-19 Thread Aaron Morton
urrent design. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/05/2014, at 1:07 am, Jabbar Azam wrote: > Hello, > > Do people use counters when they want

Re: Storing log structured data in Cassandra without compactions for performance boost.

2014-05-15 Thread Aaron Morton
. Cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/05/2014, at 8:36 am, DuyHai Doan wrote: > Hello Kevin > > You can disable compaction by configuring the compa

Re: How to balance this cluster out ?

2014-05-15 Thread Aaron Morton
distributed. Hope that helps. Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/05/2014, at 11:58 pm, Oleg Dulin wrote: > I have a cluster that looks like this: > > Datace

Re: How long are expired values actually returned?

2014-05-15 Thread Aaron Morton
> Is this normal or am I doing something wrong?. probably this one. But the TTL is set based on the system clock on the server, first through would be to check the times are correct. If that fails, send over the schema and the insert. Cheers Aaron ----- Aaron Morton

Re: Disable reads during node rebuild

2014-05-15 Thread Aaron Morton
> As of 2.0.7, driftx has added this long-requested feature. Thanks A ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/05/2014, at 9:36 am, Robert Coli wrote: > On Mon, May 12,

Re: Disable reads during node rebuild

2014-05-13 Thread Aaron Morton
ge tasks on the node you want to rebuild. If you have read repair enabled it will still get some traffic. * Do rebuild * Reset severity to 0 Hope that helps. Aaron --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http

Re: Really need some advices on large data considerations

2014-05-12 Thread Aaron Morton
) and bootstrapping. I’d recommend testing a smaller cluster, say 12 nodes, with a high load per node 3TB. cheers Aaron - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/05/2014, at 12:09

Re: Cassandra & MapReduce/Storm/ etc

2014-05-12 Thread Aaron Morton
timeout and is generally not a recommended access pattern in > Cassandra. The Hadoop integration is token aware, it splits the tasks to run local on the node. The tasks then scan over the token range local to the node. Hope that helps. A ----- Aaron Morton New Zealand @aaron

Re: Effect of number of keyspaces on write-throughput....

2014-05-12 Thread Aaron Morton
pace instead of multiple keyspaces to > increase the write throughput? > > You should expect to get 3,000 to 4,000 writes per core per node. What are you getting now? Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consul

Re: Question about READS in a multi DC environment.

2014-05-12 Thread Aaron Morton
ground. Setting this to 1.0 will mean it’s active across the entire cluster for each read. Change read_repair_chance to 0 and set dclocal_read_repair_chance to 0.1 so that read repair will only happen local to the DC you are connected to. Hope that helps. A - Aaron Mort

Re: Cassandra mad GC

2014-01-16 Thread Aaron Morton
? > cpu load > 1000% Is this all from cassandra ? try jvmtop (https://code.google.com/p/jvmtop/) to see what cassandra threads are doing. It’s a lot easier to tune a system with fewer non default settings. Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Foun

Re: various Cassandra performance problems when CQL3 is really used

2014-01-16 Thread Aaron Morton
the write path. So I would normally say make a new table to store the data you want to read, or change the layout of a table to me more flexible. Can you provide the table definition and the query you are using ? Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Pr

Re: upgrade from cassandra 1.2.3 -> 1.2.13 + start using SSL

2014-01-16 Thread Aaron Morton
able to run repair. All nodes have to use the same file version, file versions are here https://github.com/apache/cassandra/blob/cassandra-1.2/src/java/org/apache/cassandra/io/sstable/Descriptor.java#L52 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Prin

Re: Need ur expertise on Cassandra issue!!

2014-01-16 Thread Aaron Morton
. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/01/2014, at 3:53 pm, Arun wrote: > Hi , > > I need your help & suggestions for our production issue. > > Details: > --

Re: Problem in running cassandra-2.0.4 trigger example

2014-01-16 Thread Aaron Morton
>> But i am getting error: Bad Request: Key may not be empty My guess is the trigger is trying to create a row with an empty key. Add some logging to the trigger to see what it’s doing. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consult

Re: Understanding about Cassandra read repair with QUORUM

2014-01-16 Thread Aaron Morton
safe to set > "read_repair_chance=0 & dclocal_read_repair_chance=0" in column family > definition. It’s safe, read repair does not affect consistency. It’s designed to reduce the chance that the server will need to repair an inconsistency during a read for a client. Cheers

Re: upgrade from cassandra 1.2.3 -> 1.2.13 + start using SSL

2014-01-09 Thread Aaron Morton
use repair to fix the data on disk. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 9/01/2014, at 7:24 am, Robert Coli wrote: > On Wed, Jan 8, 2014 at 1:17 AM, Jir

Re: nodetool cleanup / TTL

2014-01-09 Thread Aaron Morton
.org/jira/browse/CASSANDRA-3442 They cannot be forced, but if there is nothing else to compact they will look for single sstables to compact. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle

Re: massive spikes in read latency

2014-01-09 Thread Aaron Morton
will also include information about the number tombstones touched in a read. Hope that helps. ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 8/01/2014, at 2:15 am, Jason Wee wrote: > /**

Re: Cassandra consuming too much memory in ubuntu as compared to within windows, same machine.

2014-01-09 Thread Aaron Morton
. Try 2Gb so there is room for other things. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 7/01/2014, at 9:03 am, Erik Forkalsud wrote: > On 01/04/2014 08:04 AM, Ertio Le

Re: Nodetool ring

2014-01-09 Thread Aaron Morton
Owns is how much of the entire, cluster wide, data set the node has. In both your examples every node has a full copy of the data. If you have 6 nodes and RF 3 they would have 50%. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Ap

Re: offheap component

2014-01-09 Thread Aaron Morton
blog posts at datastax. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 2/01/2014, at 7:08 pm, Jason Wee wrote: > Solely by the Cassandra version. Are you asking about a par

Re: Cleanup and old files

2013-12-30 Thread Aaron Morton
about the file. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 30/12/2013, at 1:28 pm, David McNelis wrote: > I am currently running a cluster with 1.2.8. One of my larger

Re: cassandra monitoring

2013-12-30 Thread Aaron Morton
r, maybe behind an “Advanced” button. The Ops Centre agent talks to the server to find out what JMX port it should use to talk to the local Cassandra install. Also check the logs in /var/log/datastax Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consu

Re: Offline migration: Random->Murmur

2013-12-30 Thread Aaron Morton
n bulk load them into the destination system.This will be much faster. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 29/12/2013, at 6:26 am, Edward Capriolo wrote: > Internally w

Re: querying time series from hadoop

2013-12-30 Thread Aaron Morton
a single row. Can you provide some more info on what you are doing ? Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 26/12/2013, at 9:56 pm, mete wrote: > Hello folks, > &

Re: Broken pipe with Thrift

2013-12-30 Thread Aaron Morton
the same as the one in the cassandra lib on the server. Can you do some simple tests using cqlsh from the client machine? That would eliminate the client driver. Hope that helps. ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandr

Re: Astyanax - multiple key search with pagination

2013-12-30 Thread Aaron Morton
You will need to paginate the list of keys to read in your app. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 21/12/2013, at 12:58 pm, Parag Patel wrote: > Hi, > &

Re: MUTATION messages dropped

2013-12-30 Thread Aaron Morton
lot of CF’s and/or secondary indexes. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 21/12/2013, at 6:03 am, Ken Hancock wrote: > I ended up changing memtable_flush_

Re: Unbalanced ring with C* 2.0.3 and vnodes after adding additional nodes

2013-12-23 Thread Aaron Morton
isting, it should settle down once compaction catches up. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 10:51 pm, Andreas Finke wrote: > Hi Aaron, > > I assume y

Re: Issue upgrading from 1.2 to 2.0.3

2013-12-23 Thread Aaron Morton
If this is still a concern can you post the output from nodetool gossipinfo ? It will give the details of the nodes think of the other ones. A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: WriteTimeoutException on Lightweight transactions

2013-12-23 Thread Aaron Morton
get to start the write. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 10:05 am, Demian Berjman wrote: > Hi. I am using Cassandra 2.0.3 with Datastax Java client.

Re: WriteTimeoutException instead of UnavailableException

2013-12-23 Thread Aaron Morton
elay in other nodes knowing it is down. If you stop gossip (nodetool disablegossip) the node will cancel the gossip thread (without interrupting), wait two seconds, then inform other nodes it’s leaving gossip. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder &am

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
odels. Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 20/12/2013, at 7:22 am, Kumar Ranjan wrote: > Rob - I got a question following your advice. This is how, I defi

Re: Cassandra pytho pagination

2013-12-23 Thread Aaron Morton
> First approach: Sounds good. > Second approach ( I used in production ): If the row gets big enough this will have bad performance. A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.

Re: org.apache.thrift.TApplicationException: get_range_slices failed: out of sequence response

2013-12-23 Thread Aaron Morton
ers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 19/12/2013, at 11:38 pm, Jason Wee wrote: > Hi, > In regards to recv_get_range_slices(), in my cassandra client code, it always

Re: Best way to measure write throughput...

2013-12-23 Thread Aaron Morton
nodetool proxyhistograms shows the throughput for the node, nodetool cfhistograms shows it for a single node. If you want to get an overview install something like Ops Centre http://www.datastax.com/what-we-offer/products-services/datastax-opscenter Cheers - Aaron Morton New

Re: How to tune cassandra to avoid OOM

2013-12-23 Thread Aaron Morton
w low the total heap use get’s to after CMS. JVM_OPTS="$JVM_OPTS -XX:SurvivorRatio=4" JVM_OPTS="$JVM_OPTS -XX:MaxTenuringThreshold=2" JVM_OPTS="$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=50” Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Fou

Re: Writes during schema migration

2013-12-23 Thread Aaron Morton
It depends a little on the nature of the change, but you need some coordination between the schema change and your code. e.g. add new column, change code to write to it or add new column, change code to use new column and not old column, remove old column. Cheers - Aaron

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-23 Thread Aaron Morton
u can reproduce this in a simple way please create a ticket at https://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 19/12/2013, at 2:42 am,

Re: Improving write performance in Cassandra and a few related issues...

2013-12-19 Thread Aaron Morton
?? > > Logging at the client level ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/12/2013, at 5:02 pm, Krishna Chaitanya wrote: > Thanks for the reply. By pac

Re: various Cassandra performance problems when CQL3 is really used

2013-12-17 Thread Aaron Morton
dary indexes are useful when you have a query pattern that is used infrequently. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 18/12/2013, at 3:47 am, Ondřej Černoš wrote: &

Re: Cassandra 1.1.6 - Disk usage and Load displayed in ring doesn't match

2013-12-17 Thread Aaron Morton
-tmp- files will sit in the data dir, if there was an error creating them during compaction or flushing to disk they will sit around until a restart. Check the logs for errors to see if compaction was failing on something. Cheers - Aaron Morton New Zealand @aaronmorton Co

Re: Cassandra 1.2 : OutOfMemoryError: unable to create new native thread

2013-12-17 Thread Aaron Morton
Try using jstack to see if there are a lot of threads there. Are you using vNodea and Hadoop ? https://issues.apache.org/jira/browse/CASSANDRA-6169 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting

Re: Improving write performance in Cassandra and a few related issues...

2013-12-17 Thread Aaron Morton
f you are not seeing that it may be configuration or the client. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 15/12/2013, at 7:51 pm, Krishna Chaitanya wrote: > Hel

Re: Bulkoutputformat

2013-12-17 Thread Aaron Morton
> Request did not complete within rpc_timeout. The node is overloaded and did not return in time. Check the logs for errors or excessive JVM GC and try selecting less data. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Ca

Re: Write performance with 1.2.12

2013-12-17 Thread Aaron Morton
n the two it’s wait time + network time. As a general rule you should get around 3k to 4k writes per second per core. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/12/201

Re: Get all the data for x number of seconds from CQL?

2013-12-17 Thread Aaron Morton
nteger, record_name text, record_valueblob, PRIMARY KEY (day, timestamp, record_name) ) Store the day as MMDD and the timestamp as before, you can then do queries like select * from test1 where day = 20131218 and timestamp > X and timestamp < y; Cheers ---

Re: Cassandra data update for a row

2013-12-17 Thread Aaron Morton
roved": "true"}'),]) > > How can I set approved to 'false' ?? > > It looks like the value of the 411186035495010304 column is a string, to cassandra that’s an opaque typer we do not make partial updates to. If you need to update the values individually they need to

Re: Cassandra pytho pagination

2013-12-17 Thread Aaron Morton
something like, What client are you using ? xget is not a standard cassandra function. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 13/12/2013, at 4:56 am, Kumar Ranjan wrote:

Re: Unbalanced ring with C* 2.0.3 and vnodes after adding additional nodes

2013-12-17 Thread Aaron Morton
cluster? If so they do not bootstrap. The extra writes in nodes 5 and 6 could be from Read Repair writing to them. Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, a

Re: Unable to create collection inside collection

2013-12-17 Thread Aaron Morton
> Could anybody suggest me how do I achieve it in Cassandra. It’s not supported. You may want to model the feeschedule as a table. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com

Re: user / password authentication advice

2013-12-11 Thread Aaron Morton
rity/securityTOC.html Hope that helps. ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 4:31 pm, onlinespending wrote: > Hi, > > I’m using Cassandra in an environment where man

Re: Write performance with 1.2.12

2013-12-11 Thread Aaron Morton
fic to other nodes the latency > drops again, I checked, this is not node specific it happens to any node. Is this the local write latency or the cluster wide write request latency ? What sort of numbers are you seeing ? Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Foun

Re: efficient way to store 8-bit or 16-bit value?

2013-12-11 Thread Aaron Morton
> What do people recommend I do to store a small binary value in a column? I’d > rather not simply use a 32-bit int for a single byte value. blob is a byte array or you could use the varint, a variable length integer, but you probably want the blob. cheers - Aaron Mort

Re: Bulkoutputformat

2013-12-11 Thread Aaron Morton
/hadoop_integration Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 11:27 am, varun allampalli wrote: > Hi All, > > I want to bulk insert data into cas

Re: CLUSTERING ORDER CQL3

2013-12-11 Thread Aaron Morton
You need to specify all the clustering key components in the CLUSTERING ORDER BY clause create table demo(oid int,cid int,ts timeuuid,PRIMARY KEY (oid,cid,ts)) WITH CLUSTERING ORDER BY (cid ASC, ts DESC); cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Princ

Re: Cyclop - CQL3 web based editor

2013-12-11 Thread Aaron Morton
thanks, looks handy. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 12/12/2013, at 6:16 am, Parth Patil wrote: > Hi Maciej, > This looks great! Thanks for building this.

Re:

2013-12-11 Thread Aaron Morton
CompositeType is a type composed of other types, see http://pycassa.github.io/pycassa/assorted/composite_types.html?highlight=compositetype Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle

Re: 2 nodes cassandra cluster raid10 or JBOD

2013-12-11 Thread Aaron Morton
is a chance of data loss with RF 2. If a write (including the hints) is only committed to one node and the disk on that node fails the write will be lost. Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassa

Re: Exactly one wide row per node for a given CF?

2013-12-11 Thread Aaron Morton
Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 11/12/2013, at 2:41 am, Robert Wille wrote: > I have a question about this statement: > > When rows get above a few 10’s of MB t

Re: setting PIG_INPUT_INITIAL_ADDRESS environment . variable in Oozie for cassandra ...¿?

2013-12-11 Thread Aaron Morton
aStorage.getSchema(CassandraStorage.java:358) > at > org.apache.pig.newplan.logical.relational.LOLoad.getSchemaFromMetaData(LOLoad.java:151) > ... 35 more Have you checked these are set ? Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Princi

Re: Nodetool repair exceptions in Cassandra 2.0.2

2013-12-11 Thread Aaron Morton
sc.keyspace, desc.columnFamily)); Hope that helps. - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 10/12/2013, at 12:57 pm, Laing, Michael wrote: > My experience is that you must upgrade to 2

Re: Data Modelling Information

2013-12-11 Thread Aaron Morton
suggest taking a look at the data modelling videos from Patrick here http://planetcassandra.org/Learn/CassandraCommunityWebinars Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 10/12/20

Re: OOMs during high (read?) load in Cassandra 1.2.11

2013-12-11 Thread Aaron Morton
Do you have the back trace for from the heap dump so we can see what the array was and what was using it ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 10/12/2013, at 4:41 am, K

Re: Write performance with 1.2.12

2013-12-11 Thread Aaron Morton
de its performance is 2x more than when I send > traffic to all the nodes. > What are you measuring, request latency or local read/write latency ? If it’s write latency it’s probably GC, if it’s read is probably IO or data model. Hope that helps. ----- Aaron Morton

Re: AddContractPoint /VIP

2013-12-11 Thread Aaron Morton
enough to route to different nodes. Too complicated. > 2) Is that problem if i use multiple Data centers in future ? You only need to give the client the local seeds, it will discover all the nodes. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Co

Re: Drop keyspace via CQL hanging on master/trunk.

2013-12-10 Thread Aaron Morton
Looks like a bug, will try to fix today https://issues.apache.org/jira/browse/CASSANDRA-6472 Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 6/12/2013, at 10:25 am, Brian O&#

Re: Raid Issue on EC2 Datastax ami, 1.2.11

2013-12-09 Thread Aaron Morton
- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 6/12/2013, at 4:42 am, Philippe Dupont wrote: > Hi again, > > I have much more in formations on this case : > > We did furthe

Re: Exactly one wide row per node for a given CF?

2013-12-09 Thread Aaron Morton
> Basically this desire all stems from wanting efficient use of memory. Do you have any real latency numbers you are trying to tune ? Otherwise this sounds a little like premature optimisation. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Con

Re: Exactly one wide row per node for a given CF?

2013-12-09 Thread Aaron Morton
her look at the data model. If you have to do it, you can try the ByteOrderedPartitioner which uses the row key as a token, given you total control of the row placement. Cheers --------- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassan

Re: Murmur Long.MIN_VALUE token allowed?

2013-12-09 Thread Aaron Morton
AFAIK any value that is a valid output from murmor3 is a valid token. The Murmur3Partitioner set’s min and max to long min and max… public static final LongToken MINIMUM = new LongToken(Long.MIN_VALUE); public static final long MAXIMUM = Long.MAX_VALUE; Cheers - Aaron

Re: Repair hangs - Cassandra 1.2.10

2013-12-09 Thread Aaron Morton
detool netstats to see if streams are being exchanged, then check the logs on those machines. cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 10:24 pm, Tamar Rosen wrote: &g

Re: CQL workaround for modifying a primary key

2013-12-08 Thread Aaron Morton
I just tested this with 1.2.9 and DROP TABLE took a snapshot and moved the existing files out of the dir. Do you have some more steps to reproduce ? Cheers A - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting

Re: Commitlog replay makes dropped and recreated keyspace and column family rows reappear

2013-12-08 Thread Aaron Morton
Do you have the logs from after the restart ? Did it include a "Drop Keyspace…” INFO level message ? Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 4/12/2013, at 2:44 am,

Re: Unable to run hadoop_cql3_word_count examples

2013-12-08 Thread Aaron Morton
does not use LOCAL_ONE, did you make a change? Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 3/12/2013, at 10:03 pm, Parth Patil wrote: > Hi, > I am new to Cassandra and I a

Re: Multiple writers writing to a cassandra node...

2013-12-08 Thread Aaron Morton
IllegalRequestException does not existing in the server code in version 2.0. Is this thrown by the client ? InvalidRequestException is thrown in a number of places. Check you are using the client correctly. cheers - Aaron Morton New Zealand @aaronmorton Co-Founder

Re: Nodetool cleanup

2013-11-28 Thread Aaron Morton
es if they are overloaded. Cleanup is less intensive than repair, but it’s still a good idea to stagger it. If you need to run it on all machines (or you have very powerful machines) it’s probably going to be OK. Hope that helps. --------- Aaron Morton New Zealand @aaronmorton Co-Foun

Re: Multiple writers writing to a cassandra node...

2013-11-28 Thread Aaron Morton
.0.0 with libQtCassandra library. > > Please upgrade to 2.0.3. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 26/11/2013, at 4:42 am, Krishna Chaitanya wrote: > Hello,

Re: While inserting data into Cassandra using Hector client

2013-11-28 Thread Aaron Morton
Hector is designed to use Column Families created via the thrift interface, e.g. using cassandra-cli Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra Consulting http://www.thelastpickle.com On 25/11/2013, at 8:51 pm, San

Re: Large system.Migration CF after upgrade to 1.1

2013-11-26 Thread Aaron Morton
e (per cf) and index_interval (yaml). My talk called “In case of emergency break glass” at the summit in SF this year talks about this http://thelastpickle.com/speaking/2013/06/11/Speaking-Cassandra-Summit-SF-2013.html Long term moving to 1.2 will help. Hope that helps. --------- A

Re: 1.1.11: system keyspace is filling up

2013-11-26 Thread Aaron Morton
up, co-ordinator starts the writes, remote nodes process the request (no dropped messages), but the response is lost. These are tracked as timeouts on the MessagingServiceMBean. Cheers - Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache

Re: Intermittent connection error

2013-11-26 Thread Aaron Morton
ces the following output: Looks like a node is getting evicted from the pool, try turning the logging level up to DEBUG see if it says anything. For DS driver specific questions you may have better luck using the mail list here https://github.com/datastax/java-driver Cheers -----

Re: Migration Cassandra 2.0 to Cassandra 2.0.2

2013-11-25 Thread Aaron Morton
the binary package it creates the directory locations, installs the init scripts and makes it a lot easier to start and stop cassandra. I recommend using them. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Principal Consultant Apache Cassandra

Re: Is there any open source software for automatized deploy C* in PRD?

2013-11-25 Thread Aaron Morton
> Thanks, But I suppose it’s just for Debian? Am I right? There are debian and rpm packages, and people deploy them or the binary packages with with chef and similar tools. It may be easier to answer your question if you describe the specific platform / needs. cheers ----- Aa

Re: Config changes to leverage new hardware

2013-11-25 Thread Aaron Morton
ot look too bad. > Another interesting thing is that the linux disk cache doesn’t seem to be > growing in spite of a lot of free memory available. Things will only get paged in when they are accessed. Cheers ----- Aaron Morton New Zealand @aaronmorton Co-Founder & Pr

  1   2   3   4   5   6   7   8   9   10   >