Re: Cassandra read throughput with little/no caching.

2012-12-23 Thread aaron morton
ter with local disks. It also introduces a single point of failure into a distributed system. > but it's likely in the Linux disk cache, given the sizing of the > node/data/jvm. Are you sure that the local Linux machine is going to cache files stored on the SAN ? Cheers

Re: Exception on running nodetool in windows

2012-12-23 Thread aaron morton
The line numbers in the stack trace do not match the code for 1.1.6. I would blow away the install and check your java install. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 22/12/2012, at 6:59 PM, Vivek Mishra

Re: Need to run nodetool repair on a cluster running 1.1.6 if no deletes

2012-12-23 Thread aaron morton
tes, I do not know of any other technical issues for running repair. And I have seen a lot of systems running without out. (I just prefer a very boring life). Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/12

Re: CQL3 Compound Primary Keys - Do I have the right idea?

2012-12-23 Thread aaron morton
NE internal column / cell, the shipname * the internal column / cell "shipname" is a composite of the *value* of time_seen. e.g. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/12/2012, at

Re: Loading sstables to Cassandra using sstableloader and JMX client

2012-12-20 Thread aaron morton
>> -d '127.0.0.1' 'C:\Anand\Workspace\H2C_POC\Customer' Are you using the quotes on the command line / in the arguments ? Try without them. >> I end up having "Unknown directory: 'C:\Anand\Workspace\H2C_POC\Customer'" >> error. Whats

Re: question about config leading to an unbalanced ring

2012-12-20 Thread aaron morton
in rack 1. If you are using racks it's best to have an even distribution of nodes and the RF to be a multiple of the number of racks. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/12/2012, at 8:13 AM, Rob Co

Re: Replication Factor and Consistency Level Confusion

2012-12-20 Thread aaron morton
me (if this is not already the case) so > that you have repeatable results. Take a look at the nodetool getendpoints command. It will tell you which nodes a key is stored on. Though for RF 3 and N3 it's all of them :) Cheers - Aaron Morton Freelance Cassandra Developer

Re: Too Many Open files error

2012-12-20 Thread aaron morton
> THe number of files in the data directory is around 29500+. If you are using Levelled Compaction it is probably easier to set the ulimit to unlimited. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 21/12/2

Re: Moving data from one datacenter to another

2012-12-20 Thread aaron morton
copy part done pretty quickly. If that's the case you can: 1) do the main copy 2) stop the old system. 3) do the delta copy 4) start the new system That way you will not have stale reads in the new system. Hope that helps. - Aaron Morton Freelance Cassandra Developer New

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-20 Thread aaron morton
Yes, but they will get compacted away again unless the patch is there. it's a small patch so you should be able to apply it easily enough if you need a fix ASAP. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-19 Thread aaron morton
Well that was fun https://issues.apache.org/jira/browse/CASSANDRA-5079 Just testing my idea of a fix now. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/12/2012, at 10:33 AM, aaron morton wrote: >> Please

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-19 Thread aaron morton
--- RowKey: 66 => (column=1, value=val, timestamp=135595439049, ttl=7884000) => (column=10, value=val, timestamp=135595439269, ttl=7884000) ... => (column=indexedColumn, value=66, timestamp=1355952223881937, ttl=7887600) Looking into it now. Thanks

Re: Exception on running nodetool in windows

2012-12-19 Thread aaron morton
> Classcastexception: can not convert java.lang.String to some another java > type( i don't remember exact java class). It's a lot easier to help if you include the full error. Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @

Re: Partition maintenance

2012-12-19 Thread aaron morton
n the sstable header will help here. Note that columns are not purged unless all fragments from the row are included in the compaction. This could be a problem. It probably depends on your workload though. Hope that helps. - Aaron Morton Freelance Cassandra Developer New Ze

Re: High disk read throughput on only one node.

2012-12-19 Thread aaron morton
Is there a sustained difference or did it settle back ? Could this have been compaction or repair or upgrade tables working ? Do the read / write counts available in nodetool cfstats show anything different ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: cassandra-cli + secured JMX = WARNING: Could not connect to the JMX

2012-12-19 Thread aaron morton
://issues.apache.org/jira/browse/CASSANDRA Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 19/12/2012, at 2:24 AM, Sergey Olefir wrote: > Hi, > > for a number of reasons (particularly to prevent accidental access), I

Re: Monitoring the number of client connections

2012-12-18 Thread aaron morton
AFAIK the count connections is not exposed. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/12/2012, at 10:37 PM, Tomas Nunez wrote: > Hi! > > I want to know how many client connections has each

Re: TTL on SecondaryIndex Columns. A bug?

2012-12-18 Thread aaron morton
Thanks for the nice steps to reproduce. I ran this on my MBP using C* 1.1.7 and got the expected results, both get's returned a row. Were you running against a single node or a cluster ? If a cluster did you change the CL, cassandra-cli defaults to ONE. Cheers -

Re: Data Model Review

2012-12-18 Thread aaron morton
at helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/12/2012, at 4:35 AM, Adam Venturella wrote: > My use case is capturing some information about Instagram photos from the > API. I have 2 use cases. One, I need to capture all of the

Re: Read operations resulting in a write?

2012-12-18 Thread aaron morton
AFAIK there is no way to disable hoisting. Feel free to let your jira fingers do the talking. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/12/2012, at 6:10 PM, Edward Capriolo wrote: > Is there a way

Re: Read operations resulting in a write?

2012-12-17 Thread aaron morton
t. I assume it means cases where minor compaction cannot keep up. E.g. it has been throttled down, or a concurrent repair / upgradesstables is slowing things. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/12/201

Re: Adding New Node to an Existing Cluster

2012-12-17 Thread aaron morton
helps. Aaron - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 17/12/2012, at 11:53 PM, Adeel Akbar wrote: > Dear Tomas, > > I didn't use token values in configuration. A new node automatically picked a > token

Re: Read operations resulting in a write?

2012-12-16 Thread aaron morton
more the min compaction sstables. > 3) Is this desired behavior? Is there something else I should be looking at > that could be causing this behavior? Yes. https://issues.apache.org/jira/browse/CASSANDRA-2503 Cheers - Aaron Morton Freelance Cassandra D

Re: Does a scrub remove deleted/expired columns?

2012-12-16 Thread aaron morton
. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 14/12/2012, at 4:45 PM, Mike Smith wrote: > Thanks for the great explanation. > > I'd just like some clarification on the last point. Is it the case that if I >

Re: BulkOutputFormat error - org.apache.thrift.transport.TTransportException

2012-12-13 Thread aaron morton
Looks like it cannot connect to the server >conf.set("cassandra.output.thrift.address", "localhost"); Is this the same address as the rpc_address in the cassandra config ? Cheers ----- Aaron Morton Freelance Cassandra Developer New Zea

Re: Does a scrub remove deleted/expired columns?

2012-12-13 Thread aaron morton
that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 14/12/2012, at 3:01 AM, Mike Smith wrote: > I'm using 1.0.12 and I find that large sstables tend to get compacted > infrequently. I've got data that gets deleted o

Re: Multiple Data Center shows very uneven load

2012-12-13 Thread aaron morton
d starting again will get you moving forwards again. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 14/12/2012, at 12:50 AM, Sergey Olefir wrote: > I'll try nodetool drain, thanks. > > But more genera

Re: Why Secondary indexes is so slowly by my test?

2012-12-12 Thread aaron morton
The IndexClause for the get_indexed_slices takes a start key. You can page the results from your secondary index query by making multiple calls with a sane count and including a start key. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Multiple Data Center shows very uneven load

2012-12-12 Thread aaron morton
try nodetool drain. It will flush everything to disk and the commit log will be truncated. HH can be ignored. If you really want them gone they can be purged using the JMX interface, or you can stop the node and delete the sstables. Cheers - Aaron Morton Freelance Cassandra

Re: upgrade from 0.8.5 to 1.1.6, now it cannot find schema

2012-12-12 Thread aaron morton
> in-vm cassandra Embedded ? The location of the SSTables has changed in 1.1, they are know in /var/lib/cassandra/data/KS_NAME/CF_NAME/SSTable.data Is the data in the right place ? Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton h

Re: Null Error Running pig_cassandra

2012-12-12 Thread aaron morton
Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 13/12/2012, at 6:04 AM, James Schappet wrote: > When trying to run the example-script.pig, I get the following error, null > error. > > > > > tsunami:pig scha

Re: Consistency QUORUM does not work anymore (hector:Could not fullfill request on this host)

2012-12-12 Thread aaron morton
> sliceRangeQuery.setRange(Character.Min_Value, Character.Max_Value, false, > Integer.Max_Value); Try selecting a smaller number of rows. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com - Aaron

Re: Multiple Data Center shows very uneven load

2012-12-12 Thread aaron morton
ata). Glancing at the logs it could be Hints or commit log replaying. Use nodetool cfstats to see which CF's are on the node and what their size is. If this is still a test the easiest thing to do is nuke it and start again. Cheers - Aaron Morton Freelance Cassandra Deve

Re: bug with cqlsh for foreign charater

2012-12-12 Thread aaron morton
Can you please put together a test case using CQL 3 to write and read the data and create a ticket at https://issues.apache.org/jira/browse/CASSANDRA ? Thanks Aaron - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/12

Re: Cassandra on EC2 - describe_ring() is giving private IPs

2012-12-11 Thread aaron morton
the nodes. Trying setting the rpc_address to the public IP. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/12/2012, at 11:32 PM, santi kumar wrote: > We have a 4 node cluster in us-east region in two different A

Re: Consistency QUORUM does not work anymore (hector:Could not fullfill request on this host)

2012-12-11 Thread aaron morton
ers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/12/2012, at 10:13 PM, dong.yajun wrote: > hi list, > I am using Cassandra with 3 data centers, each DC has more than 10 nodes. > > the schema for a keyspace: >

Re: Slow Reads in Cassandra with Hadoop

2012-12-11 Thread aaron morton
%29 Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 7/12/2012, at 4:29 AM, Ralph Romanos wrote: > Hello Cassandra users, > > I am trying to read and process data in Cassandra using Hadoop. I ha

Re: Selecting rows efficiently from a Cassandra CF containing time series data

2012-12-11 Thread aaron morton
n over the dirty partitions CF to read all rows, and then reading the dirty partition for the user. You would want to look at a low GC Grace and LDB for the dirty partitions CF. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronm

Re: Virtual Nodes, lots of physical nodes and potentially increasing outage count?

2012-12-11 Thread aaron morton
ord :) ) Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/12/2012, at 6:42 AM, Eric Parusel wrote: > Ok, thanks Richard. That's good to hear. > > However, I still contend that as node count increases to

Re: multiget_slice SlicePredicate

2012-12-11 Thread aaron morton
hewed through. This this is more of an issue with smaller clusters. As Dean says, the client request is performed in parallel on multiple machines. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/12/2012, at 3:

Re: Multiple Data Center shows very uneven load

2012-12-11 Thread aaron morton
Hi Sergey, I think you have forgotten to include some information in your email. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 12/12/2012, at 3:00 AM, Sergey Olefir wrote: > Keith Wright wrote >> I

Re: Multiple Data Center shows very uneven load

2012-12-11 Thread aaron morton
that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 11/12/2012, at 4:29 PM, Keith Wright wrote: > Hello, > > I have base Cassandra 1.1.7 installed in two data centers with 3 nodes each > using a Proper

Re: Batch mutation streaming

2012-12-09 Thread aaron morton
Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 9/12/2012, at 7:18 AM, Ben Hood <0x6e6...@gmail.com> wrote: > Thanks for the clarification Andrey. If that is the case, I had better ensure > that I

Re: JDBC, Pools and clusters ?

2012-12-09 Thread aaron morton
not appear to be in the (current) 1.1.2 branch. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 10/12/2012, at 3:23 AM, Andy Cobley wrote: > I'm starting to move to JBC for Cassandra (away from Hecto

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-06 Thread aaron morton
> Meaning terabyte size databases. > Lots of people have TB sized systems. Just add more nodes. 300 to 400 Gb is just a rough guideline. The bigger picture is considering how routine and non routine maintenance tasks are going to be carried out. Cheers - Aaron

Re: entire range of node out of sync -- out of the blue

2012-12-06 Thread aaron morton
The log message matches what I would expect to see for nodetool -pr Not using pr means repair all the ranges the node is a replica for. If you have RF == number of nodes, then it will repair all the data. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand

Re: Help on MMap of SSTables

2012-12-06 Thread aaron morton
> So for memory mapped files, compaction can do a madvise SEQUENTIAL instead of > current DONTNEED flag after detecting appropriate OS versions. Will this help? AFAIK Compaction does use memory mapped file access. Cheers - Aaron Morton Freelance Cassandra Developer New Z

Re: how to take consistant snapshot?

2012-12-06 Thread aaron morton
M for reads you *may* be ok (cannot work it out quickly.). If you use CL ALL for reads you will be ok. Or you can use nodetool repair to ensure the data is consistent. I doubt that even using repair would give you a provable guarantee though. Anyone ? Cheers - Aaron Morton Free

Re: [BETA RELEASE] Apache Cassandra 1.2.0-beta3 released

2012-12-05 Thread aaron morton
There are two thrift calls, batch_mutate and atomic_batch_mutate . Check with your favourite thrift client to see how it handles it. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 6/12/2012, at 7:31 AM, Andrey

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-12-05 Thread aaron morton
ke for cassandra to stream all the data over ? (Or to rsync the data over.) How long does it take to run nodetool repair on the node ? With RF 3, if you lose a node you have lost your redundancy. It's important to have a plan about how to get it back and how long it may take. Hope that help

Re: entire range of node out of sync -- out of the blue

2012-12-05 Thread aaron morton
t; - how do i clean up my stables ( grew from 6k to 20k since this started, > while i shut writes off completely ) Sounds like repair is streaming a lot of differences. If you have the space I would give Levelled compaction time to take care of it. Hope that helps. - Aaron

Re: Help on MMap of SSTables

2012-12-05 Thread aaron morton
osix_fadvise if you want to look it up. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/12/2012, at 11:04 PM, Ravikumar Govindarajan wrote: > Thanks Aaron, > > I am not quite clear on how MMap loads SS

Re: Loading SSTables failing via Cassandra SSTableLoader on mulit-node cluster.

2012-12-05 Thread aaron morton
Have you checked the yaml configuration for the sstableloader ? Background configuration section here http://www.datastax.com/dev/blog/bulk-loading Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/12

Re: Diagnosing memory issues

2012-12-04 Thread aaron morton
you can turn them up. Hope that helps. A ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/12/2012, at 7:04 AM, Mike wrote: > Hello, > > Our Cassandra cluster has, relatively recently, started experiencing memo

Re: Data backup and restore

2012-12-04 Thread aaron morton
I wrote a script to sym link the snapshots together the other day https://github.com/amorton/cass_snapshot_link I've not really used it in anger yet. That is to say I wrote it for fun and it worked on my mac book. If you use it let me know if it works. Cheers A - Aaron M

Re: strange row cache behavior

2012-12-04 Thread aaron morton
The key cache and os disk cache will help. If you find latency is an issue then start poking around. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/12/2012, at 4:23 AM, Yiming Sun wrote: > Hi Aaron, >

Re: Nodes not synced

2012-12-04 Thread aaron morton
ownership here. Check the schema has the RF you think it does. You can also run nodetool repair to make sure the data is fully distributed. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 5/12/2012, at 2:26 AM, Adeel

Re: Help on MMap of SSTables

2012-12-04 Thread aaron morton
mmapping will map the entire file, but pages of data are read into memory on demand and purged when space is needed. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/12/2012, at 11:59 PM, Ravikumar Govindarajan wrot

Re: Having issues with node token collisions when starting up Cassandra nodes in a cluster on VMWare.

2012-12-04 Thread aaron morton
other nodes, which then gossiped it around, or by this one. When a node automatically selects a token at bootstrap it logs a message such as "New token will be {} to assume load from {}" do you see that ? If not the token has been read from the system KS. Hope that helps ---

Re: Row caching + Wide row column family == almost crashed?

2012-12-04 Thread aaron morton
I responded on your other thread. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/12/2012, at 5:31 PM, Yiming Sun wrote: > I ran into a different problem with Row cache recently, sent a message to the >

Re: strange row cache behavior

2012-12-04 Thread aaron morton
esting with a lower number of hot rows, and/or a bigger row cache. But to be honest, with rows in the 10's of MB you will probably only get good cache performance with a small set of hot rows. Hope that helps. ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaron

Re: Data not replicating to all datacenters

2012-12-04 Thread aaron morton
for both reads and writes. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/12/2012, at 9:33

Re: Hadoop Integration: Limiting scan to a range of keys

2012-12-03 Thread aaron morton
is local to the node. It's not really possible to select individual rows by token. If you had a secondary index on the row you could use the setInputRange overload that takes an index expression. Or it may be easier to use hive. Hope that helps. - Aaron Morton Free

Re: Row caching + Wide row column family == almost crashed?

2012-12-03 Thread aaron morton
you were using the ConcurrentLinkedHashCacheProvider that would explain the increase in GC activity. Try the SerializingCacheProvider , it will take the row cache off the JVM heap. And as Ed says, it's not always a great idea for wide rows. Cheers ----- Aaron Morton Freelance Cassandr

Re: Data not replicating to all datacenters

2012-12-03 Thread aaron morton
ads from another ? Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/12/2012, at 6:45 AM, Шамим wrote: > Yes, it's should be. dc1:3 means u have 3 copy of every piece of row, with > local quorum you alwa

Re: Cassandra 1.1.5 - SerializingCacheProvider - possible memory leak?

2012-12-03 Thread aaron morton
esult of the configuration and the work load. Look for very big rows, very long lived rows with a lot of deletes, or very big select / get calls. Hope that helps. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 4/12/2012

Re: How to determine compaction bottlenecks

2012-11-27 Thread aaron morton
I would also check the logs for GC issues. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/11/2012, at 4:23 AM, Derek Bromenshenkel wrote: > Setup: C* 1.1.6, 6 node (Linux, 64GB RAM, 16 Core CPU, 2x512 SSD)

Re: Upgrade

2012-11-27 Thread aaron morton
Do you have the error stack ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 28/11/2012, at 12:28 AM, Everton Lima wrote: > Hello people. > I was using cassandra 1.1.6 and use the Object CassandraServe

Re: InvalidRequestException(why:Not enough bytes to read value of component 0)

2012-11-26 Thread aaron morton
It looks like the client is not sending the correct bytes. Are you using Hector or Astyanax? It kind of looks like you are using raw thrift, using a pre-written client is much easier. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: Changing compression_parameters of exsisting CF

2012-11-26 Thread aaron morton
> is it expectable behaviour? or it's bug? It exhibits bug like qualities. Can you create a ticket on https://issues.apache.org/jira/browse/CASSANDRA ? Thanks ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 27/11/

Re: huge commitlog

2012-11-25 Thread aaron morton
Can you please create a ticket for this on https://issues.apache.org/jira/browse/CASSANDRA Thanks - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 26/11/2012, at 1:58 PM, Chuan-Heng Hsiao wrote: > Hi Aaron, > >

Re: Generic questions over Cassandra 1.1/1.2

2012-11-25 Thread aaron morton
#x27;s within 5% (maybe 10%) under stress tests. See Eric's talk at the Cassandra SF conference for the exact numbers. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 26/11/2012, at 11:58 AM, cbert...@l

Re: Generic questions over Cassandra 1.1/1.2

2012-11-25 Thread aaron morton
however altering the schema is easier. And in 1.2 will support concurrent schema modifications. Thrift API is still schema less. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 26/11/2012, at 12:21 AM, cbert...@liber

Re: huge commitlog

2012-11-25 Thread aaron morton
> I checked the log, and found some ERROR about network problems, > and some ERROR about "Keys must not be empty". Do you have the full error stack ? Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 25/

Re: Concurrency and secondary indexes

2012-11-25 Thread aaron morton
> Nodetool reports: 1.1.6-dse-p1 If you are using DSE the best place to get help is the support forums http://www.datastax.com/support-forums/ Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 24/11/2012, at 6:34

Re: Freeing up disk space on Cassandra 1.1.5 with Size-Tiered compaction.

2012-11-22 Thread aaron morton
en look at LDB http://www.datastax.com/dev/blog/when-to-use-leveled-compaction Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/11/2012, at 9:18 AM, Alain RODRIGUEZ wrote: > Hi Alexandru, > > "We ar

Re: Concurrency and secondary indexes

2012-11-22 Thread aaron morton
ommand line are built at the same time. Rebuilding any one index requires reading all the rows in the CF. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 23/11/2012, at 8:20 AM, Simon Guindon wrote: > We are impor

Re: Query regarding SSTable timestamps and counts

2012-11-20 Thread aaron morton
>> upgradetables re-writes every sstable to have the same contents in the >> newest format. Agree. In the world of compaction, and excluding upgrades, have older sstables is expected. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaro

Re: Invalid argument

2012-11-20 Thread aaron morton
> Thanks for the work around, setting disk_access_mode: standard worked. hmmm, it's only a work around. If you can reproduce the fault could you report it on https://issues.apache.org/jira/browse/CASSANDRA Cheers ----- Aaron Morton Freelance Cassandra Developer New

Re: row cache re-fill very slow

2012-11-20 Thread aaron morton
-Filter.db) component. Also the SSTables are opened in parallel. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/11/2012, at 10:39 AM, Andras Szerdahelyi wrote: > Aaron, > >> What version are you on ?

Re: Query regarding SSTable timestamps and counts

2012-11-20 Thread aaron morton
ta files and > removed all the data files with the old timestamps. upgradetables re-writes every sstable to have the same contents in the newest format. Cheers --------- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 19/11/2

Re: Invalid argument

2012-11-19 Thread aaron morton
Are you running a 32 bit JVM ? What is the full JVM version ? As a work around you can try disabling memory mapped access set disk_access_mode to standard. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/11

Re: row cache re-fill very slow

2012-11-19 Thread aaron morton
tarting > with a cold row cache ) row_cache_keys_to_save in yaml may help you find a happy half way point. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 20/11/2012, at 3:17 AM, Andras Szerdahelyi wrote: > Hey list, &g

Re: Upgrade 1.1.2 -> 1.1.6

2012-11-18 Thread aaron morton
rations ? (I saw some dropped messages in the S1 log). S1 shows a lot of Commit Log replay going on. Reading your timeline below this sounds like the auto restart catching you out. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelas

Re: Query regarding SSTable timestamps and counts

2012-11-18 Thread aaron morton
compaction issues you are having ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 18/11/2012, at 1:18 AM, Ananth Gundabattula wrote: > > We have a cluster running cassandra 1.1.4. On this cluster, > >

Re: Cassandra nodes failing with OOM

2012-11-18 Thread aaron morton
event those? As above. As a work around sometimes drastically slowing down compaction can help. For LDB try reducing in_memory_compaction_limit_in_mb and compaction_throughput_mb_per_sec Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: unable to read saved rowcache from disk

2012-11-18 Thread aaron morton
> . But what is the upper bound? And rules of thumb? If you are using the off heap cache the upper bound is memory. If you are using the on head it's the JVM heap. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.co

Re: huge commitlog

2012-11-18 Thread aaron morton
mn family (around 10M in data_file_directories) Can you describe how you created the 700 CF's ? > and how can we reduce the size of commitlog? As a work around nodetool flush should checkpoint the log. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand

Re: Offsets and Range Queries

2012-11-16 Thread aaron morton
slice that starts in the middle of a row of 10 million columns just by using a start column. Having a slice operation that is constrained in size improves the overall throughout of the server and reduces the (jvm) GC churn in the server. Cheers ----- Aaron Morton Freelance Cassan

Re: Datatype Conversion in CQL-Client?

2012-11-16 Thread aaron morton
> Does the official/built-in Cassandra CQL client (in 1.2) What language ? Check the Java http://code.google.com/a/apache-extras.org/p/cassandra-jdbc/ and python http://code.google.com/a/apache-extras.org/p/cassandra-dbapi2/ drivers. Cheers ----- Aaron Morton Freelance Cassan

Re: unable to read saved rowcache from disk

2012-11-16 Thread aaron morton
300B. > Did I miss something? Did that take into account the token, the row key, and the row payload, and the java memory overhead ? Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/11/2012, at 9:35 AM, Wei Zhu

Re: Upgrade 1.1.2 -> 1.1.6

2012-11-15 Thread aaron morton
Can you provide an example of the increase ? Can you provide the log from startup ? Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 16/11/2012, at 3:21 AM, Alain RODRIGUEZ wrote: > We had an issue with count

Re: unable to read saved rowcache from disk

2012-11-15 Thread aaron morton
For a row cache of 1,650,000: 16 byte token 300 byte row key ? and row data ? multiply by a java fudge factor or 5 or 10. Trying delete the saved cache and restarting. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http

Re: CF metadata syntax for an array

2012-11-14 Thread aaron morton
ers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 4:18 PM, Kevin Burton wrote: > In the below example I am thinking that id is the order id. Would there be > considerable duplication if there are oth

Re: CF metadata syntax for an array

2012-11-14 Thread aaron morton
value of item_id : "price" * value of item_id : "title" Hope that helps. - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 11:35 AM, Peter Lin wrote: > it means the column family uses c

Re: CF metadata syntax for an array

2012-11-14 Thread aaron morton
8 | this is another example 1 | 3 | 6 | this is the last example - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 10:38 AM, Kevin Burton wrote: > An array would be a list of groups of items.

Re: Fixing / Rebuilding Secondary Index

2012-11-14 Thread aaron morton
Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 8:50 AM, Eran Chinthaka Withana wrote: > Hi, > > I have a secondary index for a column family which is connected to a keyspace > that spa

Re: SchemaDisagreementException

2012-11-14 Thread aaron morton
end doing that. If you are trying to do something more complicated you'll need to provide more information. Cheers ----- Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 3:13 AM, Everton Lima wrote: > Some

Re: Memory Manager

2012-11-14 Thread aaron morton
S="$JVM_OPTS -XX:CMSInitiatingOccupancyFraction=75" JVM_OPTS="$JVM_OPTS -XX:+UseCMSInitiatingOccupancyOnly" Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 2:56 AM, Everton Lima wrote: &

Re: describe columnfamilies?

2012-11-14 Thread aaron morton
4946 is marked as a dup of https://issues.apache.org/jira/browse/CASSANDRA-4913 Looks like it's fixed in the trunk now. Cheers - Aaron Morton Freelance Cassandra Developer New Zealand @aaronmorton http://www.thelastpickle.com On 15/11/2012, at 2:19 AM, Timmy Turner

<    5   6   7   8   9   10   11   12   13   14   >