Re: Order of the cyclic group of hashed partitioners

2012-08-26 Thread aaron morton
> AbstractHashedPartitioner does not exist in the trunk. https://git-wip-us.apache.org/repos/asf?p=cassandra.git;a=commitdiff;h=a89ef1ffd4cd2ee39a2751f37044dba3015d72f1 Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 24/08/2012, at 10

Re: Cluster temporarily split into segments

2012-08-26 Thread aaron morton
s continue and are Consistent, I would look at RF 3 with QUOURM / QUOURM. If it's important that reads continue and consistency can be relaxed I would look at RF 3 (or 6) and read ONE write QUOURM Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://

Re: Data Modelling Suggestions

2012-08-26 Thread aaron morton
az3')]) In [9]: FOO.get("bar", column_start=(2,2), column_finish=(3,1)) Out[9]: OrderedDict([((2, 2), u'baz2')]) In [10]: FOO.get("bar", column_start=(2,), column_finish=(3,)) Out[10]: OrderedDict([((2, 2), u'baz2'), ((3, 3), u'baz3')]) > We see

Re: Secondary index partially created

2012-08-27 Thread aaron morton
If you are still having problems can you post the query and the output from nodetool cfstats on one of the nodes that fails ? cfstats will tell us if the secondary index was built. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/08

Re: Commit log periodic sync?

2012-08-27 Thread aaron morton
you try to reproduce the problem ? If possible can you reproduce it with a single node ? Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/08/2012, at 11:00 AM, rubbish me wrote: > Thanks, Aaron, for your reply - please see the inline.

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-27 Thread aaron morton
/cassandra/blob/trunk/src/java/org/apache/cassandra/io/sstable/SSTableSimpleWriter.java > Right now my Cassandra data store has about 4 months of data and we > have 5 years of historical ingest all the histories! Cheers ----- Aaron Morton Freelance Develo

Re: unsubscribe

2012-08-27 Thread aaron morton
http://wiki.apache.org/cassandra/FAQ#unsubscribe - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 26/08/2012, at 4:12 AM, Shen wrote: >

Re: Expanding cluster to include a new DR datacenter

2012-08-27 Thread aaron morton
I did a quick test on a clean 1.1.4 and it worked Can you check the logs for errors ? Can you see your schema change in there ? Also what is the output from show schema; in the cli ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 25/08

Re: QUORUM writes, QUORUM reads -- and eventual consistency

2012-08-27 Thread aaron morton
ion it's from the point of view of the coordinator. it may be the case that the coordinator is isolated and all the other nodes are UP and happy. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 26/08/2012, at 5:03 AM, Guille

Re: Dynamic Column Families in CQLSH v3

2012-08-27 Thread aaron morton
apache.org/msg23636.html Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 24/08/2012, at 2:24 PM, Erik Onnen wrote: > Hello All, > > Attempting to create what the Datastax 1.1 documentation calls a > Dynamic Column Family >

Re: TTL and Cassandra counters

2012-08-27 Thread aaron morton
o "hey this timer run out" event. > Please consult on how we can achieve a solution for this issue.. Best I could offer would be to expire the messages manually and avoid using TTL. Otherwise let the count get out of sync, and repair it the next time the user the messages. Cheers

Re: Order of the cyclic group of hashed partitioners

2012-08-27 Thread aaron morton
Sorry I don't understand your question. Can you explain it a bit more or maybe someone else knows. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 27/08/2012, at 7:16 PM, Romain HARDOUIN wrote: > > Thank you Aaron. >

Re: Cassandra 1.1.4 RPM required

2012-08-27 Thread aaron morton
ging Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 27/08/2012, at 8:14 PM, Marco Schirrmeister wrote: > > On Aug 23, 2012, at 12:15 PM, Adeel Akbar wrote: > >> Dear Aaron, Its required username and password which I have not. C

Re: can you use hostnames in the topology file?

2012-08-28 Thread aaron morton
helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 28/08/2012, at 5:00 AM, "Hiller, Dean" wrote: > In the example, I see all ips being used, but our machines are on dhcp so I > would prefer using hostnames for everything(plus

Re: optimizing use of sstableloader / SSTableSimpleUnsortedWriter

2012-08-28 Thread aaron morton
> dataset... just under 4 months of data is less then 2GB! I'm pretty > thrilled. Be thrilled by all the compressions ! :) Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 28/08/2012, at 6:10 AM, Aaron Turner wrote: > On Mon

Re: sstableloader error

2012-08-28 Thread aaron morton
t; the below message: > INFO 21:40:30,335 Node /192.168.11.11 is now part of the cluster This is the bulk load process joining the ring to send the file around. Cheers --------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 28/08/2012, at 10:56 AM, Swat

Re: Commit log periodic sync?

2012-08-29 Thread aaron morton
alk the test scenario forward to multiple nodes then multiple DC's until it fails. If the single node test fails check your test and then grab someone on IRC (I'm aaron_morton and there are plenty of other smart helpful people there). Sorry it's sometimes hard to diagnose probl

Re: Expanding cluster to include a new DR datacenter

2012-08-29 Thread aaron morton
a. Without knowing what the error is it's hard to say if it would work. Cheers --------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 29/08/2012, at 9:10 AM, Bryce Godfrey wrote: > I believe what may be really going on is that my schema is in a bad

Re: Automating nodetool repair

2012-08-29 Thread aaron morton
Staggering the repairs also gives the DynamicSnitch a chance to route around nodes which maybe running slow. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 29/08/2012, at 11:19 AM, Omid Aladini wrote: >>> Secondly, what'

Re: Row level statistics

2012-08-29 Thread aaron morton
> But does cassandra provide statistics at the granularity of rows. No. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 29/08/2012, at 12:05 PM, Shankaranarayanan P N wrote: > Hello, > > I have seen that cassandra gives

Re: Node forgets about most of its column families

2012-08-29 Thread aaron morton
he situation please create a ticket on https://issues.apache.org/jira/browse/CASSANDRA Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 29/08/2012, at 8:38 AM, Edward Sargisson wrote: > For the record, we just had a recurrence of thi

Re: Node forgets about most of its column families

2012-08-29 Thread aaron morton
Thanks Peter. This is 1.1.X ? Any thoughts on how recent the last schema change was ? Had the schema started in a pre 1.1X cluster? If so had their been a migration change after 1.1 upgrade? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com

Re: keyspace and column family creationŠhow to use ConsistencyLevel.ALL with creation?

2012-08-29 Thread aaron morton
describe_schema_versions on the thrift API (SystemManager.describe_schema_versions() on pycassa) is what you are after. Call it before hand to know what's what, and then call until all nodes converge on the new schema. Cheers - Aaron Morton Freelance Developer @aaronm

Re: Why Cassandra secondary indexes are so slow on just 350k rows?

2012-08-29 Thread aaron morton
> *from 12 to 20 seconds (!!!) to find 5000 rows*. More is not always better. Cassandra must materialise the full 5000 rows and send them all over the wire to be materialised on the other side. Try asking for a few hundred at a time and see how it goes. Cheers ----- Aa

Re: performance is drastically degraded after 0.7.8 --> 1.0.11 upgrade

2012-08-29 Thread aaron morton
planation ? If you can provide some more information on your use case we may be able to help. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 30/08/2012, at 5:18 AM, Илья Шипицин wrote: > in terms of our high-rate write load cassan

Re: Node forgets about most of its column families

2012-08-29 Thread aaron morton
For those playing along at home Edwards ticket was marked as a dup of Problem with creating keyspace after drop https://issues.apache.org/jira/browse/CASSANDRA-4219 Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 30/08/2012, at 4:43 AM

Re: Store a timeline with uniques properties

2012-08-30 Thread aaron morton
> Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 30/08/2012, at 11:32 PM, Morgan Segalis wrote: > Sorry for the scheme that has not keep the right tabulation for some people... > Here's a space-version instead of a tab

Re: performance is drastically degraded after 0.7.8 --> 1.0.11 upgrade

2012-08-30 Thread aaron morton
thing unusual in the log ? Cheers --------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 31/08/2012, at 3:30 AM, Edward Capriolo wrote: > If you move from 7.X to 0.8X or 1.0X you have to rebuild sstables as > soon as possible. If you have large bl

Re: How to set LeveledCompactionStrategy for an existing table

2012-08-30 Thread aaron morton
Looks like a bug. Can you please create a ticket on https://issues.apache.org/jira/browse/CASSANDRA and update the email thread ? Can you include this: CFPropDefs.applyToCFMetadata() does not set the compaction class on CFM Thanks - Aaron Morton Freelance Developer

Re: performance is drastically degraded after 0.7.8 --> 1.0.11 upgrade

2012-09-02 Thread aaron morton
hat are taking longer ? There are full request metrics available on the StorageProxy JMX object. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 31/08/2012, at 4:45 PM, Илья Шипицин wrote: > we are using functional tests ( ~500 tests i

Re: Composite row keys with SSTableSimpleUnsortedWriter for Cassandra 1.0?

2012-09-02 Thread aaron morton
I think you want the o.a.c.db.marshal.TypeParser. You can pass a CLI format composite type to the parse() func. It's in 1.0X Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 1/09/2012, at 6:44 AM, Jeff Schmidt wrote: > Hello:

Re: force gc?

2012-09-03 Thread aaron morton
r multiple size tiers. Expanding from 5GB to 70Gb is out of the normal expections I would say. You may want to check it the db contains what you expect it to. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 3/09/2012, at 5:32 PM, Alexande

Re: Order of the cyclic group of hashed partitioners

2012-09-04 Thread aaron morton
> I believe the question is why is the maximum 2**127 and not > 0x The maximum is the size of the digest created by MD5. Does that answer the question? - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 3/09/2012, at 8:20 P

Re: Text searches and free form queries

2012-09-04 Thread aaron morton
helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 4/09/2012, at 3:00 AM, Andrey V. Panov wrote: > Some one did search on Lucene, but for very fresh data they build search > index in memory so data become available for search without delays. > &g

Re: configure KeyCahce to use Non-Heap memory ?

2012-09-04 Thread aaron morton
any keys it contains Vs the number of rows on the box and the hit rate. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 4/09/2012, at 3:01 PM, Ananth Gundabattula wrote: > > Is there any way I can configure KeyCahce to use Non-He

Re: java.lang.NoClassDefFoundError when trying to do anything on one CF on one node

2012-09-04 Thread aaron morton
/ cqlsh to print the contents of the NodeIdInfo and LocationInfo CF's from system ? I *think* a work around may be to: * stop the node * remove LocationInfo and NodeInfo cfs. * restart Note this will read the token from the yaml file again, so make sure it's right. cheers --

Re: performance is drastically degraded after 0.7.8 --> 1.0.11 upgrade

2012-09-04 Thread aaron morton
Histogram stats can help with that as they provide a spread of latencies. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 12:27 AM, Илья Шипицин wrote: > it was good idea to have a look at StorageProxy :-) >

Re: anyone know how to lookup non-continguous columns BUT for prefixes?

2012-09-04 Thread aaron morton
e. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 4:56 AM, "Hiller, Dean" wrote: > I have a row that is an index like so > > Index row -> ., ., ., > . , ., ., . > > I would like to get all of the pks for >

Re: keyspace not propagated to a new node?

2012-09-04 Thread aaron morton
What version are you on ? Anything in the logs from MigrationManager ? You could try nodetool resetlocalschema . Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 7:02 AM, Yang wrote: > I let a new node join the ring,

Re: why do I have to use internal IP for EC2 nodes?

2012-09-04 Thread aaron morton
eers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 7:37 AM, Yang wrote: > http://www.datastax.com/docs/1.1/initialize/cluster_init > > > says: > > " Note In the - seeds list property, include the internal I

Re: performance is drastically degraded after 0.7.8 --> 1.0.11 upgrade

2012-09-06 Thread aaron morton
known edge case. Whatever the cause we would need more details to help you. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 4:19 PM, Илья Шипицин wrote: > all tests use similar data access patterns, so every test on 1.0.11

Re: java.lang.NoClassDefFoundError when trying to do anything on one CF on one node

2012-09-06 Thread aaron morton
d up there. Deleting the NodeIdInfo CF SSTables should fix it. I created https://issues.apache.org/jira/browse/CASSANDRA-4626 can you please add more information there if you can and/or watch the ticket incase there are other questions. Thanks - Aaron Morton Freelance Developer

Re: configure KeyCahce to use Non-Heap memory ?

2012-09-06 Thread aaron morton
The hit rate is pretty low > 0.451 recent hit rate, A bigger cache would not help too much. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 11:31 PM, Ananth Gundabattula wrote: > Hello Aaron, > > Thanks a

Re: Secondary index read/write explanation

2012-09-06 Thread aaron morton
n the cluster. Or for a restricted token range if you have a key restriction in the query. > If there is any article/blog that can help understand this better, please let > me know. I think this is still mostly relevant http://www.datastax.com/docs/0.7/data_model/secondary_indexes Cheers -

Re: Monitoring replication lag/latency in multi DC setup

2012-09-06 Thread aaron morton
ava/org/apache/cassandra/db/HintedHandOffManagerMBean.java Note that counting the number of hits involves counting the number of hits, so that can take a while. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 6/09/2012, at 5:33 PM, Ven

Re: Helenos - web based gui tool

2012-09-06 Thread aaron morton
Thanks Tomek, Feel free to add it to http://wiki.apache.org/cassandra/Administration%20Tools Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 5/09/2012, at 9:54 AM, Tomek Kuprowski wrote: > Dear all, > > I'm happy

Re: Practical node size limits

2012-09-09 Thread aaron morton
bootstrapping a node. (It wont help reduce the time taken to calculate merkle trees though). Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 7/09/2012, at 7:28 AM, Dustin Wenz wrote: > This is actually another problem that we've en

Re: Issue after upgraded Cassandra 1.1.4

2012-09-09 Thread aaron morton
This is a server side timeout. Consistent Level nodes did not respond to the coordinator within rpc_timeout. The nodes may have been overloaded, check the nodetool tpstats. It will tell you if the node is backing up and if it has dropped messages. Cheers - Aaron Morton

Re: Replication factor 2, consistency and failover

2012-09-09 Thread aaron morton
t reduced consistency for high availability" rather than say "in general we want to achieve strong consistency". Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 9/09/2012, at 9:09 PM, Sergey Tryuber wrote: >

Re: Number of columns per row for Composite Primary Key CQL 3.0

2012-09-10 Thread aaron morton
would suggest 1MM cols is fine, if you get to 10MM cols per row you probably have gone too far. Remember the byte size of the row is also important; larger rows churn memory more and take longer to compact / repair. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton

Re: Suggestions for tuning and monitoring.

2012-09-10 Thread aaron morton
d. > The config options we are unsure about are things like commit log sizes, …. I would try to find some indication of what's going on before tweaking. Have you checked iostat ? Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com

Re: any way to prefer just 3 column families for partial row caching

2012-09-10 Thread aaron morton
x27;s use it. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 11/09/2012, at 3:54 AM, "Hiller, Dean" wrote: > We have 3 tables for all indexing we do called > IntegerIndexing > DecimalIndexing > StringIndexing > > playOrm woul

Re: Assertions running Cleanup on a 3-node cluster with Cassandra 1.1.4 and LCS

2012-09-10 Thread aaron morton
CF's or just one ? * If you can identify the CF can you include the .json file that is kept on disk. It contains information about levelled compaction. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 11/09/2012, at 4:37 AM, Rudolf v

Re: replace_token code?

2012-09-11 Thread aaron morton
s to remove is started. Has the 80 node re appeared in the logs ? If it does can you include the output from nodetool gossipinfo ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 11/09/2012, at 5:59 AM, Yang wrote: > Thanks Jim, l

Re: Number of columns per row for Composite Primary Key CQL 3.0

2012-09-12 Thread aaron morton
> What is "MM" stands for? million ? Yup. No idea why I do that. cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 12/09/2012, at 11:25 AM, Data Craftsman 木匠 wrote: > Hi Aaron, > > Thanks for the suggestion, as a

Re: how to enter float value from cassandra-cli ?

2012-09-12 Thread aaron morton
It's not supported, yet. Can you create a ticket on https://issues.apache.org/jira/browse/CASSANDRA ? You could try cqlsh http://www.datastax.com/docs/1.1/dml/using_cql Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 12/09/2012, at

Re: nodetool connection refused

2012-09-12 Thread aaron morton
Thanks for updating the Wiki :) Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 12/09/2012, at 1:14 PM, Manu Zhang wrote: > problems solved. I didn't add the jmx_host and jmx_port to vm_arguments in > Eclipse. How come it is

Re: Astyanax InstantiationException when accessing ColumnList

2012-09-12 Thread aaron morton
- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 12/09/2012, at 2:04 PM, Ran User wrote: > Oops, forgot to mention Cassandra version - 1.1.4 > > On Tue, Sep 11, 2012 at 5:54 AM, Ran User wrote: > Stuck for hours on this one, thank

Re: hadoop inserts blow out heap

2012-09-13 Thread aaron morton
you if mutations are pending, and will say how many have been dropped. The log may also contain entries about pending and dropped messages. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 12/09/2012, at 11:52 PM, Brian Jeltema

Re: thoughts on this feature request

2012-09-13 Thread aaron morton
ld always be consistent as well. Can you embrace the inconsistency ? Here is one approach cassandra will be taking https://issues.apache.org/jira/browse/CASSANDRA-2897 Discard the invalid entries on read and repair the problem. Cheers ----- Aaron Morton Freelance Developer @aaro

Re: Composite Column Types Storage

2012-09-13 Thread aaron morton
hat helps. ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 13/09/2012, at 2:30 AM, Ravikumar Govindarajan wrote: > Thanks for the clarification. Even though compression solves disk space > issue, we might still have Memtable bloat right? &

Re: nodetool connection refused

2012-09-13 Thread aaron morton
Yes. If your IDE is starting cassandra the settings from cassandra-env.sh will not be used. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 13/09/2012, at 12:41 PM, Manu Zhang wrote: > I'm afraid we have to include all $JVM_OPT

Re: Schema consistently not propagating to a node.

2012-09-14 Thread aaron morton
Out of interest, how out of sync where they ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/09/2012, at 6:53 AM, Ben Frank wrote: > Hi Sergey, >That was exactly it, thank you! > > -Ben > > On Thu, Sep 13

Re: secondery indexes TTL - strange issues

2012-09-14 Thread aaron morton
you able to do a test with SiezedTieredCompaction ? Are you able to replicate the problem with a fresh testing CF and some test Data? If it's only a problem with imported data can you provide a sample of the failing query ? Any maybe the CF definition ? Cheers -

Re: Composite Column Query Modeling

2012-09-14 Thread aaron morton
/blog/cql3_collections Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/09/2012, at 8:31 AM, Adam Holmberg wrote: > I'm modeling a new application and considering the use of SuperColumn vs. > Composite Column p

Re: Data Model

2012-09-14 Thread aaron morton
umn name is the student ID. * Column value may be blank or some useful value. Hope that helps. ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/09/2012, at 3:19 PM, Michael Morris wrote: > I'm fairly new to Cassandra myself,

Re: Changing bloom filter false positive ratio

2012-09-14 Thread aaron morton
I have a hunch that the SSTable selection based on the Min and Max keys in ColumnFamilyStore.markReferenced() means that a higher false positive has less of an impact. it's just a hunch, i've not tested it. Cheers ----- Aaron Morton Freelance Developer @aaronm

Re: hadoop inserts blow out heap

2012-09-14 Thread aaron morton
Hi Brian did you see my follow up questions here http://www.mail-archive.com/user@cassandra.apache.org/msg24840.html Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 12/09/2012, at 11:52 PM, Brian Jeltema wrote: > I'm a fairl

Re: Reading column names only

2012-09-14 Thread aaron morton
It's not possible to read just the column names. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/09/2012, at 9:05 PM, Robin Verlangen wrote: > Hi there, > > Would it be possible to read only the column names, instead of

Re: Reading column names only

2012-09-16 Thread aaron morton
helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/09/2012, at 9:32 PM, Robin Verlangen wrote: > Hi Aaron, > > Is this something that's worth becoming a feature in the future? Or should I > rework my data model? If so, do you have any

Re: secondery indexes TTL - strange issues

2012-09-16 Thread aaron morton
If you can include DEBUG level logs that would be helpful. Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 14/09/2012, at 10:08 PM, Roland Gude wrote: > I am not sure it is compacting an old file: the same thing happens eeverytime >

Re: Query advice to prevent node overload

2012-09-16 Thread aaron morton
urned query to a few MB's. Otherwise a lot of data get's dragged through cassandra, the network and finally Python. You may want to consider a CF like the inode CF it the article above. Where the parent dir is a column with a secondary index. Cheers - Aaron Morton Fr

Re: Is it possible to create a schema before a Cassandra node starts up ?

2012-09-16 Thread aaron morton
> I have a script that needs to set up a schema first before starting up the > cassandra node. Is this possible ? No. A node must be running to make a DDL change. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/09/2012, at 2

Re: cassandra does not close the stdout console on startup

2012-09-16 Thread aaron morton
Starting with -f backgrounds the process. By default logging is configured to write to stdout, maybe update log4j-server.properties. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/09/2012, at 2:49 AM, "Xu, Zaili&qu

Re: Composite Column Query Modeling

2012-09-16 Thread aaron morton
. Or a secondary index for the s value. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/09/2012, at 3:08 AM, Adam Holmberg wrote: > I think what you're describing might give me what I'm after, but I don't see &

Re: nodetool cfstats and compression

2012-09-17 Thread aaron morton
Yes. It is the space taken up on disk, including compaction. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/09/2012, at 6:30 AM, Jim Ancona wrote: > Do the row size stats reported by 'nodetool cfstats' include th

Re: minor compaction and delete expired column-tombstones

2012-09-17 Thread aaron morton
Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/09/2012, at 6:32 AM, Rene Kochen wrote: > Hi all, > > Does minor compaction delete expired column-tombstones when the row is > also present in another table which is not subject to the

Re: Disk configuration in new cluster node

2012-09-17 Thread aaron morton
g a long time. These are simply soft limits that provide a good rule of thumb for HDD based systems with 1 GigE networking. Hope that helps. ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 15/09/2012, at 7:39 AM, Casey Deccio wrote: > I

Re: Query advice to prevent node overload

2012-09-17 Thread aaron morton
> Could you explain the usage of the "sentinel"? Queries that use a secondary index must include an equality clause. That's the sentinel is there for… > select filename from inode where filename > ‘/tmp’ and filename < ‘/tmq’ and > sentinel = ‘x’; Cheers

Re: Cassandra Messages Dropped

2012-09-17 Thread aaron morton
or ? Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 2:16 AM, Michael Theroux wrote: > Hello, > > While under load, we have occasionally been seeing "messages dropped" errors > in our cassandra log.

Re: Composite Column Types Storage

2012-09-18 Thread aaron morton
t's key/column > indexes to SSTables. No. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 2:44 AM, Ravikumar Govindarajan wrote: > Yes Aaron, I was not clear about Bloom Filters. I was thinking about the > colum

Re: Disk configuration in new cluster node

2012-09-18 Thread aaron morton
eed more machines. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 3:53 AM, Casey Deccio wrote: > On Mon, Sep 17, 2012 at 1:19 AM, aaron morton wrote: >> 4 drives for data and 1 drive for commitlog, >

Re: Cassandra supercolumns with same name

2012-09-18 Thread aaron morton
They are. Can you provide some more information ? What happens when you read the super column ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 5:33 AM, Cyril Auburtin wrote: > First sorry but I'm using an old

Re: Cassandra Messages Dropped

2012-09-18 Thread aaron morton
Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 3:46 PM, Michael Theroux wrote: > Thanks for the response. > > We are on version 1.1.2. We don't see the MutationStage back up. The dump > from the message

Re: persistent compaction issue (1.1.4 and 1.1.5)

2012-09-18 Thread aaron morton
What Compaction Strategy are you using ? Are there any errors in the logs ? If you restart a node how long does it take for the numbers to start to rise ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 7:39 AM, Michael

Re: Is Cassandra right for me?

2012-09-18 Thread aaron morton
s you are comfortable with. Same for the questions about HDFS etc. Start with the smallest about of infrastructure. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 10:28 AM, Marcelo Elias Del Valle wrote: &g

Re: Bloom Filters in Cassandra

2012-09-18 Thread aaron morton
Some more background http://spyced.blogspot.com/2009/01/all-you-ever-wanted-to-know-about.html In additional to the SSTable bloom filter for keys, there are row level bloom filters for columns. Cheers - Aaron Morton Freelance Developer @aaronmorton http

Re: Stream definition is lost after server restart

2012-09-18 Thread aaron morton
What is the query you are using to read the streams ? Can you reduce the fault to "this query is not returning data but it's there" ? Cheers --------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 4:11 PM, Ishan Thilina

Re: HTimedOutException and cluster not working

2012-09-18 Thread aaron morton
t increase MutationStage active and pending values? Check the log for ERRORs Check for failing or overloaded IO. See comment above about memtable flush queue size. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 4:24 PM,

Re: downgrade from 1.1.4 to 1.0.X

2012-09-19 Thread aaron morton
No. They use different minor file versions which are not backwards compatible. Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 18/09/2012, at 11:18 PM, Arend-Jan Wijtzes wrote: > Hi, > > We are running Cassandra 1.1.4 an

Re: Query advice to prevent node overload

2012-09-19 Thread aaron morton
ill return inodes where the file path starts with "/tmp" > select filename from inode where filename >= ‘/tmp/’ and filename < ‘/tmp0’ > and sentinel = ‘x’; > > Would this work? Sounds ok. Cheers - Aaron Morton Freelance Developer @aaronmorto

Re: HTimedOutException and cluster not working

2012-09-19 Thread aaron morton
node-1 failing to write hints to node-3. I forgot to ask, what consistency level are you using for writes ? Have you checked the disk health on node-3 ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 19/09/2012, at 1:10 AM, Jason Wee

Re: updating CF from a mapper-only Hadoop job

2012-09-19 Thread aaron morton
> That job would consistently fail with a flurry of exceptions What were the exceptions ? Cheers ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 19/09/2012, at 2:16 AM, Brian Jeltema wrote: > I wrote a Hadoop mapper-only job tha

Re: Is Cassandra right for me?

2012-09-20 Thread aaron morton
and/or you are technically curious, I would recommend trying Cassandra. Chose a small part of your product and create a Proof of Concept, it should only take a week or so. Make as many mistakes as you can as fast as you can and have fun. Hope that helps. - Aaron M

Re: Row caches

2012-09-20 Thread aaron morton
Set the caching attribute for the CF. It defaults to keys_only, other values are both or rows_only. See http://www.datastax.com/dev/blog/caching-in-cassandra-1-1 Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 19/09/2012, at 1:34 PM

Re: Disk configuration in new cluster node

2012-09-20 Thread aaron morton
ou can expect to comfortably run up 400GB of data (maybe 500GB). That is replicated storage, so 400 / 3 = 133GB if you replicate data 3 times. Hope that helps. - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 19/09/2012, at 3:42 PM, Віталій Ти

Re: Solr Use Cases

2012-09-20 Thread aaron morton
> Also, Cassandra is great for writes but not as optimized for reads. From cassandra 1.0 read throughout on a par with writes http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-0-performance You milage may vary depending on the workload. Cheers ----- Aaron Mor

Re: Setting the default replication factor for Solandra cores

2012-09-20 Thread aaron morton
default is NetworkTopologyStrategy which is the new RAS. Again , this is set as part of the CREATE KEYSPACE command. You can update both using UPDATE KEYSPACE in the cli. Check the operations page in the wiki for info on changing replication. Cheers ----- Aaron Morton Freelance Developer @

Re: Correct model

2012-09-20 Thread aaron morton
t side, get the first N columns from GlobalRequests, make a multi get call to UserRequests NOTE: Assuming the size of the global requests space is not huge. Hope that helps. ----- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 20/09/2012, at 11:1

Re: Losing keyspace on cassandra upgrade

2012-09-21 Thread aaron morton
Have you tried nodetool resetlocalschema on the 1.1.5 ? Cheers - Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 20/09/2012, at 11:41 PM, Thomas Stets wrote: > A follow-up: > > Currently I'm back on version 1.1.1. > > I tr

<    1   2   3   4   5   6   7   8   9   10   >