RE: Retrieving all row keys of a CF

2015-01-29 Thread Ravi Agrawal
Select distinct keys from column family; hits a timeout exception. pk1, pk2,…pkn are 800K in total. From: Mohammed Guller [mailto:moham...@glassbeam.com] Sent: Friday, January 23, 2015 3:24 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF No wonder, the client

RE: Retrieving all row keys of a CF

2015-01-23 Thread Mohammed Guller
: RE: Retrieving all row keys of a CF Hi, I increased range timeout, read timeout to first to 50 secs then 500 secs and Astyanax client to 60, 550 secs respectively. I still get timeout exception. I see the logic with .withCheckpointManager() code, is that the only way it could work? From: Eric

RE: Retrieving all row keys of a CF

2015-01-22 Thread Ravi Agrawal
] Sent: Saturday, January 17, 2015 9:55 AM To: user@cassandra.apache.org Subject: Re: Retrieving all row keys of a CF If you're getting partial data back, then failing eventually, try setting .withCheckpointManager() - this will let you keep track of the token ranges you've successfully processed

RE: Retrieving all row keys of a CF

2015-01-22 Thread Mohammed Guller
CF” You will need to specify all the composite columns if you are using a composite partition key. Mohammed From: Ravi Agrawal [mailto:ragra...@clearpoolgroup.com] Sent: Thursday, January 22, 2015 1:57 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF Hi, I increased

RE: Retrieving all row keys of a CF

2015-01-22 Thread Ravi Agrawal
In each partition cql rows on average is 200K. Max is 3M. 800K is number of cassandra partitions. From: Mohammed Guller [mailto:moham...@glassbeam.com] Sent: Thursday, January 22, 2015 7:43 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF What is the average and max

Re: Retrieving all row keys of a CF

2015-01-17 Thread Eric Stevens
[mailto:moham...@glassbeam.com moham...@glassbeam.com] *Sent:* Friday, January 16, 2015 7:30 PM *To:* user@cassandra.apache.org *Subject:* RE: Retrieving all row keys of a CF A few questions: 1) What is the heap size and total memory on each node? 2) How big is the cluster? 3

Re: Retrieving all row keys of a CF

2015-01-16 Thread Eric Stevens
Note that getAllRows() is deprecated in Astyanax (see here https://github.com/Netflix/astyanax/wiki/Getting-Started#iterate-through-the-entire-keyspace-deprecated ). You should prefer to use the AllRowsReader recipe: https://github.com/Netflix/astyanax/wiki/AllRowsReader-All-rows-query Note the

RE: Retrieving all row keys of a CF

2015-01-16 Thread Mohammed Guller
Ruchir, I am curious if you had better luck with the AllRowsReader recipe. Mohammed From: Eric Stevens [mailto:migh...@gmail.com] Sent: Friday, January 16, 2015 12:33 PM To: user@cassandra.apache.org Subject: Re: Retrieving all row keys of a CF Note that getAllRows() is deprecated in Astyanax

Re: Retrieving all row keys of a CF

2015-01-16 Thread Ravi Agrawal
Hi, I and Ruchir tried query using AllRowsReader recipe but had no luck. We are seeing PoolTimeoutException. SEVERE: [Thread_1] Error reading RowKeys com.netflix.astyanax.connectionpool.exceptions.PoolTimeoutException: PoolTimeoutException: [host=servername, latency=2003(2003), attempts=4]Timed

RE: Retrieving all row keys of a CF

2015-01-16 Thread Mohammed Guller
* nodes? How long does GC for new gen and old gen take? 6) Does any node crash with OOM error when you try AllRowsReader? Mohammed From: Ravi Agrawal [mailto:ragra...@clearpoolgroup.com] Sent: Friday, January 16, 2015 4:14 PM To: user@cassandra.apache.org Subject: Re: Retrieving all row keys

RE: Retrieving all row keys of a CF

2015-01-16 Thread Ravi Agrawal
, January 16, 2015 7:30 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF A few questions: 1) What is the heap size and total memory on each node? 2) How big is the cluster? 3) What are the read and range timeouts (in cassandra.yaml) on the C* nodes? 4

RE: Retrieving all row keys of a CF

2015-01-16 Thread Mohammed Guller
the nodes after increasing the timeout and try again. Mohammed From: Ravi Agrawal [mailto:ragra...@clearpoolgroup.com] Sent: Friday, January 16, 2015 5:11 PM To: user@cassandra.apache.org Subject: RE: Retrieving all row keys of a CF 1)What is the heap size and total memory on each node