Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-25 Thread Mina Naguib
On 2012-11-24, at 10:37 AM, Chuan-Heng Hsiao hsiao.chuanh...@gmail.com wrote: However, I continue seeing the following in /var/log/cassandra/system.log INFO [HintedHandoff:1] 2012-11-24 22:58:28,088 HintedHandOffManager.java (line 296) Started hinted handoff for token:

Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-25 Thread Chuan-Heng Hsiao
Hi Mina, Thank you very much for replying. My machines are running Oracle java 1.7.09. so that might be the issue. (My machines are running Oracle java 1.7.09 from the beginning.) I cleaned up the specific empty CF again, and the hinted handoff of 0 rows showed up again, and the scrub system

continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-24 Thread Chuan-Heng Hsiao
Hi Cassandra Devs, I intended to reduce the size of the db by the following steps: 1. removing all keys from one cf (somehow I can get all keys from the cf). 2. run nodetool cleanup on that cf one-node-by-one-node. the size of the cf on one node is about 150 G, I've made another cf with the

Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-24 Thread Michael Kjellman
Some people (myself included) have seen issues when upgrading from 1.1.2 to 1.1.6 with tombstoned rows in the HintsColumnFamily Some (mysql included) have fixed this by doing a nodetool scrub system HintsColumnFamily -mike On 11/24/12 7:37 AM, Chuan-Heng Hsiao hsiao.chuanh...@gmail.com wrote:

Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-24 Thread Michael Kjellman
Sorry, auto correct changed 'myself' to 'mysql'. Sorry for the confusion... On Nov 24, 2012, at 9:29 AM, Michael Kjellman mkjell...@barracuda.com wrote: Some people (myself included) have seen issues when upgrading from 1.1.2 to 1.1.6 with tombstoned rows in the HintsColumnFamily Some

Re: continue seeing Finished hinted handoff of 0 rows to endpoint

2012-11-24 Thread Chuan-Heng Hsiao
Hi Mike and Cassandra Devs, It seems like the reason was because I was trying to cleanup 2 CFs at the same time. The scrub command successfully snapshoot HintsColumnFamily, but seems hanged also (maybe because I did not stop cleanup.) I ended up restarting the node, and redoing the cleanup