I scanned it during normal traffic hours.There was no I/O load on the server. I dont see any GC locks too. Also i have given 1.5G to RS , 512M to each Master and Zookeeper.
One correction in the post above : Actual time to scan whole table is even more , it takes 10 mins to scan 0.1 million rows ( so total of 2.5 hours to scan 1.6 million rows) . The time i mentioned in previous post was for different type of lookup.Please ignore that. On Mon, Jul 1, 2013 at 2:24 PM, Viral Bajaria <[email protected]>wrote: > When you did the scan, did you check what the bottleneck was ? Was it I/O ? > Did you see any GC locks ? How much RAM are you giving to your RS ? > > -Viral > > On Mon, Jul 1, 2013 at 1:44 AM, Vimal Jain <[email protected]> wrote: > > > To completely scan the table for all 140 columns , it takes around 30-40 > > minutes. > > > -- Thanks and Regards, Vimal Jain
