If you have a very slow data source (S3), then it fetches 100 row before coming back to your client with all of them and that can take a lot of time. Also make sure that 100 of your rows can fit in a region server's memory. How big is each row?
J-D On Tue, Oct 20, 2009 at 1:32 PM, Ananth T. Sarathy <[email protected]> wrote: > I am running this code where > > getScannerForAllRows(columns) just does return table.getScanner(columns); > > and the table has setScannerCaching(100); > > But it spins forever after getting the iterator. Why would that be? How can > I speed it up? > > HBaseTableDataManagerImpl htdmni = new HBaseTableDataManagerImpl( > "GS_Applications"); > > String[] columns = { "Files:Name" }; > log.info("Getting all Rows with Files"); > Scanner s = htdmni.getScannerForAllRows(columns); > log.info("Got all Rows with Files"); > log.info("Getting Iterator"); > > Iterator<RowResult> iter = s.iterator(); > log.info("Got Iterator"); > > while (iter.hasNext()) > { > log.info("Getting next Row"); > RowResult rr = iter.next(); > > > Ananth T Sarathy >
