Re: Scanning big region parallely

2016-10-21 Thread Sanooj Padmakumar
Thanks Sergey. Let me check this Regards Sanooj On 22 Oct 2016 1:55 a.m., "Sergey Soldatov" wrote: > Hi Sanooj, > > You may take a look at BaseResulterators.getIterators() and > BaseResultIterators.getParallelScans() > > Thanks, > Sergey > > On Fri, Oct 21, 2016 at 6:02 AM, Sanooj Padmakumar

Re: Scanning big region parallely

2016-10-21 Thread Sergey Soldatov
Hi Sanooj, You may take a look at BaseResulterators.getIterators() and BaseResultIterators.getParallelScans() Thanks, Sergey On Fri, Oct 21, 2016 at 6:02 AM, Sanooj Padmakumar wrote: > Hi all > > If anyone can provide some information as to which part of the phoenix > code we need to check to

Re: Scanning big region parallely

2016-10-21 Thread Sanooj Padmakumar
Hi all If anyone can provide some information as to which part of the phoenix code we need to check to see how parallel execution is performed. Thanks again Sanooj On 20 Oct 2016 11:31 a.m., "Sanooj Padmakumar" wrote: > Hi James, > > We are loading data from Phoenix tables into in-memory datab

Re: Scanning big region parallely

2016-10-19 Thread Vivek Paranthaman
Hi, How to get the Schema out of Hbase using Phoenix driver? metadata.getSchemas() produce.. http://stackoverflow.com/questions/40123547/phoenixioexception-nomethodexception-deferredfileoutputstramstring-string-fi On Thu, Oct 20, 2016 at 11:31 AM, Sanooj Padmakumar wrote: > Hi James, > > We are

Re: Scanning big region parallely

2016-10-19 Thread Sanooj Padmakumar
Hi James, We are loading data from Phoenix tables into in-memory database. Based on the query we are finding the number of phoenix input splits (similar to what happens inside phoenix MR) and loads the data into in-memory database in parallel. So we are looking for ways to further parallelize the

Re: Scanning big region parallely

2016-10-19 Thread James Taylor
Hi Sanooj, I'm not sure what you mean by "loading data in our HBase table into in-memory", but Phoenix queries tables in parallel, even within a region depending on how you've configured statistics and guideposts as described here: http://phoenix.apache.org/update_statistics.html Thanks, James On