I'm trying to see how performance differs with different batch sizes. My table has 13 integer fields and 1 string field, and has 8M records. Following the code with a debugger, there seem to be 4096 records in a batch. Can this be 8192 or larger?
On Tue, Jul 5, 2016 at 6:47 PM, Abdel Hakim Deneche <[email protected]> wrote: > hey Eric, > > Can you give more information about what you are trying to achieve ? > > Thanks > > On Tue, Jul 5, 2016 at 3:41 PM, Eric Fukuda <[email protected]> wrote: > > > Hi, > > > > Does anyone know if there is a way to increase or specify the number of > > records per batch manually? > > > > Thanks, > > Eric > > > > > > -- > > Abdelhakim Deneche > > Software Engineer > > <http://www.mapr.com/> > > > Now Available - Free Hadoop On-Demand Training > < > http://www.mapr.com/training?utm_source=Email&utm_medium=Signature&utm_campaign=Free%20available > > >
