Re: Merge multiple record batches

2018-02-19 Thread Wes McKinney
em. >> >> I didn’t try, but I think that you can go both ways and then tell us if >> the result is the same and if one of the two is faster then the other. >> >> Alberto >> >> Da: Rares Vernica<mailto:rvern...@gmail.com> >> Inviato: mercoledì 14

Re: Merge multiple record batches

2018-02-19 Thread Bryan Cutler
t; the result is the same and if one of the two is faster then the other. > > Alberto > > Da: Rares Vernica<mailto:rvern...@gmail.com> > Inviato: mercoledì 14 febbraio 2018 05:13 > A: dev@arrow.apache.org<mailto:dev@arrow.apache.org> > Oggetto: Merge m

R: Merge multiple record batches

2018-02-14 Thread ALBERTO Bocchinfuso
<mailto:rvern...@gmail.com> Inviato: mercoledì 14 febbraio 2018 05:13 A: dev@arrow.apache.org<mailto:dev@arrow.apache.org> Oggetto: Merge multiple record batches Hi, If I have multiple RecordBatchStreamReader inputs, what is the recommended way to get all the RecordBatch from al

Merge multiple record batches

2018-02-13 Thread Rares Vernica
Hi, If I have multiple RecordBatchStreamReader inputs, what is the recommended way to get all the RecordBatch from all the inputs together, maybe in a Table? They all have the same schema. The source for the readers are different files. So, I do something like: reader1 = pa.open_stream('foo')