selvavm edited a comment on issue #1533:
URL:
https://github.com/apache/arrow-datafusion/issues/1533#issuecomment-1008620650
Hi @alamb. Thanks for response. I will see if I can do a self contained
reproducer. Sorry, I am new to Parquet files and Datafusion, so having trouble
in understanding it.
I also found that `results` is of size 12 with most of them having 0 rows.
So, I added my code like below,
for batch in results {
for i in 0..batch.num_rows() {
let max = batch
.column(0)
.as_any()
.downcast_ref::<Float32Array>()
.unwrap()
.value(i);
max_col.push(max);
let min = batch
.column(1)
.as_any()
.downcast_ref::<Float32Array>()
.unwrap()
.value(i);
min_col.push(min);
}
}
Not an elegant approach. Is there any util to combine all `Vec<RecordBatch>`
into one `RecordBatch`?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
