[
https://issues.apache.org/jira/browse/ARROW-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anthony Abate updated ARROW-7156:
---------------------------------
Description:
I have a 30 gig arrow file with 100 batches. the largest batch in the file
causes get batch to fail - All other batches load fine.
I dont know if this is fixed in 15.x because 15.x fails to load the file
(another bug)
{color:#0000FF}> {color}{color:#0000FF} rbn <-
data_rbfr$get_batch(4){color}{color:#c5060b}Error in
ipc___RecordBatchFileReader__ReadRecordBatch(self, i) :
Invalid: negative malloc size{color}
was:
I have a 30 gig arrow file with 100 batches. the largest batch in the file
causes get batch to fail - All other batches load fine.
I dont know if this is fixed in 15.x because 15.x fails to load the file
(another bug)
> [R] [C++] get_batch - failes for large batches
> ----------------------------------------------
>
> Key: ARROW-7156
> URL: https://issues.apache.org/jira/browse/ARROW-7156
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, R
> Affects Versions: 0.14.1
> Reporter: Anthony Abate
> Priority: Major
>
> I have a 30 gig arrow file with 100 batches. the largest batch in the file
> causes get batch to fail - All other batches load fine.
> I dont know if this is fixed in 15.x because 15.x fails to load the file
> (another bug)
>
> {color:#0000FF}> {color}{color:#0000FF} rbn <-
> data_rbfr$get_batch(4){color}{color:#c5060b}Error in
> ipc___RecordBatchFileReader__ReadRecordBatch(self, i) :
> Invalid: negative malloc size{color}
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
