[
https://issues.apache.org/jira/browse/ARROW-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973717#comment-16973717
]
Anthony Abate commented on ARROW-7156:
--------------------------------------
>From Event viewer:
Faulting application name: rsession.exe, version: 1.2.1335.0, time stamp:
0x5c9d0154
Faulting module name: arrow.dll, version: 0.0.0.0, time stamp: 0x5dc40022
Exception code: 0xc0000005
Fault offset: 0x00000000003e4c05
Faulting process id: 0x8ec
Faulting application start time: 0x01d59a59ff052a76
Faulting application path: C:\software\RStudio\bin\rsession.exe
Faulting module path:
C:\Users\aabate\Documents\R\win-library\3.6\arrow\libs\x64\arrow.dll
Report Id: db7e29f8-54ba-40fc-a104-75d3b6f75d0e
Faulting package full name:
Faulting package-relative application ID:
> [R] [C++] Large Batches Cause Error / Crashes
> ---------------------------------------------
>
> Key: ARROW-7156
> URL: https://issues.apache.org/jira/browse/ARROW-7156
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, R
> Affects Versions: 0.14.1, 0.15.1
> Reporter: Anthony Abate
> Priority: Major
> Attachments: image-2019-11-13-16-27-30-641.png
>
>
> I have a 30 gig arrow file with 100 batches. the largest batch in the file
> causes get batch to fail - All other batches load fine. in 14.11 the
> individual batch errors.. in 15.1.1 the batch crashes R studio when it is used
> *14.1.1*
> {code:java}
> > rbn <- data_rbfr$get_batch(x)
> Error in ipc__RecordBatchFileReader_ReadRecordBatch(self, i) :
> Invalid: negative malloc size
> {code}
> *15.1.1*
> {code:java}
> rbn <- data_rbfr$get_batch(x) works!
> df <- as.data.frame(rbn) - Crashes R Studio! {code}
>
> Update
> I put the data in the batch into a separate file. The file size is over 2
> gigs.
> Using 15.1.1, when I try to load this entire file via read_arrow it also
> fails.
> {code:java}
> ar <- arrow::read_arrow("e:\\temp\\file.arrow")
> Error in Table__from_RecordBatchFileReader(batch_reader) :
> Invalid: negative malloc size{code}
> {color:#c5060b} {color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
