[
https://issues.apache.org/jira/browse/ARROW-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16942126#comment-16942126
]
Wes McKinney commented on ARROW-6682:
-------------------------------------
[~abbot] it is a problem, but we haven't really figured out what the problem
is. I haven't been able to reproduce the issue so I'm not sure how to proceed
> [C#] Arrow R/C++ hangs reading binary file generated by C#
> ----------------------------------------------------------
>
> Key: ARROW-6682
> URL: https://issues.apache.org/jira/browse/ARROW-6682
> Project: Apache Arrow
> Issue Type: Bug
> Components: C#
> Affects Versions: 0.14.1
> Reporter: Anthony Abate
> Assignee: Eric Erhardt
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.15.0
>
> Attachments: Generated_4000Batch_50Columns_100Rows_PerBatch.rar,
> Generated_4000Batch_50Columns_100Rows_PerBatch.zip, arrow.benchmark.r,
> script.runner.ps1
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> I get random hangs on arrow_read in R (windows) when using a very large file
> (10-12gb). (the file has 37 columns)
> I have memory dumps - All threads seem to be in wait handles.
> Are there debug symbols somewhere?
> Is there a way to get the C++ code to produce diagnostic logging from R?
>
> *UPDATE:* it seems that the hangs are not related to file size, row counts,
> or # of record batches, but rather the number of *columns*
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
