[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-20 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911098#comment-16911098 ] Micah Kornfield commented on ARROW-6202: OK, so even with the old API due to how the allocator

[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-13 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906377#comment-16906377 ] Micah Kornfield commented on ARROW-6202: Sorry should clarify above. With an 800mb of data I

[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-13 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906332#comment-16906332 ] Micah Kornfield commented on ARROW-6202: Thanks for the update.  The code on master might still

[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-13 Thread Jim Northrup (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905982#comment-16905982 ] Jim Northrup commented on ARROW-6202: - for the record we have pre-tensorflow column counts of about

[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-13 Thread Jim Northrup (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905974#comment-16905974 ] Jim Northrup commented on ARROW-6202: - full program execution below, stderr. record count 6.6 million

[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-12 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905620#comment-16905620 ] Micah Kornfield commented on ARROW-6202: Specifically, I think there was at least one memory leak

[jira] [Commented] (ARROW-6202) [Java] Exception in thread "main" org.apache.arrow.memory.OutOfMemoryException: Unable to allocate buffer of size 4 due to memory limit. Current allocation: 2147483646

2019-08-12 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905577#comment-16905577 ] Micah Kornfield commented on ARROW-6202: Is it possible to share a sample file or at least a