[jira] [Created] (ARROW-1330) [Plasma] Turn on plasma tests on manylinux1

2017-08-03 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-1330: - Summary: [Plasma] Turn on plasma tests on manylinux1 Key: ARROW-1330 URL: https://issues.apache.org/jira/browse/ARROW-1330 Project: Apache Arrow Issue

[jira] [Updated] (ARROW-1311) python hangs after write a few parquet tables

2017-08-03 Thread Keith Curtis (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keith Curtis updated ARROW-1311: Description: I had a program to read some csv files (a few million rows each, 9 columns), and

[jira] [Updated] (ARROW-1311) python hangs after write a few parquet tables

2017-08-03 Thread Keith Curtis (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Keith Curtis updated ARROW-1311: Attachment: thread-apply-all-bt-full.txt Okay, to get the new backtrace, attached, I had to install

[jira] [Resolved] (ARROW-1224) [Format] Clarify language around buffer padding and alignment in IPC

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1224. - Resolution: Fixed Issue resolved by pull request 932 [https://github.com/apache/arrow/pull/932]

[jira] [Resolved] (ARROW-1043) [Python] Make sure pandas metadata created by arrow conforms to the pandas spec

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1043. - Resolution: Fixed Fix Version/s: (was: 0.6.0) 0.5.0 I'm resolving

[jira] [Resolved] (ARROW-1256) [Plasma] Fix compile warnings on macOS

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1256. - Resolution: Not A Problem Assignee: Wes McKinney The one related compiler warning is not

[jira] [Updated] (ARROW-473) [C++/Python] Add public API for retrieving block locations for a particular HDFS file

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-473: --- Fix Version/s: (was: 0.6.0) 0.7.0 > [C++/Python] Add public API for retrieving

[jira] [Updated] (ARROW-1313) [C++/Python] Add troubleshooting section for setting up HDFS JNI interface

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1313: Fix Version/s: (was: 0.6.0) 0.7.0 > [C++/Python] Add troubleshooting section

[jira] [Updated] (ARROW-759) [Python] Implement a transient list serialization function that can handle a mix of scalars, lists, ndarrays, dicts

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-759: --- Fix Version/s: (was: 0.6.0) 0.7.0 > [Python] Implement a transient list

[jira] [Commented] (ARROW-232) C++/Parquet: Support writing chunked arrays as part of a table

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113313#comment-16113313 ] Wes McKinney commented on ARROW-232: Moving this to 0.7.0; there are a number of interrelated issues

[jira] [Updated] (ARROW-232) C++/Parquet: Support writing chunked arrays as part of a table

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-232: --- Fix Version/s: (was: 0.6.0) 0.7.0 > C++/Parquet: Support writing chunked arrays

[jira] [Resolved] (ARROW-1310) [JAVA] Revert ARROW-886

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1310. - Resolution: Fixed Issue resolved by pull request 937 [https://github.com/apache/arrow/pull/937]

[jira] [Commented] (ARROW-1328) [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column values

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113105#comment-16113105 ] Wes McKinney commented on ARROW-1328: - Marked for 0.6.0. I would like to do away with the

[jira] [Updated] (ARROW-1328) [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column values

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1328: Fix Version/s: 0.6.0 > [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column >

[jira] [Created] (ARROW-1328) [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column values

2017-08-03 Thread Florian Jetter (JIRA)
Florian Jetter created ARROW-1328: - Summary: [Python] pyarrow.Table.from_pandas option timestamps_to_ms changes column values Key: ARROW-1328 URL: https://issues.apache.org/jira/browse/ARROW-1328

[jira] [Comment Edited] (ARROW-1327) [Python] Failing to release GIL in MemoryMappedFile._open causes deadlock

2017-08-03 Thread Chris Bartak (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112732#comment-16112732 ] Chris Bartak edited comment on ARROW-1327 at 8/3/17 1:55 PM: - Thanks!

[jira] [Comment Edited] (ARROW-1327) [Python] Failing to release GIL in MemoryMappedFile._open causes deadlock

2017-08-03 Thread Chris Bartak (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112732#comment-16112732 ] Chris Bartak edited comment on ARROW-1327 at 8/3/17 1:55 PM: - Thanks!

[jira] [Commented] (ARROW-1327) [Python] Failing to release GIL in MemoryMappedFile._open causes deadlock

2017-08-03 Thread Chris Bartak (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112732#comment-16112732 ] Chris Bartak commented on ARROW-1327: - Thanks! Apparently this came up because `mod_wsgi` uses

[jira] [Commented] (ARROW-1282) Large memory reallocation by Arrow causes hang in jemalloc

2017-08-03 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112706#comment-16112706 ] Wes McKinney commented on ARROW-1282: - Awesome, yeah! The GIL is not being released here

[jira] [Created] (ARROW-1327) [Python] Failing to release GIL in MemoryMappedFile._open causes deadlock

2017-08-03 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1327: --- Summary: [Python] Failing to release GIL in MemoryMappedFile._open causes deadlock Key: ARROW-1327 URL: https://issues.apache.org/jira/browse/ARROW-1327 Project:

[jira] [Comment Edited] (ARROW-1282) Large memory reallocation by Arrow causes hang in jemalloc

2017-08-03 Thread Chris Bartak (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112693#comment-16112693 ] Chris Bartak edited comment on ARROW-1282 at 8/3/17 1:22 PM: - Here's a

[jira] [Commented] (ARROW-1282) Large memory reallocation by Arrow causes hang in jemalloc

2017-08-03 Thread Chris Bartak (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112693#comment-16112693 ] Chris Bartak commented on ARROW-1282: - Here's a backtrace - I guess it's actually hanging on

[jira] [Comment Edited] (ARROW-1282) Large memory reallocation by Arrow causes hang in jemalloc

2017-08-03 Thread Chris Bartak (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112693#comment-16112693 ] Chris Bartak edited comment on ARROW-1282 at 8/3/17 1:20 PM: - Here's a

[jira] [Updated] (ARROW-1311) python hangs after write a few parquet tables

2017-08-03 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated ARROW-1311: --- Description: I had a program to read some csv files (a few million rows each, 9 columns), and

[jira] [Commented] (ARROW-1311) python hangs after write a few parquet tables

2017-08-03 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112378#comment-16112378 ] Uwe L. Korn commented on ARROW-1311: Two things I see in this BT: * The size change is quite small:

[jira] [Commented] (ARROW-1302) C++: ${MAKE} variable not set sometimes on older MacOS installations

2017-08-03 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112364#comment-16112364 ] Uwe L. Korn commented on ARROW-1302: No, this would break all builds that are not based on Unix