[jira] [Updated] (ARROW-5071) [Benchmarking] Performs a benchmark run with archery

2019-04-24 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Francois Saint-Jacques updated ARROW-5071: -- Description: Run all regression benchmarks, consume output and re-format

[jira] [Assigned] (ARROW-5206) [Java] Add APIs in MessageSerializer to directly serialize/deserialize ArrowBuf

2019-04-24 Thread Ji Liu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ji Liu reassigned ARROW-5206: - Assignee: Ji Liu > [Java] Add APIs in MessageSerializer to directly serialize/deserialize > ArrowBuf >

[jira] [Assigned] (ARROW-5207) [Java] add APIs to support vector reuse

2019-04-24 Thread Ji Liu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ji Liu reassigned ARROW-5207: - Assignee: Ji Liu > [Java] add APIs to support vector reuse > --- >

[jira] [Commented] (ARROW-5130) [Python] Segfault when importing TensorFlow after Pyarrow

2019-04-24 Thread Alexander Sergeev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825601#comment-16825601 ] Alexander Sergeev commented on ARROW-5130: -- Wes, would you take a PR that cleans these things

[jira] [Commented] (ARROW-3873) [C++] Build shared libraries consistently with -fvisibility=hidden

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825571#comment-16825571 ] Wes McKinney commented on ARROW-3873: - I just closed https://github.com/apache/arrow/pull/2437 and

[jira] [Assigned] (ARROW-5186) [Plasma] Crash on deleting CUDA memory

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-5186: --- Assignee: shengjun.li > [Plasma] Crash on deleting CUDA memory >

[jira] [Updated] (ARROW-5186) [Plasma] Crash on deleting CUDA memory

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-5186: Summary: [Plasma] Crash on deleting CUDA memory (was: [plasma] carsh on delete gpu memory) >

[jira] [Commented] (ARROW-5130) [Python] Segfault when importing TensorFlow after Pyarrow

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825562#comment-16825562 ] Wes McKinney commented on ARROW-5130: - We aren't doing so on purpose > [Python] Segfault when

[jira] [Updated] (ARROW-4139) [Python] Cast Parquet column statistics to unicode if UTF8 ConvertedType is set

2019-04-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-4139: -- Labels: parquet pull-request-available python (was: parquet python) > [Python] Cast Parquet

[jira] [Commented] (ARROW-5130) [Python] Segfault when importing TensorFlow after Pyarrow

2019-04-24 Thread Alexander Sergeev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825554#comment-16825554 ] Alexander Sergeev commented on ARROW-5130: -- One workaround we found is to LD_PRELOAD 

[jira] [Commented] (ARROW-4717) [C#] Consider exposing ValueTask instead of Task

2019-04-24 Thread Mani Gandham (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825532#comment-16825532 ] Mani Gandham commented on ARROW-4717: - [~jthelin]  Since this is a performance-focused project,

[jira] [Commented] (ARROW-4935) [C++] Errors from jemalloc when building pyarrow from source on OSX and Debian

2019-04-24 Thread Ian Mateus Vieira Manor (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825517#comment-16825517 ] Ian Mateus Vieira Manor commented on ARROW-4935: Solved the jemalloc problem on my

[jira] [Created] (ARROW-5212) Array BinaryBuilder in Go library has no access to resize the values buffer

2019-04-24 Thread Jonathan A Sternberg (JIRA)
Jonathan A Sternberg created ARROW-5212: --- Summary: Array BinaryBuilder in Go library has no access to resize the values buffer Key: ARROW-5212 URL: https://issues.apache.org/jira/browse/ARROW-5212

[jira] [Created] (ARROW-5211) Missing documentation under `Dictionary encoding` section on MetaData page

2019-04-24 Thread Lennox Stevenson (JIRA)
Lennox Stevenson created ARROW-5211: --- Summary: Missing documentation under `Dictionary encoding` section on MetaData page Key: ARROW-5211 URL: https://issues.apache.org/jira/browse/ARROW-5211

[jira] [Commented] (ARROW-4935) [C++] Errors from jemalloc when building pyarrow from source on OSX and Debian

2019-04-24 Thread Ian Mateus Vieira Manor (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825464#comment-16825464 ] Ian Mateus Vieira Manor commented on ARROW-4935: Having the same problem running

[jira] [Assigned] (ARROW-4717) [C#] Consider exposing ValueTask instead of Task

2019-04-24 Thread Eric Erhardt (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Erhardt reassigned ARROW-4717: --- Assignee: Eric Erhardt > [C#] Consider exposing ValueTask instead of Task >

[jira] [Commented] (ARROW-3978) [C++] Implement hashing, dictionary-encoding for StructArray

2019-04-24 Thread Jacques Nadeau (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825451#comment-16825451 ] Jacques Nadeau commented on ARROW-3978: --- Here is some info about what we found worked well. Note

[jira] [Commented] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825426#comment-16825426 ] Joris Van den Bossche commented on ARROW-3176: -- This seems to be a pandas regression:

[jira] [Commented] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825413#comment-16825413 ] Joris Van den Bossche commented on ARROW-3176: -- Actually, I take that back. It seems that it

[jira] [Commented] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825407#comment-16825407 ] Joris Van den Bossche commented on ARROW-3176: -- Yes, I think, ideally, arrow should be

[jira] [Commented] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825405#comment-16825405 ] Wes McKinney commented on ARROW-3176: - This is a limitation with pandas's {{datetime64[ns]}}. One

[jira] [Updated] (ARROW-5208) [Python] Inconsistent resulting type during casting in pa.array() when mask is present

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-5208: Fix Version/s: 0.14.0 > [Python] Inconsistent resulting type during casting in pa.array() when

[jira] [Commented] (ARROW-5208) [Python] Inconsistent resulting type during casting in pa.array() when mask is present

2019-04-24 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825402#comment-16825402 ] Wes McKinney commented on ARROW-5208: - Seems reasonable. Would you like to submit a pull request? >

[jira] [Commented] (ARROW-2835) [C++] ReadAt/WriteAt are inconsistent with moving the files position

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825258#comment-16825258 ] Antoine Pitrou commented on ARROW-2835: --- I see two other ways around this: 1) As soon as ReadAt or

[jira] [Comment Edited] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824911#comment-16824911 ] Joris Van den Bossche edited comment on ARROW-3176 at 4/24/19 2:02 PM:

[jira] [Commented] (ARROW-5210) [Python] editable install (pip install -e .) is failing

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825170#comment-16825170 ] Joris Van den Bossche commented on ARROW-5210: -- The reason it is currently failing is

[jira] [Comment Edited] (ARROW-5210) [Python] editable install (pip install -e .) is failing

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825155#comment-16825155 ] Joris Van den Bossche edited comment on ARROW-5210 at 4/24/19 1:42 PM:

[jira] [Commented] (ARROW-5210) [Python] editable install (pip install -e .) is failing

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16825155#comment-16825155 ] Joris Van den Bossche commented on ARROW-5210: -- With pip 19.1 (released yesterday), one

[jira] [Updated] (ARROW-3767) [C++] Add cast for Null to any type

2019-04-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-3767: -- Labels: pull-request-available (was: ) > [C++] Add cast for Null to any type >

[jira] [Assigned] (ARROW-3767) [C++] Add cast for Null to any type

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-3767: - Assignee: Antoine Pitrou > [C++] Add cast for Null to any type >

[jira] [Updated] (ARROW-5210) [Python] editable install (pip install -e .) is failing

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5210: - Description: Following the python development documentation on building arrow

[jira] [Created] (ARROW-5210) [Python] editable install (pip install -e .) is failing

2019-04-24 Thread Joris Van den Bossche (JIRA)
Joris Van den Bossche created ARROW-5210: Summary: [Python] editable install (pip install -e .) is failing Key: ARROW-5210 URL: https://issues.apache.org/jira/browse/ARROW-5210 Project:

[jira] [Resolved] (ARROW-5204) [C++] Improve BufferBuilder performance

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-5204. --- Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4193

[jira] [Resolved] (ARROW-4934) [Python] Address deprecation notice that will be a bug in Python 3.8

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-4934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche resolved ARROW-4934. -- Resolution: Fixed Apparently https://issues.apache.org/jira/browse/ARROW-5201

[jira] [Assigned] (ARROW-5165) [Python][Documentation] Build docs don't suggest assigning $ARROW_BUILD_TYPE

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-5165: - Assignee: Joris Van den Bossche (was: Rok Mihevc) > [Python][Documentation] Build docs

[jira] [Resolved] (ARROW-5165) [Python][Documentation] Build docs don't suggest assigning $ARROW_BUILD_TYPE

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-5165. --- Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4192

[jira] [Resolved] (ARROW-5201) [Python] Import ABCs from collections is deprecated in Python 3.7

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-5201. --- Resolution: Fixed Fix Version/s: 0.14.0 Issue resolved by pull request 4187

[jira] [Commented] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824911#comment-16824911 ] Joris Van den Bossche commented on ARROW-3176: -- Note that the default type changed: it now

[jira] [Updated] (ARROW-3176) [Python] Overflow in Date32 column conversion to pandas

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-3176: - Description: When converting an arrow column holding a {{Date32Array}} to

[jira] [Updated] (ARROW-5208) [Python] Inconsistent resulting type during casting in pa.array() when mask is present

2019-04-24 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou updated ARROW-5208: -- Summary: [Python] Inconsistent resulting type during casting in pa.array() when mask is

[jira] [Commented] (ARROW-5200) [Java] Provide light-weight arrow APIs

2019-04-24 Thread Liya Fan (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16824900#comment-16824900 ] Liya Fan commented on ARROW-5200: - Sounds reasonable. Thanks a lot for your comments.  We have opened a

[jira] [Created] (ARROW-5209) [Java] Add performance benchmarks from SQL workloads

2019-04-24 Thread Liya Fan (JIRA)
Liya Fan created ARROW-5209: --- Summary: [Java] Add performance benchmarks from SQL workloads Key: ARROW-5209 URL: https://issues.apache.org/jira/browse/ARROW-5209 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-5125) [Python] Cannot roundtrip extreme dates through pyarrow

2019-04-24 Thread Joris Van den Bossche (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joris Van den Bossche updated ARROW-5125: - Labels: parquet windows (was: parquet) > [Python] Cannot roundtrip extreme

[jira] [Updated] (ARROW-5208) Inconsistent resulting type during casting in pa.array() when mask is present

2019-04-24 Thread Artem KOZHEVNIKOV (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artem KOZHEVNIKOV updated ARROW-5208: - Description: I would expect Int64Array type in all cases below : {code:java} >>>

[jira] [Created] (ARROW-5208) Inconsistent resulting type during casting in pa.array() when mask is present

2019-04-24 Thread Artem KOZHEVNIKOV (JIRA)
Artem KOZHEVNIKOV created ARROW-5208: Summary: Inconsistent resulting type during casting in pa.array() when mask is present Key: ARROW-5208 URL: https://issues.apache.org/jira/browse/ARROW-5208