[jira] [Created] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
jiangyu created ARROW-6011: -- Summary: Data incomplete when using pyarrow in pyspark in python 3.x Key: ARROW-6011 URL: https://issues.apache.org/jira/browse/ARROW-6011 Project: Apache Arrow Issue

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   In spark 2.3, pandas udf add to pyspark and pyarrow as a default serialization and

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Attachment: test.csv test.py > Data incomplete when using pyarrow in pyspark in python 3.x >

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   Since spark 2.3, pandas udf have been added to pyspark and pyarrow as a default

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   Since Spark 2.3.x, pandas udf has been introduced as default ser/des method. However,

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   Since Spark 2.3.x, pandas udf has been introduced as default ser/des method. However,

[jira] [Commented] (ARROW-5994) [CI] [Rust] Create nightly releases of the Rust implementation

2019-07-23 Thread Uwe L. Korn (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890743#comment-16890743 ] Uwe L. Korn commented on ARROW-5994: {quote} having published nightly releases {quote}   No, we

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Attachment: worker.png > Data incomplete when using pyarrow in pyspark in python 3.x >

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Attachment: py3.6.png > Data incomplete when using pyarrow in pyspark in python 3.x >

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   Since spark 2.3, pandas udf have been added to pyspark and pyarrow as a default

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   Since spark 2.3, pandas udf have been added to pyspark and pyarrow as a default

[jira] [Updated] (ARROW-6011) Data incomplete when using pyarrow in pyspark in python 3.x

2019-07-23 Thread jiangyu (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiangyu updated ARROW-6011: --- Description: Hi,   Since spark 2.3, pandas udf have been added to pyspark and pyarrow as a default

[jira] [Updated] (ARROW-6007) [Release] Document to use SNAPSHOT versions in pom.xml files for patch releases

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krisztian Szucs updated ARROW-6007: --- Summary: [Release] Document to use SNAPSHOT versions in pom.xml files for patch releases

[jira] [Commented] (ARROW-6007) [Release] Document to use SNAPSHOT versions in pom.xml files for patch releases

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890821#comment-16890821 ] Krisztian Szucs commented on ARROW-6007: Updated the issue title to document is accordingly then.

[jira] [Assigned] (ARROW-5974) [Python][C++] Enable CSV reader to read from concatenated gzip stream

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-5974: - Assignee: Antoine Pitrou > [Python][C++] Enable CSV reader to read from concatenated

[jira] [Updated] (ARROW-5974) [Python][C++] Enable CSV reader to read from concatenated gzip stream

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-5974: -- Labels: pull-request-available (was: ) > [Python][C++] Enable CSV reader to read from

[jira] [Created] (ARROW-6012) [C++] Fall back on known Apache mirror for Thrift downloads

2019-07-23 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-6012: - Summary: [C++] Fall back on known Apache mirror for Thrift downloads Key: ARROW-6012 URL: https://issues.apache.org/jira/browse/ARROW-6012 Project: Apache Arrow

[jira] [Updated] (ARROW-6012) [C++] Fall back on known Apache mirror for Thrift downloads

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6012: -- Labels: pull-request-available (was: ) > [C++] Fall back on known Apache mirror for Thrift

[jira] [Assigned] (ARROW-6012) [C++] Fall back on known Apache mirror for Thrift downloads

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-6012: - Assignee: Antoine Pitrou > [C++] Fall back on known Apache mirror for Thrift downloads

[jira] [Resolved] (ARROW-6012) [C++] Fall back on known Apache mirror for Thrift downloads

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou resolved ARROW-6012. --- Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 4924

[jira] [Updated] (ARROW-6013) [Java] Support range searcher

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6013: -- Labels: pull-request-available (was: ) > [Java] Support range searcher >

[jira] [Created] (ARROW-6014) [Release] Dockerize post-03-website.sh script

2019-07-23 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-6014: -- Summary: [Release] Dockerize post-03-website.sh script Key: ARROW-6014 URL: https://issues.apache.org/jira/browse/ARROW-6014 Project: Apache Arrow Issue

[jira] [Created] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Ruslan Kuprieiev (JIRA)
Ruslan Kuprieiev created ARROW-6015: --- Summary: [Python] pyarrow: `DLL load failed` when importing on windows Key: ARROW-6015 URL: https://issues.apache.org/jira/browse/ARROW-6015 Project: Apache

[jira] [Commented] (ARROW-6004) [C++] CSV reader ignore_empty_lines option doesn't handle empty lines

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890923#comment-16890923 ] Antoine Pitrou commented on ARROW-6004: --- > Correct behavior should be to fill those empty lines

[jira] [Commented] (ARROW-5977) [Python] Method for read_csv to limit which columns are read?

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890878#comment-16890878 ] Antoine Pitrou commented on ARROW-5977: --- [~npr] What do you think? > [Python] Method for read_csv

[jira] [Created] (ARROW-6013) Support range searcher

2019-07-23 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6013: --- Summary: Support range searcher Key: ARROW-6013 URL: https://issues.apache.org/jira/browse/ARROW-6013 Project: Apache Arrow Issue Type: New Feature

[jira] [Updated] (ARROW-6013) [Java] Support range searcher

2019-07-23 Thread Liya Fan (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-6013: Summary: [Java] Support range searcher (was: Support range searcher) > [Java] Support range searcher >

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890927#comment-16890927 ] Krisztian Szucs commented on ARROW-6015: [~efiop] How did you install 0.14.1? Via conda or via

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890927#comment-16890927 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 12:03 PM: --

[jira] [Updated] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Ruslan Kuprieiev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Kuprieiev updated ARROW-6015: Description: When installing pyarrow 0.14.1 on windows 10 x64 with python 3.7, you get:

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Ruslan Kuprieiev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890930#comment-16890930 ] Ruslan Kuprieiev commented on ARROW-6015: - [~kszucs] Pip that comes with vanilla official Python

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890933#comment-16890933 ] Krisztian Szucs commented on ARROW-6015: I suggest you to use 0.14 or conda until it gets

[jira] [Updated] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Ruslan Kuprieiev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruslan Kuprieiev updated ARROW-6015: Description: When installing pyarrow 0.14.1 on windows 10 x64 with python 3.7, you get:

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Ruslan Kuprieiev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890934#comment-16890934 ] Ruslan Kuprieiev commented on ARROW-6015: - [~kszucs] Yep, did that already :) Thanks! > [Python]

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890939#comment-16890939 ] Krisztian Szucs commented on ARROW-6015: I suspect that the missing dso is zlib which is not

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890940#comment-16890940 ] Krisztian Szucs commented on ARROW-6015: We can also rebuild the windows wheels, but don't know

[jira] [Commented] (ARROW-5140) [Bug?][Parquet] Can write a jagged array column of strings to disk, but hit `ArrowNotImplementedError` on read

2019-07-23 Thread Takuya Kato (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890944#comment-16890944 ] Takuya Kato commented on ARROW-5140: On macOS with pyarrow == 0.14.0, I could not reproduce the issue

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890945#comment-16890945 ] Antoine Pitrou commented on ARROW-6015: --- I don't know either. On manylinux we hack around this by

[jira] [Updated] (ARROW-5842) [Java] Revise the semantic of lastSet in ListVector

2019-07-23 Thread Liya Fan (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-5842: Labels: behavior-changes pull-request-available (was: pull-request-available) > [Java] Revise the

[jira] [Updated] (ARROW-5973) [Java] Variable width vectors' get methods should return null when the underlying data is null

2019-07-23 Thread Liya Fan (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-5973: Labels: behavior-changes pull-request-available (was: pull-request-available) > [Java] Variable width

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890954#comment-16890954 ] Krisztian Szucs commented on ARROW-6015: I'm trying to rebuild the windows wheels with bundled

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890954#comment-16890954 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 12:40 PM: -- I'm

[jira] [Commented] (ARROW-5994) [CI] [Rust] Create nightly releases of the Rust implementation

2019-07-23 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890968#comment-16890968 ] Andy Grove commented on ARROW-5994: --- Alright. I'll close this PR and see where I can help overall with

[jira] [Closed] (ARROW-5994) [CI] [Rust] Create nightly releases of the Rust implementation

2019-07-23 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove closed ARROW-5994. - Resolution: Won't Fix > [CI] [Rust] Create nightly releases of the Rust implementation >

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890954#comment-16890954 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 12:53 PM: -- I'm

[jira] [Updated] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread Matthijs Brobbel (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthijs Brobbel updated ARROW-6016: Description: The added code here:

[jira] [Created] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread Matthijs Brobbel (JIRA)
Matthijs Brobbel created ARROW-6016: --- Summary: [Python] pyarrow get_library_dirs assertion error Key: ARROW-6016 URL: https://issues.apache.org/jira/browse/ARROW-6016 Project: Apache Arrow

[jira] [Commented] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890983#comment-16890983 ] Krisztian Szucs commented on ARROW-6016: cc [~pitrou] > [Python] pyarrow get_library_dirs

[jira] [Updated] (ARROW-6005) [C++] parquet::arrow::FileReader::GetRecordBatchReader() does not behave as documented since ARROW-1012

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-6005: Summary: [C++] parquet::arrow::FileReader::GetRecordBatchReader() does not behave as documented

[jira] [Commented] (ARROW-6005) [C++] arrow::FileReader::GetRecordBatchReader() does not behave as documented since ARROW-1012

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891001#comment-16891001 ] Wes McKinney commented on ARROW-6005: - cc [~hatem] > [C++] arrow::FileReader::GetRecordBatchReader()

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891018#comment-16891018 ] Krisztian Szucs commented on ARROW-6015: The patch was cherry picked, so this issue doesn't

[jira] [Commented] (ARROW-5995) [Python] pyarrow: hdfs: support file checksum

2019-07-23 Thread Ruslan Kuprieiev (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891017#comment-16891017 ] Ruslan Kuprieiev commented on ARROW-5995: - [~wesmckinn] I am aware that libhdfs3 is not

[jira] [Commented] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891016#comment-16891016 ] Antoine Pitrou commented on ARROW-6016: --- When you say "from the bintray repositories", which

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891071#comment-16891071 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 2:34 PM: - I'm

[jira] [Updated] (ARROW-5140) [Bug?][Parquet] Can write a jagged array column of strings to disk, but hit `ArrowNotImplementedError` on read

2019-07-23 Thread Zachary Jablons (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zachary Jablons updated ARROW-5140: --- Fix Version/s: 0.14.0 > [Bug?][Parquet] Can write a jagged array column of strings to disk,

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891118#comment-16891118 ] Antoine Pitrou commented on ARROW-6015: --- You mean the zlib isn't always available on macOS? >

[jira] [Assigned] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-6016: - Assignee: Antoine Pitrou > [Python] pyarrow get_library_dirs assertion error >

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891046#comment-16891046 ] Antoine Pitrou commented on ARROW-6015: --- I confirm that the 3.6 wheel seems to load zlib.dll from

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891047#comment-16891047 ] Antoine Pitrou commented on ARROW-6015: --- I confirm that the 3.6 wheel seems to load zlib.dll from

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891071#comment-16891071 ] Krisztian Szucs commented on ARROW-6015: I'm afraid the same issue affect the OSX wheels: {code}

[jira] [Commented] (ARROW-6004) [C++] CSV reader ignore_empty_lines option doesn't handle empty lines

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891078#comment-16891078 ] Antoine Pitrou commented on ARROW-6004: --- Pandas does this: {code:python} >>>

[jira] [Commented] (ARROW-5140) [Bug?][Parquet] Can write a jagged array column of strings to disk, but hit `ArrowNotImplementedError` on read

2019-07-23 Thread Zachary Jablons (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891100#comment-16891100 ] Zachary Jablons commented on ARROW-5140: Hey there, I tested it on Deb8 with pyarrow 0.14.0 and

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890998#comment-16890998 ] Krisztian Szucs commented on ARROW-6015: Agree with the removal of 0.14.1 windows wheels. I don't

[jira] [Updated] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6016: -- Labels: pull-request-available (was: ) > [Python] pyarrow get_library_dirs assertion error >

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891058#comment-16891058 ] Antoine Pitrou commented on ARROW-6015: --- I don't think so? > [Python] pyarrow: `DLL load failed`

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891005#comment-16891005 ] Wes McKinney commented on ARROW-6015: - You're listed as a maintainer on

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891006#comment-16891006 ] Wes McKinney commented on ARROW-6015: - Please also remove the 0.14.0 Windows wheels > [Python]

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891021#comment-16891021 ] Wes McKinney commented on ARROW-6015: - I see. I'm surprised that

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891027#comment-16891027 ] Krisztian Szucs commented on ARROW-6015: Thought the same. I think cmake picks up the dynamic

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891027#comment-16891027 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 1:48 PM: - Thought

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891027#comment-16891027 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 1:48 PM: - Thought

[jira] [Updated] (ARROW-6000) [Python] Expose LargeBinaryType and LargeStringType

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6000: -- Labels: pull-request-available (was: ) > [Python] Expose LargeBinaryType and LargeStringType

[jira] [Assigned] (ARROW-6004) [C++] CSV reader ignore_empty_lines option doesn't handle empty lines

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-6004: - Assignee: Antoine Pitrou > [C++] CSV reader ignore_empty_lines option doesn't handle

[jira] [Assigned] (ARROW-6000) [Python] Expose LargeBinaryType and LargeStringType

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antoine Pitrou reassigned ARROW-6000: - Assignee: Antoine Pitrou > [Python] Expose LargeBinaryType and LargeStringType >

[jira] [Commented] (ARROW-6001) Add from_pydict(), from_pylist() and to_pylist() to pyarrow.Table + improve pandas.to_dict()

2019-07-23 Thread David Lee (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891152#comment-16891152 ] David Lee commented on ARROW-6001: --   Table.from_dict in 0.14.1 looks fine. The code I originally

[jira] [Created] (ARROW-6017) [FlightRPC] Allow creating Locations with unknown schemes

2019-07-23 Thread lidavidm (JIRA)
lidavidm created ARROW-6017: --- Summary: [FlightRPC] Allow creating Locations with unknown schemes Key: ARROW-6017 URL: https://issues.apache.org/jira/browse/ARROW-6017 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890990#comment-16890990 ] Krisztian Szucs commented on ARROW-6015: The produced wheels are going to be available at the

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891028#comment-16891028 ] Antoine Pitrou commented on ARROW-6015: --- Right. CMake does not have a way of saying "prefer the

[jira] [Commented] (ARROW-6004) [C++] CSV reader ignore_empty_lines option doesn't handle empty lines

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891011#comment-16891011 ] Wes McKinney commented on ARROW-6004: - Hm, I am not sure about this. What do other CSV readers do

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891012#comment-16891012 ] Krisztian Szucs commented on ARROW-6015: Why should we remove the 0.14.0 wheels? > [Python]

[jira] [Assigned] (ARROW-6005) [C++] parquet::arrow::FileReader::GetRecordBatchReader() does not behave as documented since ARROW-1012

2019-07-23 Thread Hatem Helal (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hatem Helal reassigned ARROW-6005: -- Assignee: Hatem Helal Sorry about breaking this but it seems we need a regression test for

[jira] [Commented] (ARROW-6016) [Python] pyarrow get_library_dirs assertion error

2019-07-23 Thread Matthijs Brobbel (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891023#comment-16891023 ] Matthijs Brobbel commented on ARROW-6016: - I'm installing everything: {{libarrow-dev

[jira] [Updated] (ARROW-5575) arrowConfig.cmake includes uninstalled targets

2019-07-23 Thread Matthijs Brobbel (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthijs Brobbel updated ARROW-5575: Affects Version/s: 0.14.1 > arrowConfig.cmake includes uninstalled targets >

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891128#comment-16891128 ] Krisztian Szucs commented on ARROW-6015: Since OSX mojave it is not shipped by default, might

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890993#comment-16890993 ] Wes McKinney commented on ARROW-6015: - This is definitely sad. Do we need to remove the wheels from

[jira] [Commented] (ARROW-5995) [Python] pyarrow: hdfs: support file checksum

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891002#comment-16891002 ] Wes McKinney commented on ARROW-5995: - libhdfs3 is unmaintained software so I am likely to -1 any

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891013#comment-16891013 ] Wes McKinney commented on ARROW-6015: - Surely they have the exact same problem, unless a patch was

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891056#comment-16891056 ] Krisztian Szucs commented on ARROW-6015: But we don't really have any way to publish is, right?

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891071#comment-16891071 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 2:31 PM: - I'm

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891071#comment-16891071 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 2:30 PM: - I'm

[jira] [Comment Edited] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891071#comment-16891071 ] Krisztian Szucs edited comment on ARROW-6015 at 7/23/19 2:39 PM: - I'm

[jira] [Commented] (ARROW-6015) [Python] pyarrow: `DLL load failed` when importing on windows

2019-07-23 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891082#comment-16891082 ] Krisztian Szucs commented on ARROW-6015: This is extremely annoying, I can revert the windows and

[jira] [Commented] (ARROW-6017) [FlightRPC] Allow creating Locations with unknown schemes

2019-07-23 Thread Antoine Pitrou (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891142#comment-16891142 ] Antoine Pitrou commented on ARROW-6017: --- Sounds fine to me. > [FlightRPC] Allow creating Locations

[jira] [Updated] (ARROW-6008) [Release] Don't parallelize the bintray upload script

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-6008: -- Labels: pull-request-available (was: ) > [Release] Don't parallelize the bintray upload

[jira] [Updated] (ARROW-5935) [C++] ArrayBuilders with mutable type are not robustly supported

2019-07-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-5935: -- Labels: pull-request-available (was: ) > [C++] ArrayBuilders with mutable type are not

[jira] [Updated] (ARROW-6007) [Release] Document to use SNAPSHOT versions in pom.xml files for patch releases

2019-07-23 Thread Sutou Kouhei (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6007: Fix Version/s: (was: 1.0.0) > [Release] Document to use SNAPSHOT versions in pom.xml files for

[jira] [Updated] (ARROW-6007) [Release] Document to use SNAPSHOT versions in pom.xml files for patch releases

2019-07-23 Thread Sutou Kouhei (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei updated ARROW-6007: Component/s: Documentation > [Release] Document to use SNAPSHOT versions in pom.xml files for

[jira] [Reopened] (ARROW-6007) [Release] Document to use SNAPSHOT versions in pom.xml files for patch releases

2019-07-23 Thread Sutou Kouhei (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sutou Kouhei reopened ARROW-6007: - > [Release] Document to use SNAPSHOT versions in pom.xml files for patch > releases >

[jira] [Updated] (ARROW-5988) [Java] Avro adapter implement simple Record type

2019-07-23 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield updated ARROW-5988: --- Component/s: Java > [Java] Avro adapter implement simple Record type >

[jira] [Resolved] (ARROW-5988) [Java] Avro adapter implement simple Record type

2019-07-23 Thread Micah Kornfield (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-5988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Micah Kornfield resolved ARROW-5988. Resolution: Fixed Fix Version/s: 1.0.0 Issue resolved by pull request 4910

  1   2   >