[jira] [Resolved] (ARROW-1429) [Python] Error loading parquet file with _metadata from HDFS

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1429. - Resolution: Fixed Issue resolved by pull request 1013 [https://github.com/apache/arrow/pull/1013]

[jira] [Commented] (ARROW-837) [Python] Expose buffer allocation, FixedSizeBufferWriter

[ https://issues.apache.org/jira/browse/ARROW-837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146581#comment-16146581 ] Wes McKinney commented on ARROW-837: PR: https://github.com/apache/arrow/pull/1014 > [Python] Expose

[jira] [Assigned] (ARROW-1377) [Python] Add function to assist with benchmarking Parquet scan performance

[ https://issues.apache.org/jira/browse/ARROW-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1377: --- Assignee: Wes McKinney > [Python] Add function to assist with benchmarking Parquet scan

[jira] [Commented] (ARROW-1433) [C++] Simplify implementation of Array::Slice

[ https://issues.apache.org/jira/browse/ARROW-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146253#comment-16146253 ] Wes McKinney commented on ARROW-1433: - PR: https://github.com/apache/arrow/pull/1011 > [C++] Simplify

[jira] [Assigned] (ARROW-1433) [C++] Simplify implementation of Array::Slice

[ https://issues.apache.org/jira/browse/ARROW-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1433: --- Assignee: Wes McKinney > [C++] Simplify implementation of Array::Slice >

[jira] [Updated] (ARROW-1116) [Python] Create single external GitHub repo building for building wheels for all platforms in one shot

[ https://issues.apache.org/jira/browse/ARROW-1116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1116: Fix Version/s: (was: 0.7.0) 1.0.0 > [Python] Create single external GitHub

[jira] [Created] (ARROW-1433) [C++] Simplify implementation of Array::Slice

Wes McKinney created ARROW-1433: --- Summary: [C++] Simplify implementation of Array::Slice Key: ARROW-1433 URL: https://issues.apache.org/jira/browse/ARROW-1433 Project: Apache Arrow Issue Type:

[jira] [Resolved] (ARROW-1302) C++: ${MAKE} variable not set sometimes on older MacOS installations

[ https://issues.apache.org/jira/browse/ARROW-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1302. - Resolution: Fixed Issue resolved by pull request 1010 [https://github.com/apache/arrow/pull/1010]

[jira] [Assigned] (ARROW-229) [C++] Implement safe casts for primitive types

[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-229: -- Assignee: Wes McKinney > [C++] Implement safe casts for primitive types >

[jira] [Commented] (ARROW-229) [C++] Implement safe casts for primitive types

[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146125#comment-16146125 ] Wes McKinney commented on ARROW-229: hi [~ankit5012], would it be OK if I took an initial pass at

[jira] [Commented] (ARROW-229) [C++] Implement safe casts for primitive types

[ https://issues.apache.org/jira/browse/ARROW-229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146058#comment-16146058 ] Ankit Aggarwal commented on ARROW-229: -- Hi Wes I have created a gist for this

[jira] [Created] (ARROW-1432) [C++] Build bundled jemalloc functions with private prefix

Uwe L. Korn created ARROW-1432: -- Summary: [C++] Build bundled jemalloc functions with private prefix Key: ARROW-1432 URL: https://issues.apache.org/jira/browse/ARROW-1432 Project: Apache Arrow

[jira] [Updated] (ARROW-1429) [Python] Error loading parquet file with _metadata from HDFS

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1429: Summary: [Python] Error loading parquet file with _metadata from HDFS (was: Error loading parquet

[jira] [Updated] (ARROW-1428) Append steps to clone source code to README.mb

[ https://issues.apache.org/jira/browse/ARROW-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1428: Fix Version/s: 0.7.0 > Append steps to clone source code to README.mb >

[jira] [Resolved] (ARROW-1428) Append steps to clone source code to README.mb

[ https://issues.apache.org/jira/browse/ARROW-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1428. - Resolution: Fixed Issue resolved by pull request 1007 [https://github.com/apache/arrow/pull/1007]

[jira] [Assigned] (ARROW-1428) Append steps to clone source code to README.mb

[ https://issues.apache.org/jira/browse/ARROW-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1428: --- Assignee: Sasaki Nobuya > Append steps to clone source code to README.mb >

[jira] [Updated] (ARROW-1428) [C++] Append steps to clone source code to README.mb

[ https://issues.apache.org/jira/browse/ARROW-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1428: Summary: [C++] Append steps to clone source code to README.mb (was: Append steps to clone source

[jira] [Assigned] (ARROW-1427) Add a link to readme of Arrow GLib

[ https://issues.apache.org/jira/browse/ARROW-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1427: --- Assignee: Tetsutaro Endo > Add a link to readme of Arrow GLib >

[jira] [Updated] (ARROW-1427) [GLib] Add a link to readme of Arrow GLib

[ https://issues.apache.org/jira/browse/ARROW-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1427: Fix Version/s: 0.7.0 > [GLib] Add a link to readme of Arrow GLib >

[jira] [Resolved] (ARROW-1427) Add a link to readme of Arrow GLib

[ https://issues.apache.org/jira/browse/ARROW-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1427. - Resolution: Fixed Issue resolved by pull request 1008 [https://github.com/apache/arrow/pull/1008]

[jira] [Resolved] (ARROW-1418) [Python] Introduce SerializationContext to register custom serialization callbacks

[ https://issues.apache.org/jira/browse/ARROW-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-1418. - Resolution: Fixed Issue resolved by pull request 1002 [https://github.com/apache/arrow/pull/1002]

[jira] [Assigned] (ARROW-1418) [Python] Introduce SerializationContext to register custom serialization callbacks

[ https://issues.apache.org/jira/browse/ARROW-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1418: --- Assignee: Philipp Moritz > [Python] Introduce SerializationContext to register custom

[jira] [Updated] (ARROW-1426) [Website] The title element of the top page is empty

[ https://issues.apache.org/jira/browse/ARROW-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1426: Summary: [Website] The title element of the top page is empty (was: The title element of the top

[jira] [Commented] (ARROW-1302) C++: ${MAKE} variable not set sometimes on older MacOS installations

[ https://issues.apache.org/jira/browse/ARROW-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145725#comment-16145725 ] Uwe L. Korn commented on ARROW-1302: PR: https://github.com/apache/arrow/pull/1010 > C++: ${MAKE}

[jira] [Created] (ARROW-1431) [Java] JsonFileReader doesn't intialize some vectors approperately

Li Jin created ARROW-1431: - Summary: [Java] JsonFileReader doesn't intialize some vectors approperately Key: ARROW-1431 URL: https://issues.apache.org/jira/browse/ARROW-1431 Project: Apache Arrow

[jira] [Created] (ARROW-1430) [Python] flake8 warnings are not failing CI builds

Wes McKinney created ARROW-1430: --- Summary: [Python] flake8 warnings are not failing CI builds Key: ARROW-1430 URL: https://issues.apache.org/jira/browse/ARROW-1430 Project: Apache Arrow Issue

[jira] [Comment Edited] (ARROW-1209) [C++] Implement converter between Arrow record batches and Avro records

[ https://issues.apache.org/jira/browse/ARROW-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145385#comment-16145385 ] Wes McKinney edited comment on ARROW-1209 at 8/29/17 2:37 PM: -- We should

[jira] [Commented] (ARROW-1209) [C++] Implement converter between Arrow record batches and Avro records

[ https://issues.apache.org/jira/browse/ARROW-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145385#comment-16145385 ] Wes McKinney commented on ARROW-1209: - We should create an {{src/arrow/adapters}} directory where we

[jira] [Commented] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145358#comment-16145358 ] Brecht Machiels commented on ARROW-1429: I managed to fix the issue with this simple adjustment:

[jira] [Updated] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1429: Fix Version/s: 0.7.0 > Error loading parquet file with _metadata from HDFS >

[jira] [Commented] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145348#comment-16145348 ] Wes McKinney commented on ARROW-1429: - Thanks. Seems like there are a couple of improvements that can

[jira] [Comment Edited] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145257#comment-16145257 ] Brecht Machiels edited comment on ARROW-1429 at 8/29/17 1:14 PM: - After

[jira] [Commented] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145257#comment-16145257 ] Brecht Machiels commented on ARROW-1429: After renaming {{_metadata}} to {{metadata}}, the tables

[jira] [Updated] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brecht Machiels updated ARROW-1429: --- Description: I can open tables stored on HDFS as long as there is no _metadata file besides

[jira] [Comment Edited] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145237#comment-16145237 ] Brecht Machiels edited comment on ARROW-1429 at 8/29/17 12:58 PM: -- For

[jira] [Commented] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

[ https://issues.apache.org/jira/browse/ARROW-1429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145237#comment-16145237 ] Brecht Machiels commented on ARROW-1429: For the last table (IndexError), this is because the

[jira] [Created] (ARROW-1429) Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file)

Brecht Machiels created ARROW-1429: -- Summary: Error loading parquet file with _metadata from HDFS (pyarrow.lib.ArrowIOError: Failed to open local file) Key: ARROW-1429 URL:

[jira] [Created] (ARROW-1428) Append steps to clone source code to README.mb

Sasaki Nobuya created ARROW-1428: Summary: Append steps to clone source code to README.mb Key: ARROW-1428 URL: https://issues.apache.org/jira/browse/ARROW-1428 Project: Apache Arrow Issue

[jira] [Created] (ARROW-1427) Add a link to readme of Arrow GLib

Tetsutaro Endo created ARROW-1427: - Summary: Add a link to readme of Arrow GLib Key: ARROW-1427 URL: https://issues.apache.org/jira/browse/ARROW-1427 Project: Apache Arrow Issue Type:

[jira] [Assigned] (ARROW-1426) The title element of the top page is empty

[ https://issues.apache.org/jira/browse/ARROW-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn reassigned ARROW-1426: -- Assignee: Wataru Shimizu > The title element of the top page is empty >

[jira] [Updated] (ARROW-1426) The title element of the top page is empty

[ https://issues.apache.org/jira/browse/ARROW-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn updated ARROW-1426: --- Fix Version/s: 0.7.0 > The title element of the top page is empty >

[jira] [Resolved] (ARROW-1426) The title element of the top page is empty

[ https://issues.apache.org/jira/browse/ARROW-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-1426. Resolution: Fixed Issue resolved by pull request 1006 [https://github.com/apache/arrow/pull/1006]

[jira] [Created] (ARROW-1426) The title element of the top page is empty

Wataru Shimizu created ARROW-1426: - Summary: The title element of the top page is empty Key: ARROW-1426 URL: https://issues.apache.org/jira/browse/ARROW-1426 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-1282) Large memory reallocation by Arrow causes hang in jemalloc

[ https://issues.apache.org/jira/browse/ARROW-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144963#comment-16144963 ] Uwe L. Korn commented on ARROW-1282: Made a PR that fixes this for the jemalloc 4.x series:

[jira] [Resolved] (ARROW-1402) [C++] Possibly deprecate public APIs that use MutableBuffer

[ https://issues.apache.org/jira/browse/ARROW-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-1402. Resolution: Fixed Issue resolved by pull request 1001 [https://github.com/apache/arrow/pull/1001]

[jira] [Resolved] (ARROW-1421) [Python] pyarrow.serialize cannot serialize a Python dict input

[ https://issues.apache.org/jira/browse/ARROW-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-1421. Resolution: Fixed Issue resolved by pull request 1005 [https://github.com/apache/arrow/pull/1005]

[jira] [Resolved] (ARROW-1344) [C++] Calling BufferOutputStream::Write after calling Finish crashes

[ https://issues.apache.org/jira/browse/ARROW-1344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-1344. Resolution: Fixed Issue resolved by pull request 1004 [https://github.com/apache/arrow/pull/1004]

[jira] [Resolved] (ARROW-1363) [C++] IPC writer sends buffer layout for dictionary rather than indices

[ https://issues.apache.org/jira/browse/ARROW-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uwe L. Korn resolved ARROW-1363. Resolution: Fixed Issue resolved by pull request 1003 [https://github.com/apache/arrow/pull/1003]