Please unsubscribe

2019-11-12 Thread Isaac Myers
I've sent multiple emails to dev-unsubscr...@arrow.apache.org and have not been removed from this list. Please remove this address. Sent from ProtonMail mobile

Re: [DISCUSS] Dictionary Encoding Clarifications/Future Proofing

2019-11-12 Thread Wes McKinney
Hi Antoine, Each *record batch* is intended to be readable in random order. To read any record batch requires loading the dictionaries indicated in the schema, so appending the deltas as part of this process does not seem like it would introduce hardship given that such logic is needed to

[NIGHTLY] Arrow Build Report for Job nightly-2019-11-12-1

2019-11-12 Thread Crossbow
Arrow Build Report for Job nightly-2019-11-12-1 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-12-1 Failed Tasks: - gandiva-jar-trusty: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-12-1-travis-gandiva-jar-trusty -

[jira] [Created] (ARROW-7151) [C++] Refactor ExpressionEvaluator to yield Arrays

2019-11-12 Thread Ben Kietzman (Jira)
Ben Kietzman created ARROW-7151: --- Summary: [C++] Refactor ExpressionEvaluator to yield Arrays Key: ARROW-7151 URL: https://issues.apache.org/jira/browse/ARROW-7151 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7150) [Python] Explain parquet file size growth

2019-11-12 Thread Bogdan Klichuk (Jira)
Bogdan Klichuk created ARROW-7150: - Summary: [Python] Explain parquet file size growth Key: ARROW-7150 URL: https://issues.apache.org/jira/browse/ARROW-7150 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7149) [C++] Remove experimental status on filesystem APIs

2019-11-12 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7149: - Summary: [C++] Remove experimental status on filesystem APIs Key: ARROW-7149 URL: https://issues.apache.org/jira/browse/ARROW-7149 Project: Apache Arrow

[jira] [Created] (ARROW-7148) [C++][Dataset] API cleanup

2019-11-12 Thread Francois Saint-Jacques (Jira)
Francois Saint-Jacques created ARROW-7148: - Summary: [C++][Dataset] API cleanup Key: ARROW-7148 URL: https://issues.apache.org/jira/browse/ARROW-7148 Project: Apache Arrow Issue

Re: Achieving parity with Java extension types in Python

2019-11-12 Thread Joris Van den Bossche
Sorry for the delay in response. I would suggest that you open a PR (or point to a branch with those changes), that will make it easier to discuss specific implementation options (rather than trying to explain and understand it in words) and give advice. On Wed, 6 Nov 2019 at 20:29, Justin

Re: [DISCUSS] Dictionary Encoding Clarifications/Future Proofing

2019-11-12 Thread Antoine Pitrou
Hi, Sorry for the delay. My high-level question is the following: is the file format intended to be readable in random order (rather than having to read through it in sequence as with the stream format)? If so, how does this play with the fact that there potentially are delta dictionaries in

[jira] [Created] (ARROW-7146) [R][CI] Pre-install the R dependencies in the dockerfile

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7146: -- Summary: [R][CI] Pre-install the R dependencies in the dockerfile Key: ARROW-7146 URL: https://issues.apache.org/jira/browse/ARROW-7146 Project: Apache Arrow

[jira] [Created] (ARROW-7145) [Archery] Consider porting the docker tool from ursabot to archery

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7145: -- Summary: [Archery] Consider porting the docker tool from ursabot to archery Key: ARROW-7145 URL: https://issues.apache.org/jira/browse/ARROW-7145 Project: Apache

[jira] [Created] (ARROW-7144) [Archery] Consider to use archery with or instead of the pre-commit hooks

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7144: -- Summary: [Archery] Consider to use archery with or instead of the pre-commit hooks Key: ARROW-7144 URL: https://issues.apache.org/jira/browse/ARROW-7144 Project:

[jira] [Created] (ARROW-7143) [Archery] Create a wrapper script in archery for docker compose in order to run the containers with the host's user and group

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7143: -- Summary: [Archery] Create a wrapper script in archery for docker compose in order to run the containers with the host's user and group Key: ARROW-7143 URL:

[jira] [Created] (ARROW-7142) [C++] Compile error with GCC 5.4.0

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7142: -- Summary: [C++] Compile error with GCC 5.4.0 Key: ARROW-7142 URL: https://issues.apache.org/jira/browse/ARROW-7142 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-7141) [C++][CI] Test the ported fuzzit integration image

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7141: -- Summary: [C++][CI] Test the ported fuzzit integration image Key: ARROW-7141 URL: https://issues.apache.org/jira/browse/ARROW-7141 Project: Apache Arrow

[jira] [Created] (ARROW-7140) [CI] Turn off unnecessary features in the integration tests (spark/turbodbc/dask/hdfs)

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7140: -- Summary: [CI] Turn off unnecessary features in the integration tests (spark/turbodbc/dask/hdfs) Key: ARROW-7140 URL: https://issues.apache.org/jira/browse/ARROW-7140

[jira] [Created] (ARROW-7138) [Go][CI] Pre-install the go dependencies in the dockerfile using go get

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7138: -- Summary: [Go][CI] Pre-install the go dependencies in the dockerfile using go get Key: ARROW-7138 URL: https://issues.apache.org/jira/browse/ARROW-7138 Project:

[jira] [Created] (ARROW-7137) [JS][CI] Pre-install the JS dependencies in the dockerfile

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7137: -- Summary: [JS][CI] Pre-install the JS dependencies in the dockerfile Key: ARROW-7137 URL: https://issues.apache.org/jira/browse/ARROW-7137 Project: Apache Arrow

[jira] [Created] (ARROW-7136) [Rust][CI] Pre-install the rust dependencies in the dockerfile

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7136: -- Summary: [Rust][CI] Pre-install the rust dependencies in the dockerfile Key: ARROW-7136 URL: https://issues.apache.org/jira/browse/ARROW-7136 Project: Apache

[jira] [Created] (ARROW-7135) [Java][CI] Pre-install the java dependencies in the dockerfile

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7135: -- Summary: [Java][CI] Pre-install the java dependencies in the dockerfile Key: ARROW-7135 URL: https://issues.apache.org/jira/browse/ARROW-7135 Project: Apache

[jira] [Created] (ARROW-7133) [CI] Allow GH Actions to run on all branches

2019-11-12 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7133: - Summary: [CI] Allow GH Actions to run on all branches Key: ARROW-7133 URL: https://issues.apache.org/jira/browse/ARROW-7133 Project: Apache Arrow Issue

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-11-12-0

2019-11-12 Thread Krisztián Szűcs
The builds are failing because of the merged docker-refactor PR during the nightly builds. I've resubmitted the nightly builds here: https://ci.ursalabs.org/#/builders/98/builds/250 On Tue, Nov 12, 2019 at 2:01 PM Crossbow wrote: > > > Arrow Build Report for Job nightly-2019-11-12-0 > > All

[NIGHTLY] Arrow Build Report for Job nightly-2019-11-12-0

2019-11-12 Thread Crossbow
Arrow Build Report for Job nightly-2019-11-12-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-12-0 Failed Tasks: - docker-c_glib: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-11-12-0-circle-docker-c_glib -

[jira] [Created] (ARROW-7132) [C#][CI] Pre-install the C# dependencies in its dockerfile if possible

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7132: -- Summary: [C#][CI] Pre-install the C# dependencies in its dockerfile if possible Key: ARROW-7132 URL: https://issues.apache.org/jira/browse/ARROW-7132 Project:

[jira] [Created] (ARROW-7131) [GLIB][CI] Fail to execute lua examples in the MacOS build

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7131: -- Summary: [GLIB][CI] Fail to execute lua examples in the MacOS build Key: ARROW-7131 URL: https://issues.apache.org/jira/browse/ARROW-7131 Project: Apache Arrow

[jira] [Created] (ARROW-7130) [C++][CMake] Automatically set ARROW_GANDIVA_PC_CXX_FLAGS for conda and OSX sdk

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7130: -- Summary: [C++][CMake] Automatically set ARROW_GANDIVA_PC_CXX_FLAGS for conda and OSX sdk Key: ARROW-7130 URL: https://issues.apache.org/jira/browse/ARROW-7130

[jira] [Created] (ARROW-7129) [C++][CI] Hiveserver2 instegration test fails to connect to impala container

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7129: -- Summary: [C++][CI] Hiveserver2 instegration test fails to connect to impala container Key: ARROW-7129 URL: https://issues.apache.org/jira/browse/ARROW-7129

[jira] [Created] (ARROW-7128) [CI] Fedora cron jobs are failing because of wrong fedora version

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7128: -- Summary: [CI] Fedora cron jobs are failing because of wrong fedora version Key: ARROW-7128 URL: https://issues.apache.org/jira/browse/ARROW-7128 Project: Apache

[jira] [Created] (ARROW-7127) [CI][Spark] Support specific Spark version in the integration tet including latest

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7127: -- Summary: [CI][Spark] Support specific Spark version in the integration tet including latest Key: ARROW-7127 URL: https://issues.apache.org/jira/browse/ARROW-7127

[jira] [Created] (ARROW-7126) [JS][CI][Archery] Move nodejs linting from js_build.sh to archery

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7126: -- Summary: [JS][CI][Archery] Move nodejs linting from js_build.sh to archery Key: ARROW-7126 URL: https://issues.apache.org/jira/browse/ARROW-7126 Project: Apache

[jira] [Created] (ARROW-7125) [CI] Find a short but related prefix for the env vars used for the docker-compose file

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7125: -- Summary: [CI] Find a short but related prefix for the env vars used for the docker-compose file Key: ARROW-7125 URL: https://issues.apache.org/jira/browse/ARROW-7125

[jira] [Created] (ARROW-7124) [Python][CI] Create a docker image for python ASV benchmarks

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7124: -- Summary: [Python][CI] Create a docker image for python ASV benchmarks Key: ARROW-7124 URL: https://issues.apache.org/jira/browse/ARROW-7124 Project: Apache Arrow

[jira] [Created] (ARROW-7123) [C#][CI] The docker container fails to run on Github Actions because of the ubuntu host version

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7123: -- Summary: [C#][CI] The docker container fails to run on Github Actions because of the ubuntu host version Key: ARROW-7123 URL: https://issues.apache.org/jira/browse/ARROW-7123

[jira] [Created] (ARROW-7121) [C++][CI][Windows] Enable more features on the windows GHA build

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7121: -- Summary: [C++][CI][Windows] Enable more features on the windows GHA build Key: ARROW-7121 URL: https://issues.apache.org/jira/browse/ARROW-7121 Project: Apache

[jira] [Created] (ARROW-7120) [C++][CI] Add .ccache to the docker-compose volume mounts

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7120: -- Summary: [C++][CI] Add .ccache to the docker-compose volume mounts Key: ARROW-7120 URL: https://issues.apache.org/jira/browse/ARROW-7120 Project: Apache Arrow

[jira] [Created] (ARROW-7119) [C++][CI] Use scripts/util_coredump.sh to show automatic backtraces

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7119: -- Summary: [C++][CI] Use scripts/util_coredump.sh to show automatic backtraces Key: ARROW-7119 URL: https://issues.apache.org/jira/browse/ARROW-7119 Project:

[jira] [Created] (ARROW-7118) [CI] [Dev] "docker-compose run ubuntu-python" fails

2019-11-12 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-7118: - Summary: [CI] [Dev] "docker-compose run ubuntu-python" fails Key: ARROW-7118 URL: https://issues.apache.org/jira/browse/ARROW-7118 Project: Apache Arrow

[jira] [Created] (ARROW-7117) [C++][CI] Fix the hanging C++ tests in Windows 2019

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7117: -- Summary: [C++][CI] Fix the hanging C++ tests in Windows 2019 Key: ARROW-7117 URL: https://issues.apache.org/jira/browse/ARROW-7117 Project: Apache Arrow

[jira] [Created] (ARROW-7116) [CI] Ask INFRA to set up the DOCKERHUB_* secrets for GitHub actions

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7116: -- Summary: [CI] Ask INFRA to set up the DOCKERHUB_* secrets for GitHub actions Key: ARROW-7116 URL: https://issues.apache.org/jira/browse/ARROW-7116 Project:

[jira] [Created] (ARROW-7115) [C++][CI] Running Gandiva tests fails on Fedora 29

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7115: -- Summary: [C++][CI] Running Gandiva tests fails on Fedora 29 Key: ARROW-7115 URL: https://issues.apache.org/jira/browse/ARROW-7115 Project: Apache Arrow

[jira] [Created] (ARROW-7114) [JS][CI] NodeJS build fails on Github Actions Windows node

2019-11-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7114: -- Summary: [JS][CI] NodeJS build fails on Github Actions Windows node Key: ARROW-7114 URL: https://issues.apache.org/jira/browse/ARROW-7114 Project: Apache Arrow

[jira] [Created] (ARROW-7113) [Rust] Buffer should accept memory owned by others

2019-11-12 Thread Renjie Liu (Jira)
Renjie Liu created ARROW-7113: - Summary: [Rust] Buffer should accept memory owned by others Key: ARROW-7113 URL: https://issues.apache.org/jira/browse/ARROW-7113 Project: Apache Arrow Issue