[jira] [Created] (ARROW-7291) [Dev]Fix FORMAT_DIR in update-flatbuffers.sh

2019-12-01 Thread Kenta Murata (Jira)
Kenta Murata created ARROW-7291: --- Summary: [Dev]Fix FORMAT_DIR in update-flatbuffers.sh Key: ARROW-7291 URL: https://issues.apache.org/jira/browse/ARROW-7291 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7290) Implement ListArray Builder in C#

2019-12-01 Thread Takashi Hashida (Jira)
Takashi Hashida created ARROW-7290: -- Summary: Implement ListArray Builder in C# Key: ARROW-7290 URL: https://issues.apache.org/jira/browse/ARROW-7290 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-7289) ListType constructor argument is redundant

2019-12-01 Thread Takashi Hashida (Jira)
Takashi Hashida created ARROW-7289: -- Summary: ListType constructor argument is redundant Key: ARROW-7289 URL: https://issues.apache.org/jira/browse/ARROW-7289 Project: Apache Arrow Issue

RE: Issues with installation on docker / R

2019-12-01 Thread Christian Klar
Perfect this seems to have worked (did a brief test on one .arrow file). Thanks a lot for all the help! Really appreciate it. Christian -Original Message- From: Wes McKinney [mailto:wesmck...@gmail.com] Sent: Sunday, December 1, 2019 9:16 PM To: dev Cc: Anthony Abate; Jason De Biasio

Re: [Result] [VOTE] Clarifications and forward compatibility changes for Dictionary Encoding (second iteration)

2019-12-01 Thread Ji Liu
Thanks Micah, I'll take the Java side implementation. Thanks, Ji Liu -- From:Micah Kornfield Send Time:2019年12月2日(星期一) 09:25 To:dev Subject:Re: [Result] [VOTE] Clarifications and forward compatibility changes for Dictionary

Re: Issues with installation on docker / R

2019-12-01 Thread Wes McKinney
OK, if you are installing using what is on CRAN you need to use the corresponding version of Apache Arrow, so please use the released 0.15.1 version instead of master which contains API changes On Sun, Dec 1, 2019 at 7:51 PM Christian Klar wrote: > > Apologies! I missed that line. > > Okay this

[jira] [Created] (ARROW-7288) [R] read_parquet() freezes on Windows

2019-12-01 Thread Hiroaki Yutani (Jira)
Hiroaki Yutani created ARROW-7288: - Summary: [R] read_parquet() freezes on Windows Key: ARROW-7288 URL: https://issues.apache.org/jira/browse/ARROW-7288 Project: Apache Arrow Issue Type: Bug

RE: Issues with installation on docker / R

2019-12-01 Thread Christian Klar
Apologies! I missed that line. Okay this worked (make install finishes with some warnings), and the R part gets further, however I'm getting a filesystem error now after around 15 steps. https://gist.github.com/klarchristian/2947eaf93c0e7ef9dd0d6ed9d0be990b Christian -Original

Re: MIME type

2019-12-01 Thread Micah Kornfield
> > Should we register our MIME types to IANA? Are there any downsides to doing this? should we wait for 1.0.0? On Thu, Nov 21, 2019 at 5:04 AM Sutou Kouhei wrote: > I found Apache Thrift registers the following MIME types: > > * application/vnd.apache.thrift.binary > *

[jira] [Created] (ARROW-7287) [Javascript] Ensure Javascript implementation implements clarified dictionary spec

2019-12-01 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-7287: -- Summary: [Javascript] Ensure Javascript implementation implements clarified dictionary spec Key: ARROW-7287 URL: https://issues.apache.org/jira/browse/ARROW-7287

[jira] [Created] (ARROW-7286) [Go] Ensure go implementation implements clarified dictionary spec

2019-12-01 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-7286: -- Summary: [Go] Ensure go implementation implements clarified dictionary spec Key: ARROW-7286 URL: https://issues.apache.org/jira/browse/ARROW-7286 Project: Apache

[jira] [Created] (ARROW-7284) [Java] ensure java implementation meets clarified dictionary spec

2019-12-01 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-7284: -- Summary: [Java] ensure java implementation meets clarified dictionary spec Key: ARROW-7284 URL: https://issues.apache.org/jira/browse/ARROW-7284 Project: Apache

[jira] [Created] (ARROW-7285) [C++] ensure C++ implementation meets clarified dictionary spec

2019-12-01 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-7285: -- Summary: [C++] ensure C++ implementation meets clarified dictionary spec Key: ARROW-7285 URL: https://issues.apache.org/jira/browse/ARROW-7285 Project: Apache

[jira] [Created] (ARROW-7283) Ensure dictionary IPC implementations match spec clarifications

2019-12-01 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-7283: -- Summary: Ensure dictionary IPC implementations match spec clarifications Key: ARROW-7283 URL: https://issues.apache.org/jira/browse/ARROW-7283 Project: Apache

Re: Issues with installation on docker / R

2019-12-01 Thread Wes McKinney
Building Thrift from source requires the "flex" and "bison" packages, which you need to install with apt-get, this is mentioned here http://arrow.apache.org/docs/developers/cpp.html#apache-parquet-development On Sun, Dec 1, 2019 at 7:09 PM Christian Klar wrote: > > Okay I ran it. With the

RE: Issues with installation on docker / R

2019-12-01 Thread Christian Klar
Okay I ran it. With the additional tag the make install errored out. Here's the link to the log. Please let me know if you need further data. https://gist.github.com/klarchristian/272d0a9bffa03d4ff2265e4e181a26ef Also one more point: The arrow-master folder is in a shared volume. I don't think

Re: Issues with installation on docker / R

2019-12-01 Thread Wes McKinney
Can you also pass -DARROW_VERBOSE_THIRDPARTY_BUILD=ON ? That will show us what's wrong with with the Thrift build in this environment (I tried locally on my Ubuntu 18.04 machine -- without the influence of conda or any other library toolchains -- and it works fine). You can upload the whole logs

RE: Issues with installation on docker / R

2019-12-01 Thread Christian Klar
No luck with cmake -DARROW_PARQUET=ON either. Getting another error. Please see below the log from the docker session. root@873cfc2bc7b1:/hello/arrow-master/cpp/release# cmake -DARROW_PARQUET=ON .. -- Building using CMake version: 3.7.2 -- The C compiler identification is GNU 6.3.0 -- The CXX

RE: Issues with installation on docker / R

2019-12-01 Thread Christian Klar
Thanks! When running "make install" it finishes fine too, but then the R installation errors out. See below. Are there any other libraries I need to install? (Would potentially "cmake -DARROW_PARQUET=ON" solve this?) Here the log. > install.packages('arrow') Installing package

Re: Issues with installation on docker / R

2019-12-01 Thread Wes McKinney
That is a “minimal release build” but it does not install the results. Try “make install” instead of just “make”. We can improve the documentation to clarify this issue On Sun, Dec 1, 2019 at 5:22 PM Christian Klar wrote: > > Thanks for the quick response! > > I attached the log to my first

[C++] CSV string column category to dictionary/indices?

2019-12-01 Thread ntfs hard
Hello I'm a newcomer and not quite sure about the library usage. I tried to find some documentation about it but failed. I have a dataset in CSV file where one column(let's call it colour) is a string category. I'd like to get indices instead of text_lines to pass it inside algorithm. I tried to

RE: Issues with installation on docker / R

2019-12-01 Thread Christian Klar
 Thanks for the quick response! I attached the log to my first email but maybe it didn't got through because of the mailing list. Copying it below below the "#"-line. I'm using the commands from the "Minimal release build" on https://arrow.apache.org/docs/developers/cpp.html. cd

Re: Issues with installation on docker / R

2019-12-01 Thread Wes McKinney
Your instructions do not include “make install” when building the C++ library which will cause this problem. Can you provide a full build log if you are actually installing the C++ library and the R build cannot find it for some reason? Thanks On Sun, Dec 1, 2019 at 4:55 PM Christian Klar

Issues with installation on docker / R

2019-12-01 Thread Christian Klar
Hi – (Resending because I was not subscribed to the mailing list prior.) I’m trying to install arrow on a docker image with R on it but R gives me always the “error in io___ReadableFile__Open(clean_path_abs(path)) : Cannot call io___ReadableFile__Open(). Please use arrow::install_arrow() to

[jira] [Created] (ARROW-7282) [Python] IOError subclassing

2019-12-01 Thread Scott Gigante (Jira)
Scott Gigante created ARROW-7282: Summary: [Python] IOError subclassing Key: ARROW-7282 URL: https://issues.apache.org/jira/browse/ARROW-7282 Project: Apache Arrow Issue Type: Bug

[NIGHTLY] Arrow Build Report for Job nightly-2019-12-01-0

2019-12-01 Thread Crossbow
Arrow Build Report for Job nightly-2019-12-01-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-01-0 Failed Tasks: - macos-r-autobrew: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-01-0-travis-macos-r-autobrew -