Documentation for dev version of C++ library

Hello, I'm using https://arrow.apache.org/docs/cpp/ when I develop the R package, but sometimes this is behind, e.g. this does not have the Read method in https://arrow.apache.org/docs/cpp/classarrow_1_1ipc_1_1feather_1_1_table_reader.html

Cast from Array to Array and Array

I'm implementing Array$cast() in the R package, i.e. https://issues.apache.org/jira/browse/ARROW-3741?filter=12344983 I'm seeing some weird results when casting from int32 to uint32 and uint64 (I'm expecting errors here as it's supposed to be safe https://github.com/apache/arrow/pull/2959#issue

Review [R] pull requests

Hello, I just sent a big (although mostly benign) pull request to the R package. https://github.com/apache/arrow/pull/3043 apparently it involves 115 files, that is a bit scary but some of these files are generated automatically. There are also oth

Bison error when making thrift on macOS

Hello, I'm trying to build arrow and parquet on Mac OS: $ cmake .. -DARROW_PARQUET=ON -DCMAKE_BUILD_TYPE=Release -DARROW_BOOST_USE_SHARED:BOOL=Off $ make install And get only up to: [ 37%] Performing build step for 'thrift_ep' CMake Error at /Users/romain/git/apache/arrow/cpp/release/thrift

Re: Bison error when making thrift on macOS

fields for the following targets are still affected by RPATH settings: arrow_shared parquet_shared This warning is for project developers. Use -Wno-dev to suppress it. -- Generating done -- Build files have been written to: /Users/romain/git/apache/arrow/cpp/release > Le 2 janv. 201

Re: Bison error when making thrift on macOS

Turns out I already have a thrift installed through brew, but cmake needed help to figure it out, I have added export THRIFT_HOME="/usr/local/Cellar/thrift/0.11.0" to my ~/.bash_profile > Le 2 janv. 2019 à 14:00, Romain Francois a écrit : > > This might be re

Parallel processing

Hello, Are the functions in parallel.h the de facto model for parallelisation in arrow ? https://github.com/apache/arrow/blob/42cf69abfc1368c9884f4581811e2e7900c98fcd/cpp/src/arrow/util/parallel.h

Re: Bison error when making thrift on macOS

1fd6c3b7ac8 > (which is part of Arrow's ThirdpartyToolchain.cmake) > > You can pass `-DBISON_EXECUTABLE=/path/to/homebrew/bison` when building > > - Wes > > On Wed, Jan 2, 2019 at 7:20 AM Romain Francois wrote: >> >> Turns out I already have a thrift installe

Re: Parallel processing

ain, > > No, it's better if you use the CPU thread pool directly (or through > TaskGroup, if that suits your execution model better). > > Regards > > Antoine. > > > Le 03/01/2019 à 14:29, Romain Francois a écrit : >> Hello, >> >> Are the

Re: Parallel processing

That should be fine indeed. I just don't want the task to start "right now" as SerialTaskGroup::AppendReal() seems to be doing. > Le 4 janv. 2019 à 13:38, Antoine Pitrou a écrit : > > > Le 04/01/2019 à 12:24, Romain Francois a écrit : >> >> I guess

Re: Using arrow to efficiently transfer data from Python to R

This is exactly (IMO) the kind of things this project is about. Thanks for looking into that, I'll try to incorporate the idea in the R package asap. Did you look at the reverse operation, i.e. promote an arrow object from R to python ? Romain > Le 11 janv. 2019 à 06:54, Jeffrey Wong a écrit

gReetings

Hello, I just wanted to introduce myself here. I’m Romain François, mostly involved in making tools for R. My track record includes being an author of Rcpp and dplyr. I will be working with Wes’s guidance on making an R front end for arrow. Initially that means going through the C++ api and p

Re: gReetings

Sounds great. > Le 14 mars 2018 à 19:03, Aneesh Karve a écrit : > > Hi Romain. Thanks for looking into this. Per discussion with Wes we'll keep > the discussion on ASF channels so the community can participate. > ᐧ

R/arrow update

Hello, Today is Tuesday, so that's the day I work on porting arrow to R. This week, I've continued some of the work from last week, still following the steps of the python front end as documented here: https://arrow.apache.org/docs/python/data.html#type-metadata

Re: Lighter build matrix on a language specific fork.

Addressed most of the comments. Anyone knows how to set rpath dynamically in: https://github.com/apache/arrow/pull/2489#discussion_r215875597 Maybe pkg-config can help ? > Le 7 sept. 2018 à 00:40, Wes McKinney a écrit : > > OK,

Re: Failures bc clang-format

Getting this: romain@purrplex ~/git/apache/arrow/r $ ./lint.sh --fix Traceback (most recent call last): File "/Users/romain/git/apache/arrow/r/../cpp/build-support/run_clang_format.py", line 74, in "-i"] + formatted_filenames) File "/Users/romain/anaconda3/lib/python3.6/subprocess.py",

Re: Failures bc clang-format

ng%2bllvm-6.0.0-x86_64-apple-darwin.tar.xz >>> >>> here's a page I found in installing with this method (unless you want >>> to build from source) >>> >>> https://nacho4d-nacho4d.blogspot.com/2013/11/clang-format.html >>> >>> You