Re: Depending on non-released Apache projects (C++ Avro)

2019-03-12 Thread Micah Kornfield
Thanks. This work has been pushed off a bit because I need to get existing PRs into better shape. Hopefully 1.9 is released when I pick it up (otherwise I would lean towards forking for the time being as well). On Tue, Mar 12, 2019 at 3:01 AM Uwe L. Korn wrote: > Hello Micah, > > > Uwe, I'm

[jira] [Created] (ARROW-4850) [CI] Integration test failures do not fail the Travis CI build

2019-03-12 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4850: --- Summary: [CI] Integration test failures do not fail the Travis CI build Key: ARROW-4850 URL: https://issues.apache.org/jira/browse/ARROW-4850 Project: Apache Arrow

[jira] [Created] (ARROW-4849) [C++] Add docker-compose entry for testing Ubuntu Bionic build with system packages

2019-03-12 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4849: -- Summary: [C++] Add docker-compose entry for testing Ubuntu Bionic build with system packages Key: ARROW-4849 URL: https://issues.apache.org/jira/browse/ARROW-4849

[jira] [Created] (ARROW-4848) Static libparquet not compiled with -DARROW_STATIC on Windows

2019-03-12 Thread Jeroen (JIRA)
Jeroen created ARROW-4848: - Summary: Static libparquet not compiled with -DARROW_STATIC on Windows Key: ARROW-4848 URL: https://issues.apache.org/jira/browse/ARROW-4848 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4847) [Python] Add pyarrow.table factory function that dispatches to various ctors based on type of input

2019-03-12 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4847: --- Summary: [Python] Add pyarrow.table factory function that dispatches to various ctors based on type of input Key: ARROW-4847 URL: https://issues.apache.org/jira/browse/ARROW-4847

[jira] [Created] (ARROW-4846) [Java] Update Jackson to 2.9.8

2019-03-12 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4846: --- Summary: [Java] Update Jackson to 2.9.8 Key: ARROW-4846 URL: https://issues.apache.org/jira/browse/ARROW-4846 Project: Apache Arrow Issue Type: Improvement

Re: MATLAB, Arrow, ABI's and Linux

2019-03-12 Thread Uwe L. Korn
Hello Joris, '/data/home/jpeeter/apps/anaconda3/envs/testarrow/lib/fromArrowStream.mexa64': /data/home/jpeeter/apps/anaconda3/envs/testarrow/lib/fromArrowStream.mexa64: undefined symbol: _ZNK5arrow6Status8ToStringEv. sounds like fromArrowStream.mexa64 was still compiled using

[jira] [Created] (ARROW-4845) Compiler warnings on Windows

2019-03-12 Thread Jeroen (JIRA)
Jeroen created ARROW-4845: - Summary: Compiler warnings on Windows Key: ARROW-4845 URL: https://issues.apache.org/jira/browse/ARROW-4845 Project: Apache Arrow Issue Type: Bug Components: R

[jira] [Created] (ARROW-4844) Static libarrow is missing vendored libdouble-conversion

2019-03-12 Thread Jeroen (JIRA)
Jeroen created ARROW-4844: - Summary: Static libarrow is missing vendored libdouble-conversion Key: ARROW-4844 URL: https://issues.apache.org/jira/browse/ARROW-4844 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-4843) [Rust] [DataFusion] Parquet data source should support DATE

2019-03-12 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4843: - Summary: [Rust] [DataFusion] Parquet data source should support DATE Key: ARROW-4843 URL: https://issues.apache.org/jira/browse/ARROW-4843 Project: Apache Arrow

[jira] [Created] (ARROW-4840) [C++] Persist CMake options in generated header

2019-03-12 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4840: -- Summary: [C++] Persist CMake options in generated header Key: ARROW-4840 URL: https://issues.apache.org/jira/browse/ARROW-4840 Project: Apache Arrow Issue Type:

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Andy Grove
I've cleaned up my issues for Rust, moving most of them to 0.14.0. I have two PRs in progress that I would appreciate reviews on: https://github.com/apache/arrow/pull/3671 - [Rust] Table API (a.k.a DataFrame) https://github.com/apache/arrow/pull/3851 - [Rust] Parquet data source in DataFusion

[jira] [Created] (ARROW-4842) [C++] Persist CMake options in pkg-config files

2019-03-12 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4842: -- Summary: [C++] Persist CMake options in pkg-config files Key: ARROW-4842 URL: https://issues.apache.org/jira/browse/ARROW-4842 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-4841) [C++] Persist CMake options in generated CMake config

2019-03-12 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4841: -- Summary: [C++] Persist CMake options in generated CMake config Key: ARROW-4841 URL: https://issues.apache.org/jira/browse/ARROW-4841 Project: Apache Arrow Issue

MATLAB, Arrow, ABI's and Linux

2019-03-12 Thread Joris Peeters
[A] Short background: We are working on a MEX library that converts a binary array (representing an Arrow stream or file) into MATLAB structs. This is in parallel/complement to what already exists in the main Arrow project, which focuses on feather, but the hope is certainly to contribute back

[jira] [Created] (ARROW-4839) [C#] Add NuGet support

2019-03-12 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4839: --- Summary: [C#] Add NuGet support Key: ARROW-4839 URL: https://issues.apache.org/jira/browse/ARROW-4839 Project: Apache Arrow Issue Type: Improvement

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Wes McKinney
I disagree. I think we need a forcing function to create some urgency to work out any of the problems that may come up. If we need to make a 0.13.1 to fix problems that are not caught during the release (and producing binary artifacts) then I think that is okay On Tue, Mar 12, 2019 at 9:53 AM

RE: Timeline for 0.13 Arrow release

2019-03-12 Thread Eric Erhardt
> Having C# NuGet package working would be nice I've opened https://issues.apache.org/jira/browse/ARROW-4839 for this and I will be working on it this week. I'd like to see an official Arrow NuGet package on www.nuget.org soon, so getting it in this release would work out perfect from my side.

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Krisztián Szűcs
Hi, The CMake refactor is huge enough to cause unexpected post-release defects. I'd consider shipping it with the next release and let is stabilize during the development of 0.14. On Tue, Mar 12, 2019 at 3:41 PM Wes McKinney wrote: > hi Uwe, > > I would be OK with trying to release next week.

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Wes McKinney
hi Uwe, I would be OK with trying to release next week. Let's see what others think. Getting the CMake refactor in and packaging sorted out is the big priority for the C++-using ecosystem. I haven't seen anything hugely pressing in the other impls based on the recent patch flow. Having C# NuGet

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Uwe L. Korn
Hello, two things come to my mind: * I'm spending now some time again on the CMake refactor. The only blocker I currently see is the issue with detecting the correct gtest libraries on Windows. Otherwise this can go in. Being very confident about my work: This will break things even though

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Wes McKinney
hi folks, I think we are on track to be able to release toward the end of this month. My proposed timeline: * This week (March 11-15): feature/improvement push mostly * Next week (March 18-22): shift to bug fixes, stabilization, empty backlog of feature/improvement JIRAs * Week of March 25:

[jira] [Created] (ARROW-4838) [C++] Implement safe Make constructor

2019-03-12 Thread Francois Saint-Jacques (JIRA)
Francois Saint-Jacques created ARROW-4838: - Summary: [C++] Implement safe Make constructor Key: ARROW-4838 URL: https://issues.apache.org/jira/browse/ARROW-4838 Project: Apache Arrow

[jira] [Created] (ARROW-4837) [C++] Support c++filt on a custom path in the run-test.sh script

2019-03-12 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-4837: -- Summary: [C++] Support c++filt on a custom path in the run-test.sh script Key: ARROW-4837 URL: https://issues.apache.org/jira/browse/ARROW-4837 Project: Apache

[jira] [Created] (ARROW-4835) [GLib] Add boolean operations

2019-03-12 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-4835: --- Summary: [GLib] Add boolean operations Key: ARROW-4835 URL: https://issues.apache.org/jira/browse/ARROW-4835 Project: Apache Arrow Issue Type: New Feature

[jira] [Created] (ARROW-4836) "Cannot tell() a compressed stream" when using RecordBatchStreamWriter

2019-03-12 Thread Mike Pedersen (JIRA)
Mike Pedersen created ARROW-4836: Summary: "Cannot tell() a compressed stream" when using RecordBatchStreamWriter Key: ARROW-4836 URL: https://issues.apache.org/jira/browse/ARROW-4836 Project: Apache

Re: Depending on non-released Apache projects (C++ Avro)

2019-03-12 Thread Uwe L. Korn
Hello Micah, > Uwe, I'm not sure I understand what type of support/help you are thinking > of. Could you elaborate a little bit more before I reach out? I would help them with the same build system improvement we have done in the recent time (and are currently) doing in Arrow for C++. Nothing

Re: [C++] Failing constructors and internal state

2019-03-12 Thread Krisztián Szűcs
+1 on Make and MakeUnsafe On Mon, Mar 11, 2019 at 3:15 PM Francois Saint-Jacques < fsaintjacq...@gmail.com> wrote: > I can settle with Micah's proposal of `MakeValidate`, though I'd prefer > that Make is safe by default and responsible users use MakeUnsafe :), I'll > settle with the pragmatic