Re: CMake refactor Heads-up

2019-03-15 Thread Suvayu Ali
On Sat, Mar 16, 2019 at 11:03:27AM +0530, Ravindra Pindikura wrote: > On Sat, Mar 16, 2019 at 2:38 AM Suvayu Ali > wrote: > > > Secondly, I was trying to compile with Gandiva enabled. But it seems the > > LLVM requirement has gone up to 7.0 (available only on F29 onwards). I had > > managed to

Re: CMake refactor Heads-up

2019-03-15 Thread Ravindra Pindikura
On Sat, Mar 16, 2019 at 2:38 AM Suvayu Ali wrote: > Hi Uwe, > > On Fri, Mar 15, 2019 at 10:38:32AM -0400, Uwe L. Korn wrote: > > > > we have merged the CMake refactor yesterday > https://github.com/apache/arrow/pull/3688 and this means that the build > system behaves a bit different. The main dif

[jira] [Created] (ARROW-4913) [Java][Memory] Limit number of ledgers and arrowbufs

2019-03-15 Thread Praveen Kumar Desabandu (JIRA)
Praveen Kumar Desabandu created ARROW-4913: -- Summary: [Java][Memory] Limit number of ledgers and arrowbufs Key: ARROW-4913 URL: https://issues.apache.org/jira/browse/ARROW-4913 Project: Apach

[jira] [Created] (ARROW-4912) [C++, Python] Allow specifying column names to CSV reader

2019-03-15 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4912: - Summary: [C++, Python] Allow specifying column names to CSV reader Key: ARROW-4912 URL: https://issues.apache.org/jira/browse/ARROW-4912 Project: Apache Arrow

[jira] [Created] (ARROW-4911) [R] Support for building package for Windows

2019-03-15 Thread Javier Luraschi (JIRA)
Javier Luraschi created ARROW-4911: -- Summary: [R] Support for building package for Windows Key: ARROW-4911 URL: https://issues.apache.org/jira/browse/ARROW-4911 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4910) [Rust] [DataFusion] Remove all uses of unimplemented!

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4910: - Summary: [Rust] [DataFusion] Remove all uses of unimplemented! Key: ARROW-4910 URL: https://issues.apache.org/jira/browse/ARROW-4910 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-4909) [CI] Use hadolint to lint Dockerfiles

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4909: -- Summary: [CI] Use hadolint to lint Dockerfiles Key: ARROW-4909 URL: https://issues.apache.org/jira/browse/ARROW-4909 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-4908) [Rust] [DataFusion] Add support for parquet date/time in int32/64 encoding

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4908: - Summary: [Rust] [DataFusion] Add support for parquet date/time in int32/64 encoding Key: ARROW-4908 URL: https://issues.apache.org/jira/browse/ARROW-4908 Project: Apache Ar

[jira] [Created] (ARROW-4907) [CI] Add docker container to inspect docker context

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4907: -- Summary: [CI] Add docker container to inspect docker context Key: ARROW-4907 URL: https://issues.apache.org/jira/browse/ARROW-4907 Project: Apache Arrow Issue Ty

Re: CMake refactor Heads-up

2019-03-15 Thread Suvayu Ali
Hi Uwe, On Fri, Mar 15, 2019 at 10:38:32AM -0400, Uwe L. Korn wrote: > > we have merged the CMake refactor yesterday > https://github.com/apache/arrow/pull/3688 and this means that the build > system behaves a bit different. The main differences are: That's a lot of work! Thank you very much

[jira] [Created] (ARROW-4906) [Format] Fix document to describe that SparseMatrixIndexCSR assumes indptr is sorted for each row

2019-03-15 Thread Kenta Murata (JIRA)
Kenta Murata created ARROW-4906: --- Summary: [Format] Fix document to describe that SparseMatrixIndexCSR assumes indptr is sorted for each row Key: ARROW-4906 URL: https://issues.apache.org/jira/browse/ARROW-4906

[jira] [Created] (ARROW-4905) [C++][Plasma] Remove dlmalloc from client library

2019-03-15 Thread Philipp Moritz (JIRA)
Philipp Moritz created ARROW-4905: - Summary: [C++][Plasma] Remove dlmalloc from client library Key: ARROW-4905 URL: https://issues.apache.org/jira/browse/ARROW-4905 Project: Apache Arrow Issu

Re: CMake refactor Heads-up

2019-03-15 Thread Philipp Moritz
Thanks Uwe for doing this! It's amazing how well the arrow build system is working given it supports so many different configurations (which makes Uwe's refactor all the more impressive). Big thanks for everybody helping to maintain it. On Fri, Mar 15, 2019 at 8:08 AM Wes McKinney wrote: > Than

[jira] [Created] (ARROW-4904) [C++] Move implementations in arrow/ipc/test-common.h into libarrow_testing

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4904: -- Summary: [C++] Move implementations in arrow/ipc/test-common.h into libarrow_testing Key: ARROW-4904 URL: https://issues.apache.org/jira/browse/ARROW-4904 Project: Apache

[jira] [Created] (ARROW-4903) [C++] Building tests using only static libs not possible

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4903: -- Summary: [C++] Building tests using only static libs not possible Key: ARROW-4903 URL: https://issues.apache.org/jira/browse/ARROW-4903 Project: Apache Arrow Iss

[jira] [Created] (ARROW-4902) [C++/Flight] Compilation fails due to unreachable code 

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4902: -- Summary: [C++/Flight] Compilation fails due to unreachable code  Key: ARROW-4902 URL: https://issues.apache.org/jira/browse/ARROW-4902 Project: Apache Arrow Issu

Re: CMake refactor Heads-up

2019-03-15 Thread Wes McKinney
Thanks Uwe for seeing through this massive improvement to our C++ build system! This should help package managers build the project in precisely the way that's needed to make the Arrow C++ libraries available in more places. A couple notes: * I personally keep my C++ toolchain and conda environme

CMake refactor Heads-up

2019-03-15 Thread Uwe L. Korn
Hello fellow Arrow Devs, we have merged the CMake refactor yesterday https://github.com/apache/arrow/pull/3688 and this means that the build system behaves a bit different. The main differences are: * If you're in a conda environment, we automatically detect this using the environment variable

[jira] [Created] (ARROW-4901) [Go] Run tests in Appveyor

2019-03-15 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-4901: --- Summary: [Go] Run tests in Appveyor Key: ARROW-4901 URL: https://issues.apache.org/jira/browse/ARROW-4901 Project: Apache Arrow Issue Type: New Feature

Re: Arrow Flight RPC usage

2019-03-15 Thread Wes McKinney
hi Maxim, What you're describing is presently an "off-label" use of Flight but it's perfectly valid if you're willing to roll up your sleeves a bit. Since we've focused on dealing with the columnar format as a multi-message stream, you'll find the APIs in Java, C++, and Python to be oriented aroun

[jira] [Created] (ARROW-4900) mingw-w64 < 5 does not have __cpuidex

2019-03-15 Thread Jeroen (JIRA)
Jeroen created ARROW-4900: - Summary: mingw-w64 < 5 does not have __cpuidex Key: ARROW-4900 URL: https://issues.apache.org/jira/browse/ARROW-4900 Project: Apache Arrow Issue Type: Bug Compon

[jira] [Created] (ARROW-4899) [Rust] [DataFusion] Remove all uses of panic! from expression.rs

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4899: - Summary: [Rust] [DataFusion] Remove all uses of panic! from expression.rs Key: ARROW-4899 URL: https://issues.apache.org/jira/browse/ARROW-4899 Project: Apache Arrow

[jira] [Created] (ARROW-4898) [C++] Old versions of FindProtobuf.cmake use ALL-CAPS for variables

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4898: -- Summary: [C++] Old versions of FindProtobuf.cmake use ALL-CAPS for variables Key: ARROW-4898 URL: https://issues.apache.org/jira/browse/ARROW-4898 Project: Apache Arrow

[jira] [Created] (ARROW-4897) [Rust] [DataFusion] Improve Rustdoc

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4897: - Summary: [Rust] [DataFusion] Improve Rustdoc Key: ARROW-4897 URL: https://issues.apache.org/jira/browse/ARROW-4897 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-4896) [Rust] [DataFusion] Remove all uses of panic! from tests

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4896: - Summary: [Rust] [DataFusion] Remove all uses of panic! from tests Key: ARROW-4896 URL: https://issues.apache.org/jira/browse/ARROW-4896 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4895) [Rust] [DataFusion] Move error.rs to top level package

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4895: - Summary: [Rust] [DataFusion] Move error.rs to top level package Key: ARROW-4895 URL: https://issues.apache.org/jira/browse/ARROW-4895 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-4894) [Rust] [DataFusion] Remove all uses of panic! from aggregate.rs

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4894: - Summary: [Rust] [DataFusion] Remove all uses of panic! from aggregate.rs Key: ARROW-4894 URL: https://issues.apache.org/jira/browse/ARROW-4894 Project: Apache Arrow

[jira] [Created] (ARROW-4893) [C++] conda packages should use $PREFIX inside of conda-build

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4893: -- Summary: [C++] conda packages should use $PREFIX inside of conda-build Key: ARROW-4893 URL: https://issues.apache.org/jira/browse/ARROW-4893 Project: Apache Arrow

[jira] [Created] (ARROW-4891) [C++] ZLIB include directories not added

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4891: -- Summary: [C++] ZLIB include directories not added Key: ARROW-4891 URL: https://issues.apache.org/jira/browse/ARROW-4891 Project: Apache Arrow Issue Type: Improve

[jira] [Created] (ARROW-4892) Move SQL parser and planner into sql package

2019-03-15 Thread Andy Grove (JIRA)
Andy Grove created ARROW-4892: - Summary: Move SQL parser and planner into sql package Key: ARROW-4892 URL: https://issues.apache.org/jira/browse/ARROW-4892 Project: Apache Arrow Issue Type: Sub-t

Arrow Flight RPC usage

2019-03-15 Thread Maxim Novikov
Hello, I am evaluating Arrow RPC for usage with multidimensional Tensors. In my case, mostly 2D/3D images with multiple channels. Let's say I want to develop a service that applies a gaussian blur on a 2D image. >From my understanding expected workflow is the following: 1. DoPut $key, image data 2

[jira] [Created] (ARROW-4890) Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2019-03-15 Thread Abdeali Kothari (JIRA)
Abdeali Kothari created ARROW-4890: -- Summary: Spark+Arrow Grouped pandas UDAF - read length must be positive or -1 Key: ARROW-4890 URL: https://issues.apache.org/jira/browse/ARROW-4890 Project: Apach

[jira] [Created] (ARROW-4889) [C++] Add STATUS messages for Protobuf in CMake

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4889: -- Summary: [C++] Add STATUS messages for Protobuf in CMake Key: ARROW-4889 URL: https://issues.apache.org/jira/browse/ARROW-4889 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-4888) [C++/Python] Test build with conda's defaults channel

2019-03-15 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-4888: -- Summary: [C++/Python] Test build with conda's defaults channel Key: ARROW-4888 URL: https://issues.apache.org/jira/browse/ARROW-4888 Project: Apache Arrow Issue