[jira] [Created] (ARROW-8413) Refactor DefLevelsToBitmap

2020-04-12 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-8413:
--

 Summary: Refactor DefLevelsToBitmap
 Key: ARROW-8413
 URL: https://issues.apache.org/jira/browse/ARROW-8413
 Project: Apache Arrow
  Issue Type: Sub-task
  Components: C++
Reporter: Micah Kornfield
Assignee: Micah Kornfield


The current code is should be split apart and made more efficient to 
consolidate logic need to support all nesting combinations.

 

We need to be able to pass in an arbitrary min definitions level to prune away 
elements that aren't included in lists.  

The functionality is also somewhat replicated in reading  the struct code, the 
two paths should be consolidated.

 

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8412) [C++][Gandiva] Fix gandiva date_diff function definitions

2020-04-12 Thread Projjal Chanda (Jira)
Projjal Chanda created ARROW-8412:
-

 Summary: [C++][Gandiva] Fix gandiva date_diff function definitions
 Key: ARROW-8412
 URL: https://issues.apache.org/jira/browse/ARROW-8412
 Project: Apache Arrow
  Issue Type: Task
  Components: C++ - Gandiva
Reporter: Projjal Chanda
Assignee: Projjal Chanda


The current gandiva date functions date_diff, date_sub definitions take integer 
as first argument and date as second argument:

date_diff(10, d) = d - 10, which seems unintuitive.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Trouble installing archery?

2020-04-12 Thread Micah Kornfield
When I follow the instructions at
https://arrow.apache.org/docs/developers/benchmarks.html

"pip install -e dev/archery"

I get a permission denied (error pasted at the end in full).  Are there
additional steps that need to happen when using virtualenv?

Thanks,
Micah

Obtaining file:///home/emkornfield_gmail_com/arrow/dev/archery
ERROR: Command errored out with exit status 1:
 command: /home/emkornfield_gmail_com/venv/bin/python3 -c 'import sys,
setuptools, tokenize; sys.argv[0] =
 '"'"'/home/emkornfield_gmail_com/arrow/dev/archery/setup.py'"'"';
__file__='"'"'/home/emkornfield_gmail_com/a
rrow/dev/archery/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"',
open)(__file__);code=f.read().replace('"'"'
\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__,
'"'"'exec'"'"'))' egg_info
 cwd: /home/emkornfield_gmail_com/arrow/dev/archery/
Complete output (2 lines):
running egg_info
error: [Errno 13] Permission denied

ERROR: Command errored out with exit status 1: python setup.py egg_info
Check the logs for full command output


[jira] [Created] (ARROW-8411) [C++] gcc6 warning re: arrow::internal::ArgSort

2020-04-12 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8411:
---

 Summary: [C++] gcc6 warning re: arrow::internal::ArgSort
 Key: ARROW-8411
 URL: https://issues.apache.org/jira/browse/ARROW-8411
 Project: Apache Arrow
  Issue Type: Bug
  Components: C++
Reporter: Wes McKinney


Observed on a Debian platform with gcc6 base

{code}
In file included from /usr/include/c++/6/algorithm:62:0,
 from ../src/arrow/util/bit_util.h:55,
 from ../src/arrow/type_traits.h:26,
 from ../src/arrow/array.h:32,
 from ../src/arrow/compute/kernel.h:24,
 from ../src/arrow/dataset/filter.h:27,
 from ../src/arrow/dataset/partition.h:27,
 from 
/home/rock/code/arrow/cpp/src/arrow/dataset/partition.cc:18:
/usr/include/c++/6/bits/stl_algo.h: In function 'void 
std::__insertion_sort(_RandomAccessIterator, _RandomAccessIterator, _Compare) 
[with _RandomAccessIterator = __gnu_cxx::__normal_iterator >; _Compare = 
__gnu_cxx::__ops::_Iter_comp_iter&, Cmp&&) [with T = std::__cxx11::basic_string; Cmp = 
std::less >]:: >]':
/usr/include/c++/6/bits/stl_algo.h:1837:5: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
 __insertion_sort(_RandomAccessIterator __first,
 ^~~~
/usr/include/c++/6/bits/stl_algo.h:1837:5: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
In file included from /usr/include/c++/6/bits/stl_algo.h:61:0,
 from /usr/include/c++/6/algorithm:62,
 from ../src/arrow/util/bit_util.h:55,
 from ../src/arrow/type_traits.h:26,
 from ../src/arrow/array.h:32,
 from ../src/arrow/compute/kernel.h:24,
 from ../src/arrow/dataset/filter.h:27,
 from ../src/arrow/dataset/partition.h:27,
 from 
/home/rock/code/arrow/cpp/src/arrow/dataset/partition.cc:18:
/usr/include/c++/6/bits/stl_heap.h: In function 'void 
std::__adjust_heap(_RandomAccessIterator, _Distance, _Distance, _Tp, _Compare) 
[with _RandomAccessIterator = __gnu_cxx::__normal_iterator >; _Distance = int; _Tp = long long int; _Compare = 
__gnu_cxx::__ops::_Iter_comp_iter&, Cmp&&) [with T = std::__cxx11::basic_string; Cmp = 
std::less >]:: >]':
/usr/include/c++/6/bits/stl_heap.h:209:5: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
 __adjust_heap(_RandomAccessIterator __first, _Distance __holeIndex,
 ^
In file included from /usr/include/c++/6/algorithm:62:0,
 from ../src/arrow/util/bit_util.h:55,
 from ../src/arrow/type_traits.h:26,
 from ../src/arrow/array.h:32,
 from ../src/arrow/compute/kernel.h:24,
 from ../src/arrow/dataset/filter.h:27,
 from ../src/arrow/dataset/partition.h:27,
 from 
/home/rock/code/arrow/cpp/src/arrow/dataset/partition.cc:18:
/usr/include/c++/6/bits/stl_algo.h: In function 'void 
std::__introsort_loop(_RandomAccessIterator, _RandomAccessIterator, _Size, 
_Compare) [with _RandomAccessIterator = __gnu_cxx::__normal_iterator >; _Size = int; _Compare = 
__gnu_cxx::__ops::_Iter_comp_iter&, Cmp&&) [with T = std::__cxx11::basic_string; Cmp = 
std::less >]:: >]':
/usr/include/c++/6/bits/stl_algo.h:1937:5: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
 __introsort_loop(_RandomAccessIterator __first,
 ^~~~
/usr/include/c++/6/bits/stl_algo.h:1937:5: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
/usr/include/c++/6/bits/stl_algo.h:1951:4: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
std::__introsort_loop(__cut, __last, __depth_limit, __comp);
^~~
/usr/include/c++/6/bits/stl_algo.h: In function 'std::vector 
arrow::internal::ArgSort(const std::vector&, Cmp&&) [with T = 
std::__cxx11::basic_string; Cmp = 
std::less >]':
/usr/include/c++/6/bits/stl_algo.h:1882:4: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
std::__insertion_sort(__first, __first + int(_S_threshold), __comp);
^~~
/usr/include/c++/6/bits/stl_algo.h:1887:2: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
  std::__insertion_sort(__first, __last, __comp);
  ^~~
/usr/include/c++/6/bits/stl_algo.h:1965:4: note: parameter passing for argument 
of type '__gnu_cxx::__normal_iterator >' will change in GCC 7.1
std::__introsort_loop(__first, __last,
^~~
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[NIGHTLY] Arrow Build Report for Job nightly-2020-04-12-2

2020-04-12 Thread Crossbow


Arrow Build Report for Job nightly-2020-04-12-2

All tasks: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2

Failed Tasks:
- conda-win-vs2015-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-win-vs2015-py36
- conda-win-vs2015-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-win-vs2015-py37
- conda-win-vs2015-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-win-vs2015-py38
- gandiva-jar-trusty:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-travis-gandiva-jar-trusty
- test-conda-cpp-hiveserver2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-cpp-hiveserver2
- test-conda-python-3.7-hdfs-2.9.2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.7-hdfs-2.9.2
- test-conda-python-3.7-turbodbc-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.7-turbodbc-latest
- test-conda-python-3.7-turbodbc-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.7-turbodbc-master
- ubuntu-focal-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-github-ubuntu-focal-amd64
- wheel-osx-cp38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-travis-wheel-osx-cp38
- wheel-win-cp35m:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-appveyor-wheel-win-cp35m

Pending Tasks:
- test-ubuntu-18.04-docs:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-ubuntu-18.04-docs

Succeeded Tasks:
- centos-6-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-github-centos-6-amd64
- centos-7-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-github-centos-7-amd64
- centos-8-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-github-centos-8-amd64
- conda-linux-gcc-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-linux-gcc-py36
- conda-linux-gcc-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-linux-gcc-py37
- conda-linux-gcc-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-linux-gcc-py38
- conda-osx-clang-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-osx-clang-py36
- conda-osx-clang-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-osx-clang-py37
- conda-osx-clang-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-azure-conda-osx-clang-py38
- debian-buster-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-github-debian-buster-amd64
- debian-stretch-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-github-debian-stretch-amd64
- gandiva-jar-osx:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-travis-gandiva-jar-osx
- homebrew-cpp-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-travis-homebrew-cpp-autobrew
- homebrew-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-travis-homebrew-cpp
- homebrew-r-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-travis-homebrew-r-autobrew
- test-conda-cpp-valgrind:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-cpp-valgrind
- test-conda-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-cpp
- test-conda-python-3.6:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.6
- test-conda-python-3.7-dask-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.7-dask-latest
- test-conda-python-3.7-kartothek-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.7-kartothek-latest
- test-conda-python-3.7-kartothek-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-python-3.7-kartothek-master
- test-conda-python-3.7-pandas-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-2-circle-test-conda-pytho

[jira] [Created] (ARROW-8410) [C++] CMake fails on aarch64 systems that do not support -march=armv8-a+crc+crypto

2020-04-12 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8410:
---

 Summary: [C++] CMake fails on aarch64 systems that do not support 
-march=armv8-a+crc+crypto
 Key: ARROW-8410
 URL: https://issues.apache.org/jira/browse/ARROW-8410
 Project: Apache Arrow
  Issue Type: Bug
  Components: C++
Reporter: Wes McKinney
 Fix For: 0.17.0


I was trying to build the project on a rockpro64 system to look into something 
else and ran into this

{code}
-- Arrow build warning level: PRODUCTION
CMake Error at cmake_modules/SetupCxxFlags.cmake:332 (message):
  Unsupported arch flag: -march=armv8-a+crc+crypto.
Call Stack (most recent call first):
  CMakeLists.txt:398 (include)

-- Configuring incomplete, errors occurred!
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8409) [R] Add arrow::cpu_count, arrow::set_cpu_count wrapper functions a la Python

2020-04-12 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8409:
---

 Summary: [R] Add arrow::cpu_count, arrow::set_cpu_count wrapper 
functions a la Python
 Key: ARROW-8409
 URL: https://issues.apache.org/jira/browse/ARROW-8409
 Project: Apache Arrow
  Issue Type: Improvement
  Components: R
Reporter: Wes McKinney
 Fix For: 0.17.0


While some people will configure these with {{$OMP_NUM_THREADS}}, it is useful 
to be able to configure the global thread pool dynamically



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8408) [Python] Add memory_map= toggle to pyarrow.feather.read_feather

2020-04-12 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-8408:
---

 Summary: [Python] Add memory_map= toggle to 
pyarrow.feather.read_feather
 Key: ARROW-8408
 URL: https://issues.apache.org/jira/browse/ARROW-8408
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Python
Reporter: Wes McKinney
Assignee: Wes McKinney
 Fix For: 0.17.0


I missed this in my prior patch



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[NIGHTLY] Arrow Build Report for Job nightly-2020-04-12-1

2020-04-12 Thread Crossbow


Arrow Build Report for Job nightly-2020-04-12-1

All tasks: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1

Failed Tasks:
- conda-win-vs2015-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-win-vs2015-py36
- conda-win-vs2015-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-win-vs2015-py37
- conda-win-vs2015-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-win-vs2015-py38
- gandiva-jar-trusty:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-gandiva-jar-trusty
- test-conda-cpp-hiveserver2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-cpp-hiveserver2
- test-conda-python-3.7-hdfs-2.9.2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.7-hdfs-2.9.2
- test-conda-python-3.7-turbodbc-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.7-turbodbc-latest
- test-conda-python-3.7-turbodbc-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.7-turbodbc-master
- ubuntu-focal-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-github-ubuntu-focal-amd64
- wheel-manylinux2014-cp38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-wheel-manylinux2014-cp38
- wheel-osx-cp35m:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-wheel-osx-cp35m
- wheel-osx-cp37m:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-wheel-osx-cp37m
- wheel-win-cp35m:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-appveyor-wheel-win-cp35m

Succeeded Tasks:
- centos-6-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-github-centos-6-amd64
- centos-7-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-github-centos-7-amd64
- centos-8-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-github-centos-8-amd64
- conda-linux-gcc-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-linux-gcc-py36
- conda-linux-gcc-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-linux-gcc-py37
- conda-linux-gcc-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-linux-gcc-py38
- conda-osx-clang-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-osx-clang-py36
- conda-osx-clang-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-osx-clang-py37
- conda-osx-clang-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-azure-conda-osx-clang-py38
- debian-buster-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-github-debian-buster-amd64
- debian-stretch-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-github-debian-stretch-amd64
- gandiva-jar-osx:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-gandiva-jar-osx
- homebrew-cpp-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-homebrew-cpp-autobrew
- homebrew-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-homebrew-cpp
- homebrew-r-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-travis-homebrew-r-autobrew
- test-conda-cpp-valgrind:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-cpp-valgrind
- test-conda-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-cpp
- test-conda-python-3.6:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.6
- test-conda-python-3.7-dask-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.7-dask-latest
- test-conda-python-3.7-kartothek-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.7-kartothek-latest
- test-conda-python-3.7-kartothek-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-1-circle-test-conda-python-3.7-kartothek-master
- test-conda-python-3.7-pandas-

[jira] [Created] (ARROW-8407) [Rust] Add rustdoc for Dictionary type

2020-04-12 Thread Andy Grove (Jira)
Andy Grove created ARROW-8407:
-

 Summary: [Rust] Add rustdoc for Dictionary type
 Key: ARROW-8407
 URL: https://issues.apache.org/jira/browse/ARROW-8407
 Project: Apache Arrow
  Issue Type: Improvement
  Components: Rust
Reporter: Andy Grove
Assignee: Andy Grove
 Fix For: 0.17.0


Add rustdoc for Dictionary type



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Preparing for 0.17.0 Arrow release

2020-04-12 Thread Krisztián Szűcs
if you mean he connection error that's a flake. The kartothek build
nightly passes in the last 3 reports.

On Sun, Apr 12, 2020 at 3:57 AM Wes McKinney  wrote:
>
> I'm not able to reproduce the test-conda-python-3.7-kartothek-master
> failure locally with docker-compose, is that a flake or real?
>
> On Sat, Apr 11, 2020 at 7:29 AM Krisztián Szűcs
>  wrote:
> >
> > On Sat, Apr 11, 2020 at 12:37 PM Antoine Pitrou  wrote:
> > >
> > >
> > > Le 11/04/2020 à 12:34, Krisztián Szűcs a écrit :
> > > > - test-conda-python-3.7-turbodbc-latest:
> > > > - test-conda-python-3.7-turbodbc-master:
> > > >   The latest is important here, because the release would break the
> > > > interoperability with turbodbc.
> > > >   I need feedback on this from Uwe.
> > >
> > > For transparency, this was diagnosed and two issues were filed for 
> > > turbodbc:
> > > https://github.com/blue-yonder/turbodbc/issues/251
> > > https://github.com/blue-yonder/turbodbc/issues/250
> > >
> > > I'm not sure there's anything Arrow can do to restore compatibility.  If
> > > we relax array validation to avoid the validation failure that turbodbc
> > > is getting, the erroneously-constructed Arrow array could lead to
> > > further errors or crashes later on.
> > Than we shouldn't consider the turbodbc integration tests as blocker.
> >
> > Thanks Antoine!
> > >
> > > Regards
> > >
> > > Antoine.


[jira] [Created] (ARROW-8406) [Python] FileSystem.from_uri erases the drive on Windows

2020-04-12 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-8406:
--

 Summary: [Python] FileSystem.from_uri erases the drive on Windows
 Key: ARROW-8406
 URL: https://issues.apache.org/jira/browse/ARROW-8406
 Project: Apache Arrow
  Issue Type: Bug
  Components: C++, Python
Reporter: Krisztian Szucs


{code:python}
path = 
"C:\Users\VssAdministrator\AppData\Local\Temp\pytest-of-VssAdministrator\pytest-0\test_construct_from_single_fil0\single-file"
_, path = FileSystem.from_uri(path)
path == 
"/Users/VssAdministrator/AppData/Local/Temp/pytest-of-VssAdministrator/pytest-0/test_construct_from_single_fil0/single-file"
{code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (ARROW-8405) [Gandiva][UDF] Support complex datatype for UDF return type.

2020-04-12 Thread ZMZ91 (Jira)
ZMZ91 created ARROW-8405:


 Summary: [Gandiva][UDF] Support complex datatype for UDF return 
type.
 Key: ARROW-8405
 URL: https://issues.apache.org/jira/browse/ARROW-8405
 Project: Apache Arrow
  Issue Type: New Feature
  Components: C++ - Gandiva
Reporter: ZMZ91


Is it possible to return a complex datatype for a UDF, like vector or event 
dictionary? Checked 
[https://github.com/apache/arrow/blob/master/cpp/src/gandiva/precompiled/types.h]
 and found the types used there are all basic datatypes. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[NIGHTLY] Arrow Build Report for Job nightly-2020-04-12-0

2020-04-12 Thread Crossbow


Arrow Build Report for Job nightly-2020-04-12-0

All tasks: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0

Failed Tasks:
- conda-win-vs2015-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-win-vs2015-py36
- conda-win-vs2015-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-win-vs2015-py37
- conda-win-vs2015-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-win-vs2015-py38
- gandiva-jar-trusty:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-gandiva-jar-trusty
- test-conda-cpp-hiveserver2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-cpp-hiveserver2
- test-conda-python-3.7-hdfs-2.9.2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-hdfs-2.9.2
- test-conda-python-3.7-turbodbc-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-turbodbc-latest
- test-conda-python-3.7-turbodbc-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-turbodbc-master
- ubuntu-focal-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-github-ubuntu-focal-amd64
- wheel-osx-cp37m:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-wheel-osx-cp37m
- wheel-osx-cp38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-wheel-osx-cp38
- wheel-win-cp35m:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-appveyor-wheel-win-cp35m

Succeeded Tasks:
- centos-6-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-github-centos-6-amd64
- centos-7-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-github-centos-7-amd64
- centos-8-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-github-centos-8-amd64
- conda-linux-gcc-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-linux-gcc-py36
- conda-linux-gcc-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-linux-gcc-py37
- conda-linux-gcc-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-linux-gcc-py38
- conda-osx-clang-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-osx-clang-py36
- conda-osx-clang-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-osx-clang-py37
- conda-osx-clang-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-azure-conda-osx-clang-py38
- debian-buster-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-github-debian-buster-amd64
- debian-stretch-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-github-debian-stretch-amd64
- gandiva-jar-osx:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-gandiva-jar-osx
- homebrew-cpp-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-homebrew-cpp-autobrew
- homebrew-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-homebrew-cpp
- homebrew-r-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-travis-homebrew-r-autobrew
- test-conda-cpp-valgrind:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-cpp-valgrind
- test-conda-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-cpp
- test-conda-python-3.6:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.6
- test-conda-python-3.7-dask-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-dask-latest
- test-conda-python-3.7-kartothek-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-kartothek-latest
- test-conda-python-3.7-kartothek-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-kartothek-master
- test-conda-python-3.7-pandas-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-04-12-0-circle-test-conda-python-3.7-pandas-latest
- test-con