[GitHub] [arrow] jorgecarleitao opened a new pull request #7881: A trivial change to test CI.

2020-08-02 Thread GitBox 


jorgecarleitao opened a new pull request #7881:
URL: https://github.com/apache/arrow/pull/7881


   CI for rust is breaking on some of the PRs, I am making a trivial PR to test 
if we have a broken CI.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] 18dcb01 opened a new pull request #7883: ARROW-9620: [C++] Added split function to Gandiva

2020-08-02 Thread GitBox 


18dcb01 opened a new pull request #7883:
URL: https://github.com/apache/arrow/pull/7883


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7881: A trivial change to test CI.

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7881:
URL: https://github.com/apache/arrow/pull/7881#issuecomment-667708975


   
   
   Thanks for opening a pull request!
   
   Could you open an issue for this pull request on JIRA?
   https://issues.apache.org/jira/browse/ARROW
   
   Then could you also rename pull request title in the following format?
   
   ARROW-${JIRA_ID}: [${COMPONENT}] ${SUMMARY}
   
   See also:
   
 * [Other pull requests](https://github.com/apache/arrow/pulls/)
 * [Contribution Guidelines - How to contribute 
patches](https://arrow.apache.org/docs/developers/contributing.html#how-to-contribute-patches)
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] Harshitg opened a new issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox 


Harshitg opened a new issue #7882:
URL: https://github.com/apache/arrow/issues/7882


   Wanted to report the performance difference observed between Pandas and 
Pyarrow. 
   
   ```
   import numpy as np
   import pandas as pd
   import pyarrow as pa
   import pyarrow.compute as pc
   
   df = pd.DataFrame(np.random.randn(1))
   %timeit -n 5 -r 5 df.multiply(df)
   
   table = pa.Table.from_pandas(df)
   %timeit -n 5 -r 5 pc.multiply(table[0],table[0])
   ```
   
   Results:
   ```
   %timeit -n 5 -r 5 df.multiply(df)
   374 ms ± 15.9 ms per loop (mean ± std. dev. of 5 runs, 5 loops each)
   ```
   
   ```
   %timeit -n 5 -r 5 pc.multiply(table[0],table[0])
   698 ms ± 297 ms per loop (mean ± std. dev. of 5 runs, 5 loops each)
   ```



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] kszucs commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox 


kszucs commented on pull request #7816:
URL: https://github.com/apache/arrow/pull/7816#issuecomment-667720694


   I mean ignore_tomezone could be a useful conversion option for mixed 
timezone aware/naive input values (should be rare or rather discouraged 
though). 
   
   I agree with the deprecation plan. I'm on vacation next week, but hopefully 
@pitrou and @jorisvandenbossche will be able to take a look at it.



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7883: ARROW-9620: [C++] Added split function to Gandiva

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7883:
URL: https://github.com/apache/arrow/pull/7883#issuecomment-667722780


   https://issues.apache.org/jira/browse/ARROW-9620



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] jorgecarleitao opened a new pull request #7879: ARROW-9618: [Rust] [DataFusion] Simplified code around optimizers.

2020-08-02 Thread GitBox 


jorgecarleitao opened a new pull request #7879:
URL: https://github.com/apache/arrow/pull/7879


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7879: ARROW-9618: [Rust] [DataFusion] Simplified code around optimizers.

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7879:
URL: https://github.com/apache/arrow/pull/7879#issuecomment-667643163


   https://issues.apache.org/jira/browse/ARROW-9618



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7880: ARROW-9619: [Rust] [DataFusion] Add predicate push-down

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7880:
URL: https://github.com/apache/arrow/pull/7880#issuecomment-667668376


   https://issues.apache.org/jira/browse/ARROW-9619



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] jorgecarleitao commented on a change in pull request #7878: ARROW-9617: [Rust] [DataFusion] Add length of string array

2020-08-02 Thread GitBox 


jorgecarleitao commented on a change in pull request #7878:
URL: https://github.com/apache/arrow/pull/7878#discussion_r464083171



##
File path: rust/arrow/src/compute/kernels/length.rs
##
@@ -0,0 +1,197 @@
+// Licensed to the Apache Software Foundation (ASF) under one
+// or more contributor license agreements.  See the NOTICE file
+// distributed with this work for additional information
+// regarding copyright ownership.  The ASF licenses this file
+// to you under the Apache License, Version 2.0 (the
+// "License"); you may not use this file except in compliance
+// with the License.  You may obtain a copy of the License at
+//
+//   http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing,
+// software distributed under the License is distributed on an
+// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+// KIND, either express or implied.  See the License for the
+// specific language governing permissions and limitations
+// under the License.
+
+//! Defines kernel for length of a string array
+
+use crate::array::*;
+use crate::{
+datatypes::DataType,
+datatypes::UInt32Type,
+error::{ArrowError, Result},
+};
+use std::sync::Arc;
+
+fn as_u32_le(array: &[u8]) -> u32 {
+// le: little endian
+((array[0] as u32) << 0)
++ ((array[1] as u32) << 8)
++ ((array[2] as u32) << 16)
++ ((array[3] as u32) << 24)
+}
+
+/// Returns an array of UInt32 denoting the number of characters in each 
string in the array.
+///
+/// * this only accepts StringArray
+/// * lenght of null is null.
+/// * length of utf8 with more than one code point is the number of code points
+pub fn length(array: ) -> Result {
+match array.data_type() {
+DataType::Utf8 => {
+// note: offsets are stored as u8, but they can be interpreted as 
u32
+let offsets = array.data_ref().clone().buffers()[0].clone();
+let offsets = offsets.data();
+
+let mut builder = UInt32BufferBuilder::new(array.len());
+
+let mut previous_offset = 0;
+// the first u32 offset is always 0 and is not needed to compute 
lengths
+for i in (4..offsets.len()).step_by(4) {
+// interpret 4 u8 as 1 u32:
+let offset = as_u32_le([i..(i + 4)]);

Review comment:
   Great suggestions, @nevi-me , thanks a lot. Implemented it leading with 
+35% or so improvement.





This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] jorgecarleitao opened a new pull request #7880: ARROW-9619: [Rust] [DataFusion] Add predicate push-down

2020-08-02 Thread GitBox 


jorgecarleitao opened a new pull request #7880:
URL: https://github.com/apache/arrow/pull/7880


   This PR adds a new optimizer to push filters down. For example, a plan of 
the form 
   
   ```
   Selection: #SUM(c) Gt Int64(10)\
 Selection: #b Gt Int64(10)\
   Aggregate: groupBy=[[#b]], aggr=[[SUM(#c)]]\
 Projection: #a AS b, #c\
   TableScan: test projection=None"
   ```
   
   is converted to 
   
   ```
   Selection: #SUM(c) Gt Int64(10)\
 Aggregate: groupBy=[[#b]], aggr=[[SUM(#c)]]\
   Projection: #a AS b, #c\
 Selection: #a Gt Int64(10)\
   TableScan: test projection=None";
   ```
   
   (note how the filter expression changed, and how only the filter on the key 
of the aggregate was pushed)
   
   This works by performing two passes on the plan. On the first pass 
(analyze), it identifies:
   
   1. all filters are on the plan (selections)
   2. all projections are on the plan (projections)
   3. all places where a filter on a column cannot be pushed down (break_points)
   
   After this pass, it computes the maximum depth that a filter can be pushed 
down as well as the new expression that the filter should have, given all the 
projections that exist.
   
   On the second pass (optimize), it:
   
   * removes all old filters
   * adds all new filters
   
   See comments on the code for details.
   
   This PR is built on top of #7879 (first two commits).
   
   FYI @andygrove @sunchao 



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] wqc200 closed pull request #7884: add a new func for ExecutionContextSchemaProvider

2020-08-02 Thread GitBox 


wqc200 closed pull request #7884:
URL: https://github.com/apache/arrow/pull/7884


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] emkornfield commented on pull request #7846: ARROW-8445: [Gandiva][UDF][c++] Add a udf for gandiva to extract all named groups.

2020-08-02 Thread GitBox 


emkornfield commented on pull request #7846:
URL: https://github.com/apache/arrow/pull/7846#issuecomment-667785504


   @praveenbingo do you have time to review?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-667778103


   Revision: 1bc156e6e5a582f15d73a848153a578461c523dd
   
   Submitted crossbow builds: [ursa-labs/crossbow @ 
actions-454](https://github.com/ursa-labs/crossbow/branches/all?query=actions-454)
   
   |Task|Status|
   ||--|
   |centos-6-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-454-github-centos-6-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-454-github-centos-6-amd64)|
   
|centos-7-aarch64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-454-travis-centos-7-aarch64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |centos-7-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-454-github-centos-7-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-454-github-centos-7-amd64)|
   
|centos-8-aarch64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-454-travis-centos-8-aarch64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |centos-8-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-454-github-centos-8-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-454-github-centos-8-amd64)|
   
|conda-clean|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-clean)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-clean)|
   
|conda-linux-gcc-py36-cpu|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-linux-gcc-py36-cpu)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-linux-gcc-py36-cpu)|
   
|conda-linux-gcc-py36-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-linux-gcc-py36-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-linux-gcc-py36-cuda)|
   
|conda-linux-gcc-py37-cpu|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-linux-gcc-py37-cpu)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-linux-gcc-py37-cpu)|
   
|conda-linux-gcc-py37-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-linux-gcc-py37-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-linux-gcc-py37-cuda)|
   
|conda-linux-gcc-py38-cpu|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-linux-gcc-py38-cpu)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-linux-gcc-py38-cpu)|
   
|conda-linux-gcc-py38-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-linux-gcc-py38-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-linux-gcc-py38-cuda)|
   
|conda-osx-clang-py36|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-osx-clang-py36)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-osx-clang-py36)|
   
|conda-osx-clang-py37|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-osx-clang-py37)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-osx-clang-py37)|
   
|conda-osx-clang-py38|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-osx-clang-py38)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-osx-clang-py38)|
   
|conda-win-vs2017-py36|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-win-vs2017-py36)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-win-vs2017-py36)|
   
|conda-win-vs2017-py37|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-454-azure-conda-win-vs2017-py37)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1=actions-454-azure-conda-win-vs2017-py37)|

[GitHub] [arrow] emkornfield commented on issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox 


emkornfield commented on issue #7882:
URL: https://github.com/apache/arrow/issues/7882#issuecomment-667784048


   @zacqed thanks for the report.  We use 
[JIRA](https://issues.apache.org/jira/secure/Dashboard.jspa) could you report 
this here? Also what version of pyarrow?



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] emkornfield commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox 


emkornfield commented on pull request #7816:
URL: https://github.com/apache/arrow/pull/7816#issuecomment-667786442


   @github-actions crossbow submit test-conda-python-3.8-spark-master



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] wqc200 opened a new pull request #7884: add a new func for ExecutionContextSchemaProvider

2020-08-02 Thread GitBox 


wqc200 opened a new pull request #7884:
URL: https://github.com/apache/arrow/pull/7884


   I use ExecutionContextSchemaProvider in outside app, so i add keyword "pub" 
for ExecutionContextSchemaProvider, and  add a new func "new" for 
ExecutionContextSchemaProvider.
   
   I add keyword "pub" for build_schema also.
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7884: add a new func for ExecutionContextSchemaProvider

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7884:
URL: https://github.com/apache/arrow/pull/7884#issuecomment-667735983


   
   
   Thanks for opening a pull request!
   
   Could you open an issue for this pull request on JIRA?
   https://issues.apache.org/jira/browse/ARROW
   
   Then could you also rename pull request title in the following format?
   
   ARROW-${JIRA_ID}: [${COMPONENT}] ${SUMMARY}
   
   See also:
   
 * [Other pull requests](https://github.com/apache/arrow/pulls/)
 * [Contribution Guidelines - How to contribute 
patches](https://arrow.apache.org/docs/developers/contributing.html#how-to-contribute-patches)
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


kou commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-66693


   @github-actions crossbow submit -g nightly



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] emkornfield commented on issue #7877: Adding local persistence to examples/flight/server.py

2020-08-02 Thread GitBox 


emkornfield commented on issue #7877:
URL: https://github.com/apache/arrow/issues/7877#issuecomment-667784599


   @lhayhurst glad you solved the issue.  these types of discussions are best 
had on user@ or dev@ arrow mailing lists (we don't use github issues to answer 
questions/track bugs).  If you have further questions feel free to send mail to 
one of the lists.  



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] emkornfield closed issue #7877: Adding local persistence to examples/flight/server.py

2020-08-02 Thread GitBox 


emkornfield closed issue #7877:
URL: https://github.com/apache/arrow/issues/7877


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] sagnikc-dremio opened a new pull request #7885: Implement round() function

2020-08-02 Thread GitBox 


sagnikc-dremio opened a new pull request #7885:
URL: https://github.com/apache/arrow/pull/7885


   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7885: Implement round() function

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7885:
URL: https://github.com/apache/arrow/pull/7885#issuecomment-667791168


   
   
   Thanks for opening a pull request!
   
   Could you open an issue for this pull request on JIRA?
   https://issues.apache.org/jira/browse/ARROW
   
   Then could you also rename pull request title in the following format?
   
   ARROW-${JIRA_ID}: [${COMPONENT}] ${SUMMARY}
   
   See also:
   
 * [Other pull requests](https://github.com/apache/arrow/pulls/)
 * [Contribution Guidelines - How to contribute 
patches](https://arrow.apache.org/docs/developers/contributing.html#how-to-contribute-patches)
   



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


kou commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-667793688


   @github-actions crossbow submit -g example -g linux



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] zacqed commented on issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox 


zacqed commented on issue #7882:
URL: https://github.com/apache/arrow/issues/7882#issuecomment-667800722


   Sure, i will open JIRA and confirm. The pyarrow version is 1.0.0



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] projjal opened a new pull request #7886: ARROW-9622: [Java] Fixed UnsupportedOperationExceptio in complexcopier with null value in unionvector inside st…

2020-08-02 Thread GitBox 


projjal opened a new pull request #7886:
URL: https://github.com/apache/arrow/pull/7886


   …ructvector



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-667806486


   Revision: 0cb21e889c61253ebeafde46de9989c553c62c32
   
   Submitted crossbow builds: [ursa-labs/crossbow @ 
actions-457](https://github.com/ursa-labs/crossbow/branches/all?query=actions-457)
   
   |Task|Status|
   ||--|
   |centos-6-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-centos-6-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-centos-6-amd64)|
   
|centos-7-aarch64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-centos-7-aarch64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |centos-7-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-centos-7-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-centos-7-amd64)|
   
|centos-8-aarch64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-centos-8-aarch64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |centos-8-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-centos-8-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-centos-8-amd64)|
   |debian-buster-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-debian-buster-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-debian-buster-amd64)|
   
|debian-buster-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-debian-buster-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |debian-stretch-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-debian-stretch-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-debian-stretch-amd64)|
   
|debian-stretch-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-debian-stretch-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-bionic-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-ubuntu-bionic-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-ubuntu-bionic-amd64)|
   
|ubuntu-bionic-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-ubuntu-bionic-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-eoan-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-ubuntu-eoan-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-ubuntu-eoan-amd64)|
   
|ubuntu-eoan-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-ubuntu-eoan-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-focal-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-ubuntu-focal-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-ubuntu-focal-amd64)|
   
|ubuntu-focal-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-ubuntu-focal-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-xenial-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-457-github-ubuntu-xenial-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-457-github-ubuntu-xenial-amd64)|
   
|ubuntu-xenial-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-457-travis-ubuntu-xenial-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   
|wheel-win-cp35m|[![Appveyor](https://img.shields.io/appveyor/ci/ursa-labs/crossbow/actions-457-appveyor-wheel-win-cp35m.svg)](https://ci.appveyor.com/project/ursa-labs/crossbow/history)|
   
|wheel-win-cp36m|[![Appveyor](https://img.shields.io/appveyor/ci/ursa-labs/crossbow/actions-457-appveyor-wheel-win-cp36m.svg)](https://ci.appveyor.com/project/ursa-labs/crossbow/history)|
   
|wheel-win-cp37m|[![Appveyor](https://img.shields.io/appveyor/ci/ursa-labs/crossbow/actions-457-appveyor-wheel-win-cp37m.svg)](https://ci.appveyor.com/project/ursa-labs/crossbow/history)|
   
|wheel-win-cp38|[![Appveyor](https://img.shields.io/appveyor/ci/ursa-labs/crossbow/actions-457-appveyor-wheel-win-cp38.svg)](https://ci.appveyor.com/project/ursa-labs/crossbow/history)|



This is an automated message from the Apache Git Service.
To respond

[GitHub] [arrow] emkornfield commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox 


emkornfield commented on pull request #7816:
URL: https://github.com/apache/arrow/pull/7816#issuecomment-667815553


   @github-actions crossbow submit test-conda-python-3.8-spark-master



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


kou commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-667789090


   @tobim Most of changes are done. I'm working on the last check. Could you 
confirm the current code and the updated PR description? If the last check is 
done and addressed your feedback, I'll merge this.
   
   Here are summary of my changes 
https://github.com/apache/arrow/compare/76b4b022179f94bdb5b77086acf253b6a7bcbbe9...3aed2131e18a7f9db00cd446fc887d78e777686a
 :
   
 * Export `ARROW_LIBRARY_PATH_SUFFIXES` and `ARROW_INCLUDE_PATH_SUFFIXES` 
to `ArrowConfig.cmake` instead of copying definitions of `LIB_PATH_SUFFIXES` 
and `INCLUDE_PATH_SUFFIXES`.
 * Rename `ARROW_USE_SHARED_SYSTEM_LIBS` to `ARROW_DEPENDENCY_USE_SHARED` 
because we already have `ARROW_DEPENDENCY_SOURCE` option that is the default 
value of `*_SOURCE`.
 * Don't use `ARROW_DEPENDENCY_USE_SHARED` as the default value of 
`ARROW_THRIFT_USE_SHARED_DEFAULT` on Windows because it seems that Thrift's DLL 
support isn't well for now.
 * Use more strict library names for LZ4, ZStandard, Snappy, Thrift and 
utf8proc. I confirmed library names of them on WIndows by provided binaries and 
build configuration files of them.
 * Use only package names (`ARROW_SYSTEM_DEPENDENCIES`) instead of 
`find_dependency(...)` (`ARROW_FIND_DEPENDENCY_LIST`) to provide 
`find_dependency()` list to `ArrowConfig.cmake` because it'll be simpler.
 * Use Docker Compose instead of raw Docker in 
`cpp/examples/minimal_build/` to manage multiple build configurations.
   * I split one `Dockerfile` that contains `*-dev` packages to 
`Dockerfile` with/without `*-dev` packages to show our build system uses 
bundled libraries for nonexistent dependencies by default.
   
   The AppVeyor failure is unrelated: 
https://issues.apache.org/jira/browse/ARROW-9621



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7816:
URL: https://github.com/apache/arrow/pull/7816#issuecomment-667789181


   Revision: e27e86cdc83dede4bb70c49ac5af2fb3a0494c51
   
   Submitted crossbow builds: [ursa-labs/crossbow @ 
actions-455](https://github.com/ursa-labs/crossbow/branches/all?query=actions-455)
   
   |Task|Status|
   ||--|
   |test-conda-python-3.8-spark-master|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-455-github-test-conda-python-3.8-spark-master)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-455-github-test-conda-python-3.8-spark-master)|



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] emkornfield commented on issue #7882: Performance difference between pc.multiply vs pd.multiply

2020-08-02 Thread GitBox 


emkornfield commented on issue #7882:
URL: https://github.com/apache/arrow/issues/7882#issuecomment-667807803


   Thanks, also if you are using prebuilt wheels, I think this could be due to 
the target compiler settings (I would guess numpy multiply has dynamic dispatch 
for more recent CPUs where this is something that we are working on 
implementing)



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7816: ARROW-9528: [Python] Honor tzinfo when converting from datetime

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7816:
URL: https://github.com/apache/arrow/pull/7816#issuecomment-667816017


   Revision: b4e3b9d4dcf3da6c7fa3e652d5b77fc4e7abad13
   
   Submitted crossbow builds: [ursa-labs/crossbow @ 
actions-458](https://github.com/ursa-labs/crossbow/branches/all?query=actions-458)
   
   |Task|Status|
   ||--|
   |test-conda-python-3.8-spark-master|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-458-github-test-conda-python-3.8-spark-master)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-458-github-test-conda-python-3.8-spark-master)|



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] github-actions[bot] commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-667794158


   Revision: d34763c65d5dd69f990f97d0a0a8787f4c8c425b
   
   Submitted crossbow builds: [ursa-labs/crossbow @ 
actions-456](https://github.com/ursa-labs/crossbow/branches/all?query=actions-456)
   
   |Task|Status|
   ||--|
   |centos-6-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-centos-6-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-centos-6-amd64)|
   
|centos-7-aarch64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-centos-7-aarch64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |centos-7-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-centos-7-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-centos-7-amd64)|
   
|centos-8-aarch64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-centos-8-aarch64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |centos-8-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-centos-8-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-centos-8-amd64)|
   |debian-buster-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-debian-buster-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-debian-buster-amd64)|
   
|debian-buster-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-debian-buster-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |debian-stretch-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-debian-stretch-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-debian-stretch-amd64)|
   
|debian-stretch-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-debian-stretch-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |example-cpp-minimal-build-static|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-example-cpp-minimal-build-static)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-example-cpp-minimal-build-static)|
   |example-cpp-minimal-build-static-system-dependency|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-example-cpp-minimal-build-static-system-dependency)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-example-cpp-minimal-build-static-system-dependency)|
   |ubuntu-bionic-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-ubuntu-bionic-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-ubuntu-bionic-amd64)|
   
|ubuntu-bionic-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-ubuntu-bionic-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-eoan-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-ubuntu-eoan-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-ubuntu-eoan-amd64)|
   
|ubuntu-eoan-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-ubuntu-eoan-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-focal-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-ubuntu-focal-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-ubuntu-focal-amd64)|
   
|ubuntu-focal-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-ubuntu-focal-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|
   |ubuntu-xenial-amd64|[![Github 
Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-456-github-ubuntu-xenial-amd64)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-456-github-ubuntu-xenial-amd64)|
   
|ubuntu-xenial-arm64|[![TravisCI](https://img.shields.io/travis/ursa-labs/crossbow/actions-456-travis-ubuntu-xenial-arm64.svg)](https://travis-ci.org/ursa-labs/crossbow/branches)|



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this

[GitHub] [arrow] github-actions[bot] commented on pull request #7886: ARROW-9622: [Java] Fixed UnsupportedOperationException in complexcopier with null value in unionvector inside st…

2020-08-02 Thread GitBox 


github-actions[bot] commented on pull request #7886:
URL: https://github.com/apache/arrow/pull/7886#issuecomment-667804677


   https://issues.apache.org/jira/browse/ARROW-9622



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [arrow] kou commented on pull request #7842: ARROW-9412: [C++] Add non-bundled dependencies to INTERFACE_LINK_LIBRARIES of static libarrow

2020-08-02 Thread GitBox 


kou commented on pull request #7842:
URL: https://github.com/apache/arrow/pull/7842#issuecomment-667805956


   @github-actions crossbow submit -g linux wheel-win-*



This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org