[GitHub] [arrow] jorgecarleitao commented on a change in pull request #7876: ARROW-9615: [Rust] Added kernel to compute length of a string.

2020-08-11 Thread GitBox
jorgecarleitao commented on a change in pull request #7876: URL: https://github.com/apache/arrow/pull/7876#discussion_r469002405 ## File path: rust/arrow/src/compute/kernels/length.rs ## @@ -0,0 +1,185 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

[GitHub] [arrow] jorgecarleitao commented on pull request #7879: ARROW-9618: [Rust] [DataFusion] Made it easier to write optimizers

2020-08-11 Thread GitBox
jorgecarleitao commented on pull request #7879: URL: https://github.com/apache/arrow/pull/7879#issuecomment-672568598 Thanks, @andygrove . This is now rebased. This is an automated message from the Apache Git Service. To

[GitHub] [arrow] andygrove commented on pull request #7879: ARROW-9618: [Rust] [DataFusion] Made it easier to write optimizers

2020-08-11 Thread GitBox
andygrove commented on pull request #7879: URL: https://github.com/apache/arrow/pull/7879#issuecomment-672564651 I did a quick review of this PR and it looks good I think. @jorgecarleitao would you mind rebasing it and I'll find time this week for a more thorough review.

[GitHub] [arrow] andygrove commented on pull request #7797: ARROW-4189 [Rust] Added coverage report.

2020-08-11 Thread GitBox
andygrove commented on pull request #7797: URL: https://github.com/apache/arrow/pull/7797#issuecomment-672564300 @jorgecarleitao So I saw that #7799 was merged. What does that mean for this PR now? This is an automated

[GitHub] [arrow] liyafan82 commented on a change in pull request #7326: ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

2020-08-11 Thread GitBox
liyafan82 commented on a change in pull request #7326: URL: https://github.com/apache/arrow/pull/7326#discussion_r468987274 ## File path: java/vector/src/main/java/org/apache/arrow/vector/VectorUnloader.java ## @@ -76,6 +97,10 @@ private void appendNodes(FieldVector vector,

[GitHub] [arrow] liyafan82 commented on a change in pull request #7326: ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

2020-08-11 Thread GitBox
liyafan82 commented on a change in pull request #7326: URL: https://github.com/apache/arrow/pull/7326#discussion_r468987159 ## File path: java/vector/src/main/java/org/apache/arrow/vector/compression/CompressionUtil.java ## @@ -0,0 +1,60 @@ +/* + * Licensed to the Apache

[GitHub] [arrow] liyafan82 commented on a change in pull request #7326: ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

2020-08-11 Thread GitBox
liyafan82 commented on a change in pull request #7326: URL: https://github.com/apache/arrow/pull/7326#discussion_r468986947 ## File path: java/vector/src/main/java/org/apache/arrow/vector/ipc/message/MessageSerializer.java ## @@ -408,11 +408,15 @@ public static

[GitHub] [arrow] liyafan82 commented on a change in pull request #7326: ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

2020-08-11 Thread GitBox
liyafan82 commented on a change in pull request #7326: URL: https://github.com/apache/arrow/pull/7326#discussion_r468986440 ## File path: java/vector/src/main/java/org/apache/arrow/vector/compression/DefaultCompressionCodec.java ## @@ -0,0 +1,54 @@ +/* + * Licensed to the

[GitHub] [arrow] liyafan82 commented on a change in pull request #7326: ARROW-9010: [Java] Framework and interface changes for RecordBatch IPC buffer compression

2020-08-11 Thread GitBox
liyafan82 commented on a change in pull request #7326: URL: https://github.com/apache/arrow/pull/7326#discussion_r468986032 ## File path: java/vector/src/main/java/org/apache/arrow/vector/compression/DefaultCompressionCodec.java ## @@ -0,0 +1,54 @@ +/* + * Licensed to the

[GitHub] [arrow] andygrove closed pull request #7930: ARROW-9691: [Rust] [DataFusion] Make sql_statement_to_plan method public

2020-08-11 Thread GitBox
andygrove closed pull request #7930: URL: https://github.com/apache/arrow/pull/7930 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #7935: ARROW-9696: [Rust] [DataFusion] fix nested binary expressions

2020-08-11 Thread GitBox
andygrove closed pull request #7935: URL: https://github.com/apache/arrow/pull/7935 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #7924: ARROW-9653: [Rust][DataFusion] Do not error in planner with SQL has multiple group by expressions

2020-08-11 Thread GitBox
andygrove closed pull request #7924: URL: https://github.com/apache/arrow/pull/7924 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] github-actions[bot] commented on pull request #7936: ARROW-9679: [Rust] [DataFusion] More efficient creation of final batch from HashAggregateExec [DRAFT]

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7936: URL: https://github.com/apache/arrow/pull/7936#issuecomment-672408880 https://issues.apache.org/jira/browse/ARROW-9679 This is an automated message from the Apache Git

[GitHub] [arrow] andygrove commented on pull request #7936: ARROW-9679: [Rust] [DataFusion] More efficient creation of final batch from HashAggregateExec [DRAFT]

2020-08-11 Thread GitBox
andygrove commented on pull request #7936: URL: https://github.com/apache/arrow/pull/7936#issuecomment-672393908 @alamb @jorgecarleitao @houqp fyi, since you've all been contributing to DataFusion lately This is an

[GitHub] [arrow] andygrove opened a new pull request #7936: ARROW-9679: [Rust] [DataFusion] More efficient creation of final batch from HashAggregateExec [DRAFT]

2020-08-11 Thread GitBox
andygrove opened a new pull request #7936: URL: https://github.com/apache/arrow/pull/7936 This isn't quite there yet. I hope to wrap this up tomorrow. This is an automated message from the Apache Git Service. To respond to

[GitHub] [arrow] mrkn edited a comment on pull request #7898: ARROW-9642: [C++] Let MakeBuilder refer DictionaryType's index_type for deciding the starting bit width of the indices

2020-08-11 Thread GitBox
mrkn edited a comment on pull request #7898: URL: https://github.com/apache/arrow/pull/7898#issuecomment-672392348 @pitrou @wesm I found that `DictionaryBuilderCase` rejects that the value type is `NullType` though there is the specialization of `DictionaryBuilderBase` with `T=NullType`.

[GitHub] [arrow] mrkn commented on pull request #7898: ARROW-9642: [C++] Let MakeBuilder refer DictionaryType's index_type for deciding the starting bit width of the indices

2020-08-11 Thread GitBox
mrkn commented on pull request #7898: URL: https://github.com/apache/arrow/pull/7898#issuecomment-672392348 @pitrou @wesm I found that DictionaryBuilderCase rejects that the value type is NullType though there is the specialization of DictionaryBuilderBase with T=NullType. Is this

[GitHub] [arrow] github-actions[bot] commented on pull request #7935: ARROW-9696: [Rust] [DataFusion] fix nested binary expressions

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7935: URL: https://github.com/apache/arrow/pull/7935#issuecomment-672284943 https://issues.apache.org/jira/browse/ARROW-9696 This is an automated message from the Apache Git

[GitHub] [arrow] mcassels opened a new pull request #7935: ARROW-9696: [Rust] [DataFusion] fix nested binary expressions

2020-08-11 Thread GitBox
mcassels opened a new pull request #7935: URL: https://github.com/apache/arrow/pull/7935 Nested binary expressions like `(a+b)/2` were previously supported and were broken by the upgrade to sqlparser 0.6.1. This is an

[GitHub] [arrow] github-actions[bot] commented on pull request #7934: ARROW-9695: Improve comments on LogicalPlan enum variants

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7934: URL: https://github.com/apache/arrow/pull/7934#issuecomment-672264125 https://issues.apache.org/jira/browse/ARROW-9695 This is an automated message from the Apache Git

[GitHub] [arrow] alamb opened a new pull request #7934: ARROW-9695: Improve comments on LogicalPlan enum variants

2020-08-11 Thread GitBox
alamb opened a new pull request #7934: URL: https://github.com/apache/arrow/pull/7934 While reviewing the DataFusion code more (thanks again for this great piece of work) I have some small suggestions on improving the documentation that I would have personally appreciated while reading

[GitHub] [arrow] nealrichardson closed pull request #7929: ARROW-9602: [R] Improve cmake detection in Linux build

2020-08-11 Thread GitBox
nealrichardson closed pull request #7929: URL: https://github.com/apache/arrow/pull/7929 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] pitrou closed pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
pitrou closed pull request #7931: URL: https://github.com/apache/arrow/pull/7931 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] pitrou commented on pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
pitrou commented on pull request #7931: URL: https://github.com/apache/arrow/pull/7931#issuecomment-672166964 +1, will merge This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [arrow] corleyma commented on pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
corleyma commented on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-672112334 > @corleyma Can you apply this patch? https://gist.github.com/pitrou/0dc970a2238b9c19b5f8fb991d2fb8f7 Whoops, didn't notice you were playing in this fork too. I'll quit

[GitHub] [arrow] kszucs commented on pull request #7933: [Release] Cherry-pick commits to 1.0.x maintenance branch

2020-08-11 Thread GitBox
kszucs commented on pull request #7933: URL: https://github.com/apache/arrow/pull/7933#issuecomment-672077311 I was using `-X theirs` during the cherry-pick which I'm going to remove to have explicit resolution about possible cherry-pick conflicts.

[GitHub] [arrow] github-actions[bot] commented on pull request #7933: [Release] Cherry-pick commits to 1.0.x maintenance branch

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7933: URL: https://github.com/apache/arrow/pull/7933#issuecomment-672062600 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then

[GitHub] [arrow] kszucs opened a new pull request #7933: [Release] Cherry-pick commits to 1.0.x maintenance branch

2020-08-11 Thread GitBox
kszucs opened a new pull request #7933: URL: https://github.com/apache/arrow/pull/7933 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] github-actions[bot] commented on pull request #7932: [Developer] Refactor archery release scripts [WIP]

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7932: URL: https://github.com/apache/arrow/pull/7932#issuecomment-672039769 Thanks for opening a pull request! Could you open an issue for this pull request on JIRA? https://issues.apache.org/jira/browse/ARROW Then

[GitHub] [arrow] kszucs opened a new pull request #7932: [Developer] Refactor archery release scripts [WIP]

2020-08-11 Thread GitBox
kszucs opened a new pull request #7932: URL: https://github.com/apache/arrow/pull/7932 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] pitrou closed pull request #7920: ARROW-9638: [C++][Compute] Implement mode kernel

2020-08-11 Thread GitBox
pitrou closed pull request #7920: URL: https://github.com/apache/arrow/pull/7920 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] pitrou commented on pull request #7909: ARROW-9659: [C++] Fix RecordBatchStreamReader when source is CudaBufferReader

2020-08-11 Thread GitBox
pitrou commented on pull request #7909: URL: https://github.com/apache/arrow/pull/7909#issuecomment-672026104 This PR is definitely a bit ad hoc, but it's required to fix the observed regression. I think we need to find a strategy later on for dealing with manipulations of GPU-located

[GitHub] [arrow] pitrou commented on pull request #7909: ARROW-9659: [C++] Fix RecordBatchStreamReader when source is CudaBufferReader

2020-08-11 Thread GitBox
pitrou commented on pull request #7909: URL: https://github.com/apache/arrow/pull/7909#issuecomment-672024248 I rebased and added some changes. This is an automated message from the Apache Git Service. To respond to the

[GitHub] [arrow] github-actions[bot] commented on pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7931: URL: https://github.com/apache/arrow/pull/7931#issuecomment-672007067 Revision: 8175df5754f677e213629e360e20611a492b9921 Submitted crossbow builds: [ursa-labs/crossbow @

[GitHub] [arrow] mrkn commented on a change in pull request #7898: ARROW-9642: [C++] Let MakeBuilder refer DictionaryType's index_type for deciding the starting bit width of the indices

2020-08-11 Thread GitBox
mrkn commented on a change in pull request #7898: URL: https://github.com/apache/arrow/pull/7898#discussion_r468657312 ## File path: cpp/src/arrow/array/builder_dict.h ## @@ -409,6 +409,10 @@ class DictionaryBuilder : public internal::DictionaryBuilderBase; using

[GitHub] [arrow] pitrou commented on pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
pitrou commented on pull request #7931: URL: https://github.com/apache/arrow/pull/7931#issuecomment-672005624 @github-actions crossbow submit -g wheel This is an automated message from the Apache Git Service. To respond to

[GitHub] [arrow] mrkn commented on a change in pull request #7898: ARROW-9642: [C++] Let MakeBuilder refer DictionaryType's index_type for deciding the starting bit width of the indices

2020-08-11 Thread GitBox
mrkn commented on a change in pull request #7898: URL: https://github.com/apache/arrow/pull/7898#discussion_r468656539 ## File path: cpp/src/arrow/array/array_dict_test.cc ## @@ -22,6 +22,8 @@ #include #include +#include Review comment: This should be removed

[GitHub] [arrow] nealrichardson commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
nealrichardson commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-672004398 > If I disable the arrow unity build, then it succeeds in linking aws-sdk, but then it fails building the vendored jemalloc. If I disable both jemalloc and unity-build,

[GitHub] [arrow] nealrichardson commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
nealrichardson commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-672004049 In https://travis-ci.org/github/ursa-labs/crossbow/builds/716930465 it seems that cmake can't find aws-c-common, though I see it is downloaded, so I wonder if we're

[GitHub] [arrow] jorgecarleitao commented on pull request #7930: ARROW-9691: [Rust] [DataFusion] Make sql_statement_to_plan method public

2020-08-11 Thread GitBox
jorgecarleitao commented on pull request #7930: URL: https://github.com/apache/arrow/pull/7930#issuecomment-672001189 LGTM! This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [arrow] andygrove commented on pull request #7930: ARROW-9691: [Rust] [DataFusion] Make sql_statement_to_plan method public

2020-08-11 Thread GitBox
andygrove commented on pull request #7930: URL: https://github.com/apache/arrow/pull/7930#issuecomment-671999147 @alamb @jorgecarleitao fyi This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow] andygrove closed pull request #7918: ARROW-9521: [Rust][DataFusion] Handle custom CSV file extensions

2020-08-11 Thread GitBox
andygrove closed pull request #7918: URL: https://github.com/apache/arrow/pull/7918 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #7925: ARROW-9683: [Rust][DataFusion] Add debug printing to physical plans and associated types

2020-08-11 Thread GitBox
andygrove closed pull request #7925: URL: https://github.com/apache/arrow/pull/7925 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] jeroen commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
jeroen commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671994419 If I disable the arrow unity build, then it succeeds in linking aws-sdk, but then it fails building the vendored jemalloc. If I disable both jemalloc and unity-build, then

[GitHub] [arrow] github-actions[bot] commented on pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7931: URL: https://github.com/apache/arrow/pull/7931#issuecomment-671982553 https://issues.apache.org/jira/browse/ARROW-9692 This is an automated message from the Apache Git

[GitHub] [arrow] nealrichardson commented on a change in pull request #7929: ARROW-9602: [R] Improve cmake detection in Linux build

2020-08-11 Thread GitBox
nealrichardson commented on a change in pull request #7929: URL: https://github.com/apache/arrow/pull/7929#discussion_r468626923 ## File path: r/tools/linuxlibs.R ## @@ -315,8 +315,13 @@ build_libarrow <- function(src_dir, dst_dir) { } ensure_cmake <- function() { - cmake

[GitHub] [arrow] github-actions[bot] commented on pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7931: URL: https://github.com/apache/arrow/pull/7931#issuecomment-671980613 Revision: 8175df5754f677e213629e360e20611a492b9921 Submitted crossbow builds: [ursa-labs/crossbow @

[GitHub] [arrow] github-actions[bot] commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671979365 Revision: 3e72b7ad35355b66ae9b34d2d26dbcb879d19f82 Submitted crossbow builds: [ursa-labs/crossbow @

[GitHub] [arrow] pitrou commented on pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
pitrou commented on pull request #7931: URL: https://github.com/apache/arrow/pull/7931#issuecomment-671977144 @github-actions crossbow submit -g python This is an automated message from the Apache Git Service. To respond to

[GitHub] [arrow] nealrichardson commented on a change in pull request #7929: ARROW-9602: [R] Improve cmake detection in Linux build

2020-08-11 Thread GitBox
nealrichardson commented on a change in pull request #7929: URL: https://github.com/apache/arrow/pull/7929#discussion_r468620814 ## File path: r/tools/linuxlibs.R ## @@ -315,8 +315,13 @@ build_libarrow <- function(src_dir, dst_dir) { } ensure_cmake <- function() { - cmake

[GitHub] [arrow] pitrou opened a new pull request #7931: ARROW-9692: [Python] Fix distutils-related warning

2020-08-11 Thread GitBox
pitrou opened a new pull request #7931: URL: https://github.com/apache/arrow/pull/7931 Setuptools should be imported before distutils. This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow] nealrichardson commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
nealrichardson commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671975955 @github-actions crossbow submit homebrew-cpp-autobrew This is an automated message from the Apache Git

[GitHub] [arrow] jeroen commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
jeroen commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671973724 Maybe there is a problem with the unity builds of aws-sdk-cpp or arrow This is an automated message from the

[GitHub] [arrow] pitrou commented on a change in pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
pitrou commented on a change in pull request #7803: URL: https://github.com/apache/arrow/pull/7803#discussion_r468605319 ## File path: cpp/src/arrow/filesystem/s3fs_test.cc ## @@ -197,6 +201,44 @@ TEST(S3Options, FromUri) { ASSERT_RAISES(Invalid,

[GitHub] [arrow] pitrou edited a comment on pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
pitrou edited a comment on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671959521 > Is there anything I need to do to get the CI systems to pick up the new conda-forge packages? I don't think so, perhaps there is a CDN in-between that delays the

[GitHub] [arrow] pitrou edited a comment on pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
pitrou edited a comment on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671963588 @corleyma Can you apply this patch? https://gist.github.com/pitrou/0dc970a2238b9c19b5f8fb991d2fb8f7 This

[GitHub] [arrow] github-actions[bot] commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671963778 Revision: 9a8364dd3e89052f2925f34fc591f5e17563ab90 Submitted crossbow builds: [ursa-labs/crossbow @

[GitHub] [arrow] pitrou commented on pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
pitrou commented on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671963588 @corleyma Can you apply this patch? This is an automated message from the Apache Git Service. To respond to the

[GitHub] [arrow] nealrichardson commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
nealrichardson commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671961594 @github-actions crossbow submit homebrew-cpp-autobrew This is an automated message from the Apache Git

[GitHub] [arrow] pitrou commented on pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
pitrou commented on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671961201 @corleyma Hmm, it seems that by force-pushing you deleted the changes I made yesterday. This is an automated

[GitHub] [arrow] pitrou commented on pull request #7803: ARROW-9517: [C++/Python] Add support for temporary credentials to S3Options

2020-08-11 Thread GitBox
pitrou commented on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671959521 > Is there anything I need to do to get the CI systems to pick up the new conda-forge packages? I don't think so, perhaps there is a CDN in-between that delays the package

[GitHub] [arrow] pitrou commented on pull request #7920: ARROW-9638: [C++][Compute] Implement mode kernel

2020-08-11 Thread GitBox
pitrou commented on pull request #7920: URL: https://github.com/apache/arrow/pull/7920#issuecomment-671958639 Rebased and pushed a tiny change. Will merge if/when CI is green. This is an automated message from the Apache Git

[GitHub] [arrow] nevi-me commented on a change in pull request #7876: ARROW-9615: [Rust] Added kernel to compute length of a string.

2020-08-11 Thread GitBox
nevi-me commented on a change in pull request #7876: URL: https://github.com/apache/arrow/pull/7876#discussion_r468582014 ## File path: rust/arrow/src/compute/kernels/length.rs ## @@ -0,0 +1,185 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more

[GitHub] [arrow] nevi-me commented on a change in pull request #7876: ARROW-9615: [Rust] Added kernel to compute length of a string.

2020-08-11 Thread GitBox
nevi-me commented on a change in pull request #7876: URL: https://github.com/apache/arrow/pull/7876#discussion_r468581694 ## File path: rust/arrow/src/compute/kernels/length.rs ## @@ -0,0 +1,185 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more

[GitHub] [arrow] github-actions[bot] commented on pull request #7930: ARROW-9691: [Rust] [DataFusion] Make sql_statement_to_plan method public

2020-08-11 Thread GitBox
github-actions[bot] commented on pull request #7930: URL: https://github.com/apache/arrow/pull/7930#issuecomment-671948694 https://issues.apache.org/jira/browse/ARROW-9691 This is an automated message from the Apache Git

[GitHub] [arrow] andygrove opened a new pull request #7930: ARROW-9691: [Rust] [DataFusion] Make sql_statement_to_plan method public

2020-08-11 Thread GitBox
andygrove opened a new pull request #7930: URL: https://github.com/apache/arrow/pull/7930 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] wesm closed issue #7910: OSError: Could not connect to socket

2020-08-11 Thread GitBox
wesm closed issue #7910: URL: https://github.com/apache/arrow/issues/7910 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] pitrou commented on pull request #7928: ARROW-6437: [R] Add AWS SDK to system dependencies for macOS and Windows

2020-08-11 Thread GitBox
pitrou commented on pull request #7928: URL: https://github.com/apache/arrow/pull/7928#issuecomment-671932929 No idea. Can we have the entire output from `make`? This is an automated message from the Apache Git Service. To

[GitHub] [arrow] rymurr commented on a change in pull request #7768: ARROW-9475: [Java] Clean up usages of BaseAllocator, use BufferAllocator in…

2020-08-11 Thread GitBox
rymurr commented on a change in pull request #7768: URL: https://github.com/apache/arrow/pull/7768#discussion_r468539432 ## File path: java/memory/memory-core/src/main/java/org/apache/arrow/memory/BufferAllocator.java ## @@ -126,6 +134,30 @@ BufferAllocator newChildAllocator(

[GitHub] [arrow] pitrou commented on pull request #7908: ARROW-9358: [Integration] remove generated_large_batch.json

2020-08-11 Thread GitBox
pitrou commented on pull request #7908: URL: https://github.com/apache/arrow/pull/7908#issuecomment-671836605 No urgency at all. This is just an improvement in development comfort. This is an automated message from the

[GitHub] [arrow] emkornfield commented on pull request #7908: ARROW-9358: [Integration] remove generated_large_batch.json

2020-08-11 Thread GitBox
emkornfield commented on pull request #7908: URL: https://github.com/apache/arrow/pull/7908#issuecomment-671835723 Is there an urgency for this? Have my hands full at work today and tomorrow at least, i can try to look later in the week?

[GitHub] [arrow] pitrou commented on a change in pull request #7929: ARROW-9602: [R] Improve cmake detection in Linux build

2020-08-11 Thread GitBox
pitrou commented on a change in pull request #7929: URL: https://github.com/apache/arrow/pull/7929#discussion_r468419449 ## File path: r/tools/linuxlibs.R ## @@ -315,8 +315,13 @@ build_libarrow <- function(src_dir, dst_dir) { } ensure_cmake <- function() { - cmake <-

[GitHub] [arrow] pitrou commented on a change in pull request #7929: ARROW-9602: [R] Improve cmake detection in Linux build

2020-08-11 Thread GitBox
pitrou commented on a change in pull request #7929: URL: https://github.com/apache/arrow/pull/7929#discussion_r468418886 ## File path: r/tools/linuxlibs.R ## @@ -315,8 +315,13 @@ build_libarrow <- function(src_dir, dst_dir) { } ensure_cmake <- function() { - cmake <-

[GitHub] [arrow] corleyma edited a comment on pull request #7803: ARROW-9517: [C++/Python] Add optional session_token to S3Options

2020-08-11 Thread GitBox
corleyma edited a comment on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671774899 > I've submitted a PR for conda-forge at [conda-forge/aws-sdk-cpp-feedstock#124](https://github.com/conda-forge/aws-sdk-cpp-feedstock/pull/124) Thanks for that

[GitHub] [arrow] corleyma commented on pull request #7803: ARROW-9517: [C++/Python] Add optional session_token to S3Options

2020-08-11 Thread GitBox
corleyma commented on pull request #7803: URL: https://github.com/apache/arrow/pull/7803#issuecomment-671774899 > I've submitted a PR for conda-forge at [conda-forge/aws-sdk-cpp-feedstock#124](https://github.com/conda-forge/aws-sdk-cpp-feedstock/pull/124) Thanks for that @pitrou.

[GitHub] [arrow] corleyma commented on a change in pull request #7803: ARROW-9517: [C++/Python] Add optional session_token to S3Options

2020-08-11 Thread GitBox
corleyma commented on a change in pull request #7803: URL: https://github.com/apache/arrow/pull/7803#discussion_r468369686 ## File path: cpp/src/arrow/filesystem/s3fs.h ## @@ -62,10 +75,18 @@ struct ARROW_EXPORT S3Options { void ConfigureAnonymousCredentials(); ///

[GitHub] [arrow] kiszk commented on pull request #7507: ARROW-8797: [C++] Read RecordBatch in a different endian

2020-08-11 Thread GitBox
kiszk commented on pull request #7507: URL: https://github.com/apache/arrow/pull/7507#issuecomment-671751774 @kou I addressed your two comments. This is an automated message from the Apache Git Service. To respond to the