[GitHub] [arrow] emkornfield merged pull request #8281: Decimal256 java implementation with working integration tests.

2020-09-25 Thread GitBox
emkornfield merged pull request #8281: URL: https://github.com/apache/arrow/pull/8281 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] emkornfield opened a new pull request #8281: Decimal256 java implementation with working integration tests.

2020-09-25 Thread GitBox
emkornfield opened a new pull request #8281: URL: https://github.com/apache/arrow/pull/8281 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [arrow] jorgecarleitao commented on a change in pull request #8199: ARROW-10019: [Rust] Add substring kernel

2020-09-25 Thread GitBox
jorgecarleitao commented on a change in pull request #8199: URL: https://github.com/apache/arrow/pull/8199#discussion_r495409403 ## File path: rust/arrow/src/compute/kernels/substring.rs ## @@ -0,0 +1,262 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or

[GitHub] [arrow] jorgecarleitao commented on a change in pull request #8280: ARROW-10103: [Rust] Add contains kernel

2020-09-25 Thread GitBox
jorgecarleitao commented on a change in pull request #8280: URL: https://github.com/apache/arrow/pull/8280#discussion_r495394022 ## File path: rust/arrow/src/compute/util.rs ## @@ -71,6 +71,47 @@ pub(super) fn combine_option_bitmap( } } +/// Compares the null bitmaps

[GitHub] [arrow] jorgecarleitao commented on pull request #8222: ARROW-10043: [Rust][DataFusion] Implement COUNT(DISTINCT col)

2020-09-25 Thread GitBox
jorgecarleitao commented on pull request #8222: URL: https://github.com/apache/arrow/pull/8222#issuecomment-699274727 I agree with your reasoning. AFAIK, `scalar` in the context of Arrow is not a mathematical scalar like `f64`: `scalar` is a "1-element representation of an Arrow

[GitHub] [arrow] github-actions[bot] commented on pull request #8280: ARROW-10103: [Rust] Add contains kernel

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8280: URL: https://github.com/apache/arrow/pull/8280#issuecomment-699272912 https://issues.apache.org/jira/browse/ARROW-10103 This is an automated message from the Apache Git

[GitHub] [arrow] nevi-me commented on a change in pull request #8280: ARROW-10103: [Rust] Add contains kernel

2020-09-25 Thread GitBox
nevi-me commented on a change in pull request #8280: URL: https://github.com/apache/arrow/pull/8280#discussion_r495375649 ## File path: rust/arrow/src/compute/kernels/comparison.rs ## @@ -555,11 +557,159 @@ where compare_op_scalar!(left, right, |a, b| a >= b) } +///

[GitHub] [arrow] nevi-me commented on pull request #8280: ARROW-10103: [Rust] Add contains kernel

2020-09-25 Thread GitBox
nevi-me commented on pull request #8280: URL: https://github.com/apache/arrow/pull/8280#issuecomment-699270344 This is extracted from #6770, PTAL @alamb @jorgecarleitao @jhorstmann CC @mcassels @maxburke

[GitHub] [arrow] nevi-me opened a new pull request #8280: ARROW-10103: [Rust] Add contains kernel

2020-09-25 Thread GitBox
nevi-me opened a new pull request #8280: URL: https://github.com/apache/arrow/pull/8280 Checks if a list contains a value in either a primitive or string Large lists are also supported This is an automated message

[GitHub] [arrow] github-actions[bot] commented on pull request #8279: ARROW-10102: [C++] Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8279: URL: https://github.com/apache/arrow/pull/8279#issuecomment-699255507 https://issues.apache.org/jira/browse/ARROW-10102 This is an automated message from the Apache Git

[GitHub] [arrow] nevi-me commented on pull request #6770: ARROW-7842: [Rust] [Parquet] implement array_reader for list type columns

2020-09-25 Thread GitBox
nevi-me commented on pull request #6770: URL: https://github.com/apache/arrow/pull/6770#issuecomment-699255325 > @nevi-me did your other PRs supercede this? I hadn't seen this @emkornfield. No, I've only been focusing on the writer, so I'll still want to merge this into the branch

[GitHub] [arrow] nevi-me commented on pull request #6770: ARROW-7842: [Rust] [Parquet] implement array_reader for list type columns

2020-09-25 Thread GitBox
nevi-me commented on pull request #6770: URL: https://github.com/apache/arrow/pull/6770#issuecomment-699254549 This has sadly fallen behind significantly from the main branch. I've spent a few hours trying to rebase, but because it looks like the PR contained changes for the below, it's a

[GitHub] [arrow] bkietz commented on a change in pull request #8188: ARROW-9924: [C++][Dataset] Enable per-column parallelism for single ParquetFileFragment scans

2020-09-25 Thread GitBox
bkietz commented on a change in pull request #8188: URL: https://github.com/apache/arrow/pull/8188#discussion_r495353620 ## File path: cpp/src/arrow/dataset/scanner.h ## @@ -73,7 +73,7 @@ class ARROW_DS_EXPORT ScanOptions { RecordBatchProjector projector; // Maximum

[GitHub] [arrow] bkietz commented on a change in pull request #8188: ARROW-9924: [C++][Dataset] Enable per-column parallelism for single ParquetFileFragment scans

2020-09-25 Thread GitBox
bkietz commented on a change in pull request #8188: URL: https://github.com/apache/arrow/pull/8188#discussion_r495353791 ## File path: ci/scripts/python_test.sh ## @@ -29,4 +29,4 @@ export LD_LIBRARY_PATH=${ARROW_HOME}/lib:${LD_LIBRARY_PATH} # Enable some checks inside Python

[GitHub] [arrow] bkietz commented on a change in pull request #8188: ARROW-9924: [C++][Dataset] Enable per-column parallelism for single ParquetFileFragment scans

2020-09-25 Thread GitBox
bkietz commented on a change in pull request #8188: URL: https://github.com/apache/arrow/pull/8188#discussion_r495353478 ## File path: cpp/src/parquet/arrow/reader.cc ## @@ -856,18 +856,32 @@ Status FileReaderImpl::GetRecordBatchReader(const std::vector& row_groups,

[GitHub] [arrow] bkietz commented on pull request #8264: ARROW-8618: [C++] Clean up some redundant std::move()s

2020-09-25 Thread GitBox
bkietz commented on pull request #8264: URL: https://github.com/apache/arrow/pull/8264#issuecomment-699251775 https://travis-ci.org/github/bkietz/arrow/builds/730424920 This is an automated message from the Apache Git

[GitHub] [arrow] MingyuZhong commented on a change in pull request #8279: ARROW-10102: [C++] Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
MingyuZhong commented on a change in pull request #8279: URL: https://github.com/apache/arrow/pull/8279#discussion_r495351658 ## File path: cpp/src/arrow/util/basic_decimal.cc ## @@ -248,40 +248,64 @@ BasicDecimal128& BasicDecimal128::operator>>=(uint32_t bits) { return

[GitHub] [arrow] bkietz commented on a change in pull request #8264: ARROW-8618: [C++] Clean up some redundant std::move()s

2020-09-25 Thread GitBox
bkietz commented on a change in pull request #8264: URL: https://github.com/apache/arrow/pull/8264#discussion_r495351571 ## File path: cpp/src/arrow/testing/gtest_util.h ## @@ -108,9 +108,9 @@ } while (false); #define ASSIGN_OR_HANDLE_ERROR_IMPL(handle_error,

[GitHub] [arrow] bkietz closed pull request #8088: ARROW-9992: [C++][Python] Refactor python to arrow conversions based on a reusable conversion API

2020-09-25 Thread GitBox
bkietz closed pull request #8088: URL: https://github.com/apache/arrow/pull/8088 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] Luminarys closed pull request #8266: Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
Luminarys closed pull request #8266: URL: https://github.com/apache/arrow/pull/8266 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] Luminarys opened a new pull request #8279: ARROW-10102: [C++] Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
Luminarys opened a new pull request #8279: URL: https://github.com/apache/arrow/pull/8279 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] Luminarys commented on pull request #8266: Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
Luminarys commented on pull request #8266: URL: https://github.com/apache/arrow/pull/8266#issuecomment-699249538 Closing this in favor of https://github.com/apache/arrow/pull/8279. This is an automated message from the

[GitHub] [arrow] Luminarys commented on a change in pull request #8266: Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
Luminarys commented on a change in pull request #8266: URL: https://github.com/apache/arrow/pull/8266#discussion_r495349095 ## File path: cpp/src/arrow/util/basic_decimal.cc ## @@ -248,40 +247,50 @@ BasicDecimal128& BasicDecimal128::operator>>=(uint32_t bits) { return

[GitHub] [arrow] Luminarys commented on a change in pull request #8266: Refactor BasicDecimal128 Multiplication to use unsigned helper

2020-09-25 Thread GitBox
Luminarys commented on a change in pull request #8266: URL: https://github.com/apache/arrow/pull/8266#discussion_r495346728 ## File path: cpp/src/arrow/util/basic_decimal.cc ## @@ -248,40 +247,50 @@ BasicDecimal128& BasicDecimal128::operator>>=(uint32_t bits) { return

[GitHub] [arrow] nealrichardson commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-699207051 Here's what I'm talking about in the failure in the 32 bit build: ``` lto-wrapper.exe: fatal error: C:\rtools40\mingw32\bin\g++.exe returned 1 exit status

[GitHub] [arrow] drusso edited a comment on pull request #8222: ARROW-10043: [Rust][DataFusion] Implement COUNT(DISTINCT col)

2020-09-25 Thread GitBox
drusso edited a comment on pull request #8222: URL: https://github.com/apache/arrow/pull/8222#issuecomment-699164097 @andygrove (cc @jorgecarleitao): My apologies, I don't have the changes ready yet. Though I did have some time today to look into integrating this with #8172/master.

[GitHub] [arrow] drusso commented on pull request #8222: ARROW-10043: [Rust][DataFusion] Implement COUNT(DISTINCT col)

2020-09-25 Thread GitBox
drusso commented on pull request #8222: URL: https://github.com/apache/arrow/pull/8222#issuecomment-699164097 @andygrove (cc @jorgecarleitao): My apologies, I don't have the changes ready yet. Though I did have some time today to look into integrating this with #8172/master.

[GitHub] [arrow] github-actions[bot] commented on pull request #8278: ARROW-10101: [WIP][Java] initial Tensor proof-of-concept

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8278: URL: https://github.com/apache/arrow/pull/8278#issuecomment-699162153 https://issues.apache.org/jira/browse/ARROW-10101 This is an automated message from the Apache Git

[GitHub] [arrow] lidavidm opened a new pull request #8278: ARROW-10101: [WIP][Java] initial Tensor proof-of-concept

2020-09-25 Thread GitBox
lidavidm opened a new pull request #8278: URL: https://github.com/apache/arrow/pull/8278 This is an attempt at a Tensor contrib module. It hard-codes a single implementation for doubles only. If the overall API looks OK, I could then apply the FreeMarker templates (like the Vector module)

[GitHub] [arrow] nealrichardson closed pull request #8277: ARROW-10098: [R][Doc] Fix copy_files doc mismatch

2020-09-25 Thread GitBox
nealrichardson closed pull request #8277: URL: https://github.com/apache/arrow/pull/8277 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] nealrichardson commented on pull request #8246: ARROW-10071: [R] segfault with ArrowObject from previous session, or saved

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8246: URL: https://github.com/apache/arrow/pull/8246#issuecomment-699156330 @bkietz you can probably just push to it, or whatever you want. AFAICT that's the only outstanding issue and I'll merge when it is resolved (since it's earlier in the day

[GitHub] [arrow] bkietz commented on pull request #8246: ARROW-10071: [R] segfault with ArrowObject from previous session, or saved

2020-09-25 Thread GitBox
bkietz commented on pull request #8246: URL: https://github.com/apache/arrow/pull/8246#issuecomment-699153455 @romainfrancois yes, should I make a PR to your branch? This is an automated message from the Apache Git Service.

[GitHub] [arrow] wesm closed pull request #8272: ARROW-8601: [Go][FOLLOWUP] Fix RAT violations related to Flight in Go

2020-09-25 Thread GitBox
wesm closed pull request #8272: URL: https://github.com/apache/arrow/pull/8272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] wesm commented on pull request #8272: ARROW-8601: [Go][FOLLOWUP] Fix RAT violations related to Flight in Go

2020-09-25 Thread GitBox
wesm commented on pull request #8272: URL: https://github.com/apache/arrow/pull/8272#issuecomment-699122927 +1 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [arrow] nealrichardson commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-699122339 No luck. One possibility is that we aren't getting the right 32/64 bit versions of the tools: there are two versions of each,

[GitHub] [arrow] github-actions[bot] commented on pull request #8277: ARROW-10098: [R][Doc] Fix copy_files doc mismatch

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8277: URL: https://github.com/apache/arrow/pull/8277#issuecomment-699121141 https://issues.apache.org/jira/browse/ARROW-10098 This is an automated message from the Apache Git

[GitHub] [arrow] pitrou commented on pull request #8200: ARROW-8883: [Rust] [Integration] Enable more tests

2020-09-25 Thread GitBox
pitrou commented on pull request #8200: URL: https://github.com/apache/arrow/pull/8200#issuecomment-699117248 Remember to update the [implementation status](https://github.com/apache/arrow/blob/master/docs/source/status.rst) when done ;-)

[GitHub] [arrow] nealrichardson opened a new pull request #8277: Fix bad merge of #8187

2020-09-25 Thread GitBox
nealrichardson opened a new pull request #8277: URL: https://github.com/apache/arrow/pull/8277 Somehow #8187 had a passing build but it didn't regenerate the R docs, so R builds are failing on master because the doc signature doesn't match the code.

[GitHub] [arrow] andygrove commented on pull request #8222: ARROW-10043: [Rust][DataFusion] Implement COUNT(DISTINCT col)

2020-09-25 Thread GitBox
andygrove commented on pull request #8222: URL: https://github.com/apache/arrow/pull/8222#issuecomment-699113117 Hi @drusso I would like to review and merge this DF PR next. Would you mind rebasing? This is an automated

[GitHub] [arrow] andygrove closed pull request #8276: ARROW-9981: [Rust] [Flight] Expose IpcWriteOptions on utils

2020-09-25 Thread GitBox
andygrove closed pull request #8276: URL: https://github.com/apache/arrow/pull/8276 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #8275: ARROW-10096: [Rust] [DataFusion] Removed unused code

2020-09-25 Thread GitBox
andygrove closed pull request #8275: URL: https://github.com/apache/arrow/pull/8275 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] andygrove closed pull request #8180: ARROW-9752: [Rust] [DataFusion] Add support for User-Defined Aggregate Functions.

2020-09-25 Thread GitBox
andygrove closed pull request #8180: URL: https://github.com/apache/arrow/pull/8180 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] nealrichardson commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-699078267 路 I'll try Makevars This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow] xhochy commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
xhochy commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-699075688 No, that is what I thought. The logs indicate though that still the wrong tools are used: https://github.com/apache/arrow/runs/1166696816#step:11:180 Maybe this needs to go

[GitHub] [arrow] nealrichardson closed pull request #8197: ARROW-9869: [R] Implement full S3FileSystem/S3Options constructor

2020-09-25 Thread GitBox
nealrichardson closed pull request #8197: URL: https://github.com/apache/arrow/pull/8197 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] nealrichardson commented on pull request #8197: ARROW-9869: [R] Implement full S3FileSystem/S3Options constructor

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8197: URL: https://github.com/apache/arrow/pull/8197#issuecomment-699074276 I'm going to merge this and we can follow up with UX questions in the next PR. This is an automated

[GitHub] [arrow] nealrichardson commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-699073582 @xhochy that did not seem to work, it still says plugin not found, though maybe I misunderstood what you were suggesting

[GitHub] [arrow] nealrichardson commented on a change in pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
nealrichardson commented on a change in pull request #8256: URL: https://github.com/apache/arrow/pull/8256#discussion_r495148711 ## File path: r/src/arrow_exports.h ## @@ -22,6 +22,7 @@ #include "./arrow_cpp11.h" #if defined(ARROW_R_WITH_ARROW) +#include Review comment:

[GitHub] [arrow] romainfrancois commented on pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
romainfrancois commented on pull request #8256: URL: https://github.com/apache/arrow/pull/8256#issuecomment-699054273 I'd like to make the `..dispatch()` methods go away. So I guess the question is when a C++ function returns an Array that in fact is a StructArray, should the R object be

[GitHub] [arrow] romainfrancois commented on a change in pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
romainfrancois commented on a change in pull request #8256: URL: https://github.com/apache/arrow/pull/8256#discussion_r495128561 ## File path: r/src/arrow_exports.h ## @@ -22,6 +22,7 @@ #include "./arrow_cpp11.h" #if defined(ARROW_R_WITH_ARROW) +#include Review comment:

[GitHub] [arrow] nevi-me commented on pull request #8274: ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
nevi-me commented on pull request #8274: URL: https://github.com/apache/arrow/pull/8274#issuecomment-699046916 I just noticed that there's more breaking changes on the branch :(. I'll address them shortly This is an

[GitHub] [arrow] github-actions[bot] commented on pull request #8276: ARROW-9981: [Rust] [Flight] Expose IpcWriteOptions on utils

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8276: URL: https://github.com/apache/arrow/pull/8276#issuecomment-699044452 https://issues.apache.org/jira/browse/ARROW-9981 This is an automated message from the Apache Git

[GitHub] [arrow] carols10cents commented on pull request #8274: ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
carols10cents commented on pull request #8274: URL: https://github.com/apache/arrow/pull/8274#issuecomment-699043524 Thanks so much! I'm going to take a look at writing dictionary types :) This is an automated message from

[GitHub] [arrow] nevi-me opened a new pull request #8276: ARROW-9981: [Rust] [Flight] Expose IpcWriteOptions on utils

2020-09-25 Thread GitBox
nevi-me opened a new pull request #8276: URL: https://github.com/apache/arrow/pull/8276 Allows flight users to specify IpcWriteOptions for Arrow to Flight conversions This is an automated message from the Apache Git

[GitHub] [arrow] nevi-me commented on a change in pull request #8199: ARROW-10019: [Rust] Add substring kernel

2020-09-25 Thread GitBox
nevi-me commented on a change in pull request #8199: URL: https://github.com/apache/arrow/pull/8199#discussion_r495116844 ## File path: rust/arrow/src/compute/kernels/substring.rs ## @@ -0,0 +1,262 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more

[GitHub] [arrow] pitrou commented on a change in pull request #8264: ARROW-8618: [C++] Clean up some redundant std::move()s

2020-09-25 Thread GitBox
pitrou commented on a change in pull request #8264: URL: https://github.com/apache/arrow/pull/8264#discussion_r495106328 ## File path: cpp/src/arrow/testing/gtest_util.h ## @@ -108,9 +108,9 @@ } while (false); #define ASSIGN_OR_HANDLE_ERROR_IMPL(handle_error,

[GitHub] [arrow] github-actions[bot] commented on pull request #8275: ARROW-10096: [Rust] [DataFusion] Removed unused code

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8275: URL: https://github.com/apache/arrow/pull/8275#issuecomment-699025441 https://issues.apache.org/jira/browse/ARROW-10096 This is an automated message from the Apache Git

[GitHub] [arrow] xubinlaile commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699021063 > > may this help: > > https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable > > Maybe I didn't read it carefully but

[GitHub] [arrow] xubinlaile removed a comment on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile removed a comment on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699019657 > > may this help: > > https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable > > Maybe I didn't read it

[GitHub] [arrow] jorgecarleitao opened a new pull request #8275: ARROW-10096: [Rust] [DataFusion] Removed unused code

2020-09-25 Thread GitBox
jorgecarleitao opened a new pull request #8275: URL: https://github.com/apache/arrow/pull/8275 A minor clean up This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [arrow] xubinlaile commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699019657 > > may this help: > > https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable > > Maybe I didn't read it carefully but

[GitHub] [arrow] arw2019 edited a comment on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
arw2019 edited a comment on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699010092 > may this help: > https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable Maybe I didn't read it carefully but

[GitHub] [arrow] xubinlaile removed a comment on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile removed a comment on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699009005 may this help: https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable

[GitHub] [arrow] xubinlaile commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699011960 > Thanks for the report! > > Can you provide a copy-pastable example so we can reproduce the issue locally and investigate? See

[GitHub] [arrow] nealrichardson closed pull request #8235: ARROW-10059: [R][Doc] Give more advice on how to set up C++ build

2020-09-25 Thread GitBox
nealrichardson closed pull request #8235: URL: https://github.com/apache/arrow/pull/8235 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] nevi-me closed pull request #8274: ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
nevi-me closed pull request #8274: URL: https://github.com/apache/arrow/pull/8274 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] arw2019 commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
arw2019 commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699010092 > may this help: > https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable Maybe I didn't read it carefully but that does

[GitHub] [arrow] nevi-me commented on pull request #8274: ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
nevi-me commented on pull request #8274: URL: https://github.com/apache/arrow/pull/8274#issuecomment-699010120 Merged, I'll rebase on the branch shortly This is an automated message from the Apache Git Service. To respond to

[GitHub] [arrow] xubinlaile commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699009005 may this help: https://stackoverflow.com/questions/50916422/python-typeerror-object-of-type-int64-is-not-json-serializable

[GitHub] [arrow] github-actions[bot] commented on pull request #8274: ARROW-10095: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8274: URL: https://github.com/apache/arrow/pull/8274#issuecomment-699007819 https://issues.apache.org/jira/browse/ARROW-10095 This is an automated message from the Apache Git

[GitHub] [arrow] arw2019 commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
arw2019 commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699006533 Thanks for the report! Can you provide a copy-pastable example so we can reproduce the issue locally and investigate? See

[GitHub] [arrow] nevi-me commented on pull request #8274: ARROW-8421: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
nevi-me commented on pull request #8274: URL: https://github.com/apache/arrow/pull/8274#issuecomment-699005892 Hi Carol  Thanks, I would definitely appreciate your help and expertise with the writer. I forgot to open a JIRA for the IPC changes, as I saw them after I had rebased.

[GitHub] [arrow] xubinlaile removed a comment on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile removed a comment on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699003981 maybe this help: class NpEncoder(json.JSONEncoder): def default(self, obj): if isinstance(obj, np.integer): return int(obj)

[GitHub] [arrow] kszucs commented on pull request #8267: ARROW-10087: [CI] Fix nightly docs job

2020-09-25 Thread GitBox
kszucs commented on pull request #8267: URL: https://github.com/apache/arrow/pull/8267#issuecomment-699004209 Thanks for fixing it! This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [arrow] xubinlaile commented on issue #8270: object of type 'init64' is not JSON serializable

2020-09-25 Thread GitBox
xubinlaile commented on issue #8270: URL: https://github.com/apache/arrow/issues/8270#issuecomment-699003981 maybe this help: class NpEncoder(json.JSONEncoder): def default(self, obj): if isinstance(obj, np.integer): return int(obj)

[GitHub] [arrow] nealrichardson closed pull request #8267: ARROW-10087: [CI] Fix nightly docs job

2020-09-25 Thread GitBox
nealrichardson closed pull request #8267: URL: https://github.com/apache/arrow/pull/8267 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [arrow] github-actions[bot] commented on pull request #8274: ARROW-8421: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8274: URL: https://github.com/apache/arrow/pull/8274#issuecomment-698997435 https://issues.apache.org/jira/browse/ARROW-8421 This is an automated message from the Apache Git

[GitHub] [arrow] nealrichardson commented on pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
nealrichardson commented on pull request #8256: URL: https://github.com/apache/arrow/pull/8256#issuecomment-698996362 > I'm not clear yet about the classes that are currently handled with `$..dispatch()` methods in R. I can think of a few possibilities (as I'm sure you can):

[GitHub] [arrow] nealrichardson commented on a change in pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
nealrichardson commented on a change in pull request #8256: URL: https://github.com/apache/arrow/pull/8256#discussion_r495061853 ## File path: r/src/arrow_exports.h ## @@ -22,6 +22,7 @@ #include "./arrow_cpp11.h" #if defined(ARROW_R_WITH_ARROW) +#include Review comment:

[GitHub] [arrow] carols10cents opened a new pull request #8274: ARROW-8421: [Rust] Update rust-parquet-arrow-writer branch's encode_arrow_schema with ipc changes

2020-09-25 Thread GitBox
carols10cents opened a new pull request #8274: URL: https://github.com/apache/arrow/pull/8274 Note that this PR is deliberately filed against the rust-parquet-arrow-writer branch, not master!! Hi!  I'm looking to help out with the rust-parquet-arrow-writer branch, and I just

[GitHub] [arrow] romainfrancois commented on pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
romainfrancois commented on pull request #8256: URL: https://github.com/apache/arrow/pull/8256#issuecomment-698983439 started to get away from the R function `shared_ptr()`. Not handling all cases yet, eventually this: ```cpp template SEXP as_sexp(const std::shared_ptr& ptr)

[GitHub] [arrow] xhochy commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
xhochy commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-698970205 @nealrichardson If you have time to continue this, I guess you need to set `NM=` & co in the environment for `R CMD INSTALL`. I wonder whether the Rtools40 setup should do this

[GitHub] [arrow] xhochy commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
xhochy commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-698969024 Ok, this got us a bit further... This is an automated message from the Apache Git Service. To respond to the

[GitHub] [arrow] nevi-me closed pull request #8223: ARROW-10040: [Rust] Add slice that realigns Buffer

2020-09-25 Thread GitBox
nevi-me closed pull request #8223: URL: https://github.com/apache/arrow/pull/8223 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] nevi-me commented on pull request #8223: ARROW-10040: [Rust] Add slice that realigns Buffer

2020-09-25 Thread GitBox
nevi-me commented on pull request #8223: URL: https://github.com/apache/arrow/pull/8223#issuecomment-698963093 Hey @jhorstmann, I haven't had time to look, but maybe I'm confused. What I recall is that I needed a way of converting a Buffer to a `Vec` when I write to Parquet. It might even

[GitHub] [arrow] bkietz commented on a change in pull request #8088: ARROW-9992: [C++][Python] Refactor python to arrow conversions based on a reusable conversion API

2020-09-25 Thread GitBox
bkietz commented on a change in pull request #8088: URL: https://github.com/apache/arrow/pull/8088#discussion_r495026946 ## File path: cpp/src/arrow/python/python_to_arrow.cc ## @@ -329,985 +303,649 @@ struct ValueConverter { default: return

[GitHub] [arrow] kszucs closed pull request #8273: ARROW-10092: [Dev][Go] Add grpc generated go files to rat exclusion list

2020-09-25 Thread GitBox
kszucs closed pull request #8273: URL: https://github.com/apache/arrow/pull/8273 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] kszucs commented on pull request #8269: ARROW-10070: [C++][Compute] Implement stdev aggregate kernel

2020-09-25 Thread GitBox
kszucs commented on pull request #8269: URL: https://github.com/apache/arrow/pull/8269#issuecomment-698948177 > missing license header? Yes, https://github.com/apache/arrow/pull/8273 should fix that. This is an

[GitHub] [arrow] kszucs edited a comment on pull request #8269: ARROW-10070: [C++][Compute] Implement stdev aggregate kernel

2020-09-25 Thread GitBox
kszucs edited a comment on pull request #8269: URL: https://github.com/apache/arrow/pull/8269#issuecomment-698948177 > missing license header? Yes, https://github.com/apache/arrow/pull/8273 should fix that.

[GitHub] [arrow] xhochy commented on pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
xhochy commented on pull request #8153: URL: https://github.com/apache/arrow/pull/8153#issuecomment-698938651 @nealrichardson I would rather guess the the issue comes from using the wrong ar/ranlib/nm. There should be a `gcc-ar` / `gcc-nm` / `gcc-ranlib` or so available that can handle

[GitHub] [arrow] github-actions[bot] commented on pull request #8272: ARROW-8601: [Go][FOLLOWUP] Fix RAT violations related to Flight in Go

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8272: URL: https://github.com/apache/arrow/pull/8272#issuecomment-698936380 https://issues.apache.org/jira/browse/ARROW-8601 This is an automated message from the Apache Git

[GitHub] [arrow] xhochy commented on a change in pull request #8153: ARROW-9616: [C++] Support LTO for R

2020-09-25 Thread GitBox
xhochy commented on a change in pull request #8153: URL: https://github.com/apache/arrow/pull/8153#discussion_r495001612 ## File path: ci/scripts/PKGBUILD ## @@ -76,8 +76,10 @@ build() { export CPPFLAGS="${CPPFLAGS} -I${MINGW_PREFIX}/include" export

[GitHub] [arrow] emkornfield merged pull request #8268: Archery C++ round trip working. Java disabled. Fix c-bridge

2020-09-25 Thread GitBox
emkornfield merged pull request #8268: URL: https://github.com/apache/arrow/pull/8268 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] xhochy closed pull request #8257: ARROW-10081: [C++/Python] Fix bash syntax in drone.io conda builds

2020-09-25 Thread GitBox
xhochy closed pull request #8257: URL: https://github.com/apache/arrow/pull/8257 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] romainfrancois edited a comment on pull request #8256: ARROW-9001: [R] Box outputs as correct type in call_function

2020-09-25 Thread GitBox
romainfrancois edited a comment on pull request #8256: URL: https://github.com/apache/arrow/pull/8256#issuecomment-698808913 ``` r library(tidyverse) brio::read_lines("~/git/apache/arrow/r/src/arrowExports.cpp") %>% str_subset("^std::[a-z]+_ptr<") %>% str_remove("

[GitHub] [arrow] jhorstmann commented on a change in pull request #8260: ARROW-10084: [Rust] [DataFusion] Added length of LargeStringArray and fixed undefined behavior.

2020-09-25 Thread GitBox
jhorstmann commented on a change in pull request #8260: URL: https://github.com/apache/arrow/pull/8260#discussion_r494974111 ## File path: rust/arrow/src/compute/kernels/length.rs ## @@ -17,52 +17,56 @@ //! Defines kernel for length of a string array -use crate::array::*;

[GitHub] [arrow] kszucs commented on pull request #8175: ARROW-8601: [Go][Flight] Implementations Flight RPC server and client

2020-09-25 Thread GitBox
kszucs commented on pull request #8175: URL: https://github.com/apache/arrow/pull/8175#issuecomment-698922798 ``` apache-rat license violation: go/arrow/flight/Flight_grpc.pb.go apache-rat license violation: go/arrow/flight/example_flight_server_test.go ``` These files

[GitHub] [arrow] cyb70289 edited a comment on pull request #8269: ARROW-10070: [C++][Compute] Implement stdev aggregate kernel

2020-09-25 Thread GitBox
cyb70289 edited a comment on pull request #8269: URL: https://github.com/apache/arrow/pull/8269#issuecomment-698754806 Dev / Lint ci failure looks not related. ``` INFO:archery:Running Docker linter apache-rat license violation: go/arrow/flight/Flight_grpc.pb.go apache-rat

[GitHub] [arrow] github-actions[bot] commented on pull request #8273: ARROW-10092: [Dev][Go] Add grpc generated go files to rat exclusion list

2020-09-25 Thread GitBox
github-actions[bot] commented on pull request #8273: URL: https://github.com/apache/arrow/pull/8273#issuecomment-698936382 https://issues.apache.org/jira/browse/ARROW-10092 This is an automated message from the Apache Git

[GitHub] [arrow] wesm opened a new pull request #8272: ARROW-8601: [Go][FOLLOWUP] Fix RAT violations related to Flight in Go

2020-09-25 Thread GitBox
wesm opened a new pull request #8272: URL: https://github.com/apache/arrow/pull/8272 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

  1   2   >