[jira] [Created] (ARROW-17300) [Java][Docs] Compare/contrast the Netty and Unsafe memory backends

2022-08-03 Thread David Li (Jira)
David Li created ARROW-17300: Summary: [Java][Docs] Compare/contrast the Netty and Unsafe memory backends Key: ARROW-17300 URL: https://issues.apache.org/jira/browse/ARROW-17300 Project: Apache Arrow

[jira] [Created] (ARROW-17299) Expose the Scanner kDefaultBatchReadahead and kDefaultFragmentReadahead parameters

2022-08-03 Thread Ziheng Wang (Jira)
Ziheng Wang created ARROW-17299: --- Summary: Expose the Scanner kDefaultBatchReadahead and kDefaultFragmentReadahead parameters Key: ARROW-17299 URL: https://issues.apache.org/jira/browse/ARROW-17299

[jira] [Created] (ARROW-17298) [C++][Docs] Add Acero project example in Getting Started Section

2022-08-03 Thread Will Jones (Jira)
Will Jones created ARROW-17298: -- Summary: [C++][Docs] Add Acero project example in Getting Started Section Key: ARROW-17298 URL: https://issues.apache.org/jira/browse/ARROW-17298 Project: Apache Arrow

[GitHub] [arrow-nanoarrow] lidavidm commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
lidavidm commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204391711 > I'm not sure which buffer you mean! The `struct ArrowBuffer`? Sorry, I mean the buffer of values inside the bitmap builder -- This is an automated message from the Apache

[GitHub] [arrow-nanoarrow] paleolimbot commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
paleolimbot commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204391097 I'm not sure which buffer you mean! The `struct ArrowBuffer`? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Created] (ARROW-17297) [Java] [Doc] C++ to Java via C Data Interface (ImportArray, ImportRecordBatch)

2022-08-03 Thread David Dali Susanibar Arce (Jira)
David Dali Susanibar Arce created ARROW-17297: - Summary: [Java] [Doc] C++ to Java via C Data Interface (ImportArray, ImportRecordBatch) Key: ARROW-17297 URL:

[jira] [Created] (ARROW-17296) [Python] Doctest failure in pyarrow.parquet.read_metadata after 10.0.0 dev version update

2022-08-03 Thread Wes McKinney (Jira)
Wes McKinney created ARROW-17296: Summary: [Python] Doctest failure in pyarrow.parquet.read_metadata after 10.0.0 dev version update Key: ARROW-17296 URL: https://issues.apache.org/jira/browse/ARROW-17296

[GitHub] [arrow-nanoarrow] lidavidm commented on a diff in pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
lidavidm commented on code in PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#discussion_r937046260 ## src/nanoarrow/typedefs_inline.h: ## @@ -0,0 +1,172 @@ +// Licensed to the Apache Software Foundation (ASF) under one +// or more contributor license agreements.

[GitHub] [arrow-nanoarrow] paleolimbot commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
paleolimbot commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204376962 Ok, made the definitions inline, although perhaps there is a prettier way to do it. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow-nanoarrow] paleolimbot opened a new pull request, #12: Add metadata builder functions

2022-08-03 Thread GitBox
paleolimbot opened a new pull request, #12: URL: https://github.com/apache/arrow-nanoarrow/pull/12 Fixes #6. This PR adds functions `ArrowMetadataBuilderAppend()` (for blindly but efficiently adding a key/value pair to the end of some metadata) and `ArrowMetadataBuilderSet()` (to

[jira] [Created] (ARROW-17295) [C++] Build separate bundled_depenencies.so

2022-08-03 Thread Will Jones (Jira)
Will Jones created ARROW-17295: -- Summary: [C++] Build separate bundled_depenencies.so Key: ARROW-17295 URL: https://issues.apache.org/jira/browse/ARROW-17295 Project: Apache Arrow Issue Type:

[GitHub] [arrow-nanoarrow] paleolimbot commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
paleolimbot commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204110572 You convinced me! I didn't know you could split up an `inline` declaration and definition and that solves the conundrum I was having. -- This is an automated message from the

[GitHub] [arrow-nanoarrow] lidavidm commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
lidavidm commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204107639 But if it's easier to do things in stages then we can just review the current PR? -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [arrow-nanoarrow] lidavidm commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
lidavidm commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204106882 I don't think we need to split up header files or rearrange things, though, and I don't think we need to inline the buffer functions - it could just be moving the definitions from

[GitHub] [arrow-adbc] lidavidm opened a new issue, #53: [Python] Driver distribution

2022-08-03 Thread GitBox
lidavidm opened a new issue, #53: URL: https://github.com/apache/arrow-adbc/issues/53 We don't want to/can't futz with shared libraries when distributing packages. Instead, since drivers have an entrypoint, just expose the entrypoint in Python? e.g. `adbc_driver_sqlite` will bundle

[GitHub] [arrow-adbc] lidavidm opened a new issue, #52: [Python] Implement DBAPI

2022-08-03 Thread GitBox
lidavidm opened a new issue, #52: URL: https://github.com/apache/arrow-adbc/issues/52 Will make implementing Ibis backends easier since we can reuse more of the code for SQLAlchemy-based backends -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [arrow-nanoarrow] pitrou commented on issue #11: Inline performance-sensitive functions and their dependencies

2022-08-03 Thread GitBox
pitrou commented on issue #11: URL: https://github.com/apache/arrow-nanoarrow/issues/11#issuecomment-1204071180 Note that inline functions (or macros) require you to be very careful if you want to maintain some ABI compatibility. I don't know if that's a goal of nanoarrow, but worth

[GitHub] [arrow-nanoarrow] paleolimbot commented on pull request #10: Implement bitmap setters, getters, and element-wise builder

2022-08-03 Thread GitBox
paleolimbot commented on PR #10: URL: https://github.com/apache/arrow-nanoarrow/pull/10#issuecomment-1204069688 I made #11 to set up a PR for the inlining process...that's definitely important but requires a rather different set of changes (splitting up header files, rearranging stuff,

[GitHub] [arrow-nanoarrow] lidavidm commented on issue #11: Inline performance-sensitive functions and their dependencies

2022-08-03 Thread GitBox
lidavidm commented on issue #11: URL: https://github.com/apache/arrow-nanoarrow/issues/11#issuecomment-1204065088 I don't think you need to split up the headers, just ```c /// \brief Docstring... inline ArrowErrorCode ArrowBufferAppend() { // Definition... } ```

[GitHub] [arrow-nanoarrow] paleolimbot opened a new issue, #11: Inline performance-sensitive functions and their dependencies

2022-08-03 Thread GitBox
paleolimbot opened a new issue, #11: URL: https://github.com/apache/arrow-nanoarrow/issues/11 A number of functions should be defined as `inline` with their definition visible to the compiler when a client types `#include "nanoarrow.h"`. Buffer appenders, element-wise builder, and bitmap

[GitHub] [arrow-adbc] lidavidm commented on pull request #51: [Python] Set up package with Poetry

2022-08-03 Thread GitBox
lidavidm commented on PR #51: URL: https://github.com/apache/arrow-adbc/pull/51#issuecomment-1204017482 I also grabbed https://pypi.org/project/adbc-driver-manager/ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow-adbc] lidavidm commented on a diff in pull request #51: [Python] Set up package with Poetry

2022-08-03 Thread GitBox
lidavidm commented on code in PR #51: URL: https://github.com/apache/arrow-adbc/pull/51#discussion_r936686336 ## python/adbc_driver_manager/requirements-dev.txt: ## @@ -1,19 +1,124 @@ -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license

[GitHub] [arrow-adbc] pitrou commented on a diff in pull request #51: [Python] Set up package with Poetry

2022-08-03 Thread GitBox
pitrou commented on code in PR #51: URL: https://github.com/apache/arrow-adbc/pull/51#discussion_r936684861 ## python/adbc_driver_manager/requirements-dev.txt: ## @@ -1,19 +1,124 @@ -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license

[jira] [Created] (ARROW-17294) [Release] Update remove old artifacts release script

2022-08-03 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-17294: --- Summary: [Release] Update remove old artifacts release script Key: ARROW-17294 URL: https://issues.apache.org/jira/browse/ARROW-17294 Project: Apache Arrow

[jira] [Created] (ARROW-17293) [Java][CI] Prune java nightly builds

2022-08-03 Thread Jacob Wujciak-Jens (Jira)
Jacob Wujciak-Jens created ARROW-17293: -- Summary: [Java][CI] Prune java nightly builds Key: ARROW-17293 URL: https://issues.apache.org/jira/browse/ARROW-17293 Project: Apache Arrow

[jira] [Created] (ARROW-17292) [C++] Segmentation fault on arrow-compute-hash-join-node-test on macos nightlies

2022-08-03 Thread Jira
Raúl Cumplido created ARROW-17292: - Summary: [C++] Segmentation fault on arrow-compute-hash-join-node-test on macos nightlies Key: ARROW-17292 URL: https://issues.apache.org/jira/browse/ARROW-17292

[GitHub] [arrow-nanoarrow] pitrou commented on issue #8: Implement `struct ArrowArrayBuilder`

2022-08-03 Thread GitBox
pitrou commented on issue #8: URL: https://github.com/apache/arrow-nanoarrow/issues/8#issuecomment-1203706719 > One way to do this is a bunch of callables that are something like the reverse of SQLite's result interface So this is for building arrays whose type is not strictly known