[GitHub] [arrow] zinking opened a new issue, #37458: NativeDatasetFactory parameter allocator and memory pool relationship

2023-08-30 Thread via GitHub
zinking opened a new issue, #37458: URL: https://github.com/apache/arrow/issues/37458 ### Describe the usage question you have. Please include as many useful details as possible. @zhztheplayer ``` /** * Constructor. * * @param allocator a context

[GitHub] [arrow] pitrou closed issue #37453: [C++][Parquet] Performance regression in TypedColumnWriter::WriteBatch

2023-08-30 Thread via GitHub
pitrou closed issue #37453: [C++][Parquet] Performance regression in TypedColumnWriter::WriteBatch URL: https://github.com/apache/arrow/issues/37453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] thisisnic closed issue #36771: [R] stringr helper functions drop calling environment when evaluating

2023-08-30 Thread via GitHub
thisisnic closed issue #36771: [R] stringr helper functions drop calling environment when evaluating URL: https://github.com/apache/arrow/issues/36771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow-adbc] paleolimbot opened a new issue, #1009: Release adbcdrivermanager 0.6.0

2023-08-30 Thread via GitHub
paleolimbot opened a new issue, #1009: URL: https://github.com/apache/arrow-adbc/issues/1009 Prepare for release: * [ ] `git pull` * [ ] Check [current CRAN check results](https://cran.rstudio.org/web/checks/check_results_adbcdrivermanager.html) * [ ] `usethis::use_news_md()`

[GitHub] [arrow-adbc] paleolimbot opened a new issue, #1010: Release adbcsqlite 0.6.0

2023-08-30 Thread via GitHub
paleolimbot opened a new issue, #1010: URL: https://github.com/apache/arrow-adbc/issues/1010 First release: * [ ] `usethis::use_news_md()` * [ ] `usethis::use_cran_comments()` * [ ] Update (aspirational) install instructions in README * [ ] Proofread `Title:` and

[GitHub] [arrow-adbc] paleolimbot opened a new issue, #1011: Release adbcpostgresql 0.6.0

2023-08-30 Thread via GitHub
paleolimbot opened a new issue, #1011: URL: https://github.com/apache/arrow-adbc/issues/1011 First release: * [ ] `usethis::use_news_md()` * [ ] `usethis::use_cran_comments()` * [ ] Update (aspirational) install instructions in README * [ ] Proofread `Title:` and

[GitHub] [arrow] metalmatze opened a new issue, #37465: Add ability to read values from Boolean Builders

2023-08-30 Thread via GitHub
metalmatze opened a new issue, #37465: URL: https://github.com/apache/arrow/issues/37465 ### Describe the enhancement requested ### Describe the enhancement requested We are currently rewriting some of our components to use Arrow and when appending data to the record, we want

[GitHub] [arrow] thisisnic opened a new issue, #37456: [R] CRAN incoming checks show NOTE due to internal function which isn't documented

2023-08-30 Thread via GitHub
thisisnic opened a new issue, #37456: URL: https://github.com/apache/arrow/issues/37456 ### Describe the bug, including details regarding any error messages, version, and platform. From the 13.0.0 release after submission to CRAN: ``` Flavor: r-devel-linux-x86_64-debian-gcc

[GitHub] [arrow] thisisnic opened a new issue, #37463: [R] CRAN incoming checks fail due to test run length

2023-08-30 Thread via GitHub
thisisnic opened a new issue, #37463: URL: https://github.com/apache/arrow/issues/37463 ### Describe the enhancement requested Our submission is now getting flagged on CRAN as the check takes too long to run (11 mins, which is higher than the limit of 10) ### Component(s)

[GitHub] [arrow] otegami opened a new issue, #37562: [Ruby] Add support for table.each_raw_record.to_a

2023-09-05 Thread via GitHub
otegami opened a new issue, #37562: URL: https://github.com/apache/arrow/issues/37562 ### Describe the enhancement requested Currently, the method Arrow::Table#each_raw_record is expected to work with .to_a without a block. However, when attempting to do so, it raises a

[GitHub] [arrow] otegami opened a new issue, #37563: [Ruby] Unify tests with raw_records and each_raw_record

2023-09-05 Thread via GitHub
otegami opened a new issue, #37563: URL: https://github.com/apache/arrow/issues/37563 ### Describe the enhancement requested Currently, we are using the same test cases for both raw_records and each_raw_record. I'd like to unify these test cases to facilitate testing. You can see

[GitHub] [arrow] paleolimbot closed issue #36819: [R] Reading large Parquet files from a seekable connection fails

2023-09-05 Thread via GitHub
paleolimbot closed issue #36819: [R] Reading large Parquet files from a seekable connection fails URL: https://github.com/apache/arrow/issues/36819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] pitrou opened a new issue, #37567: [C++] Migrate JSON Integration code to Result<>

2023-09-05 Thread via GitHub
pitrou opened a new issue, #37567: URL: https://github.com/apache/arrow/issues/37567 ### Describe the enhancement requested The JSON Integration code is not a public API, so this was overlooked. Nevertheless, migrating to `Result`-returning APIs will make it easier to use for us.

[GitHub] [arrow] kevingurney opened a new issue, #37572: [MATLAB] Add `arrow.array.Date64Array` class

2023-09-05 Thread via GitHub
kevingurney opened a new issue, #37572: URL: https://github.com/apache/arrow/issues/37572 ### Describe the enhancement requested Now that `arrow.array.Date32Array` has been added to the MATLAB interface (#37445), we should also add `arrow.array.Date64Array`. ### Component(s)

[GitHub] [arrow] kevingurney opened a new issue, #37568: [MATLAB] Implement `isequal` for `arrow.tabular.Schema` MATLAB class

2023-09-05 Thread via GitHub
kevingurney opened a new issue, #37568: URL: https://github.com/apache/arrow/issues/37568 ### Describe the enhancement requested Following on to #37474, #37446, and #37525, we should implement `isequal` for the `arrow.tabular.Schema` MATLAB class. ### Component(s)

[GitHub] [arrow] otegami opened a new issue, #37561: Add tests to consider an empty chunked array for Arrow::Table#each_raw_records

2023-09-05 Thread via GitHub
otegami opened a new issue, #37561: URL: https://github.com/apache/arrow/issues/37561 ### Describe the enhancement requested Some test cases currently couldn't consider the an empty array. So we should add this test pattern to the other test cases about

[GitHub] [arrow] martinfleis opened a new issue, #37574: Compatibility with numpy 2.0 (removal of np.unicode_)

2023-09-05 Thread via GitHub
martinfleis opened a new issue, #37574: URL: https://github.com/apache/arrow/issues/37574 ### Describe the bug, including details regarding any error messages, version, and platform. Numpy has deprecated `np.unicode_` and removed it in an upcoming 2.0 release. Current nightly builds

[GitHub] [arrow] kevingurney opened a new issue, #37571: [MATLAB] Add `arrow.tabular.Table` MATLAB class

2023-09-05 Thread via GitHub
kevingurney opened a new issue, #37571: URL: https://github.com/apache/arrow/issues/37571 ### Describe the enhancement requested Now that `arrow.array.ChunkedArray` has been added to the MATLAB interface (#37525), we can implement an `arrow.tabular.Table` class. ###

[GitHub] [arrow] zeroshade closed issue #37523: [C++][CI][CUDA] CUDA Crossbow build failure

2023-09-05 Thread via GitHub
zeroshade closed issue #37523: [C++][CI][CUDA] CUDA Crossbow build failure URL: https://github.com/apache/arrow/issues/37523 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] pitrou opened a new issue, #37575: [Archery][Integration] Consider removing `--write_generated_json` option

2023-09-05 Thread via GitHub
pitrou opened a new issue, #37575: URL: https://github.com/apache/arrow/issues/37575 ### Describe the bug, including details regarding any error messages, version, and platform. The `archery integration` has a `--write_generated_json` flag that is only used by the JS test suite:

[GitHub] [arrow] 0x26res closed issue #37545: to_pandas(date_as_object=False) returns different dtype in pyarrow 13.0.0

2023-09-05 Thread via GitHub
0x26res closed issue #37545: to_pandas(date_as_object=False) returns different dtype in pyarrow 13.0.0 URL: https://github.com/apache/arrow/issues/37545 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [arrow] likun666661 opened a new issue, #37566: [C++] Update fast_float version to 4.0.0 #37564

2023-09-05 Thread via GitHub
likun61 opened a new issue, #37566: URL: https://github.com/apache/arrow/issues/37566 ### Describe the enhancement requested Update fast_float version to 4.0.0 ### Component(s) C++ -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [arrow] kevingurney opened a new issue, #37570: [MATLAB] Implement `isequal` for the `arrow.tabular.RecordBatch` MATLAB class

2023-09-05 Thread via GitHub
kevingurney opened a new issue, #37570: URL: https://github.com/apache/arrow/issues/37570 ### Describe the enhancement requested Following on to #37474, #37446, and #37525, we should implement `isequal` for the `arrow.tabular.RecordBatch` MATLAB class. ### Component(s)

[GitHub] [arrow-adbc] lidavidm opened a new issue, #1035: python: add README to pyproject.toml for PyPI

2023-09-05 Thread via GitHub
lidavidm opened a new issue, #1035: URL: https://github.com/apache/arrow-adbc/issues/1035 e.g. https://python-poetry.org/docs/pyproject/#readme -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] kevingurney opened a new issue, #37569: [MATLAB] Implement `isequal` for the `arrow.type.Field` MATLAB class

2023-09-05 Thread via GitHub
kevingurney opened a new issue, #37569: URL: https://github.com/apache/arrow/issues/37569 ### Describe the enhancement requested Following on to #37474, #37446, and #37525, we should implement `isequal` for the `arrow.type.Field` MATLAB class. ### Component(s) MATLAB

[GitHub] [arrow] rafapereirabr closed issue #37529: dplyr::mutate_at does not work with a Dataset nor Table

2023-09-03 Thread via GitHub
rafapereirabr closed issue #37529: dplyr::mutate_at does not work with a Dataset nor Table URL: https://github.com/apache/arrow/issues/37529 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] rafapereirabr opened a new issue, #37529: dplyr::mutate_at does not work with a Dataset nor Table

2023-09-02 Thread via GitHub
rafapereirabr opened a new issue, #37529: URL: https://github.com/apache/arrow/issues/37529 ### Describe the bug, including details regarding any error messages, version, and platform. The function `dplyr::mutate_at()` does not work with arrow Dataset nor Table. # Reprex:

[GitHub] [arrow] kou closed issue #37448: [MATLAB] Add `arrow.array.ChunkedArray` class

2023-09-03 Thread via GitHub
kou closed issue #37448: [MATLAB] Add `arrow.array.ChunkedArray` class URL: https://github.com/apache/arrow/issues/37448 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] jaychia opened a new issue, #37580: Reading back (some) Parquet int96 timestamps provides wrong round-trip results

2023-09-05 Thread via GitHub
jaychia opened a new issue, #37580: URL: https://github.com/apache/arrow/issues/37580 ### Describe the bug, including details regarding any error messages, version, and platform. PyArrow version: 13.0.0 Python version: 3.10.9 OS: MacOSX, arm64 Some Timestamp values

[GitHub] [arrow] kevingurney opened a new issue, #37577: [MATLAB] Create a superclass for `DateType`-related MATLAB tests

2023-09-05 Thread via GitHub
kevingurney opened a new issue, #37577: URL: https://github.com/apache/arrow/issues/37577 ### Describe the enhancement requested Many of the tests for `Date32Type` and `Date64Type` are similar. To reduce code duplication, we could consider adding a shared superclass for

[GitHub] [arrow] paleolimbot opened a new issue, #37576: [R] Failed allocations call into R from a non-R thread

2023-09-05 Thread via GitHub
paleolimbot opened a new issue, #37576: URL: https://github.com/apache/arrow/issues/37576 ### Describe the bug, including details regarding any error messages, version, and platform. The `gc_memory_pool()` is the one we use almost everywhere in the R package. It uses a special

[GitHub] [arrow] kevingurney closed issue #37230: [MATLAB] Add `arrow.type.Date64Type` class and `arrow.date64` construction function

2023-09-05 Thread via GitHub
kevingurney closed issue #37230: [MATLAB] Add `arrow.type.Date64Type` class and `arrow.date64` construction function URL: https://github.com/apache/arrow/issues/37230 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow-adbc] kou opened a new issue, #1033: .github/workflows: don't run scheduled jobs in fork repositories

2023-09-03 Thread via GitHub
kou opened a new issue, #1033: URL: https://github.com/apache/arrow-adbc/issues/1033 Because they are needless and "Upload packages to Gemfury" step is failed when `GEMFURY_PUSH_TOKEN` isn't set on fork repositories:

[GitHub] [arrow] kou closed issue #37410: [C++] libgandiva.so links with libzstd.so even though the Gandiva module doesn't depend on zstd and zstd isn't enabled

2023-09-03 Thread via GitHub
kou closed issue #37410: [C++] libgandiva.so links with libzstd.so even though the Gandiva module doesn't depend on zstd and zstd isn't enabled URL: https://github.com/apache/arrow/issues/37410 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [arrow] kou opened a new issue, #37532: [MATLAB] Reconsider GoogleTest needs

2023-09-03 Thread via GitHub
kou opened a new issue, #37532: URL: https://github.com/apache/arrow/issues/37532 ### Describe the enhancement requested Now, our build system has GoogleTest support but it's not used. There is only a placeholder test that tests nothing. We had one test for `mex_util` but it

[GitHub] [arrow] rafapereirabr closed issue #37529: [R] dplyr::mutate_at does not work with a Dataset nor Table

2023-09-03 Thread via GitHub
rafapereirabr closed issue #37529: [R] dplyr::mutate_at does not work with a Dataset nor Table URL: https://github.com/apache/arrow/issues/37529 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] kou closed issue #37067: [C++][CI] Flight tests fail running on some configurations

2023-09-05 Thread via GitHub
kou closed issue #37067: [C++][CI] Flight tests fail running on some configurations URL: https://github.com/apache/arrow/issues/37067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow] thisisnic opened a new issue, #37535: [R][CI] Nightly CI job test-r-depsource-system failing with Thrift error

2023-09-04 Thread via GitHub
thisisnic opened a new issue, #37535: URL: https://github.com/apache/arrow/issues/37535 ### Describe the bug, including details regarding any error messages, version, and platform. Nightly CI job

[GitHub] [arrow] 0x26res opened a new issue, #37545: to_pandas(date_as_object=False) returns different dtype in pyarrow 13.0.0

2023-09-04 Thread via GitHub
0x26res opened a new issue, #37545: URL: https://github.com/apache/arrow/issues/37545 ### Describe the bug, including details regarding any error messages, version, and platform. With `pyarrow==12.0.0`: ```python import pyarrow as pa import datetime import numpy as np

[GitHub] [arrow] thisisnic closed issue #36802: [R] CRAN packaging checklist for version 13.0.0

2023-09-06 Thread via GitHub
thisisnic closed issue #36802: [R] CRAN packaging checklist for version 13.0.0 URL: https://github.com/apache/arrow/issues/36802 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow-adbc] judahrand opened a new issue, #1037: [C] Postgres bulk insert is slow

2023-09-06 Thread via GitHub
judahrand opened a new issue, #1037: URL: https://github.com/apache/arrow-adbc/issues/1037 Currently the Postgres bulk inserter uses a standard `INSERT INTO ... VALUES` query to insert data. This is slow compared to `COPY data FROM STDIN WITH (FORMAT BINARY)`. Given that we already

[GitHub] [arrow] brancz opened a new issue, #37584: [Go] Add `ValueLen` function to string array

2023-09-06 Thread via GitHub
brancz opened a new issue, #37584: URL: https://github.com/apache/arrow/issues/37584 ### Describe the enhancement requested The binary array already has this function, and it's a useful mechanism when all one needs is the length of a value and not the value itself (for

[GitHub] [arrow] paolosartiprom opened a new issue, #37583: [Python] pyarrow.dataset.write_dataset doesn't write empty datasets, even if they had a schema, thus losing it when reading back the dataset

2023-09-06 Thread via GitHub
paolosartiprom opened a new issue, #37583: URL: https://github.com/apache/arrow/issues/37583 ### Describe the bug, including details regarding any error messages, version, and platform. The write_dataset function doesn't write anything if the table is empty. This has the consequence

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #89: Add a CI job on macOS

2023-09-05 Thread via GitHub
kou closed issue #89: Add a CI job on macOS URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/89 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] litao3rd opened a new issue, #37556: TaggedRecordBatch does not implement operator==

2023-09-04 Thread via GitHub
litao3rd opened a new issue, #37556: URL: https://github.com/apache/arrow/issues/37556 ### Describe the bug, including details regarding any error messages, version, and platform. I am a novice in Apache Arrow, and I'm not sure if this is a best practice. When I tried to

[GitHub] [arrow] kou closed issue #33749: [Ruby] Add Arrow::RecordBatch#each_raw_record

2023-09-04 Thread via GitHub
kou closed issue #33749: [Ruby] Add Arrow::RecordBatch#each_raw_record URL: https://github.com/apache/arrow/issues/33749 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] aru-trackunit opened a new issue, #37560: PyArrow Documentation bug dataset.to_batches()

2023-09-05 Thread via GitHub
aru-trackunit opened a new issue, #37560: URL: https://github.com/apache/arrow/issues/37560 ### Describe the bug, including details regarding any error messages, version, and platform. https://github.com/apache/arrow/blob/main/python/pyarrow/_dataset.pyx#L3439 Default value is

[GitHub] [arrow] kou opened a new issue, #37601: [CI][C++] test-ubuntu-20.04-cpp-minimal-with-formats failed

2023-09-06 Thread via GitHub
kou opened a new issue, #37601: URL: https://github.com/apache/arrow/issues/37601 ### Describe the bug, including details regarding any error messages, version, and platform. https://github.com/ursacomputing/crossbow/actions/runs/6099155746/job/1655386#step:6:1592 ```text

[GitHub] [arrow] js8544 closed issue #34300: [C++] Struct and its substruct length problem

2023-09-07 Thread via GitHub
js8544 closed issue #34300: [C++] Struct and its substruct length problem URL: https://github.com/apache/arrow/issues/34300 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] kou closed issue #37601: [CI][C++] test-ubuntu-20.04-cpp-minimal-with-formats failed

2023-09-06 Thread via GitHub
kou closed issue #37601: [CI][C++] test-ubuntu-20.04-cpp-minimal-with-formats failed URL: https://github.com/apache/arrow/issues/37601 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow] mapleFU opened a new issue, #37643: [C++] Enhande arrow::Datum::ToString

2023-09-10 Thread via GitHub
mapleFU opened a new issue, #37643: URL: https://github.com/apache/arrow/issues/37643 ### Describe the enhancement requested As document says, `::arrow::Datum::ToString` only prints the "type" of tagged enum: ``` /// \brief Return a string representation of the kind of

[GitHub] [arrow] kou closed issue #37535: [R][CI] Nightly CI jobs failing with Thrift error

2023-09-10 Thread via GitHub
kou closed issue #37535: [R][CI] Nightly CI jobs failing with Thrift error URL: https://github.com/apache/arrow/issues/37535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #109: Binaries release script requires source archive

2023-09-11 Thread via GitHub
kou opened a new issue, #109: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/109 It has `package/apt/test.sh`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #103: Add a command to re-run verifycation CI job

2023-09-10 Thread via GitHub
kou opened a new issue, #103: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/103 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #104: Verifycation script doesn't work for binaries

2023-09-10 Thread via GitHub
kou opened a new issue, #104: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/104 There are many problems... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #104: Verifycation script doesn't work for binaries

2023-09-10 Thread via GitHub
kou closed issue #104: Verifycation script doesn't work for binaries URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/104 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #103: Add a command to re-run verifycation CI job

2023-09-10 Thread via GitHub
kou closed issue #103: Add a command to re-run verifycation CI job URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/103 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #102: Verification script uses wrong download URL

2023-09-10 Thread via GitHub
kou closed issue #102: Verification script uses wrong download URL URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/102 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #98: Separate verify RC CI jobs from packages

2023-09-10 Thread via GitHub
kou opened a new issue, #98: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/98 We need to wait for packages jobs to prepare verify RC jobs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #98: Separate verify RC CI jobs from packages

2023-09-10 Thread via GitHub
kou closed issue #98: Separate verify RC CI jobs from packages URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/98 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow] giocomai opened a new issue, #37645: arrow causes "object 'input' not found" in R Shiny apps when passed to function in filtering

2023-09-10 Thread via GitHub
giocomai opened a new issue, #37645: URL: https://github.com/apache/arrow/issues/37645 ### Describe the bug, including details regarding any error messages, version, and platform. The `input` object used in Shiny apps does not seem to be fully available to arrow when passed to a

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #102: Verification script uses wrong download URL

2023-09-10 Thread via GitHub
kou opened a new issue, #102: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/102 It should use `https://github.com/apache/arrow-flight-sql-postgresql/releases/download/${TAG}/${FILE}` not

[GitHub] [arrow] AlwaysZhi opened a new issue, #37647: [Go] array.RecordFromJSON() method does not return for a significant amount of time for large JSON file

2023-09-10 Thread via GitHub
AlwaysZhi opened a new issue, #37647: URL: https://github.com/apache/arrow/issues/37647 ### Describe the usage question you have. Please include as many useful details as possible. When I attempt to use the array.RecordFromJSON() method to read a relatively large JSON file

[GitHub] [arrow] kou closed issue #37562: [Ruby] Add support for table.each_raw_record.to_a

2023-09-10 Thread via GitHub
kou closed issue #37562: [Ruby] Add support for table.each_raw_record.to_a URL: https://github.com/apache/arrow/issues/37562 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow] kou opened a new issue, #37648: [Packaging][Linux] libarrow-glib-dev/arrow-glib-devel misses libarrow-acero-dev/arrow-acero-devel dependencies

2023-09-10 Thread via GitHub
kou opened a new issue, #37648: URL: https://github.com/apache/arrow/issues/37648 ### Describe the bug, including details regarding any error messages, version, and platform. Apache Arrow GLib always uses Acero. So development packages of Apache Arrow GLib must depend on development

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #108: Source verification script on Ubuntu error on exit

2023-09-11 Thread via GitHub
kou opened a new issue, #108: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/108 ```text Release candidate looks good! rm: cannot remove

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #109: Binaries release script requires source archive

2023-09-11 Thread via GitHub
kou closed issue #109: Binaries release script requires source archive URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/109 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-adbc] lidavidm closed issue #1033: .github/workflows: don't run scheduled jobs in fork repositories

2023-09-07 Thread via GitHub
lidavidm closed issue #1033: .github/workflows: don't run scheduled jobs in fork repositories URL: https://github.com/apache/arrow-adbc/issues/1033 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [arrow] deanm0000 opened a new issue, #37604: pyarrow.parquet.ParquetFile.metadata shows deprecated min/max only not min_value/max_value

2023-09-07 Thread via GitHub
deanm opened a new issue, #37604: URL: https://github.com/apache/arrow/issues/37604 ### Describe the bug, including details regarding any error messages, version, and platform. If I do ``` import polars as pl import pyarrow.parquet as pq

[GitHub] [arrow-adbc] lidavidm closed issue #1035: python: add README to pyproject.toml for PyPI

2023-09-07 Thread via GitHub
lidavidm closed issue #1035: python: add README to pyproject.toml for PyPI URL: https://github.com/apache/arrow-adbc/issues/1035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [arrow] mapleFU opened a new issue, #37606: [C++][Parquet] Dataset: Parquet Writer Supports user memory-pool

2023-09-07 Thread via GitHub
mapleFU opened a new issue, #37606: URL: https://github.com/apache/arrow/issues/37606 ### Describe the enhancement requested Support User memory-pool in Parquet Writer ### Component(s) C++, Parquet -- This is an automated message from the Apache Git Service. To

[GitHub] [arrow-adbc] judahrand opened a new issue, #1043: python/driver/sqlite: add ability to `load_extension`

2023-09-07 Thread via GitHub
judahrand opened a new issue, #1043: URL: https://github.com/apache/arrow-adbc/issues/1043 The standard library `sqlite3` module has the methods ```python conn.enable_load_extension(enabled: bool)` conn.load_extenstion(extenstion: str) ``` if Python is compiled with

[GitHub] [arrow] domoritz closed issue #17168: [Integration][JS] Fix map type to allow non-standard field names

2023-09-07 Thread via GitHub
domoritz closed issue #17168: [Integration][JS] Fix map type to allow non-standard field names URL: https://github.com/apache/arrow/issues/17168 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] domoritz closed issue #37063: [JavaScript] Vector includes will return false for first element

2023-09-07 Thread via GitHub
domoritz closed issue #37063: [JavaScript] Vector includes will return false for first element URL: https://github.com/apache/arrow/issues/37063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-flight-sql-postgresql] kou closed issue #108: Source verification script on Ubuntu error on exit

2023-09-11 Thread via GitHub
kou closed issue #108: Source verification script on Ubuntu error on exit URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] r-priyam opened a new issue, #37649: [Python] How to cast STRING JSON to STRUCT in pyarrow?

2023-09-11 Thread via GitHub
r-priyam opened a new issue, #37649: URL: https://github.com/apache/arrow/issues/37649 ### Describe the usage question you have. Please include as many useful details as possible. I have a `parquet` file where some column values are stored as JSON in string and I have to use

[GitHub] [arrow] thisisnic closed issue #37645: [R] "object 'input' not found" in R Shiny apps when passed to function in filtering arrow object

2023-09-11 Thread via GitHub
thisisnic closed issue #37645: [R] "object 'input' not found" in R Shiny apps when passed to function in filtering arrow object URL: https://github.com/apache/arrow/issues/37645 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [arrow-adbc] sfc-gh-twhite opened a new issue, #1047: python/driver/snowflake: TypeError: __init__() got multiple values for keyword argument 'database'

2023-09-11 Thread via GitHub
sfc-gh-twhite opened a new issue, #1047: URL: https://github.com/apache/arrow-adbc/issues/1047 I'm using the following libraries to connect to Snowflake with ADBC: adbc-driver-flightsql==0.6.0 adbc-driver-manager==0.6.0 adbc-driver-snowflake==0.6.0 I'm encountering an

[GitHub] [arrow] oliviermeslin opened a new issue, #37655: [C++] PR #35087 makes merging large tables impossible even when key data size is not an issue

2023-09-11 Thread via GitHub
oliviermeslin opened a new issue, #37655: URL: https://github.com/apache/arrow/issues/37655 ### Describe the bug, including details regarding any error messages, version, and platform. **TL;DR: [PR 35087](https://github.com/apache/arrow/pull/35087) introduced an explicit fail in

[GitHub] [arrow] WillAyd opened a new issue, #37650: Passing table as argument to pyarrow.Table.filter causes segfault

2023-09-11 Thread via GitHub
WillAyd opened a new issue, #37650: URL: https://github.com/apache/arrow/issues/37650 ### Describe the bug, including details regarding any error messages, version, and platform. This is not correct code, but I did actually make this mistake and was puzzled for a while by the

[GitHub] [arrow] sgilmore10 opened a new issue, #37653: [MATLAB] Add `arrow.array.StructArray` MATLAB class

2023-09-11 Thread via GitHub
sgilmore10 opened a new issue, #37653: URL: https://github.com/apache/arrow/issues/37653 ### Describe the enhancement requested Now that many of the commonly-used "primitive" array types have been added to the MATLAB Inferface, we can implement `arrow.array.StructArray` class.

[GitHub] [arrow] lidavidm closed issue #37224: [C++][FlightRPC] Evaluate gRPC call tracer, channel filter APIs

2023-09-11 Thread via GitHub
lidavidm closed issue #37224: [C++][FlightRPC] Evaluate gRPC call tracer, channel filter APIs URL: https://github.com/apache/arrow/issues/37224 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow] austin3dickey opened a new issue, #37657: [JS] [Benchmarking] JavaScript microbenchmarks are failing

2023-09-11 Thread via GitHub
austin3dickey opened a new issue, #37657: URL: https://github.com/apache/arrow/issues/37657 ### Describe the bug, including details regarding any error messages, version, and platform. Since this PR: - https://github.com/apache/arrow/pull/37122 the JavaScript

[GitHub] [arrow] davidhcoe opened a new issue, #37651: [C#] Expose ArrowArrayConcatenator.Concatenate

2023-09-11 Thread via GitHub
davidhcoe opened a new issue, #37651: URL: https://github.com/apache/arrow/issues/37651 ### Describe the enhancement requested Other libraries, such as upcoming drivers written in C#, need the ability to concatenate arrays, particularly for metadata calls. ### Component(s)

[GitHub] [arrow] sgilmore10 opened a new issue, #37654: [MATLAB] Add `Fields` property to `arrow.type.Type` class

2023-09-11 Thread via GitHub
sgilmore10 opened a new issue, #37654: URL: https://github.com/apache/arrow/issues/37654 ### Describe the enhancement requested In order to implement `arrow.array.StructType`, we need to add a property called `Fields` to `arrow.type.Type`. This property will be a N-by-1

[GitHub] [arrow-adbc] lidavidm closed issue #1015: c/driver/postgresql: Writing large string to Postgres fails

2023-09-11 Thread via GitHub
lidavidm closed issue #1015: c/driver/postgresql: Writing large string to Postgres fails URL: https://github.com/apache/arrow-adbc/issues/1015 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [arrow-adbc] lidavidm closed issue #728: ci: enable Java integration tests

2023-09-11 Thread via GitHub
lidavidm closed issue #728: ci: enable Java integration tests URL: https://github.com/apache/arrow-adbc/issues/728 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [arrow-adbc] lidavidm closed issue #1017: c/driver/postgresql: hardcode the overflow check

2023-09-11 Thread via GitHub
lidavidm closed issue #1017: c/driver/postgresql: hardcode the overflow check URL: https://github.com/apache/arrow-adbc/issues/1017 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [arrow] deanm0000 opened a new issue, #37666: [Python][Parquet] read_table much slower with multiple row group files when column pruning than single row group

2023-09-11 Thread via GitHub
deanm opened a new issue, #37666: URL: https://github.com/apache/arrow/issues/37666 ### Describe the bug, including details regarding any error messages, version, and platform. Here's the setup, scroll to bottom for results and better summary. ``` import fsspec

[GitHub] [arrow] wjones127 opened a new issue, #37669: [Python] RecordBatch.from_arrays() segfaults if passed storage array

2023-09-11 Thread via GitHub
wjones127 opened a new issue, #37669: URL: https://github.com/apache/arrow/issues/37669 ### Describe the bug, including details regarding any error messages, version, and platform. If you try to create a record batch using `RecordBatch.from_arrays()` where a field in the schema is

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #112: release:rc:vote has problems

2023-09-11 Thread via GitHub
kou opened a new issue, #112: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/112 * `${version}` in `Subject` isn't substituted * There are some wording mistakes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [arrow] swyatt7 opened a new issue, #37667: [Python][dataset] Unable to read dataset from cloud storage

2023-09-11 Thread via GitHub
swyatt7 opened a new issue, #37667: URL: https://github.com/apache/arrow/issues/37667 ### Describe the bug, including details regarding any error messages, version, and platform. Hi all, I am trying to read a hive partitioned parquet dataset from cloud storage and am running into

[GitHub] [arrow] kou opened a new issue, #37715: [Packaging][CentOS] Failed to build RPM for CentOS 9 Stream

2023-09-13 Thread via GitHub
kou opened a new issue, #37715: URL: https://github.com/apache/arrow/issues/37715 ### Describe the bug, including details regarding any error messages, version, and platform. https://github.com/ursacomputing/crossbow/actions/runs/6170008018/job/16745412708#step:8:1983 ```text

[GitHub] [arrow-flight-sql-postgresql] kou opened a new issue, #129: example/flight-sql/query-prepared.cc misses some FlightCallOptions

2023-09-14 Thread via GitHub
kou opened a new issue, #129: URL: https://github.com/apache/arrow-flight-sql-postgresql/issues/129 https://lists.apache.org/thread/1xdcmv4or5tzgyzchrvzpnszbs0q58qo -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [arrow] zinking opened a new issue, #37719: [Java] Arrow native reader load next batch importing vector from c causing performance degrade

2023-09-14 Thread via GitHub
zinking opened a new issue, #37719: URL: https://github.com/apache/arrow/issues/37719 ### Describe the bug, including details regarding any error messages, version, and platform. it seems the native reader is first read the data into c vector, then import it into java format,

[GitHub] [arrow] kou closed issue #37697: [Python] How to install pyarrow package in an anaconda virtual env running on rhel 8.6 on Linux on System z

2023-09-14 Thread via GitHub
kou closed issue #37697: [Python] How to install pyarrow package in an anaconda virtual env running on rhel 8.6 on Linux on System z URL: https://github.com/apache/arrow/issues/37697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [arrow] kou opened a new issue, #37716: [C++] re2_SOURCE=BUNDLED on macOS failed

2023-09-14 Thread via GitHub
kou opened a new issue, #37716: URL: https://github.com/apache/arrow/issues/37716 ### Describe the bug, including details regarding any error messages, version, and platform. Note that Homebrew's re2 formula is installed. ```text FAILED: debug/gandiva-internals-test :

[GitHub] [arrow] alamb opened a new issue, #37741: [FlightSQL] Support `DoExchange` (in addition to `DoPut`) to bind parameters and execute prepared statements

2023-09-15 Thread via GitHub
alamb opened a new issue, #37741: URL: https://github.com/apache/arrow/issues/37741 ### Describe the enhancement requested As suggested by @kou on https://github.com/apache/arrow/issues/37720#issuecomment-1720662204 # Usecase 1. Reduce the number of messages round trips

[GitHub] [arrow] evofromko opened a new issue, #37735: error: implicit conversion loses integer precision: 'size_t' (aka 'unsigned long') to 'const int' ....

2023-09-15 Thread via GitHub
evofromko opened a new issue, #37735: URL: https://github.com/apache/arrow/issues/37735 ### Describe the bug, including details regarding any error messages, version, and platform. New to al lthe stuff compiling. Running FreeBSD 13.2-RELEASE-p1 trying to install pyarrow and i was

[GitHub] [arrow] RPAraujo opened a new issue, #37737: [GO] how to run parameterized queries?

2023-09-15 Thread via GitHub
RPAraujo opened a new issue, #37737: URL: https://github.com/apache/arrow/issues/37737 ### Describe the usage question you have. Please include as many useful details as possible. Can't find examples, or documentation, about how to run parameterized queries. Going through

  1   2   3   4   5   6   7   8   9   10   >