(arrow) branch main updated (a708fabfe6 -> 290e606c4d)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from a708fabfe6 MINOR: [C++] Include `` before using `std::string` (#42004) add 290e606c4d GH-41652: [C++][CMake][Windows] Don't build needless object libraries (#41658) No new revisions were added by this update. Summary of changes: cpp/src/arrow/CMakeLists.txt | 37 ++--- 1 file changed, 22 insertions(+), 15 deletions(-)
(arrow) branch main updated (41ae29ebd9 -> a708fabfe6)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 41ae29ebd9 GH-42005: [Java][Integration][CI] Fix ARROW_BUILD_ROOT Path to find pom.xml (#42008) add a708fabfe6 MINOR: [C++] Include `` before using `std::string` (#42004) No new revisions were added by this update. Summary of changes: cpp/src/arrow/json/object_writer.h | 1 + 1 file changed, 1 insertion(+)
(arrow) branch main updated: GH-42005: [Java][Integration][CI] Fix ARROW_BUILD_ROOT Path to find pom.xml (#42008)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new 41ae29ebd9 GH-42005: [Java][Integration][CI] Fix ARROW_BUILD_ROOT Path to find pom.xml (#42008) 41ae29ebd9 is described below commit 41ae29ebd98e66d1502d6a830f88d6da056c670e Author: Hyunseok Seo AuthorDate: Fri Jun 7 10:15:50 2024 +0900 GH-42005: [Java][Integration][CI] Fix ARROW_BUILD_ROOT Path to find pom.xml (#42008) ### Rationale for this change This PR aims to fix the issue where the integration tests are failing due to the missing `/java/pom.xml` file. It appears that the current code incorrectly determines the path to `ARROW_BUILD_ROOT`, leading to the failure in locating the `pom.xml` file. ### What changes are included in this PR? - Updating the `ARROW_BUILD_ROOT` path determination logic in `tester_java.py` to correctly reference the project root. ### Are these changes tested? Maybe, Yes. ### Are there any user-facing changes? No. * GitHub Issue: #42005 Authored-by: Hyunseok Seo Signed-off-by: Sutou Kouhei --- dev/archery/archery/integration/tester_java.py | 2 +- dev/archery/archery/integration/tester_js.py | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/dev/archery/archery/integration/tester_java.py b/dev/archery/archery/integration/tester_java.py index ccc807410a..9b14c6939c 100644 --- a/dev/archery/archery/integration/tester_java.py +++ b/dev/archery/archery/integration/tester_java.py @@ -28,7 +28,7 @@ from .util import run_cmd, log ARROW_BUILD_ROOT = os.environ.get( 'ARROW_BUILD_ROOT', -Path(__file__).resolve().parents[5] +Path(__file__).resolve().parents[4] ) diff --git a/dev/archery/archery/integration/tester_js.py b/dev/archery/archery/integration/tester_js.py index 3d1a229931..dcf56f9a5a 100644 --- a/dev/archery/archery/integration/tester_js.py +++ b/dev/archery/archery/integration/tester_js.py @@ -24,7 +24,7 @@ from .util import run_cmd, log ARROW_BUILD_ROOT = os.environ.get( 'ARROW_BUILD_ROOT', -Path(__file__).resolve().parents[5] +Path(__file__).resolve().parents[4] ) ARROW_JS_ROOT = os.path.join(ARROW_BUILD_ROOT, 'js') _EXE_PATH = os.path.join(ARROW_JS_ROOT, 'bin')
(arrow) branch main updated (9ee6ea701e -> 3d11205517)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 9ee6ea701e MINOR: [C++][CI] Work around bug in conda-forge benchmark package (#41987) add 3d11205517 GH-41999: [Swift] Add methods for adding array and vargs to arrow array (#42000) No new revisions were added by this update. Summary of changes: swift/Arrow/Sources/Arrow/ArrowArrayBuilder.swift | 12 +++ swift/Arrow/Tests/ArrowTests/ArrayTests.swift | 40 +-- 2 files changed, 50 insertions(+), 2 deletions(-)
(arrow) branch main updated (e4baf6be21 -> fb0773cfcc)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from e4baf6be21 GH-38553 : [C++] Replace null_count with MayHaveNulls in ListArrayFromArray and MapArray (#41957) add fb0773cfcc MINOR: [JS] Bump eslint-plugin-unicorn from 52.0.0 to 53.0.0 in /js (#41916) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 78 - 2 files changed, 56 insertions(+), 24 deletions(-)
(arrow) branch main updated (7d60148d24 -> 8d2db80586)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 7d60148d24 MINOR: [JS] Bump @types/node from 20.13.0 to 20.14.1 in /js (#41948) add 8d2db80586 MINOR: [JS] Bump @typescript-eslint/parser from 7.11.0 to 7.12.0 in /js (#41949) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 53 - 2 files changed, 45 insertions(+), 10 deletions(-)
(arrow) branch main updated: MINOR: [JS] Bump @types/node from 20.13.0 to 20.14.1 in /js (#41948)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new 7d60148d24 MINOR: [JS] Bump @types/node from 20.13.0 to 20.14.1 in /js (#41948) 7d60148d24 is described below commit 7d60148d24a454b135988a3a394938d207ad90e7 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Tue Jun 4 14:08:15 2024 +0900 MINOR: [JS] Bump @types/node from 20.13.0 to 20.14.1 in /js (#41948) Bumps [@ types/node](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/node) from 20.13.0 to 20.14.1. Commits See full diff in https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/node;>compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@ dependabot rebase` will rebase this PR - `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@ dependabot merge` will merge this PR after your CI passes on it - `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@ dependabot cancel merge` will cancel a previously requested merge and block automerging - `@ dependabot reopen` will reopen this PR if it is closed - `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@ dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Sutou Kouhei --- js/yarn.lock | 15 --- 1 file changed, 4 insertions(+), 11 deletions(-) diff --git a/js/yarn.lock b/js/yarn.lock index d552709734..c19f69a901 100644 --- a/js/yarn.lock +++ b/js/yarn.lock @@ -1370,17 +1370,10 @@ dependencies: "@types/node" "*" -"@types/node@*": - version "20.12.8" - resolved "https://registry.yarnpkg.com/@types/node/-/node-20.12.8.tgz#35897bf2bfe3469847ab04634636de09552e8256; - integrity sha512-NU0rJLJnshZWdE/097cdCBbyW1h4hEg0xpovcoAQYHl8dnEyp/NAOiE45pvc+Bd1Dt+2r94v2eGFpQJ4R7g+2w== - dependencies: -undici-types "~5.26.4" - -"@types/node@>=13.7.4", "@types/node@^20.13.0": - version "20.13.0" - resolved "https://registry.yarnpkg.com/@types/node/-/node-20.13.0.tgz#011a76bc1e71ae9a026dddcfd7039084f752c4b6; - integrity sha512-FM6AOb3khNkNIXPnHFDYaHerSv8uN22C91z098AnGccVu+Pcdhi+pNUFDi0iLmPIsVE0JBD0KVS7mzUYt4nRzQ== +"@types/node@*", "@types/node@>=13.7.4", "@types/node@^20.13.0": + version "20.14.1" + resolved "https://registry.yarnpkg.com/@types/node/-/node-20.14.1.tgz#2434dbcb1f039e31f2c0e9969da93f52cf6348f3; + integrity sha512-T2MzSGEu+ysB/FkWfqmhV3PLyQlowdptmmgD20C6QxsS8Fmv5SjpZ1ayXaEC0S21/h5UJ9iA6W/5vSNU5l00OA== dependencies: undici-types "~5.26.4"
(arrow) branch main updated (2c2c6c505d -> 4ec1c986a0)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 2c2c6c505d GH-41905: [JS] Update dependencies (#41906) add 4ec1c986a0 GH-41945: [Swift] Add interface ArrowArrayHolderBuilder (#41946) No new revisions were added by this update. Summary of changes: swift/Arrow/Sources/Arrow/ArrowArrayBuilder.swift | 15 +++- swift/Arrow/Tests/ArrowTests/ArrayTests.swift | 28 ++- 2 files changed, 41 insertions(+), 2 deletions(-)
(arrow) branch main updated (fd54260f29 -> b08c8be3d6)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from fd54260f29 MINOR: [Java] Bump org.apache.maven.plugins:maven-install-plugin from 3.1.1 to 3.1.2 in /java (#41941) add b08c8be3d6 MINOR: [Java] Bump com.google.guava:guava-bom from 33.0.0-jre to 33.2.1-jre in /java (#41943) No new revisions were added by this update. Summary of changes: java/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(arrow) branch main updated (9ab28c6826 -> fd54260f29)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 9ab28c6826 MINOR: [Java] Bump dep.slf4j.version from 2.0.12 to 2.0.13 in /java (#41940) add fd54260f29 MINOR: [Java] Bump org.apache.maven.plugins:maven-install-plugin from 3.1.1 to 3.1.2 in /java (#41941) No new revisions were added by this update. Summary of changes: java/maven/module-info-compiler-maven-plugin/pom.xml | 2 +- java/performance/pom.xml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
(arrow) branch main updated (9b59157a44 -> 9ab28c6826)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 9b59157a44 MINOR: [Java] Bump org.apache.maven.plugins:maven-gpg-plugin from 3.2.2 to 3.2.4 in /java (#41939) add 9ab28c6826 MINOR: [Java] Bump dep.slf4j.version from 2.0.12 to 2.0.13 in /java (#41940) No new revisions were added by this update. Summary of changes: java/maven/pom.xml | 2 +- java/pom.xml | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
(arrow) branch main updated (2b1593d78f -> 9b59157a44)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 2b1593d78f MINOR: [Go] Bump github.com/hamba/avro/v2 from 2.22.0 to 2.22.1 in /go (#41937) add 9b59157a44 MINOR: [Java] Bump org.apache.maven.plugins:maven-gpg-plugin from 3.2.2 to 3.2.4 in /java (#41939) No new revisions were added by this update. Summary of changes: java/gandiva/pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(arrow) branch main updated (7f0c4070dd -> 2b1593d78f)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 7f0c4070dd GH-41397: [C#] Downgrade macOS test runner to avoid infrastructure bug (#41934) add 2b1593d78f MINOR: [Go] Bump github.com/hamba/avro/v2 from 2.22.0 to 2.22.1 in /go (#41937) No new revisions were added by this update. Summary of changes: go/go.mod | 2 +- go/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
(arrow) branch main updated (1598782d4f -> 7f0c4070dd)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 1598782d4f GH-41262: [Java][FlightSQL] Implement stateless prepared statements (#41237) add 7f0c4070dd GH-41397: [C#] Downgrade macOS test runner to avoid infrastructure bug (#41934) No new revisions were added by this update. Summary of changes: .github/workflows/csharp.yml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
(arrow) branch main updated (44070eb99f -> 02585cd112)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 44070eb99f GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when building GLib libraries with MSVC (#41839) add 02585cd112 GH-39345: [C++][FS][Azure] Add support for environment credential (#41715) No new revisions were added by this update. Summary of changes: cpp/src/arrow/filesystem/azurefs.cc | 14 ++ cpp/src/arrow/filesystem/azurefs.h | 10 +++--- cpp/src/arrow/filesystem/azurefs_test.cc | 19 +++ 3 files changed, 40 insertions(+), 3 deletions(-)
(arrow) branch main updated: GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when building GLib libraries with MSVC (#41839)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 44070eb99f GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when
building GLib libraries with MSVC (#41839)
44070eb99f is described below
commit 44070eb99f0db907e1cf7a445bf7c6fea78e17fe
Author: Adam Reeve
AuthorDate: Mon Jun 3 08:53:34 2024 +1200
GH-41806: [GLib][CI] Use vcpkg for C++ dependencies when building GLib
libraries with MSVC (#41839)
### Rationale for this change
This is more consistent as vcpkg is now used for both the Arrow C++
dependencies and GLib library dependencies, and also fixes building
arrow-flight-glib and arrow-flight-sql-glib which previously failed due to a
missing zlib dependency.
### What changes are included in this PR?
* Configure the MSVC GLib build to use VCPKG as the dependency source for
the C++ build
* Configure GitHub packages based vcpkg caching (see
https://learn.microsoft.com/en-us/vcpkg/users/binarycaching#quickstart-github)
* Enable building Flight and Flight SQL
### Are these changes tested?
NA
### Are there any user-facing changes?
No
Because GitHub packages is being used for caching, this will start creating
GitHub packages that are visible in the main page of the Arrow GitHub
repository by default. Eg. you can see them in the right panel on the crossbow
repo which also runs tasks that use GitHub packages for vcpkg caching:
https://github.com/ursacomputing/crossbow.
The Arrow repository doesn't currently publish any packages, so it would
probably be best to hide these by default to avoid confusing users and adding
unnecessary noise. Someone with admin privileges on the Arrow GitHub repository
would need to click the cog on the home page and hide this section:
If this isn't desirable I could look into other ways of caching instead,
eg. using a file based cache combined with GitHub actions cache action, or the
experimental GitHub actions cache in vcpkg.
* GitHub Issue: #41806
Lead-authored-by: Adam Reeve
Co-authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
.github/workflows/ruby.yml | 35 ---
ci/scripts/cpp_build.sh | 1 +
cpp/cmake_modules/Usevcpkg.cmake | 3 +++
3 files changed, 32 insertions(+), 7 deletions(-)
diff --git a/.github/workflows/ruby.yml b/.github/workflows/ruby.yml
index 04f944f56c..35c4460d47 100644
--- a/.github/workflows/ruby.yml
+++ b/.github/workflows/ruby.yml
@@ -313,15 +313,17 @@ jobs:
strategy:
fail-fast: false
env:
+ ARROW_ACERO: ON
ARROW_BOOST_USE_SHARED: OFF
ARROW_BUILD_BENCHMARKS: OFF
ARROW_BUILD_SHARED: ON
ARROW_BUILD_STATIC: OFF
ARROW_BUILD_TESTS: OFF
- ARROW_ACERO: ON
ARROW_DATASET: ON
- ARROW_FLIGHT: OFF
- ARROW_FLIGHT_SQL: OFF
+ ARROW_DEPENDENCY_SOURCE: VCPKG
+ ARROW_DEPENDENCY_USE_SHARED: OFF
+ ARROW_FLIGHT: ON
+ ARROW_FLIGHT_SQL: ON
ARROW_GANDIVA: OFF
ARROW_HDFS: OFF
ARROW_HOME: "${{ github.workspace }}/dist"
@@ -337,13 +339,16 @@ jobs:
ARROW_WITH_LZ4: OFF
ARROW_WITH_OPENTELEMETRY: OFF
ARROW_WITH_SNAPPY: ON
- ARROW_WITH_ZLIB: OFF
+ ARROW_WITH_ZLIB: ON
ARROW_WITH_ZSTD: ON
- BOOST_SOURCE: BUNDLED
CMAKE_CXX_STANDARD: "17"
CMAKE_GENERATOR: Ninja
CMAKE_INSTALL_PREFIX: "${{ github.workspace }}/dist"
CMAKE_UNITY_BUILD: ON
+ VCPKG_BINARY_SOURCES: 'clear;nuget,GitHub,readwrite'
+ VCPKG_ROOT: "${{ github.workspace }}/vcpkg"
+permissions:
+ packages: write
steps:
- name: Disable Crash Dialogs
run: |
@@ -361,7 +366,7 @@ jobs:
- name: Install vcpkg
shell: bash
run: |
- ci/scripts/install_vcpkg.sh ./vcpkg
+ ci/scripts/install_vcpkg.sh "${VCPKG_ROOT}"
- name: Install meson
run: |
python -m pip install meson
@@ -387,6 +392,22 @@ jobs:
env:
# We can invalidate the current cache by updating this.
CACHE_VERSION: "2024-05-09"
+ - name: Setup NuGet credentials for vcpkg caching
+shell: bash
+run: |
+ $(vcpkg/vcpkg.exe fetch nuget | tail -n 1) \
+sources add \
+-source
"https://nuget.pkg.github.com/$GITHUB_REPOSITORY_OWNER/index.json; \
+-storepasswordincleartext \
+-name "GitHub" \
+-username "$GITHUB_REPOSITORY_OWNER" \
+-password "${{ secrets.GITHUB_TOKEN }}"
+
(arrow) branch main updated: GH-41920: [CI][JS] Add missing build directory argument (#41921)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 0d9d699250 GH-41920: [CI][JS] Add missing build directory argument
(#41921)
0d9d699250 is described below
commit 0d9d699250ad98cdcc5c99735e1379b1e79bc195
Author: Sutou Kouhei
AuthorDate: Sun Jun 2 06:51:56 2024 +0900
GH-41920: [CI][JS] Add missing build directory argument (#41921)
### Rationale for this change
This is a follow-up of GH-41455.
### What changes are included in this PR?
Add missing build directory argument.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41920
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
.github/workflows/js.yml | 8
1 file changed, 4 insertions(+), 4 deletions(-)
diff --git a/.github/workflows/js.yml b/.github/workflows/js.yml
index c9b7d7b742..e03d0c2dad 100644
--- a/.github/workflows/js.yml
+++ b/.github/workflows/js.yml
@@ -106,10 +106,10 @@ jobs:
node-version: ${{ matrix.node }}
- name: Build
shell: bash
-run: ci/scripts/js_build.sh $(pwd)
+run: ci/scripts/js_build.sh $(pwd) build
- name: Test
shell: bash
-run: ci/scripts/js_test.sh $(pwd)
+run: ci/scripts/js_test.sh $(pwd) build
windows:
name: AMD64 Windows NodeJS ${{ matrix.node }}
@@ -136,7 +136,7 @@ jobs:
node-version: ${{ matrix.node }}
- name: Build
shell: bash
-run: ci/scripts/js_build.sh $(pwd)
+run: ci/scripts/js_build.sh $(pwd) build
- name: Test
shell: bash
-run: ci/scripts/js_test.sh $(pwd)
+run: ci/scripts/js_test.sh $(pwd) build
(arrow-site) branch main updated: [Website] Add Sarah Gilmore to committer list (#527)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new d4aac47db1c [Website] Add Sarah Gilmore to committer list (#527) d4aac47db1c is described below commit d4aac47db1cc2333a393dbc4c40c46c1c6b57743 Author: Sarah Gilmore <74676073+sgilmor...@users.noreply.github.com> AuthorDate: Fri May 31 17:39:24 2024 -0400 [Website] Add Sarah Gilmore to committer list (#527) I was accepted as a committer to the Apache Arrow project on April 11, 2024. See the mailing thread below: https://lists.apache.org/thread/797fx29557x5g8t404nqmm58mmlj7sjq - Co-authored-by: Sutou Kouhei --- _data/committers.yml | 4 1 file changed, 4 insertions(+) diff --git a/_data/committers.yml b/_data/committers.yml index 1740e4f20dd..3d1068312ab 100644 --- a/_data/committers.yml +++ b/_data/committers.yml @@ -424,6 +424,10 @@ role: Committer alias: wayne affiliation: Greptime +- name: Sarah Gilmore + role: Committer + alias: sgilmore + affiliation: MathWorks - name: Xudong Wang role: Committer alias: xudong963
(arrow) branch main updated (706b3e09e1 -> 052c330de1)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 706b3e09e1 GH-40932: [Java] Implement TransferPair functionality for StringView (#41861) add 052c330de1 GH-41836: [Java] Fix an undefined symbol error when ARROW_S3=OFF (#41837) No new revisions were added by this update. Summary of changes: java/dataset/src/main/cpp/jni_wrapper.cc | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
(arrow) branch main updated: MINOR: [Swift] cleanup some go and C++ artifacts (#41878)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new da0eb7e9fc MINOR: [Swift] cleanup some go and C++ artifacts (#41878)
da0eb7e9fc is described below
commit da0eb7e9fc90190b616aa85635d561d03e1ffe67
Author: abandy
AuthorDate: Wed May 29 16:55:13 2024 -0400
MINOR: [Swift] cleanup some go and C++ artifacts (#41878)
### Rationale for this change
Follow up changes requested in the #41342
### What changes are included in this PR?
Update includes header file and go dependencies changes related to the C
Data interface changes.
Authored-by: Alva Bandy
Signed-off-by: Sutou Kouhei
---
swift/Arrow/Sources/ArrowC/ArrowCData.c | 1 +
swift/Arrow/Sources/ArrowC/include/ArrowCData.h | 5 +-
swift/CDataWGo/go.mod | 28 +++
swift/CDataWGo/go.sum | 106
4 files changed, 49 insertions(+), 91 deletions(-)
diff --git a/swift/Arrow/Sources/ArrowC/ArrowCData.c
b/swift/Arrow/Sources/ArrowC/ArrowCData.c
index ac366febda..fe0f808997 100644
--- a/swift/Arrow/Sources/ArrowC/ArrowCData.c
+++ b/swift/Arrow/Sources/ArrowC/ArrowCData.c
@@ -15,6 +15,7 @@
// specific language governing permissions and limitations
// under the License.
+#include
#include "include/ArrowCData.h"
void ArrowSwiftClearReleaseSchema(struct ArrowSchema* arrowSchema) {
diff --git a/swift/Arrow/Sources/ArrowC/include/ArrowCData.h
b/swift/Arrow/Sources/ArrowC/include/ArrowCData.h
index 9df8992114..4b2f35efcb 100644
--- a/swift/Arrow/Sources/ArrowC/include/ArrowCData.h
+++ b/swift/Arrow/Sources/ArrowC/include/ArrowCData.h
@@ -22,10 +22,7 @@
#define ARROW_FLAG_NULLABLE 2
#define ARROW_FLAG_MAP_KEYS_SORTED 4
-#include
-#include
-#include // Must have this!
-
+#include // For int64_t
#ifdef __cplusplus
extern "C" {
diff --git a/swift/CDataWGo/go.mod b/swift/CDataWGo/go.mod
index 631dd58e74..323b5daac2 100644
--- a/swift/CDataWGo/go.mod
+++ b/swift/CDataWGo/go.mod
@@ -18,24 +18,18 @@ module go-swift
go 1.21
+require github.com/apache/arrow/go/v16 v16.1.0
+
require (
- github.com/andybalholm/brotli v1.0.5 // indirect
- github.com/apache/arrow/go/v12 v12.0.1 // indirect
- github.com/apache/arrow/go/v16 v16.0.0-20240203105949-22f2cfd1e1eb //
indirect
- github.com/apache/thrift v0.17.0 // indirect
github.com/goccy/go-json v0.10.2 // indirect
- github.com/golang/snappy v0.0.4 // indirect
- github.com/google/flatbuffers v23.5.26+incompatible // indirect
- github.com/klauspost/asmfmt v1.3.2 // indirect
- github.com/klauspost/compress v1.16.7 // indirect
- github.com/klauspost/cpuid/v2 v2.2.5 // indirect
- github.com/minio/asm2plan9s v0.0.0-20200509001527-cdd76441f9d8 //
indirect
- github.com/minio/c2goasm v0.0.0-20190812172519-36a3d3bbc4f3 // indirect
- github.com/pierrec/lz4/v4 v4.1.18 // indirect
+ github.com/google/flatbuffers v24.3.25+incompatible // indirect
+ github.com/klauspost/compress v1.17.7 // indirect
+ github.com/klauspost/cpuid/v2 v2.2.7 // indirect
+ github.com/pierrec/lz4/v4 v4.1.21 // indirect
github.com/zeebo/xxh3 v1.0.2 // indirect
- golang.org/x/exp v0.0.0-20231006140011-7918f672742d // indirect
- golang.org/x/mod v0.13.0 // indirect
- golang.org/x/sys v0.13.0 // indirect
- golang.org/x/tools v0.14.0 // indirect
- golang.org/x/xerrors v0.0.0-20220907171357-04be3eba64a2 // indirect
+ golang.org/x/exp v0.0.0-2024034643-814bf88cf225 // indirect
+ golang.org/x/mod v0.16.0 // indirect
+ golang.org/x/sys v0.18.0 // indirect
+ golang.org/x/tools v0.19.0 // indirect
+ golang.org/x/xerrors v0.0.0-20231012003039-104605ab7028 // indirect
)
diff --git a/swift/CDataWGo/go.sum b/swift/CDataWGo/go.sum
index 983c3cecaa..e0c7e6f274 100644
--- a/swift/CDataWGo/go.sum
+++ b/swift/CDataWGo/go.sum
@@ -1,75 +1,41 @@
-github.com/andybalholm/brotli v1.0.4
h1:V7DdXeJtZscaqfNuAdSRuRFzuiKlHSC/Zh3zl9qY3JY=
-github.com/andybalholm/brotli v1.0.4/go.mod
h1:fO7iG3H7G2nSZ7m0zPUDn85XEX2GTukHGRSepvi9Eig=
-github.com/andybalholm/brotli v1.0.5
h1:8uQZIdzKmjc/iuPu7O2ioW48L81FgatrcpfFmiq/cCs=
-github.com/andybalholm/brotli v1.0.5/go.mod
h1:fO7iG3H7G2nSZ7m0zPUDn85XEX2GTukHGRSepvi9Eig=
-github.com/apache/arrow/go/v12 v12.0.1
h1:JsR2+hzYYjgSUkBSaahpqCetqZMr76djX80fF/DiJbg=
-github.com/apache/arrow/go/v12 v12.0.1/go.mod
h1:weuTY7JvTG/HDPtMQxEUp7pU73vkLWMLpY67QwZ/WWw=
-github.com/apache/arrow/go/v16 v16.0.0-20240202201540-0fb00fdea7a9
h1:/hG2vtror6DZi7vLBjasliWY+/3GQPnt5FrrLt+boN0=
-github.com/apache/arrow/go/v16 v16.0.0-20240202201540-0fb00fdea7a9/go.mod
h1:+HkSDKotr3KDBxj7gTVgj8Egy18Y1ECzQdnY5XsXwlQ=
-github.com/apache/
(arrow) branch main updated (4d524eb401 -> 9f5899019d)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 4d524eb401 GH-37938: [Swift] Add initial C data interface implementation (#41342) add 9f5899019d GH-41679: [Release][Packaging][deb] Update package name in 01-preparesh too (#41859) No new revisions were added by this update. Summary of changes: dev/release/01-prepare-test.rb| 45 -- dev/release/01-prepare.sh | 15 +++- dev/release/post-11-bump-versions-test.rb | 8 ++-- dev/release/post-11-bump-versions.sh | 50 ++-- dev/release/test-helper.rb| 29 -- dev/release/utils-prepare.sh | 63 ++- 6 files changed, 142 insertions(+), 68 deletions(-)
(arrow) branch main updated (13630c7a83 -> 4d524eb401)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
from 13630c7a83 MINOR: [Java] Bump org.apache.commons:commons-compress from
1.26.0 to 1.26.2 in /java (#41853)
add 4d524eb401 GH-37938: [Swift] Add initial C data interface
implementation (#41342)
No new revisions were added by this update.
Summary of changes:
ci/docker/ubuntu-swift.dockerfile | 2 +-
dev/release/rat_exclude_files.txt | 1 +
swift/.swiftlint.yml | 4 +
swift/Arrow/Package.swift | 22 ++-
swift/Arrow/Sources/Arrow/ArrowArray.swift | 39 +++--
swift/Arrow/Sources/Arrow/ArrowBuffer.swift| 17 +-
swift/Arrow/Sources/Arrow/ArrowCExporter.swift | 135
swift/Arrow/Sources/Arrow/ArrowCImporter.swift | 179 +
swift/Arrow/Sources/Arrow/ArrowReaderHelper.swift | 16 +-
swift/Arrow/Sources/Arrow/ArrowSchema.swift| 6 +-
swift/Arrow/Sources/Arrow/ArrowTable.swift | 18 ++-
swift/Arrow/Sources/Arrow/ArrowType.swift | 116 +
swift/Arrow/Sources/Arrow/ChunkedArray.swift | 5 +
.../Arrow/Sources/ArrowC/ArrowCData.c | 18 +--
swift/Arrow/Sources/ArrowC/include/ArrowCData.h| 81 ++
swift/Arrow/Tests/ArrowTests/CDataTests.swift | 125 ++
swift/Arrow/Tests/ArrowTests/IPCTests.swift| 16 +-
.../Arrow/Tests/ArrowTests/RecordBatchTests.swift | 4 +-
swift/Arrow/Tests/ArrowTests/TableTests.swift | 4 +-
swift/ArrowFlight/Package.swift| 4 +-
.../Tests/ArrowFlightTests/FlightTest.swift| 6 +-
swift/CDataWGo/.gitignore | 8 +
.../CDataWGo/Package.swift | 46 +++---
swift/CDataWGo/Sources/go-swift/CDataTest.swift| 132 +++
.../swift-datagen => CDataWGo}/go.mod | 31 ++--
.../swift-datagen => CDataWGo}/go.sum | 32 +++-
.../chunker.h => swift/CDataWGo/include/go_swift.h | 19 +--
swift/CDataWGo/main.go | 127 +++
28 files changed, 1099 insertions(+), 114 deletions(-)
create mode 100644 swift/Arrow/Sources/Arrow/ArrowCExporter.swift
create mode 100644 swift/Arrow/Sources/Arrow/ArrowCImporter.swift
copy cpp/examples/arrow/helloworld.proto =>
swift/Arrow/Sources/ArrowC/ArrowCData.c (73%)
create mode 100644 swift/Arrow/Sources/ArrowC/include/ArrowCData.h
create mode 100644 swift/Arrow/Tests/ArrowTests/CDataTests.swift
create mode 100644 swift/CDataWGo/.gitignore
copy go/arrow/compute/fieldref_hash.go => swift/CDataWGo/Package.swift (57%)
create mode 100644 swift/CDataWGo/Sources/go-swift/CDataTest.swift
copy swift/{data-generator/swift-datagen => CDataWGo}/go.mod (59%)
copy swift/{data-generator/swift-datagen => CDataWGo}/go.sum (60%)
copy cpp/src/arrow/json/chunker.h => swift/CDataWGo/include/go_swift.h (70%)
create mode 100644 swift/CDataWGo/main.go
(arrow) branch main updated: GH-41784: [Packaging][RPM] Use SO version for -libs package name (#41838)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new f904928054 GH-41784: [Packaging][RPM] Use SO version for -libs package
name (#41838)
f904928054 is described below
commit f904928054fad89360d83015db5c23ac1ef86d05
Author: Sutou Kouhei
AuthorDate: Tue May 28 13:17:35 2024 +0900
GH-41784: [Packaging][RPM] Use SO version for -libs package name (#41838)
### Rationale for this change
We should use `arrow${SO_VERSION}-libs` not `arrow${MAJOR_VERSION}-libs` to
co-exist newer versions and older versions.
### What changes are included in this PR?
Use SO version not major version.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
Yes.
* GitHub Issue: #41784
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
.../linux-packages/apache-arrow/yum/arrow.spec.in | 148 +++--
1 file changed, 75 insertions(+), 73 deletions(-)
diff --git a/dev/tasks/linux-packages/apache-arrow/yum/arrow.spec.in
b/dev/tasks/linux-packages/apache-arrow/yum/arrow.spec.in
index c6148e9260..d5e6c3a332 100644
--- a/dev/tasks/linux-packages/apache-arrow/yum/arrow.spec.in
+++ b/dev/tasks/linux-packages/apache-arrow/yum/arrow.spec.in
@@ -27,7 +27,9 @@
%define is_centos_7 (%{_rhel} == 7 && !%{is_amazon_linux})
-%define major_version %(echo @VERSION@ | grep -o '^[0-9]*')
+%define major_version %(echo @VERSION@ | cut -d. -f 1)
+%define minor_version %(echo @VERSION@ | cut -d. -f 2)
+%define so_version %(expr %{major_version} '*' 100 + %{minor_version})
%define boost_version %( \
if [ %{_rhel} -eq 7 ]; then \
@@ -239,7 +241,7 @@ cd cpp
rm -rf %{buildroot}%{_docdir}/arrow/
cd -
-%package -n %{name}%{major_version}-libs
+%package -n %{name}%{so_version}-libs
Summary: Runtime libraries for Apache Arrow C++
License: Apache-2.0
%if %{have_lz4_libs}
@@ -248,10 +250,10 @@ Requires: lz4-libs %{lz4_requirement}
Requires: lz4 %{lz4_requirement}
%endif
-%description -n %{name}%{major_version}-libs
+%description -n %{name}%{so_version}-libs
This package contains the libraries for Apache Arrow C++.
-%files -n %{name}%{major_version}-libs
+%files -n %{name}%{so_version}-libs
%defattr(-,root,root,-)
%doc README.md
%license LICENSE.txt NOTICE.txt
@@ -260,7 +262,7 @@ This package contains the libraries for Apache Arrow C++.
%package tools
Summary: Tools for Apache Arrow C++
License: Apache-2.0
-Requires: %{name}%{major_version}-libs = %{version}-%{release}
+Requires: %{name}%{so_version}-libs = %{version}-%{release}
%description tools
Tools for Apache Arrow C++.
@@ -274,7 +276,7 @@ Tools for Apache Arrow C++.
%package devel
Summary: Libraries and header files for Apache Arrow C++
License: Apache-2.0
-Requires: %{name}%{major_version}-libs = %{version}-%{release}
+Requires: %{name}%{so_version}-libs = %{version}-%{release}
Requires: brotli-devel
Requires: bzip2-devel
Requires: curl-devel
@@ -322,15 +324,15 @@ Libraries and header files for Apache Arrow C++.
%{_libdir}/pkgconfig/arrow-orc.pc
%{_libdir}/pkgconfig/arrow.pc
-%package -n %{name}%{major_version}-acero-libs
+%package -n %{name}%{so_version}-acero-libs
Summary: C++ library to execute a query in streaming
License: Apache-2.0
-Requires: %{name}%{major_version}-libs = %{version}-%{release}
+Requires: %{name}%{so_version}-libs = %{version}-%{release}
-%description -n %{name}%{major_version}-acero-libs
+%description -n %{name}%{so_version}-acero-libs
This package contains the libraries for Apache Arrow Acero.
-%files -n %{name}%{major_version}-acero-libs
+%files -n %{name}%{so_version}-acero-libs
%defattr(-,root,root,-)
%doc README.md
%license LICENSE.txt NOTICE.txt
@@ -339,7 +341,7 @@ This package contains the libraries for Apache Arrow Acero.
%package acero-devel
Summary: Libraries and header files for Apache Arrow Acero
License: Apache-2.0
-Requires: %{name}%{major_version}-acero-libs = %{version}-%{release}
+Requires: %{name}%{so_version}-acero-libs = %{version}-%{release}
Requires: %{name}-devel = %{version}-%{release}
%description acero-devel
@@ -355,16 +357,16 @@ Libraries and header files for Apache Arrow Acero
%{_libdir}/libarrow_acero.so
%{_libdir}/pkgconfig/arrow-acero.pc
-%package -n %{name}%{major_version}-dataset-libs
+%package -n %{name}%{so_version}-dataset-libs
Summary: C++ library to read and write semantic datasets stored in
different locations and formats
License: Apache-2.0
-Requires: %{name}%{major_version}-acero-libs = %{version}-%{release}
-Requires: parquet%{major_version}-libs = %{version}-%{release}
+Requires: %{name}%{so_versio
(arrow) branch main updated: MINOR: [Go] Bump github.com/goccy/go-json from 0.10.2 to 0.10.3 in /go (#41850)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new f8fe2ae327 MINOR: [Go] Bump github.com/goccy/go-json from 0.10.2 to 0.10.3 in /go (#41850) f8fe2ae327 is described below commit f8fe2ae3279f71cb2256024a9ab5d70dd9432f89 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Tue May 28 08:44:56 2024 +0900 MINOR: [Go] Bump github.com/goccy/go-json from 0.10.2 to 0.10.3 in /go (#41850) Bumps [github.com/goccy/go-json](https://github.com/goccy/go-json) from 0.10.2 to 0.10.3. Release notes Sourced from https://github.com/goccy/go-json/releases;>github.com/goccy/go-json's releases. 0.10.3 What's Changed Add license for string processing by https://github.com/goccy;>@goccy in https://redirect.github.com/goccy/go-json/pull/476;>goccy/go-json#476 fix: decode struct with pointer must be nil by https://github.com/misyuari;>@misyuari in https://redirect.github.com/goccy/go-json/pull/473;>goccy/go-json#473 fix: fix a bug for escaping 0xE2 0x80 0xA8 in compactString by https://github.com/lizixing;>@lizixing in https://redirect.github.com/goccy/go-json/pull/479;>goccy/go-json#479 Fix custom map marshaling by https://github.com/viewsharp;>@viewsharp in https://redirect.github.com/goccy/go-json/pull/505;>goccy/go-json#505 Use io package instead of ioutil package by https://github.com/shamaton;>@shamaton in https://redirect.github.com/goccy/go-json/pull/498;>goccy/go-json#498 New Contributors https://github.com/misyuari;>@misyuari made their first contribution in https://redirect.github.com/goccy/go-json/pull/473;>goccy/go-json#473 https://github.com/lizixing;>@lizixing made their first contribution in https://redirect.github.com/goccy/go-json/pull/479;>goccy/go-json#479 https://github.com/viewsharp;>@viewsharp made their first contribution in https://redirect.github.com/goccy/go-json/pull/505;>goccy/go-json#505 https://github.com/shamaton;>@shamaton made their first contribution in https://redirect.github.com/goccy/go-json/pull/498;>goccy/go-json#498 Full Changelog: https://github.com/goccy/go-json/compare/v0.10.2...v0.10.3;>https://github.com/goccy/go-json/compare/v0.10.2...v0.10.3 Commits https://github.com/goccy/go-json/commit/5e2ae3f23c1db71990844a230a4d11559efe128e;>5e2ae3f Use io package instead of ioutil package (https://redirect.github.com/goccy/go-json/issues/498;>#498) https://github.com/goccy/go-json/commit/3c67b038e0dcaa3b8ea3a55b5fe2a4fb6abde75f;>3c67b03 Fix custom map marshaling (https://redirect.github.com/goccy/go-json/issues/505;>#505) https://github.com/goccy/go-json/commit/581620b5c599de0141523d6332d1f513b8515278;>581620b Update go.yml https://github.com/goccy/go-json/commit/c352e8fb182b75605fbc618eef91d91bfa154bca;>c352e8f fix: fix a bug for escaping 0xE2 0x80 0xA8 in compactString (https://redirect.github.com/goccy/go-json/issues/479;>#479) https://github.com/goccy/go-json/commit/df897aec9dc4228e585e8127b4db026d506d2b3c;>df897ae fix: decode struct with pointer must be nil (https://redirect.github.com/goccy/go-json/issues/473;>#473) https://github.com/goccy/go-json/commit/3d5ab28ab3362e5b9536f6f76a7eda22d2658e8f;>3d5ab28 add license for encoding int processing https://github.com/goccy/go-json/commit/9b91208837a56bcf74bd65cce368ee3911ae7d03;>9b91208 Add license for string processing (https://redirect.github.com/goccy/go-json/issues/476;>#476) See full diff in https://github.com/goccy/go-json/compare/v0.10.2...v0.10.3;>compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@ dependabot rebase` will rebase this PR - `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@ dependabot merge` will merge this PR after your CI passes on it - `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@ dependabot cancel merge` will c
(arrow) branch main updated (1c9e393b73 -> ff9921ffa8)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 1c9e393b73 GH-41749: [GLib] Allow getting a RecordBatchReader from a Dataset or Scanner (#41750) add ff9921ffa8 GH-41755: [C++][ORC] Ensure setting detected ORC version (#41767) No new revisions were added by this update. Summary of changes: cpp/cmake_modules/FindorcAlt.cmake | 1 + 1 file changed, 1 insertion(+)
(arrow) branch main updated: GH-41749: [GLib] Allow getting a RecordBatchReader from a Dataset or Scanner (#41750)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 1c9e393b73 GH-41749: [GLib] Allow getting a RecordBatchReader from a
Dataset or Scanner (#41750)
1c9e393b73 is described below
commit 1c9e393b73195840960dfb9eca8c0dc390be751a
Author: Adam Reeve
AuthorDate: Sun May 26 09:43:52 2024 +1200
GH-41749: [GLib] Allow getting a RecordBatchReader from a Dataset or
Scanner (#41750)
### Rationale for this change
See #41749
### What changes are included in this PR?
Adds `to_reader` methods to `GADatasetDataset` and `GADatasetScanner`.
### Are these changes tested?
Yes I've added new unit tests.
### Are there any user-facing changes?
Yes this is a new feature.
* GitHub Issue: #41749
Lead-authored-by: Adam Reeve
Co-authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
c_glib/arrow-dataset-glib/dataset.cpp | 37 -
c_glib/arrow-dataset-glib/dataset.h | 3 ++
c_glib/arrow-dataset-glib/scanner.cpp | 22 +++
c_glib/arrow-dataset-glib/scanner.h | 4 +++
c_glib/test/dataset/test-file-system-dataset.rb | 24 ++--
c_glib/test/dataset/test-scanner.rb | 10 +++
6 files changed, 96 insertions(+), 4 deletions(-)
diff --git a/c_glib/arrow-dataset-glib/dataset.cpp
b/c_glib/arrow-dataset-glib/dataset.cpp
index 704d6b589e..f84e4e3db3 100644
--- a/c_glib/arrow-dataset-glib/dataset.cpp
+++ b/c_glib/arrow-dataset-glib/dataset.cpp
@@ -19,6 +19,7 @@
#include
#include
+#include
#include
#include
@@ -152,12 +153,46 @@ gadataset_dataset_to_table(GADatasetDataset *dataset,
GError **error)
}
auto arrow_scanner = *arrow_scanner_result;
auto arrow_table_result = arrow_scanner->ToTable();
- if (!garrow::check(error, arrow_scanner_result, "[dataset][to-table]")) {
+ if (!garrow::check(error, arrow_table_result, "[dataset][to-table]")) {
return NULL;
}
return garrow_table_new_raw(&(*arrow_table_result));
}
+/**
+ * gadataset_dataset_to_record_batch_reader:
+ * @dataset: A #GADatasetDataset.
+ * @error: (nullable): Return location for a #GError or %NULL.
+ *
+ * Returns: (transfer full) (nullable):
+ * A #GArrowRecordBatchReader on success, %NULL on error.
+ *
+ * Since: 17.0.0
+ */
+GArrowRecordBatchReader *
+gadataset_dataset_to_record_batch_reader(GADatasetDataset *dataset, GError
**error)
+{
+ auto arrow_dataset = gadataset_dataset_get_raw(dataset);
+ auto arrow_scanner_builder_result = arrow_dataset->NewScan();
+ if (!garrow::check(error,
+ arrow_scanner_builder_result,
+ "[dataset][to-record-batch-reader]")) {
+return nullptr;
+ }
+ auto arrow_scanner_builder = *arrow_scanner_builder_result;
+ auto arrow_scanner_result = arrow_scanner_builder->Finish();
+ if (!garrow::check(error, arrow_scanner_result,
"[dataset][to-record-batch-reader]")) {
+return nullptr;
+ }
+ auto arrow_scanner = *arrow_scanner_result;
+ auto arrow_reader_result = arrow_scanner->ToRecordBatchReader();
+ if (!garrow::check(error, arrow_reader_result,
"[dataset][to-record-batch-reader]")) {
+return nullptr;
+ }
+ auto sources = g_list_prepend(nullptr, dataset);
+ return garrow_record_batch_reader_new_raw(&(*arrow_reader_result), sources);
+}
+
/**
* gadataset_dataset_get_type_name:
* @dataset: A #GADatasetDataset.
diff --git a/c_glib/arrow-dataset-glib/dataset.h
b/c_glib/arrow-dataset-glib/dataset.h
index 657de330e6..5b957f0538 100644
--- a/c_glib/arrow-dataset-glib/dataset.h
+++ b/c_glib/arrow-dataset-glib/dataset.h
@@ -34,6 +34,9 @@ gadataset_dataset_to_table(GADatasetDataset *dataset, GError
**error);
GADATASET_AVAILABLE_IN_5_0
gchar *
gadataset_dataset_get_type_name(GADatasetDataset *dataset);
+GADATASET_AVAILABLE_IN_17_0
+GArrowRecordBatchReader *
+gadataset_dataset_to_record_batch_reader(GADatasetDataset *dataset, GError
**error);
#define GADATASET_TYPE_FILE_SYSTEM_DATASET_WRITE_OPTIONS
\
(gadataset_file_system_dataset_write_options_get_type())
diff --git a/c_glib/arrow-dataset-glib/scanner.cpp
b/c_glib/arrow-dataset-glib/scanner.cpp
index 717532db92..28af1f16e5 100644
--- a/c_glib/arrow-dataset-glib/scanner.cpp
+++ b/c_glib/arrow-dataset-glib/scanner.cpp
@@ -128,6 +128,28 @@ gadataset_scanner_to_table(GADatasetScanner *scanner,
GError **error)
}
}
+/**
+ * gadataset_scanner_to_record_batch_reader:
+ * @scanner: A #GADatasetScanner.
+ * @error: (nullable): Return location for a #GError or %NULL.
+ *
+ * Returns: (transfer full) (nullable):
+ * A #GArrowRecordBatchReader on success, %NULL on error.
+ *
+ * Since: 17.0.0
+ *
(arrow) branch main updated: GH-41770: [CI][GLib] Remove temporary files explicitly (#41807)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 7c8ce4589a GH-41770: [CI][GLib] Remove temporary files explicitly
(#41807)
7c8ce4589a is described below
commit 7c8ce4589ae9e3c4a9c0cd54cff81a54ac003079
Author: Sutou Kouhei
AuthorDate: Sat May 25 12:34:04 2024 +0900
GH-41770: [CI][GLib] Remove temporary files explicitly (#41807)
### Rationale for this change
If we remove temporary files by GC, "`unlink': Permission denied" warnings
are happen on Windows.
### What changes are included in this PR?
Use `Tempfile.create {...}` to remove temporary files explicitly.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41770
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
c_glib/test/parquet/test-arrow-file-reader.rb | 27 ++
c_glib/test/parquet/test-arrow-file-writer.rb | 27 ++
c_glib/test/parquet/test-boolean-statistics.rb | 24 ++---
c_glib/test/parquet/test-byte-array-statistics.rb | 24 ++---
c_glib/test/parquet/test-column-chunk-metadata.rb | 61 +-
c_glib/test/parquet/test-double-statistics.rb | 24 ++---
c_glib/test/parquet/test-file-metadata.rb | 61 +-
.../test-fixed-length-byte-array-statistics.rb | 28 ++
c_glib/test/parquet/test-float-statistics.rb | 24 ++---
c_glib/test/parquet/test-int32-statistics.rb | 24 ++---
c_glib/test/parquet/test-int64-statistics.rb | 26 +
c_glib/test/parquet/test-row-group-metadata.rb | 61 +-
c_glib/test/parquet/test-statistics.rb | 36 -
13 files changed, 281 insertions(+), 166 deletions(-)
diff --git a/c_glib/test/parquet/test-arrow-file-reader.rb
b/c_glib/test/parquet/test-arrow-file-reader.rb
index 45eb335965..eff5ad966a 100644
--- a/c_glib/test/parquet/test-arrow-file-reader.rb
+++ b/c_glib/test/parquet/test-arrow-file-reader.rb
@@ -20,16 +20,23 @@ class TestParquetArrowFileReader < Test::Unit::TestCase
def setup
omit("Parquet is required") unless defined?(::Parquet)
-@file = Tempfile.open(["data", ".parquet"])
-@a_array = build_string_array(["foo", "bar"])
-@b_array = build_int32_array([123, 456])
-@table = build_table("a" => @a_array,
- "b" => @b_array)
-writer = Parquet::ArrowFileWriter.new(@table.schema, @file.path)
-chunk_size = 1
-writer.write_table(@table, chunk_size)
-writer.close
-@reader = Parquet::ArrowFileReader.new(@file.path)
+Tempfile.create(["data", ".parquet"]) do |file|
+ @file = file
+ @a_array = build_string_array(["foo", "bar"])
+ @b_array = build_int32_array([123, 456])
+ @table = build_table("a" => @a_array,
+ "b" => @b_array)
+ writer = Parquet::ArrowFileWriter.new(@table.schema, @file.path)
+ chunk_size = 1
+ writer.write_table(@table, chunk_size)
+ writer.close
+ @reader = Parquet::ArrowFileReader.new(@file.path)
+ begin
+yield
+ ensure
+@reader.unref
+ end
+end
end
def test_schema
diff --git a/c_glib/test/parquet/test-arrow-file-writer.rb
b/c_glib/test/parquet/test-arrow-file-writer.rb
index 855527444d..f899e7273b 100644
--- a/c_glib/test/parquet/test-arrow-file-writer.rb
+++ b/c_glib/test/parquet/test-arrow-file-writer.rb
@@ -20,7 +20,10 @@ class TestParquetArrowFileWriter < Test::Unit::TestCase
def setup
omit("Parquet is required") unless defined?(::Parquet)
-@file = Tempfile.open(["data", ".parquet"])
+Tempfile.create(["data", ".parquet"]) do |file|
+ @file = file
+ yield
+end
end
def test_write
@@ -33,14 +36,18 @@ class TestParquetArrowFileWriter < Test::Unit::TestCase
writer.close
reader = Parquet::ArrowFileReader.new(@file.path)
-reader.use_threads = true
-assert_equal([
- enabled_values.length / chunk_size,
- true,
- ],
- [
- reader.n_row_groups,
- table.equal_metadata(reader.read_table, false),
- ])
+begin
+ reader.use_threads = true
+ assert_equal([
+ enabled_values.length / chunk_size,
+ true,
+ ],
+ [
+ reader.n_row_groups,
+ table.equal_metadata(reader.read_table, false),
+ ])
(arrow) branch main updated: MINOR: [CI] Only try to read vcpkg version from .env if it isn't specified (#41805)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 19044ee609 MINOR: [CI] Only try to read vcpkg version from .env if it
isn't specified (#41805)
19044ee609 is described below
commit 19044ee609d8618aeea086c3a199ae5a002e92d7
Author: Adam Reeve
AuthorDate: Fri May 24 17:53:27 2024 +1200
MINOR: [CI] Only try to read vcpkg version from .env if it isn't specified
(#41805)
### Rationale for this change
See https://github.com/apache/arrow/pull/41599#discussion_r1612517256
This is a small tidy up of `install_vcpkg.sh` based on code review in
#41599 after it was merged. Some uses of `install_vcpkg.sh` are in Docker
containers where the `.env` file hasn't been copied. Rather than try to read it
and ignore any errors, only read the `.env` file if the vcpkg version wasn't
specified as an argument to the script. This way if there is an error reading
the `.env` file and we do need the default version, the error should be more
helpful.
### What changes are included in this PR?
Update `install_vcpkg.sh` to only try to read the vcpkg version from `.env`
if it isn't specified as an argument and don't ignore any errors.
### Are these changes tested?
Yes, this script already runs as part of CI.
### Are there any user-facing changes?
No
Authored-by: Adam Reeve
Signed-off-by: Sutou Kouhei
---
ci/scripts/install_vcpkg.sh | 7 +--
1 file changed, 5 insertions(+), 2 deletions(-)
diff --git a/ci/scripts/install_vcpkg.sh b/ci/scripts/install_vcpkg.sh
index 861aeeea8b..08989d6444 100755
--- a/ci/scripts/install_vcpkg.sh
+++ b/ci/scripts/install_vcpkg.sh
@@ -25,13 +25,16 @@ if [ "$#" -lt 1 ]; then
fi
arrow_dir=$(cd -- "$(dirname -- "$0")/../.." && pwd -P)
-default_vcpkg_version=$(source "${arrow_dir}/.env" && echo "$VCPKG" || echo "")
default_vcpkg_ports_patch="${arrow_dir}/ci/vcpkg/ports.patch"
vcpkg_destination=$1
-vcpkg_version=${2:-$default_vcpkg_version}
+vcpkg_version=${2:-}
vcpkg_ports_patch=${3:-$default_vcpkg_ports_patch}
+if [ -z "${vcpkg_version}" ]; then
+ vcpkg_version=$(source "${arrow_dir}/.env" && echo "$VCPKG")
+fi
+
# reduce the fetched data using a shallow clone
git clone --shallow-since=2021-04-01 https://github.com/microsoft/vcpkg
${vcpkg_destination}
(arrow) branch main updated: MINOR: [Docs][Python] Fixed a typo in dataset join docs (#41802)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new fb61e9f7a8 MINOR: [Docs][Python] Fixed a typo in dataset join docs (#41802) fb61e9f7a8 is described below commit fb61e9f7a821dcb3c753fa6d6c36eec3714c257b Author: Wenbo Li <424026...@qq.com> AuthorDate: Fri May 24 08:44:41 2024 +0800 MINOR: [Docs][Python] Fixed a typo in dataset join docs (#41802) ### Rationale for this change Found a typo in a code example of Python docs. ### What changes are included in this PR? `ds1.join(ds2, key="id")` should be `ds1.join(ds2, keys="id")` ### Are these changes tested? No, just docs. ### Are there any user-facing changes? Yes, but just docs. Authored-by: Wenbo Li <424026...@qq.com> Signed-off-by: Sutou Kouhei --- docs/source/python/compute.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/python/compute.rst b/docs/source/python/compute.rst index ce3dfabb0e..c2b46c8f3f 100644 --- a/docs/source/python/compute.rst +++ b/docs/source/python/compute.rst @@ -275,7 +275,7 @@ take two datasets and join them: ds1 = ds.dataset(table1) ds2 = ds.dataset(table2) - joined_ds = ds1.join(ds2, key="id") + joined_ds = ds1.join(ds2, keys="id") The resulting dataset will be an :class:`.InMemoryDataset` containing the joined data::
(arrow) branch main updated: GH-41547: [C++] Thirdparty: Upgrade xsimd to 13.0.0 (#41548)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new 522b097f94 GH-41547: [C++] Thirdparty: Upgrade xsimd to 13.0.0 (#41548) 522b097f94 is described below commit 522b097f94fd2d4664e43e25dd0abeb442629d9c Author: mwish AuthorDate: Fri May 24 08:04:38 2024 +0800 GH-41547: [C++] Thirdparty: Upgrade xsimd to 13.0.0 (#41548) ### Rationale for this change Arrow now uses xsimd 9.0.1, currently, some conversion for batch is now support in neon, see: https://github.com/apache/arrow/pull/40335#issuecomment-1983609146 . So we can upgrading it. The xsimd currently released 13.0.0, see: https://github.com/xtensor-stack/xsimd/issues/1015 For conan, seems community is updating it: https://github.com/conan-io/conan-center-index/pull/23859 . Maybe we can wait for a while ### What changes are included in this PR? Update xsimd to 13.0.0 ### Are these changes tested? Tested by existing test code ### Are there any user-facing changes? no * GitHub Issue: #41547 Authored-by: mwish Signed-off-by: Sutou Kouhei --- cpp/thirdparty/versions.txt | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/cpp/thirdparty/versions.txt b/cpp/thirdparty/versions.txt index 4983f3cee2..06506d32be 100644 --- a/cpp/thirdparty/versions.txt +++ b/cpp/thirdparty/versions.txt @@ -113,8 +113,8 @@ ARROW_UCX_BUILD_VERSION=1.12.1 ARROW_UCX_BUILD_SHA256_CHECKSUM=9bef31aed0e28bf1973d28d74d9ac4f8926c43ca3b7010bd22a084e164e31b71 ARROW_UTF8PROC_BUILD_VERSION=v2.7.0 ARROW_UTF8PROC_BUILD_SHA256_CHECKSUM=4bb121e297293c0fd55f08f83afab6d35d48f0af4ecc07523ad8ec99aa2b12a1 -ARROW_XSIMD_BUILD_VERSION=9.0.1 -ARROW_XSIMD_BUILD_SHA256_CHECKSUM=b1bb5f92167fd3a4f25749db0be7e61ed37e0a5d943490f3accdcd2cd2918cc0 +ARROW_XSIMD_BUILD_VERSION=13.0.0 +ARROW_XSIMD_BUILD_SHA256_CHECKSUM=8bdbbad0c3e7afa38d88d0d484d70a1671a1d8aefff03f4223ab2eb6a41110a3 ARROW_ZLIB_BUILD_VERSION=1.3.1 ARROW_ZLIB_BUILD_SHA256_CHECKSUM=9a93b2b7dfdac77ceba5a558a580e74667dd6fede4585b91eefb60f03b72df23 ARROW_ZSTD_BUILD_VERSION=1.5.6
(arrow) branch main updated: GH-41780: [C++][Flight][Benchmark] Ensure waiting server ready (#41793)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new e086bbf48c GH-41780: [C++][Flight][Benchmark] Ensure waiting server
ready (#41793)
e086bbf48c is described below
commit e086bbf48cf625e6fa2a7990efba8b9c5a99d09f
Author: Sutou Kouhei
AuthorDate: Fri May 24 08:11:16 2024 +0900
GH-41780: [C++][Flight][Benchmark] Ensure waiting server ready (#41793)
### Rationale for this change
We should read from result stream to get an error of this RPC. If we don't
read from result stream, we can't detect an error of this RPC.
### What changes are included in this PR?
Call `Drain()` to detect an error.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41780
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
cpp/src/arrow/flight/flight_benchmark.cc | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git a/cpp/src/arrow/flight/flight_benchmark.cc
b/cpp/src/arrow/flight/flight_benchmark.cc
index f53b1c6dce..057ef15c3c 100644
--- a/cpp/src/arrow/flight/flight_benchmark.cc
+++ b/cpp/src/arrow/flight/flight_benchmark.cc
@@ -131,7 +131,8 @@ struct PerformanceStats {
Status WaitForReady(FlightClient* client, const FlightCallOptions&
call_options) {
Action action{"ping", nullptr};
for (int attempt = 0; attempt < 10; attempt++) {
-if (client->DoAction(call_options, action).ok()) {
+auto result_stream_result = client->DoAction(call_options, action);
+if (result_stream_result.ok() && (*result_stream_result)->Drain().ok()) {
return Status::OK();
}
std::this_thread::sleep_for(std::chrono::milliseconds(1000));
(arrow) branch main updated (9bd0ddb4bf -> 9185d7dad7)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
from 9bd0ddb4bf GH-41725: [Python] CMake: ignore Parquet encryption option
if Parquet itself is not enabled (fix Java integration build) (#41776)
add 9185d7dad7 GH-41783: [C++] Make git-dependent definitions internal
(#41781)
No new revisions were added by this update.
Summary of changes:
.pre-commit-config.yaml| 2 +-
cpp/cmake_modules/ThirdpartyToolchain.cmake| 6 --
cpp/src/arrow/CMakeLists.txt | 6 ++
cpp/src/arrow/config.cc| 1 +
cpp/src/arrow/util/config.h.cmake | 3 ---
.../arrow/{csv/type_fwd.h => util/config_internal.h.cmake} | 14 --
dev/archery/archery/utils/lint.py | 2 +-
7 files changed, 13 insertions(+), 21 deletions(-)
copy cpp/src/arrow/{csv/type_fwd.h => util/config_internal.h.cmake} (79%)
(arrow-site) branch main updated: Add Spice.ai OSS to powered_by.md (#524)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new 447a816304e Add Spice.ai OSS to powered_by.md (#524) 447a816304e is described below commit 447a816304edc4a8cac9debfebe728660d5f2a8a Author: Luke Kim <80174+luke...@users.noreply.github.com> AuthorDate: Wed May 22 16:48:32 2024 -0700 Add Spice.ai OSS to powered_by.md (#524) Org name: Spice AI Org URL: https://spice.ai Project URL: https://github.com/spiceai/spiceai Arrow components: Arrow, Flight, FlightSQL, ADBC --- powered_by.md | 5 + 1 file changed, 5 insertions(+) diff --git a/powered_by.md b/powered_by.md index 0d255b457fa..c484270417b 100644 --- a/powered_by.md +++ b/powered_by.md @@ -197,6 +197,10 @@ short description of your use case. genomic, clinical, images, sensor, environmental, and IoT data - all in one analytical platform. [SciDB streaming][22] and [accelerated_io_tools][24] are powered by Apache Arrow. +* **[Spice.ai OSS][56]:** A unified SQL query interface and portable runtime built in Rust + to locally materialize, accelerate, and query datasets from any database, + data warehouse, or data lake. Spice.ai OSS uses Arrow along with DataFusion internally, + and supports Flight and Flight SQL connectivity. * **[TileDB][32]:** TileDB is an open-source, cloud-optimized engine for storing and accessing dense/sparse multi-dimensional arrays and dataframes. It is an embeddable C++ library that works on Linux, macOS, and Windows, which comes @@ -277,3 +281,4 @@ short description of your use case. [53]: https://iceburst.io [54]: https://github.com/delta-io/delta-rs [55]: https://github.com/tradewelltech/protarrow +[56]: https://github.com/spiceai/spiceai
(arrow) branch main updated: GH-41725: [Python] CMake: ignore Parquet encryption option if Parquet itself is not enabled (fix Java integration build) (#41776)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new 9bd0ddb4bf GH-41725: [Python] CMake: ignore Parquet encryption option if Parquet itself is not enabled (fix Java integration build) (#41776) 9bd0ddb4bf is described below commit 9bd0ddb4bf10a70101fa0c59dd881179dfd76994 Author: Joris Van den Bossche AuthorDate: Wed May 22 23:03:38 2024 +0200 GH-41725: [Python] CMake: ignore Parquet encryption option if Parquet itself is not enabled (fix Java integration build) (#41776) ### Rationale for this change Because of refactoring in https://github.com/apache/arrow/issues/41480, explicitly enabling `PYARROW_WITH_PARQUET_ENCRYPTION` without enabling `PYARROW_WITH_PARQUET` (and without Arrow C++ being built with Parquet support) now raises an error, while before we checked in `setup.py` that both were enabled for enabling encryption support. This patch mimics that logic in CMakeLists.txt with a warning added. ### What changes are included in this PR? When PyArrow with Parquet Encryption is enabled but PyArrow with Parquet itself is not, ignore the encryption setting, but warn about it. ### Are these changes tested? Yes * GitHub Issue: #41725 Authored-by: Joris Van den Bossche Signed-off-by: Sutou Kouhei --- python/CMakeLists.txt | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/python/CMakeLists.txt b/python/CMakeLists.txt index 07acb9e31a..a8bbed1171 100644 --- a/python/CMakeLists.txt +++ b/python/CMakeLists.txt @@ -370,12 +370,18 @@ if(PYARROW_BUILD_ACERO) endif() endif() -if(PYARROW_BUILD_PARQUET OR PYARROW_BUILD_PARQUET_ENCRYPTION) +if(PYARROW_BUILD_PARQUET) message(STATUS "Building PyArrow with Parquet") if(NOT ARROW_PARQUET) message(FATAL_ERROR "You must build Arrow C++ with ARROW_PARQUET=ON") endif() find_package(Parquet REQUIRED) +else() + if(PYARROW_BUILD_PARQUET_ENCRYPTION) +message(WARNING "Building PyArrow with Parquet Encryption is requested, but Parquet itself is not enabled. Ignoring the Parquet Encryption setting." +) +set(PYARROW_BUILD_PARQUET_ENCRYPTION OFF) + endif() endif() # Check for only Arrow C++ options
(arrow) branch main updated (8169d6e719 -> 37e5240e24)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 8169d6e719 GH-40078: [C++] Import/Export ArrowDeviceArrayStream (#40807) add 37e5240e24 GH-41681: [GLib] Generate separate version macros for each GLib library (#41721) No new revisions were added by this update. Summary of changes: .pre-commit-config.yaml| 2 +- c_glib/arrow-cuda-glib/arrow-cuda-glib.h | 2 + c_glib/arrow-cuda-glib/cuda.h | 38 ++ c_glib/arrow-cuda-glib/meson.build | 9 +- c_glib/arrow-cuda-glib/version.h.in| 157 ++ c_glib/arrow-dataset-glib/arrow-dataset-glib.h | 2 + c_glib/arrow-dataset-glib/dataset-definition.h | 3 + c_glib/arrow-dataset-glib/dataset-factory.h| 20 +- c_glib/arrow-dataset-glib/dataset.h| 12 +- c_glib/arrow-dataset-glib/file-format.h| 28 +- c_glib/arrow-dataset-glib/fragment.h | 6 +- c_glib/arrow-dataset-glib/meson.build | 15 +- c_glib/arrow-dataset-glib/partitioning.h | 25 +- c_glib/arrow-dataset-glib/scanner.h| 13 +- c_glib/arrow-dataset-glib/version.h.in | 157 ++ c_glib/arrow-flight-glib/arrow-flight-glib.h | 2 + c_glib/arrow-flight-glib/client.h | 26 +- c_glib/arrow-flight-glib/common.h | 66 ++- c_glib/arrow-flight-glib/meson.build | 8 + c_glib/arrow-flight-glib/server.h | 41 +- c_glib/arrow-flight-glib/version.h.in | 157 ++ .../arrow-flight-sql-glib/arrow-flight-sql-glib.h | 2 + c_glib/arrow-flight-sql-glib/client.h | 30 +- c_glib/arrow-flight-sql-glib/meson.build | 8 + c_glib/arrow-flight-sql-glib/server.h | 59 ++- c_glib/arrow-flight-sql-glib/version.h.in | 157 ++ c_glib/arrow-glib/meson.build | 16 +- c_glib/arrow-glib/version.h.in | 542 + c_glib/gandiva-glib/expression.h | 5 + c_glib/gandiva-glib/filter.h | 4 + c_glib/gandiva-glib/function-registry.h| 9 +- c_glib/gandiva-glib/function-signature.h | 14 + c_glib/gandiva-glib/meson.build| 14 +- c_glib/gandiva-glib/native-function.h | 14 + c_glib/gandiva-glib/node.h | 70 +++ c_glib/gandiva-glib/projector.h| 5 + c_glib/gandiva-glib/selection-vector.h | 4 + c_glib/gandiva-glib/version.h.in | 71 +-- c_glib/meson.build | 4 + c_glib/parquet-glib/arrow-file-reader.h| 15 +- c_glib/parquet-glib/arrow-file-writer.h| 36 +- c_glib/parquet-glib/meson.build| 9 +- c_glib/parquet-glib/metadata.h | 49 +- c_glib/parquet-glib/parquet-glib.h | 2 + c_glib/parquet-glib/statistics.h | 52 +- c_glib/parquet-glib/version.h.in | 157 ++ c_glib/tool/generate-version-header.py | 151 ++ dev/release/post-11-bump-versions-test.rb | 6 + dev/release/utils-prepare.sh | 10 + 49 files changed, 1492 insertions(+), 812 deletions(-) create mode 100644 c_glib/arrow-cuda-glib/version.h.in create mode 100644 c_glib/arrow-dataset-glib/version.h.in create mode 100644 c_glib/arrow-flight-glib/version.h.in create mode 100644 c_glib/arrow-flight-sql-glib/version.h.in create mode 100644 c_glib/parquet-glib/version.h.in create mode 100755 c_glib/tool/generate-version-header.py
(arrow-adbc) branch main updated: chore(dev/release): fix website post-release script (#1877)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-adbc.git
The following commit(s) were added to refs/heads/main by this push:
new 9aed38dfe chore(dev/release): fix website post-release script (#1877)
9aed38dfe is described below
commit 9aed38dfe24886ae9bc3394ee594111d75d42335
Author: David Li
AuthorDate: Tue May 21 10:41:14 2024 +0900
chore(dev/release): fix website post-release script (#1877)
---
dev/release/post-10-website.sh | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dev/release/post-10-website.sh b/dev/release/post-10-website.sh
index 0d0f7141f..098aec7ac 100755
--- a/dev/release/post-10-website.sh
+++ b/dev/release/post-10-website.sh
@@ -109,7 +109,7 @@ or the [Arrow mailing lists][5].
[1]: ${MILESTONE_URL}
[2]: #contributors
-[3]:
https://github.com/apache/arrow-adbc/blob/apache-arrow-adbc-${version}/CHANGELOG.md
+[3]:
https://github.com/apache/arrow-adbc/blob/apache-arrow-adbc-${RELEASE}/CHANGELOG.md
[4]: https://github.com/apache/arrow-adbc/issues
[5]: {% link community.md %}
EOF
(arrow-adbc) branch main updated (75ed0954e -> 76747aace)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow-adbc.git from 75ed0954e chore(csharp): bump Apache.Arrow from 16.0.0 to 16.1.0 in /csharp (#1874) add 76747aace chore(dev/release): fix post-release scripts (#1875) No new revisions were added by this update. Summary of changes: dev/release/post-03-python.sh | 7 +++ dev/release/post-04-go.sh | 4 ++-- dev/release/post-07-csharp.sh | 4 3 files changed, 9 insertions(+), 6 deletions(-)
(arrow) branch main updated: GH-41735: [CI][Archery] Update archery to be compatible with pygit2 1.15 API change (#41739)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new 11decbc107 GH-41735: [CI][Archery] Update archery to be compatible with pygit2 1.15 API change (#41739) 11decbc107 is described below commit 11decbc10776bbe0361fe7b8bfebcf3e47ae9c6c Author: Raúl Cumplido AuthorDate: Mon May 20 17:17:38 2024 -0400 GH-41735: [CI][Archery] Update archery to be compatible with pygit2 1.15 API change (#41739) ### Rationale for this change pygit2 updated how they expose some of the `GIT_OBJ` variables to use `GIT_OBJECT` prefix here: https://github.com/libgit2/pygit2/commit/8b3861b9092d1e3517b11f6ab06434ea866dd051 ### What changes are included in this PR? Update code to make it compatible with both possible APIs. ### Are these changes tested? Via archery ### Are there any user-facing changes? No * GitHub Issue: #41735 Authored-by: Raúl Cumplido Signed-off-by: Sutou Kouhei --- dev/archery/archery/crossbow/core.py | 8 +++- 1 file changed, 7 insertions(+), 1 deletion(-) diff --git a/dev/archery/archery/crossbow/core.py b/dev/archery/archery/crossbow/core.py index c85f1f754b..0b5d242bba 100644 --- a/dev/archery/archery/crossbow/core.py +++ b/dev/archery/archery/crossbow/core.py @@ -427,8 +427,14 @@ class Repo: return branch def create_tag(self, tag_name, commit_id, message=''): +git_object_commit = ( +pygit2.GIT_OBJECT_COMMIT +if getattr(pygit2, 'GIT_OBJECT_COMMIT') +else pygit2.GIT_OBJ_COMMIT +) tag_id = self.repo.create_tag(tag_name, commit_id, - pygit2.GIT_OBJ_COMMIT, self.signature, + git_object_commit, + self.signature, message) # append to the pushable references
(arrow) branch main updated: GH-41711: [C++] macros.h: Fix ARROW_FORCE_INLINE for MSVC (#41712)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new a04339a49e GH-41711: [C++] macros.h: Fix ARROW_FORCE_INLINE for MSVC (#41712) a04339a49e is described below commit a04339a49e08bec8c559a32c01eacc9469ef4196 Author: Felipe Oliveira Carvalho AuthorDate: Fri May 17 18:40:53 2024 -0300 GH-41711: [C++] macros.h: Fix ARROW_FORCE_INLINE for MSVC (#41712) ### Rationale for this change Define the macro correctly. Nothing is broken at the moment because the macro is not used within Arrow at the moment. ### What changes are included in this PR? Correct definition of the macro. ### Are these changes tested? Yes, by having this commit in other PRs that pass CI tests on Windows. * GitHub Issue: #41711 Authored-by: Felipe Oliveira Carvalho Signed-off-by: Sutou Kouhei --- cpp/src/arrow/util/macros.h | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/cpp/src/arrow/util/macros.h b/cpp/src/arrow/util/macros.h index d0c05a7908..484df3400d 100644 --- a/cpp/src/arrow/util/macros.h +++ b/cpp/src/arrow/util/macros.h @@ -102,7 +102,7 @@ #elif defined(_MSC_VER) // MSVC #define ARROW_NORETURN __declspec(noreturn) #define ARROW_NOINLINE __declspec(noinline) -#define ARROW_FORCE_INLINE __declspec(forceinline) +#define ARROW_FORCE_INLINE __forceinline #define ARROW_PREDICT_FALSE(x) (x) #define ARROW_PREDICT_TRUE(x) (x) #define ARROW_PREFETCH(addr)
(arrow) branch main updated (e04f5b4b90 -> 084387c56e)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from e04f5b4b90 GH-41560: [C++] ChunkResolver: Implement ResolveMany and add unit tests (#41561) add 084387c56e GH-39204: [Format][FlightRPC][Docs] Stabilize Flight SQL (#41657) No new revisions were added by this update. Summary of changes: cpp/src/arrow/flight/client.h | 8 +- cpp/src/arrow/flight/cookie_internal.cc| 3 +- cpp/src/arrow/flight/middleware.h | 2 +- cpp/src/arrow/flight/server.h | 3 +- cpp/src/arrow/flight/server_middleware.h | 3 +- cpp/src/arrow/flight/sql/server.cc | 3 +- cpp/src/arrow/flight/sql/server.h | 3 +- .../arrow/flight/sql/server_session_middleware.h | 1 - cpp/src/arrow/flight/transport.h | 4 --- cpp/src/arrow/flight/types.h | 4 +-- cpp/src/arrow/flight/types_async.h | 4 --- docs/source/cpp/api/flightsql.rst | 2 -- docs/source/format/FlightSql.rst | 3 -- docs/source/java/overview.rst | 4 +-- format/FlightSql.proto | 32 -- java/flight/flight-core/pom.xml| 2 +- .../arrow/flight/ServerSessionMiddleware.java | 2 -- java/flight/flight-sql/pom.xml | 2 +- 18 files changed, 12 insertions(+), 73 deletions(-)
(arrow) branch main updated: GH-41660: [CI][Java] Restore devtoolset relatead GANDIVA_CXX_FLAGS (#41661)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 63fddd7b2f GH-41660: [CI][Java] Restore devtoolset relatead
GANDIVA_CXX_FLAGS (#41661)
63fddd7b2f is described below
commit 63fddd7b2f12fb65ed5feff820a1913931773968
Author: Sutou Kouhei
AuthorDate: Thu May 16 00:54:12 2024 +0900
GH-41660: [CI][Java] Restore devtoolset relatead GANDIVA_CXX_FLAGS (#41661)
### Rationale for this change
Because #41451 removed devtoolset related flags unexpectedly.
### What changes are included in this PR?
Restore devtoolset related flags.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41660
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
ci/scripts/java_jni_manylinux_build.sh | 5 -
1 file changed, 4 insertions(+), 1 deletion(-)
diff --git a/ci/scripts/java_jni_manylinux_build.sh
b/ci/scripts/java_jni_manylinux_build.sh
index 4921ce170b..6f3769751a 100755
--- a/ci/scripts/java_jni_manylinux_build.sh
+++ b/ci/scripts/java_jni_manylinux_build.sh
@@ -35,6 +35,9 @@ echo "=== Clear output directories and leftovers ==="
rm -rf ${build_dir}
echo "=== Building Arrow C++ libraries ==="
+devtoolset_version=$(rpm -qa "devtoolset-*-gcc" --queryformat %{VERSION} | \
+ grep -o "^[0-9]*")
+devtoolset_include_cpp="/opt/rh/devtoolset-${devtoolset_version}/root/usr/include/c++/${devtoolset_version}"
: ${ARROW_ACERO:=ON}
export ARROW_ACERO
: ${ARROW_BUILD_TESTS:=ON}
@@ -55,7 +58,7 @@ export ARROW_ORC
: ${VCPKG_ROOT:=/opt/vcpkg}
: ${VCPKG_FEATURE_FLAGS:=-manifests}
:
${VCPKG_TARGET_TRIPLET:=${VCPKG_DEFAULT_TRIPLET:-x64-linux-static-${CMAKE_BUILD_TYPE}}}
-:
${GANDIVA_CXX_FLAGS:=-isystem;${devtoolset_include_cpp};-isystem;${devtoolset_include_cpp}/x86_64-redhat-linux;-isystem;-lpthread}
+:
${GANDIVA_CXX_FLAGS:=-isystem;${devtoolset_include_cpp};-isystem;${devtoolset_include_cpp}/x86_64-redhat-linux;-lpthread}
if [ "${ARROW_USE_CCACHE}" == "ON" ]; then
echo "=== ccache statistics before build ==="
(arrow-site) branch main updated: Fix update of dev docs (test-ubuntu-*-docs -> test-debian-*-docs build change) (#513)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-site.git
The following commit(s) were added to refs/heads/main by this push:
new 2169281ac35 Fix update of dev docs (test-ubuntu-*-docs ->
test-debian-*-docs build change) (#513)
2169281ac35 is described below
commit 2169281ac35dfe7e6a784631bd145eca6d1119a6
Author: Joris Van den Bossche
AuthorDate: Tue May 14 17:54:28 2024 +0200
Fix update of dev docs (test-ubuntu-*-docs -> test-debian-*-docs build
change) (#513)
The doc build was changed in https://github.com/apache/arrow/pull/41455,
we need a change here accordingly to ensure to keep updating the dev
docs from that crossbow build.
---
.github/workflows/devdocs.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/devdocs.yml b/.github/workflows/devdocs.yml
index eb4027f5c41..ee7968c2105 100644
--- a/.github/workflows/devdocs.yml
+++ b/.github/workflows/devdocs.yml
@@ -76,7 +76,7 @@ jobs:
git config user.name "github-actions[bot]"
git config user.email "github-actions[bot]@users.noreply.github.com"
mkdir -p docs/dev
- tar -xvzf ../downloads/${{ steps.build.outputs.LATEST
}}/test-ubuntu-*-docs/docs.tar.gz -C docs/dev --strip-components=1
+ tar -xvzf ../downloads/${{ steps.build.outputs.LATEST
}}/test-debian-*-docs/docs.tar.gz -C docs/dev --strip-components=1
cp docs/c_glib/index.html docs/dev/c_glib/index.html
if [ "$(git status --porcelain)" != "" ]; then
# There are changes to the dev docs
(arrow-site) branch main updated: [Website] Add release note for 16.1.0 (#514)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new ac3ef7374d1 [Website] Add release note for 16.1.0 (#514) ac3ef7374d1 is described below commit ac3ef7374d1a30131ee7c87c6dfa8e5f943e9b3d Author: Raúl Cumplido AuthorDate: Tue May 14 17:09:58 2024 +0200 [Website] Add release note for 16.1.0 (#514) --- _data/versions.yml | 26 +++ _release/16.1.0.md | 142 +++ _release/index.md | 194 +++-- 3 files changed, 253 insertions(+), 109 deletions(-) diff --git a/_data/versions.yml b/_data/versions.yml index 303c8fd1a36..a0e0a349652 100644 --- a/_data/versions.yml +++ b/_data/versions.yml @@ -16,17 +16,17 @@ # Database of the current version # current: - number: '16.0.0' - pinned_number: '16.0.*' + number: '16.1.0' + pinned_number: '16.1.*' major_number: '16' - date: 2024-04-20 - git-tag: '6a28035c2b49b432dc63f5ee7524d76b4ed2d762' - github-tag-link: 'https://github.com/apache/arrow/releases/tag/apache-arrow-16.0.0' - release-notes: 'https://arrow.apache.org/release/16.0.0.html' - mirrors: 'https://www.apache.org/dyn/closer.lua/arrow/arrow-16.0.0/' - tarball-name: 'apache-arrow-16.0.0.tar.gz' - tarball-url: 'https://www.apache.org/dyn/closer.lua?action=download=arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz' - java-artifacts: 'https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.arrow%22%20AND%20v%3A%2216.0.0%22' - asc: 'https://downloads.apache.org/arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz.asc' - sha256: 'https://downloads.apache.org/arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz.sha256' - sha512: 'https://downloads.apache.org/arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz.sha512' + date: 2024-05-14 + git-tag: '7dd1d34074af176d9e861a360e135ae57b21cf96' + github-tag-link: 'https://github.com/apache/arrow/releases/tag/apache-arrow-16.1.0' + release-notes: 'https://arrow.apache.org/release/16.1.0.html' + mirrors: 'https://www.apache.org/dyn/closer.lua/arrow/arrow-16.1.0/' + tarball-name: 'apache-arrow-16.1.0.tar.gz' + tarball-url: 'https://www.apache.org/dyn/closer.lua?action=download=arrow/arrow-16.1.0/apache-arrow-16.1.0.tar.gz' + java-artifacts: 'https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.arrow%22%20AND%20v%3A%2216.1.0%22' + asc: 'https://downloads.apache.org/arrow/arrow-16.1.0/apache-arrow-16.1.0.tar.gz.asc' + sha256: 'https://downloads.apache.org/arrow/arrow-16.1.0/apache-arrow-16.1.0.tar.gz.sha256' + sha512: 'https://downloads.apache.org/arrow/arrow-16.1.0/apache-arrow-16.1.0.tar.gz.sha512' diff --git a/_release/16.1.0.md b/_release/16.1.0.md new file mode 100644 index 000..79589919fd2 --- /dev/null +++ b/_release/16.1.0.md @@ -0,0 +1,142 @@ +--- +layout: default +title: Apache Arrow 16.1.0 Release +permalink: /release/16.1.0.html +--- + + +# Apache Arrow 16.1.0 (14 May 2024) + +This is a patch release covering more than 0 months of development. + +## Download + +* [**Source Artifacts**][1] +* **Binary Artifacts** + * [For AlmaLinux][2] + * [For Amazon Linux][3] + * [For CentOS][4] + * [For C#][5] + * [For Debian][6] + * [For Python][7] + * [For Ubuntu][8] +* [Git tag][9] + +## Contributors + +This release includes 38 commits from 16 distinct contributors. + +```console +$ git shortlog -sn apache-arrow-16.0.0..apache-arrow-16.1.0 + 7 Adam Reeve + 7 Raúl Cumplido + 6 Sutou Kouhei + 4 Dominik Moritz + 3 Rossi Sun + 1 Alex Shcherbakov + 1 Austin Dickey + 1 Felipe Oliveira Carvalho + 1 Gang Wu + 1 Hyunseok Seo + 1 Jacob Wujciak-Jens + 1 Jonathan Keane + 1 Kartik Verma + 1 Kevin Gurney + 1 Mike Bostock + 1 mwish +``` + +## Patch Committers + +The following Apache committers merged contributed patches to the repository. + +```console +$ git shortlog -sn --group=trailer:signed-off-by apache-arrow-16.0.0..apache-arrow-16.1.0 + 7 Curt Hagenlocher + 5 Sutou Kouhei + 3 Jacob Wujciak-Jens + 2 Benjamin Kietzman + 2 Matt Topol + 2 Raúl Cumplido + 1 Antoine Pitrou + 1 Felipe Oliveira Carvalho + 1 Gang Wu + 1 Jonathan Keane + 1 Joris Van den Bossche + 1 Kevin Gurney + 1 Weston Pace +``` + +## Changelog + + +## Apache Arrow 16.1.0 (2024-05-14 07:00:00) + +### Bug Fixes + +* [GH-40069](https://github.com/apache/arrow/issues/40069) - [C++] Make scalar scratch space immutable after initialization (#40237) +* [GH-40407](https://github.com/apache/arrow/issues/40407) - [JS] Fix string coercion in MapRowProxyHandler.ownKeys (#40408) +* [GH-40563](https://github.com/apache/arrow/issues/40563) - [Go] Unable to JSON marshal float64 arrays which contain a NaN value (#41109) +* [GH-41133](https://github.com/apache/arrow/issues/41133
(arrow) branch main updated: MINOR: [Go] Bump golang.org/x/tools from 0.20.0 to 0.21.0 in /go (#41639)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new fc7c723bab MINOR: [Go] Bump golang.org/x/tools from 0.20.0 to 0.21.0 in /go (#41639) fc7c723bab is described below commit fc7c723babce0bb6aae3e2b9653296cdb508578d Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Tue May 14 09:25:09 2024 +0900 MINOR: [Go] Bump golang.org/x/tools from 0.20.0 to 0.21.0 in /go (#41639) Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.20.0 to 0.21.0. Commits https://github.com/golang/tools/commit/cc29c91ba3acb47c1793da56d919cc40def4ea41;>cc29c91 go.mod: update golang.org/x dependencies https://github.com/golang/tools/commit/397fef9629377c5179518414e4502009dc0918a2;>397fef9 gopls/internal/protocol: add links to LSP spec https://github.com/golang/tools/commit/e2a352c850a52c32b9bfdb78fbfb97882b7c1424;>e2a352c internal/refactor/inline: extensible API https://github.com/golang/tools/commit/c16c816ac486df69471674bcaf6f1a8f76f2bdcf;>c16c816 go/analysis/passes/stdversion: test *.go go.mod version https://github.com/golang/tools/commit/629a7be6d0a4808cd8e7af805986652d81bb975f;>629a7be go/analysis/analysistest: stricter errors and GOWORK setting https://github.com/golang/tools/commit/4db16973aa22c2c1a5a873261a68949f351efe2b;>4db1697 go/packages/packagestest: fold modules_111.go into modules.go https://github.com/golang/tools/commit/ccdef3cc2699ea2a30a2931a43a1774bd974000a;>ccdef3c gopls/internal/golang: fix nil panic in InlayHint https://github.com/golang/tools/commit/74c9cfe4d22faa696baabeea02df6493b15e8c79;>74c9cfe go/analysis: add Pass.ReadFile https://github.com/golang/tools/commit/5ef4fc9014e76bcc56324b24218c0216a7146306;>5ef4fc9 gopls/internal/golang/completion: fix the isEmptyInterface predicate https://github.com/golang/tools/commit/77f691badad098462fed0a46c9a3f5f3d178b633;>77f691b internal/gcimporter: use Alias.Rhs, not unsafe hack Additional commits viewable in https://github.com/golang/tools/compare/v0.20.0...v0.21.0;>compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) Signed-off-by: dependabot[bot] Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> --- go/go.mod | 6 +++--- go/go.sum | 16 2 files changed, 11 insertions(+), 11 deletions(-) diff --git a/go/go.mod b/go/go.mod index 7c14ddcf9e..8fdfea3dbe 100644 --- a/go/go.mod +++ b/go/go.mod @@ -37,7 +37,7 @@ require ( golang.org/x/exp v0.0.0-2024034643-814bf88cf225 golang.org/x/sync v0.7.0 golang.org/x/sys v0.20.0 - golang.org/x/tools v0.20.0 + golang.org/x/tools v0.21.0 golang.org
(arrow) branch main updated: MINOR: [C++][ORC][CMake] Fix ORC CMake args to use LZ4_STATIC_LIB (#41632)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 2552c26c96 MINOR: [C++][ORC][CMake] Fix ORC CMake args to use
LZ4_STATIC_LIB (#41632)
2552c26c96 is described below
commit 2552c26c9625f8f0c538a520d26c11d13ce3b48d
Author: Gang Wu
AuthorDate: Mon May 13 10:37:36 2024 +0800
MINOR: [C++][ORC][CMake] Fix ORC CMake args to use LZ4_STATIC_LIB (#41632)
### Rationale for this change
In the ORC_CMAKE_ARGS, we use `LZ4_STATIC_LIBRARY` but the Apache ORC
library expects
[`LZ4_STATIC_LIB`](https://github.com/apache/orc/blob/08aaebc371927e6bb9a0f19c7cc90478200e3b6f/cmake_modules/ThirdpartyToolchain.cmake#L313)
### What changes are included in this PR?
Switch `LZ4_STATIC_LIBRARY` to `LZ4_STATIC_LIB` in the ORC_CMAKE_ARGS.
### Are these changes tested?
Pass CIs.
### Are there any user-facing changes?
No.
Authored-by: Gang Wu
Signed-off-by: Sutou Kouhei
---
cpp/cmake_modules/ThirdpartyToolchain.cmake | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/cpp/cmake_modules/ThirdpartyToolchain.cmake
b/cpp/cmake_modules/ThirdpartyToolchain.cmake
index 2102a7fdcd..c24442dcb8 100644
--- a/cpp/cmake_modules/ThirdpartyToolchain.cmake
+++ b/cpp/cmake_modules/ThirdpartyToolchain.cmake
@@ -4522,7 +4522,7 @@ macro(build_orc)
"-DSNAPPY_HOME=${ORC_SNAPPY_ROOT}"
"-DSNAPPY_LIBRARY=$"
"-DLZ4_LIBRARY=$"
- "-DLZ4_STATIC_LIBRARY=$"
+ "-DLZ4_STATIC_LIB=$"
"-DLZ4_INCLUDE_DIR=${ORC_LZ4_ROOT}/include"
"-DSNAPPY_INCLUDE_DIR=${ORC_SNAPPY_INCLUDE_DIR}"
"-DZSTD_HOME=${ORC_ZSTD_ROOT}"
(arrow) branch main updated: GH-41626: [R][CI] Update OpenSUSE to 15.5 from 15.3 (#41627)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 9a3973c9ee GH-41626: [R][CI] Update OpenSUSE to 15.5 from 15.3 (#41627)
9a3973c9ee is described below
commit 9a3973c9eec639de4750dcba334711a2a3c707a6
Author: Sutou Kouhei
AuthorDate: Mon May 13 06:45:45 2024 +0900
GH-41626: [R][CI] Update OpenSUSE to 15.5 from 15.3 (#41627)
### Rationale for this change
OpenSUSE 15.3 reached EOL and rstudio/r-builds dropped support for it:
https://github.com/rstudio/r-builds/pull/177
### What changes are included in this PR?
Use `4.1-opensuse155` instead of `4.1-opensuse153`.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41626
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
dev/tasks/tasks.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/dev/tasks/tasks.yml b/dev/tasks/tasks.yml
index 5bf5037652..d8e09ec207 100644
--- a/dev/tasks/tasks.yml
+++ b/dev/tasks/tasks.yml
@@ -1358,7 +1358,7 @@ tasks:
{% for r_org, r_image, r_tag in [("rhub", "ubuntu-release", "latest"),
("rocker", "r-ver", "latest"),
("rstudio", "r-base", "4.2-focal"),
- ("rstudio", "r-base", "4.1-opensuse153")] %}
+ ("rstudio", "r-base", "4.1-opensuse155")] %}
test-r-{{ r_org }}-{{ r_image }}-{{ r_tag }}:
ci: azure
template: r/azure.linux.yml
(arrow) branch main updated (a0f9d2eb2f -> 37bd413c83)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from a0f9d2eb2f GH-41617: [C++][CMake] Fix ARROW_USE_BOOST detect condition (#41622) add 37bd413c83 GH-40734: [Packaging][Debian] Drop support for Debian bullseye (#41394) No new revisions were added by this update. Summary of changes: c_glib/meson.build | 2 - dev/release/binary-task.rb | 3 - dev/release/verify-apt.sh | 6 -- dev/release/verify-release-candidate.sh| 4 +- .../apt/debian-bullseye/Dockerfile | 41 -- .../apache-arrow/apt/debian-bullseye-arm64/from| 18 - .../apache-arrow/apt/debian-bullseye/Dockerfile| 87 -- dev/tasks/linux-packages/package-task.rb | 2 - dev/tasks/tasks.yml| 3 +- r/tools/nixlibs.R | 4 +- 10 files changed, 3 insertions(+), 167 deletions(-) delete mode 100644 dev/tasks/linux-packages/apache-arrow-apt-source/apt/debian-bullseye/Dockerfile delete mode 100644 dev/tasks/linux-packages/apache-arrow/apt/debian-bullseye-arm64/from delete mode 100644 dev/tasks/linux-packages/apache-arrow/apt/debian-bullseye/Dockerfile
(arrow) branch main updated: GH-41617: [C++][CMake] Fix ARROW_USE_BOOST detect condition (#41622)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new a0f9d2eb2f GH-41617: [C++][CMake] Fix ARROW_USE_BOOST detect condition (#41622) a0f9d2eb2f is described below commit a0f9d2eb2fe6743a869f3509f456389cf3de4926 Author: Sutou Kouhei AuthorDate: Sun May 12 20:09:55 2024 +0900 GH-41617: [C++][CMake] Fix ARROW_USE_BOOST detect condition (#41622) ### Rationale for this change We also need Boost when ARROW_FLIGHT and ARROW_TESTING are true. ### What changes are included in this PR? Add missing the condition. ### Are these changes tested? Yes. ### Are there any user-facing changes? Yes. * GitHub Issue: #41617 Authored-by: Sutou Kouhei Signed-off-by: Sutou Kouhei --- cpp/cmake_modules/ThirdpartyToolchain.cmake | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/cpp/cmake_modules/ThirdpartyToolchain.cmake b/cpp/cmake_modules/ThirdpartyToolchain.cmake index ddea1c399c..2102a7fdcd 100644 --- a/cpp/cmake_modules/ThirdpartyToolchain.cmake +++ b/cpp/cmake_modules/ThirdpartyToolchain.cmake @@ -1263,7 +1263,7 @@ endif() # - S3FS and Flight benchmarks need Boost at runtime. if(ARROW_BUILD_INTEGRATION OR ARROW_BUILD_TESTS - OR (ARROW_FLIGHT AND ARROW_BUILD_BENCHMARKS) + OR (ARROW_FLIGHT AND (ARROW_TESTING OR ARROW_BUILD_BENCHMARKS)) OR (ARROW_S3 AND ARROW_BUILD_BENCHMARKS)) set(ARROW_USE_BOOST TRUE) set(ARROW_BOOST_REQUIRE_LIBRARY TRUE)
(arrow) branch main updated: GH-41316: [CI][Python] Reduce CI time on macOS (#41378)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 7aea8bf7a6 GH-41316: [CI][Python] Reduce CI time on macOS (#41378)
7aea8bf7a6 is described below
commit 7aea8bf7a65d679bd71d973b358f997eb3b6c6af
Author: Hyunseok Seo
AuthorDate: Fri May 10 23:58:10 2024 +0900
GH-41316: [CI][Python] Reduce CI time on macOS (#41378)
### Rationale for this change
Reduce CI time for python build on macos-12 and macos-14 using ccache
### What changes are included in this PR?
Add ccache for macos-12 and macos-14
### Are these changes tested?
Check the cache hit rate
### Are there any user-facing changes?
No
* GitHub Issue: #41316
Authored-by: Hyunseok Seo
Signed-off-by: Sutou Kouhei
---
.github/workflows/python.yml | 13 +
1 file changed, 13 insertions(+)
diff --git a/.github/workflows/python.yml b/.github/workflows/python.yml
index 15056961f8..a568f8346e 100644
--- a/.github/workflows/python.yml
+++ b/.github/workflows/python.yml
@@ -182,6 +182,19 @@ jobs:
python -m pip install \
-r python/requirements-build.txt \
-r python/requirements-test.txt
+ - name: Setup ccache
+shell: bash
+run: ci/scripts/ccache_setup.sh
+ - name: ccache info
+id: ccache-info
+shell: bash
+run: echo "cache-dir=$(ccache --get-config cache_dir)" >>
$GITHUB_OUTPUT
+ - name: Cache ccache
+uses: actions/cache@v4
+with:
+ path: ${{ steps.ccache-info.outputs.cache-dir }}
+ key: python-ccache-macos-${{ matrix.macos-version }}-${{
hashFiles('cpp/**', 'python/**') }}
+ restore-keys: python-ccache-macos-${{ matrix.macos-version }}-
- name: Build
shell: bash
run: |
(arrow) branch main updated: GH-41356: [Release][Docs] Update post release documentation task to remove the warnings banner for stable version (#41377)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new f6127a6d18 GH-41356: [Release][Docs] Update post release documentation
task to remove the warnings banner for stable version (#41377)
f6127a6d18 is described below
commit f6127a6d18af12ce18a0b8b1eac02346721cc399
Author: Alenka Frim
AuthorDate: Thu May 9 04:58:59 2024 +0200
GH-41356: [Release][Docs] Update post release documentation task to remove
the warnings banner for stable version (#41377)
### Rationale for this change
With every release dev documentation is moved to `docs/` and becomes stable
version of the documentation but the version warnings banner is still present.
### What changes are included in this PR?
This PR removes the banner before the dev docs are copied to the `docs/`
folder.
### Are these changes tested?
Not yet.
### Are there any user-facing changes?
No.
* GitHub Issue: #41356
Lead-authored-by: AlenkaF
Co-authored-by: Alenka Frim
Co-authored-by: Raúl Cumplido
Signed-off-by: Sutou Kouhei
---
dev/release/post-08-docs.sh | 17 -
1 file changed, 16 insertions(+), 1 deletion(-)
diff --git a/dev/release/post-08-docs.sh b/dev/release/post-08-docs.sh
index c59f9b9685..58a462551f 100755
--- a/dev/release/post-08-docs.sh
+++ b/dev/release/post-08-docs.sh
@@ -72,13 +72,28 @@ fi
# delete current stable docs and restore all previous versioned docs
rm -rf docs/*
git checkout "${versioned_paths[@]}"
+# Download and untar released docs in a temp folder
+rm -rf docs_new
+mkdir docs_new
+pushd docs_new
curl \
--fail \
--location \
--remote-name \
https://apache.jfrog.io/artifactory/arrow/docs/${version}/docs.tar.gz
tar xvf docs.tar.gz
-rm -f docs.tar.gz
+# Update DOCUMENTATION_OPTIONS.show_version_warning_banner
+find docs \
+ -type f \
+ -exec \
+sed -i.bak \
+ -e "s/DOCUMENTATION_OPTIONS.show_version_warning_banner =
true/DOCUMENTATION_OPTIONS.show_version_warning_banner = false/g" \
+ {} \;
+find ./ -name '*.bak' -delete
+popd
+mv docs_new/docs/* docs/
+rm -rf docs_new
+
if [ "$is_major_release" = "yes" ] ; then
previous_series=${previous_version%.*}
mv docs_temp docs/${previous_series}
(arrow) branch main updated (318d22adda -> 46e7816093)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 318d22adda MINOR: [Dev] Remove Dane from collaborators list (#41589) add 46e7816093 GH-41430: [Docs] Use sphinxcontrib-mermaid instead of generating images from .mmd (#41455) No new revisions were added by this update. Summary of changes: .github/workflows/docs.yml | 13 ++--- .github/workflows/docs_light.yml | 2 +- ci/conda_env_sphinx.txt| 1 + ci/docker/linux-apt-docs.dockerfile| 60 ++ ci/scripts/cpp_build.sh| 13 +++-- ci/scripts/integration_arrow.sh| 2 + ci/scripts/java_build.sh | 13 - ci/scripts/java_cdata_integration.sh | 4 +- ci/scripts/js_build.sh | 19 +-- ci/scripts/js_test.sh | 3 +- ci/scripts/python_build.sh | 33 ++-- ci/scripts/r_build.sh | 20 ++-- dev/archery/archery/docker/core.py | 4 ++ dev/archery/archery/integration/tester_java.py | 16 -- dev/archery/archery/integration/tester_js.py | 8 ++- dev/tasks/tasks.yml| 12 ++--- docker-compose.yml | 39 -- docs/requirements.txt | 3 +- docs/source/conf.py| 8 ++- docs/source/format/Flight.rst | 20 +++- docs/source/format/Flight/DoExchange.mmd | 3 -- docs/source/format/Flight/DoExchange.mmd.svg | 1 - docs/source/format/Flight/DoGet.mmd| 3 -- docs/source/format/Flight/DoGet.mmd.svg| 1 - docs/source/format/Flight/DoPut.mmd| 3 -- docs/source/format/Flight/DoPut.mmd.svg| 1 - docs/source/format/Flight/PollFlightInfo.mmd | 3 -- docs/source/format/Flight/PollFlightInfo.mmd.svg | 1 - docs/source/format/FlightSql.rst | 20 +++- docs/source/format/FlightSql/CommandGetTables.mmd | 3 -- .../format/FlightSql/CommandGetTables.mmd.svg | 1 - .../FlightSql/CommandPreparedStatementQuery.mmd| 3 -- .../CommandPreparedStatementQuery.mmd.svg | 1 - .../format/FlightSql/CommandStatementIngest.mmd| 3 -- .../FlightSql/CommandStatementIngest.mmd.svg | 1 - .../format/FlightSql/CommandStatementQuery.mmd | 3 -- .../format/FlightSql/CommandStatementQuery.mmd.svg | 1 - 37 files changed, 210 insertions(+), 135 deletions(-) delete mode 100644 docs/source/format/Flight/DoExchange.mmd.svg delete mode 100644 docs/source/format/Flight/DoGet.mmd.svg delete mode 100644 docs/source/format/Flight/DoPut.mmd.svg delete mode 100644 docs/source/format/Flight/PollFlightInfo.mmd.svg delete mode 100644 docs/source/format/FlightSql/CommandGetTables.mmd.svg delete mode 100644 docs/source/format/FlightSql/CommandPreparedStatementQuery.mmd.svg delete mode 100644 docs/source/format/FlightSql/CommandStatementIngest.mmd.svg delete mode 100644 docs/source/format/FlightSql/CommandStatementQuery.mmd.svg
(arrow-adbc) branch main updated: chore(ci/linux-packages): remove explicit arrow-glib-devel dependency (#1840)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-adbc.git
The following commit(s) were added to refs/heads/main by this push:
new b615a7091 chore(ci/linux-packages): remove explicit arrow-glib-devel
dependency (#1840)
b615a7091 is described below
commit b615a709138d6ec731da6ecb094192cf5f0d6b0b
Author: Sutou Kouhei
AuthorDate: Thu May 9 06:10:09 2024 +0900
chore(ci/linux-packages): remove explicit arrow-glib-devel dependency
(#1840)
RPM generates dependencies automatically based on package contents such
as `.pc`. Let's use it instead of specifying `arrow-glib-devel`
explicitly by `Requires:`.
Fixes #1839.
---
ci/linux-packages/yum/apache-arrow-adbc.spec.in | 1 -
1 file changed, 1 deletion(-)
diff --git a/ci/linux-packages/yum/apache-arrow-adbc.spec.in
b/ci/linux-packages/yum/apache-arrow-adbc.spec.in
index fea7b061c..9af14a2bf 100644
--- a/ci/linux-packages/yum/apache-arrow-adbc.spec.in
+++ b/ci/linux-packages/yum/apache-arrow-adbc.spec.in
@@ -319,7 +319,6 @@ Summary:Libraries and header files for Apache Arrow
GLib integration
License: Apache-2.0
Requires: %{name}-arrow-glib%{major_version_native}-libs =
%{version}-%{release}
Requires: %{name}-glib-devel = %{version}-%{release}
-Requires: arrow-glib-devel
%description arrow-glib-devel
Libraries and header files for Apache Arrow GLib integration
(arrow-adbc) branch main updated: chore(ci/linux-packages): fix RPM packages name (#1838)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-adbc.git
The following commit(s) were added to refs/heads/main by this push:
new 62383368f chore(ci/linux-packages): fix RPM packages name (#1838)
62383368f is described below
commit 62383368f5ef544cfccb490594959bda823afa95
Author: Sutou Kouhei
AuthorDate: Wed May 8 17:16:10 2024 +0900
chore(ci/linux-packages): fix RPM packages name (#1838)
We should use the major part of `VERSION_NATIVE` not `RELEASE` for RPM
package name.
(We should use `RELEASE` only for RPM version.)
Fixes #1837.
---
ci/linux-packages/Rakefile | 22 +++--
ci/linux-packages/yum/apache-arrow-adbc.spec.in | 62 -
2 files changed, 50 insertions(+), 34 deletions(-)
diff --git a/ci/linux-packages/Rakefile b/ci/linux-packages/Rakefile
index bc5daab6d..ca11a1345 100644
--- a/ci/linux-packages/Rakefile
+++ b/ci/linux-packages/Rakefile
@@ -40,15 +40,22 @@ module Helper
versions_env = top_source_dir / "dev" / "release" / "versions.env"
version = versions_env.read[/RELEASE="(.+?)"/, 1]
-adbc_version_cmake = top_source_dir / "c" / "cmake_modules" /
"AdbcVersion.cmake"
-native_version = adbc_version_cmake.read[/ADBC_VERSION "(.+?)"/, 1]
-if native_version.end_with?("-SNAPSHOT")
+version_native = detect_version_native
+if version_native.end_with?("-SNAPSHOT")
formatted_release_time = release_time.strftime("%Y%m%d")
version += "-dev#{formatted_release_time}"
end
version
end
+ def detect_version_native
+version_native_env = ENV["VERSION_NATIVE"]
+return version_native_env if version_native_env
+
+adbc_version_cmake = top_source_dir / "c" / "cmake_modules" /
"AdbcVersion.cmake"
+adbc_version_cmake.read[/ADBC_VERSION "(.+?)"/, 1]
+ end
+
def detect_release_time
release_time_env = ENV["RELEASE_TIME"]
if release_time_env
@@ -138,6 +145,15 @@ class ADBCPackageTask < PackageTask
]
end
+ def yum_expand_variable(name)
+case name
+when "VERSION_NATIVE"
+ detect_version_native
+else
+ super
+end
+ end
+
def github_repository
ENV["GITHUB_REPOSITORY"] || "apache/arrow-adbc"
end
diff --git a/ci/linux-packages/yum/apache-arrow-adbc.spec.in
b/ci/linux-packages/yum/apache-arrow-adbc.spec.in
index 9d6da18ba..fea7b061c 100644
--- a/ci/linux-packages/yum/apache-arrow-adbc.spec.in
+++ b/ci/linux-packages/yum/apache-arrow-adbc.spec.in
@@ -17,7 +17,7 @@
# specific language governing permissions and limitations
# under the License.
-%define major_version %(echo @VERSION@ | grep -o '^[0-9]*')
+%define major_version_native %(echo @VERSION_NATIVE@ | grep -o '^[0-9]*')
%if %{rhel} >= 9
%define adbc_cmake_builddir %{__cmake_builddir}
@@ -95,14 +95,14 @@ cd glib
DESTDIR=%{buildroot} meson install -C build
cd -
-%package driver-manager%{major_version}-libs
+%package driver-manager%{major_version_native}-libs
Summary: Runtime libraries for ADBC driver manager
License: Apache-2.0
-%description driver-manager%{major_version}-libs
+%description driver-manager%{major_version_native}-libs
This package contains the libraries for ADBC driver manager.
-%files driver-manager%{major_version}-libs
+%files driver-manager%{major_version_native}-libs
%defattr(-,root,root,-)
%doc README.md
%license LICENSE.txt NOTICE.txt
@@ -111,7 +111,7 @@ This package contains the libraries for ADBC driver manager.
%package driver-manager-devel
Summary: Libraries and header files for ADBC driver manager
License: Apache-2.0
-Requires: %{name}-driver-manager%{major_version}-libs =
%{version}-%{release}
+Requires: %{name}-driver-manager%{major_version_native}-libs =
%{version}-%{release}
%description driver-manager-devel
Libraries and header files for ADBC driver manager.
@@ -127,15 +127,15 @@ Libraries and header files for ADBC driver manager.
%{_libdir}/libadbc_driver_manager.so
%{_libdir}/pkgconfig/adbc-driver-manager.pc
-%package driver-postgresql%{major_version}-libs
+%package driver-postgresql%{major_version_native}-libs
Summary: ADBC PostgreSQL driver
License: Apache-2.0
Requires: libpq
-%description driver-postgresql%{major_version}-libs
+%description driver-postgresql%{major_version_native}-libs
This package provides an ADBC driver for PostgreSQL.
-%files driver-postgresql%{major_version}-libs
+%files driver-postgresql%{major_version_native}-libs
%defattr(-,root,root,-)
%doc README.md
%license LICENSE.txt NOTICE.txt
@@ -144,7 +144,7 @@ This package provides an ADBC driver for PostgreSQL.
%package dr
svn commit: r69028 - /release/arrow/arrow-julia-2.7.1/
Author: kou Date: Wed May 8 06:37:05 2024 New Revision: 69028 Log: Remove old Apache Arrow Julia release: arrow-julia-2.7.1/ Removed: release/arrow/arrow-julia-2.7.1/
svn commit: r69027 - /dev/arrow/apache-arrow-julia-2.7.2-rc1/ /release/arrow/arrow-julia-2.7.2/
Author: kou Date: Wed May 8 06:37:00 2024 New Revision: 69027 Log: Apache Arrow Julia 2.7.2 Added: release/arrow/arrow-julia-2.7.2/ - copied from r69026, dev/arrow/apache-arrow-julia-2.7.2-rc1/ Removed: dev/arrow/apache-arrow-julia-2.7.2-rc1/
(arrow-adbc) branch main updated: fix(dev/release): handle versioning scheme in binary verification (#1834)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow-adbc.git
The following commit(s) were added to refs/heads/main by this push:
new 2d842cbae fix(dev/release): handle versioning scheme in binary
verification (#1834)
2d842cbae is described below
commit 2d842cbaeba513d6f70d794dd3279969e00190bc
Author: David Li
AuthorDate: Wed May 8 13:46:13 2024 +0900
fix(dev/release): handle versioning scheme in binary verification (#1834)
Fixes #1833.
---
dev/release/verify-release-candidate.sh | 22 --
1 file changed, 16 insertions(+), 6 deletions(-)
diff --git a/dev/release/verify-release-candidate.sh
b/dev/release/verify-release-candidate.sh
index ca81e78ba..825a450d4 100755
--- a/dev/release/verify-release-candidate.sh
+++ b/dev/release/verify-release-candidate.sh
@@ -614,6 +614,15 @@ ensure_source_directory() {
if [ ! -d "${ARROW_SOURCE_DIR}" ]; then
git clone --depth=1 https://github.com/$ARROW_REPOSITORY $ARROW_SOURCE_DIR
fi
+
+ source "${ADBC_SOURCE_DIR}/dev/release/versions.env"
+ echo "Versions:"
+ echo "Release: ${RELEASE} (requested: ${VERSION})"
+ echo "C#: ${VERSION_CSHARP}"
+ echo "Java: ${VERSION_JAVA}"
+ echo "C/C++/GLib/Go/Python/Ruby: ${VERSION_NATIVE}"
+ echo "R: ${VERSION_R}"
+ echo "Rust: ${VERSION_RUST}"
}
test_source_distribution() {
@@ -701,14 +710,13 @@ test_linux_wheels() {
CONDA_ENV=wheel-${pyver}-${arch} PYTHON_VERSION=${pyver} maybe_setup_conda
|| exit 1
VENV_ENV=wheel-${pyver}-${arch} PYTHON_VERSION=${pyver}
maybe_setup_virtualenv || continue
pip install --force-reinstall \
-
adbc_*-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-manylinux*${arch}*.whl
\
-
adbc_*-${TEST_PYARROW_VERSION:-${VERSION}}-py3-none-manylinux*${arch}*.whl
+
adbc_*-${VERSION_NATIVE}-cp${pyver/.}-cp${python/.}-manylinux*${arch}*.whl \
+adbc_*-${VERSION_NATIVE}-py3-none-manylinux*${arch}*.whl
${ADBC_DIR}/ci/scripts/python_wheel_unix_test.sh ${ADBC_SOURCE_DIR}
done
}
test_macos_wheels() {
- local python_versions="3.9 3.10 3.11"
# apple silicon processor
if [ "$(uname -m)" = "arm64" ]; then
local platform_tags="arm64"
@@ -716,6 +724,8 @@ test_macos_wheels() {
local platform_tags="x86_64"
fi
+ local python_versions="${TEST_PYTHON_VERSIONS:-3.9 3.10 3.11}"
+
# verify arch-native wheels inside an arch-native conda environment
for python in ${python_versions}; do
local pyver=${python/m}
@@ -726,8 +736,8 @@ test_macos_wheels() {
VENV_ENV=wheel-${pyver}-${platform} PYTHON_VERSION=${pyver}
maybe_setup_virtualenv || continue
pip install --force-reinstall \
-
adbc_*-${TEST_PYARROW_VERSION:-${VERSION}}-cp${pyver/.}-cp${python/.}-macosx_*_${platform}.whl
\
-
adbc_*-${TEST_PYARROW_VERSION:-${VERSION}}-py3-none-macosx_*_${platform}.whl
+
adbc_*-${VERSION_NATIVE}-cp${pyver/.}-cp${python/.}-macosx_*_${platform}.whl \
+ adbc_*-${VERSION_NATIVE}-py3-none-macosx_*_${platform}.whl
${ADBC_DIR}/ci/scripts/python_wheel_unix_test.sh ${ADBC_SOURCE_DIR}
done
done
@@ -765,7 +775,7 @@ test_jars() {
local -r components=(".jar" "-javadoc.jar" "-sources.jar")
for package in "${packages[@]}"; do
for component in "${components[@]}"; do
- local filename="${BINARY_DIR}/${package}-${VERSION}${component}"
+ local filename="${BINARY_DIR}/${package}-${VERSION_JAVA}${component}"
if [[ ! -f "${filename}" ]]; then
echo "ERROR: missing artifact ${filename}"
return 1
svn commit: r68981 - in /dev/arrow/apache-arrow-julia-2.7.2-rc1: ./ apache-arrow-julia-2.7.2.tar.gz apache-arrow-julia-2.7.2.tar.gz.asc apache-arrow-julia-2.7.2.tar.gz.sha256 apache-arrow-julia-2.7.2.
Author: kou Date: Mon May 6 22:05:36 2024 New Revision: 68981 Log: Apache Arrow Julia 2.7.2 1 Added: dev/arrow/apache-arrow-julia-2.7.2-rc1/ dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz (with props) dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.asc dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha256 dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha512 Added: dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz == Binary file - no diff available. Propchange: dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz -- svn:mime-type = application/octet-stream Added: dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.asc == --- dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.asc (added) +++ dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.asc Mon May 6 22:05:36 2024 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCAAdFiEECNNWS3xqnK+/9qZnkdGPzwefgAcFAmY5VCwACgkQkdGPzwef +gAeSjA/+OOnkW+cvSSDxlYssfquP8jSIdVtuvmnIcigOS1b960xiE9oyMHWFggo9 ++svL+7f3U7pgLr6Pcy5ANCpm9HLsYo6t+KBqzGJbPGmuHnmyxCBlO3einFkO/z4M +QKREfIbE1dso+rwxSRYwQ66e+0wvq8fUV+WRZTF955VBzuS5Z0aAAzcj0FV1i1kx +ujKrx285KhrBInv8KwLGbhyAliRKPSHOsLZnOVycrivDCjdjOQOnpPRPQKmqSRol +EfgR2E+CV0XHB+qDon4ROdzpx7IAG4aU46KWXbNlH8RjyN0tmhThGADx8v6A6c8+ +KKMx8cOaDR+jQoR0QOl8hlmeKaINs978zN3EoVXwkWPURPl2AXp7KotxEpHcbYEY +UvAiDR51rlSPSsptXt5GNJ2k7c/iST2a/SfxtLzmT4cdCiQ+QtnjSueE2Coekip0 +IfjtAskdg6/B9gC/vQUDK8UrPxZb50uKMrJLx4EFQs6b9pxuHhvAe6e61gG6L4F4 +0mASUN+vxNGMrha0jX3Gru4V4kb29Zbiga6cG7DijWV4dh7ylEN4FEzYHHpxbQMV +m//05qoIPnHNKYZh93WIZa0pa5xUqQ/BhKKwP/JIDLHpAiIh3Nss3yI0qi8orPOv +0uCxRi6T3GVtBqxSKQJxBdoIZ49p8vfKtCTdc54g3okHgDHydO8= +=Smpd +-END PGP SIGNATURE- Added: dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha256 == --- dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha256 (added) +++ dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha256 Mon May 6 22:05:36 2024 @@ -0,0 +1 @@ +91ce70042db8fe5e2013c476ceb9d357d755abd47342146248c50ee5e4f50caa apache-arrow-julia-2.7.2.tar.gz Added: dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha512 == --- dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha512 (added) +++ dev/arrow/apache-arrow-julia-2.7.2-rc1/apache-arrow-julia-2.7.2.tar.gz.sha512 Mon May 6 22:05:36 2024 @@ -0,0 +1 @@ +fb49263a119c146eca3facfdd25b5aa6a7df57362a888f90a6859f80a5105e34c04f027642df3aa2949313912ca8124f17d3dcd26ae7dfb7eed70f13d42f14b1 apache-arrow-julia-2.7.2.tar.gz
(arrow-julia) annotated tag v2.7.2-rc1 updated (64fc730 -> 4457844)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to annotated tag v2.7.2-rc1 in repository https://gitbox.apache.org/repos/asf/arrow-julia.git *** WARNING: tag v2.7.2-rc1 was modified! *** from 64fc730 (commit) to 4457844 (tag) tagging 64fc730f767de84835a5f1b4fc9b7831a3c2d15b (commit) replaces v2.7.1 by Sutou Kouhei on Tue May 7 07:05:27 2024 +0900 - Log - 2.7.2 RC1 --- No new revisions were added by this update. Summary of changes:
(arrow) branch main updated (d10ebf055a -> 3a54e68c69)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from d10ebf055a MINOR: [R] fix no visible global function definition: left_join (#41542) add 3a54e68c69 MINOR: [Dev] Add zanmato1984 and ZhangHuiGui in collaborators list (#41544) No new revisions were added by this update. Summary of changes: .asf.yaml | 2 ++ 1 file changed, 2 insertions(+)
(arrow) branch main updated: MINOR: [JS] Bump @swc/helpers from 0.5.10 to 0.5.11 in /js (#41486)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new 2ba129f0a2 MINOR: [JS] Bump @swc/helpers from 0.5.10 to 0.5.11 in /js (#41486) 2ba129f0a2 is described below commit 2ba129f0a28e0ec93c7f383a64c54bef24e26f59 Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Mon May 6 06:56:08 2024 +0900 MINOR: [JS] Bump @swc/helpers from 0.5.10 to 0.5.11 in /js (#41486) Bumps [@ swc/helpers](https://github.com/swc-project/swc) from 0.5.10 to 0.5.11. Commits See full diff in https://github.com/swc-project/swc/commits;>compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@ dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@ dependabot rebase` will rebase this PR - `@ dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@ dependabot merge` will merge this PR after your CI passes on it - `@ dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@ dependabot cancel merge` will cancel a previously requested merge and block automerging - `@ dependabot reopen` will reopen this PR if it is closed - `@ dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@ dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@ dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@ dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@ dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) Authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Signed-off-by: Sutou Kouhei --- js/yarn.lock | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/js/yarn.lock b/js/yarn.lock index abde21f603..eb7ed33520 100644 --- a/js/yarn.lock +++ b/js/yarn.lock @@ -1199,9 +1199,9 @@ integrity sha512-e2BR4lsJkkRlKZ/qCHPw9ZaSxc0MVUd7gtbtaB7aMvHeJVYe8sOB8DBZkP2DtISHGSku9sCK6T6cnY0CtXrOCQ== "@swc/helpers@^0.5.10": - version "0.5.10" - resolved "https://registry.yarnpkg.com/@swc/helpers/-/helpers-0.5.10.tgz#5720082d007197cd85743dd599198097126a3f6e; - integrity sha512-CU+RF9FySljn7HVSkkjiB84hWkvTaI3rtLvF433+jRSBL2hMu3zX5bGhHS8C80SM++h4xy8hBSnUHFQHmRXSBw== + version "0.5.11" + resolved "https://registry.yarnpkg.com/@swc/helpers/-/helpers-0.5.11.tgz#5bab8c660a6e23c13b2d23fcd1ee44a2db1b0cb7; + integrity sha512-YNlnKRWF2sVojTpIyzwou9XoTNbzbzONwRhOoniEioF1AtaitTvVZblaQRrAzChWQ1bLYyYSWzM18y4WwgzJ+A== dependencies: tslib "^2.4.0"
(arrow) branch main updated (5959024e9c -> c8bf9753d7)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 5959024e9c MINOR: [JS] Bump eslint-plugin-jest from 27.9.0 to 28.4.0 in /js (#41524) add c8bf9753d7 MINOR: [JS] Bump @types/node from 20.12.7 to 20.12.8 in /js (#41526) No new revisions were added by this update. Summary of changes: js/yarn.lock | 15 --- 1 file changed, 4 insertions(+), 11 deletions(-)
(arrow) branch main updated (b102aebb0a -> 5959024e9c)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from b102aebb0a MINOR: [JS] Bump @typescript-eslint/parser from 7.7.0 to 7.8.0 in /js (#41522) add 5959024e9c MINOR: [JS] Bump eslint-plugin-jest from 27.9.0 to 28.4.0 in /js (#41524) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 115 +++- 2 files changed, 56 insertions(+), 61 deletions(-)
(arrow) branch main updated: MINOR: [JS] Bump @typescript-eslint/parser from 7.7.0 to 7.8.0 in /js (#41522)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new b102aebb0a MINOR: [JS] Bump @typescript-eslint/parser from 7.7.0 to 7.8.0 in /js (#41522) b102aebb0a is described below commit b102aebb0a9eb05e94544fd1f15f85f660fc89be Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> AuthorDate: Fri May 3 23:17:41 2024 +0900 MINOR: [JS] Bump @typescript-eslint/parser from 7.7.0 to 7.8.0 in /js (#41522) Bumps [@ typescript-eslint/parser](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/parser) from 7.7.0 to 7.8.0. Release notes Sourced from https://github.com/typescript-eslint/typescript-eslint/releases;>@typescript-eslint/parser's releases. v7.8.0 7.8.0 (2024-04-29) Features rule-tester: assert suggestion messages are unique (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8995;>#8995) typescript-estree: add maximumDefaultProjectFileMatchCount and wide allowDefaultProjectForFiles glob restrictions (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8925;>#8925) 啕 Fixes eslint-plugin: [no-unsafe-argument] handle tagged templates (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8746;>#8746) eslint-plugin: [prefer-optional-chain] suggests optional chaining during strict null equality check (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8717;>#8717) eslint-plugin: [consistent-type-assertions] handle tagged templates (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8993;>#8993) eslint-plugin: [no-unsafe-return] handle union types (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/9001;>#9001) eslint-plugin: [no-unused-vars] clear error report range (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8640;>#8640) utils: export ESLint backwards-compat functions (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8976;>#8976) ❤️ Thank You auvred https://github.com/auvred;>@auvred Josh Goldberg ✨ jsfm01 https://github.com/jsfm01;>@jsfm01 Kim Sang Du https://github.com/developer-bandi;>@developer-bandi YeonJuan https://github.com/yeonjuan;>@yeonjuan You can read about our https://main--typescript-eslint.netlify.app/users/versioning;>versioning strategy and https://main--typescript-eslint.netlify.app/users/releases;>releases on our website. v7.7.1 7.7.1 (2024-04-22) 啕 Fixes eslint-plugin: [no-unsafe-assignment] handle shorthand property assignment (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8800;>#8800) eslint-plugin: [explicit-function-return-type] fix checking wrong ancestor's return type (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8809;>#8809) eslint-plugin: [prefer-optional-chain] only look at left operand for requireNullish (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8559;>#8559) eslint-plugin: [no-for-in-array] refine report location (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8874;>#8874) eslint-plugin: [no-unnecessary-type-assertion] allow non-null assertion for void type (https://redirect.github.com/typescript-eslint/typescript-eslint/pull/8912;>#8912) ❤️ Thank You Abraham Guo Kirk Waiblinger https://github.com/kirkwaiblinger;>@kirkwaiblinger YeonJuan https://github.com/yeonjuan;>@yeonjuan You can read about our https://main--typescript-eslint.netlify.app/users/versioning;>versioning strategy and https://main--typescript-eslint.netlify.app/users/releases;>releases on our website. Changelog Sourced from https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/parser/CHANGELOG.md;>@typescript-eslint/parser's changelog. 7.8.0 (2024-04-29) This was a version bump only for parser to align it with other projects, there were no code changes. You can read about our https://main--typescript-eslint.netlify.app/users/versioning;>versioning strategy and https://main--typescript-eslint.netlify.app/users/releases;>releases on our website. 7.7.1 (2024-04-22) This was a version bump only for parser to align it with other projects, there were no code changes. You can read about our https://main--typescript-eslint.netlify.app/users/versioning;>versioning strategy and https://main--typescript-eslint.netlify.app/users/releases;>releases on our website. Commits https://github.com/typescript-eslint/typescript-e
(arrow) branch main updated (c8cf61c569 -> 32916f8355)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from c8cf61c569 GH-41385: [CI][MATLAB][Packaging] Add support for MATLAB `R2024a` in CI and crossbow packaging workflows (#41504) add 32916f8355 MINOR: [JS] Bump @swc/core from 1.4.14 to 1.4.17 in /js (#41519) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 128 2 files changed, 65 insertions(+), 65 deletions(-)
(arrow) branch main updated (49bf3d9bf2 -> 71e38fc8a9)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 49bf3d9bf2 GH-41467: [CI][Release] Don't push conda-verify-rc image (#41468) add 71e38fc8a9 MINOR: [JS] Bump @typescript-eslint/eslint-plugin from 7.7.0 to 7.8.0 in /js (#41485) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 77 + 2 files changed, 57 insertions(+), 22 deletions(-)
(arrow) branch main updated (3c67091f93 -> 49bf3d9bf2)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 3c67091f93 GH-41491: [Python] remove special methods related to buffers in python <2.6 (#41492) add 49bf3d9bf2 GH-41467: [CI][Release] Don't push conda-verify-rc image (#41468) No new revisions were added by this update. Summary of changes: dev/tasks/verify-rc/github.linux.amd64.docker.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(arrow) branch main updated (cc78c7a9bf -> 9ce7ab10fb)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from cc78c7a9bf MINOR: [JS] Bump memfs from 4.8.2 to 4.9.2 in /js (#41482) add 9ce7ab10fb MINOR: [JS] Bump rollup from 4.14.3 to 4.17.2 in /js (#41484) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 198 2 files changed, 100 insertions(+), 100 deletions(-)
(arrow) branch main updated (281122c018 -> cc78c7a9bf)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 281122c018 GH-41306: [C++] Check to avoid copying when NullBitmapBuffer is Null (#41452) add cc78c7a9bf MINOR: [JS] Bump memfs from 4.8.2 to 4.9.2 in /js (#41482) No new revisions were added by this update. Summary of changes: js/package.json | 2 +- js/yarn.lock| 53 + 2 files changed, 50 insertions(+), 5 deletions(-)
(arrow) branch main updated: GH-41410: [C++][FS][Azure][Docs] Add AzureFileSystem to Filesystems API reference (#41411)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 22f88fa4a8 GH-41410: [C++][FS][Azure][Docs] Add AzureFileSystem to
Filesystems API reference (#41411)
22f88fa4a8 is described below
commit 22f88fa4a8f5ac7250f1845aace5a78d20006ef2
Author: Bryce Mecum
AuthorDate: Wed May 1 00:12:37 2024 -0800
GH-41410: [C++][FS][Azure][Docs] Add AzureFileSystem to Filesystems API
reference (#41411)
### Rationale for this change
See https://github.com/apache/arrow/issues/41410.
### What changes are included in this PR?
Just changes to filesystem.rst.
### Are these changes tested?
Yes, locally.
### Are there any user-facing changes?
These are those changes.
* GitHub Issue: #41410
Authored-by: Bryce Mecum
Signed-off-by: Sutou Kouhei
---
cpp/src/arrow/filesystem/azurefs.h | 17 -
docs/source/cpp/api/filesystem.rst | 9 +
2 files changed, 17 insertions(+), 9 deletions(-)
diff --git a/cpp/src/arrow/filesystem/azurefs.h
b/cpp/src/arrow/filesystem/azurefs.h
index 667b4e372a..b71a5ae73b 100644
--- a/cpp/src/arrow/filesystem/azurefs.h
+++ b/cpp/src/arrow/filesystem/azurefs.h
@@ -141,18 +141,14 @@ struct ARROW_EXPORT AzureOptions {
///
/// 1. abfs[s]://[:\@]\.blob.core.windows.net
///[/\[/\]]
- /// 2.
abfs[s]://\[:\]@\.dfs.core.windows.net
- /// [/path]
+ /// 2.
abfs[s]://\[:\]\@\.dfs.core.windows.net[/path]
/// 3. abfs[s]://[\]@]\[\<:port\>]
///[/\[/path]]
/// 4. abfs[s]://[\]@]\[/path]
///
- /// 1. and 2. are compatible with the Azure Data Lake Storage Gen2 URIs:
- ///
https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction-abfs-uri
- ///
- /// 3. is for Azure Blob Storage compatible service including Azurite.
- ///
- /// 4. is a shorter version of 1. and 2.
+ /// (1) and (2) are compatible with the Azure Data Lake Storage Gen2 URIs
+ /// [1], (3) is for Azure Blob Storage compatible service including Azurite,
+ /// and (4) is a shorter version of (1) and (2).
///
/// Note that there is no difference between abfs and abfss. HTTPS is
/// used with abfs by default. You can force to use HTTP by specifying
@@ -178,6 +174,9 @@ struct ARROW_EXPORT AzureOptions {
/// AzureOptions::ConfigureClientSecretCredential() is called.
/// * client_secret: You must specify "tenant_id" and "client_id"
/// too. AzureOptions::ConfigureClientSecretCredential() is called.
+ ///
+ /// [1]:
+ ///
https://learn.microsoft.com/en-us/azure/storage/blobs/data-lake-storage-introduction-abfs-uri
static Result FromUri(const Uri& uri, std::string* out_path);
static Result FromUri(const std::string& uri, std::string*
out_path);
@@ -226,7 +225,7 @@ struct ARROW_EXPORT AzureOptions {
/// overwriting.
/// - When you use the ListBlobs operation without specifying a delimiter, the
results
/// include both directories and blobs. If you choose to use a delimiter,
use only a
-/// forward slash (/) -- the only supported delimiter.
+/// forward slash (/) \--- the only supported delimiter.
/// - If you use the DeleteBlob API to delete a directory, that directory is
deleted only
/// if it's empty. This means that you can't use the Blob API delete
directories
/// recursively.
diff --git a/docs/source/cpp/api/filesystem.rst
b/docs/source/cpp/api/filesystem.rst
index 02b1266832..599e9fedb6 100644
--- a/docs/source/cpp/api/filesystem.rst
+++ b/docs/source/cpp/api/filesystem.rst
@@ -97,3 +97,12 @@ Google Cloud Storage filesystem
.. doxygenclass:: arrow::fs::GcsFileSystem
:members:
+
+Azure filesystem
+
+
+.. doxygenstruct:: arrow::fs::AzureOptions
+ :members:
+
+.. doxygenclass:: arrow::fs::AzureFileSystem
+ :members:
(arrow) branch main updated: GH-41433: [C++][Gandiva] Fix ascii_utf8 function to return same result on x86 and Arm (#41434)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 6dc662324c GH-41433: [C++][Gandiva] Fix ascii_utf8 function to return
same result on x86 and Arm (#41434)
6dc662324c is described below
commit 6dc662324c2c46a7b5066b91cd0ace93a275ecf7
Author: DenisTarasyuk <131180287+denistaras...@users.noreply.github.com>
AuthorDate: Tue Apr 30 03:59:51 2024 +0300
GH-41433: [C++][Gandiva] Fix ascii_utf8 function to return same result on
x86 and Arm (#41434)
### Rationale for this change
Fixing ascii_utf8 function that has different return result on x86 and Arm
due to default char type sign difference on those platforms. Added tests to
cover existing x86 behavior for ascii symbols with code >127.
### What changes are included in this PR?
1. Added type cast to signed char to save existing x86 behavior on Arm
platform.
2. Added tests cases for negative results.
### Are these changes tested?
UT included.
### Are there any user-facing changes?
None
* GitHub Issue: #41433
Authored-by: DenisTarasyuk
Signed-off-by: Sutou Kouhei
---
cpp/src/gandiva/precompiled/string_ops.cc | 2 +-
cpp/src/gandiva/precompiled/string_ops_test.cc | 2 ++
2 files changed, 3 insertions(+), 1 deletion(-)
diff --git a/cpp/src/gandiva/precompiled/string_ops.cc
b/cpp/src/gandiva/precompiled/string_ops.cc
index 5aa0eb38ea..3849cf7bdf 100644
--- a/cpp/src/gandiva/precompiled/string_ops.cc
+++ b/cpp/src/gandiva/precompiled/string_ops.cc
@@ -1377,7 +1377,7 @@ gdv_int32 ascii_utf8(const char* data, gdv_int32
data_len) {
if (data_len == 0) {
return 0;
}
- return static_cast(data[0]);
+ return static_cast(static_cast(data[0]));
}
// Returns the ASCII character having the binary equivalent to A.
diff --git a/cpp/src/gandiva/precompiled/string_ops_test.cc
b/cpp/src/gandiva/precompiled/string_ops_test.cc
index 89213592e7..aaa25db0a9 100644
--- a/cpp/src/gandiva/precompiled/string_ops_test.cc
+++ b/cpp/src/gandiva/precompiled/string_ops_test.cc
@@ -51,6 +51,8 @@ TEST(TestStringOps, TestAscii) {
EXPECT_EQ(ascii_utf8("", 0), 0);
EXPECT_EQ(ascii_utf8("123", 3), 49);
EXPECT_EQ(ascii_utf8("999", 3), 57);
+ EXPECT_EQ(ascii_utf8("\x80", 1), -128);
+ EXPECT_EQ(ascii_utf8("\xFF", 1), -1);
}
TEST(TestStringOps, TestChrBigInt) {
(arrow) branch main updated (5ee70ee1bc -> 4b2cf22f5a)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 5ee70ee1bc GH-41367: [C++] Replace [[maybe_unused]] with Arrow macro (#41359) add 4b2cf22f5a GH-41405: [Release][Docs][GLib] Use Sphinx based GLib front page (#41406) No new revisions were added by this update. Summary of changes: dev/release/post-08-docs.sh | 1 - 1 file changed, 1 deletion(-)
(arrow-site) branch asf-site updated: Use Sphinx generated page for the GLib front page (#510)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/arrow-site.git
The following commit(s) were added to refs/heads/asf-site by this push:
new fa76dd803b6 Use Sphinx generated page for the GLib front page (#510)
fa76dd803b6 is described below
commit fa76dd803b67b9e2cd955e0f5e447c8172da3cba
Author: Sutou Kouhei
AuthorDate: Sun Apr 28 05:29:46 2024 +0900
Use Sphinx generated page for the GLib front page (#510)
The GLib front page: https://arrow.apache.org/docs/c_glib/
This is a manual workaround of
https://github.com/apache/arrow/issues/41405 for 16.0.0 release.
The new `index.html` is `docs/c_glib/index.html` in
https://apache.jfrog.io/artifactory/arrow/docs/16.0.0/docs.tar.gz .
---
docs/c_glib/index.html | +---
1 file changed, 873 insertions(+), 238 deletions(-)
diff --git a/docs/c_glib/index.html b/docs/c_glib/index.html
index d14636c8e91..4e573706692 100644
--- a/docs/c_glib/index.html
+++ b/docs/c_glib/index.html
@@ -1,271 +1,906 @@
+
+
-
+
+
+
+
-
-
-
-
+
+https://docutils.sourceforge.io/; />
+
+Apache Arrow GLib (C) Apache Arrow v16.0.0
+
+
+
+
+document.documentElement.dataset.mode = localStorage.getItem("mode") || "";
+document.documentElement.dataset.theme = localStorage.getItem("theme") ||
"light";
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+DOCUMENTATION_OPTIONS.pagename = 'c_glib/index';
+
+DOCUMENTATION_OPTIONS.theme_version = '0.15.2';
+DOCUMENTATION_OPTIONS.theme_switcher_json_url =
'/docs/_static/versions.json';
+DOCUMENTATION_OPTIONS.theme_switcher_version_match = '';
+DOCUMENTATION_OPTIONS.show_version_warning_banner = true;
+
+https://arrow.apache.org/docs/c_glib/index.html; />
+
+
+
+
+
+
+
+
+
+
+
+var _paq = window._paq = window._paq || [];
+/* tracker methods like "setCustomDimension" should be called before
"trackPageView" */
+/* We explicitly disable cookie tracking to avoid privacy issues */
+_paq.push(['disableCookies']);
+_paq.push(['trackPageView']);
+_paq.push(['enableLinkTracking']);
+(function() {
+ var u="<a rel="nofollow" href="https://analytics.apache.org/"">https://analytics.apache.org/"</a>;;
+ _paq.push(['setTrackerUrl', u+'matomo.php']);
+ _paq.push(['setSiteId', '20']);
+ var d=document, g=d.createElement('script'),
s=d.getElementsByTagName('script')[0];
+ g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s);
+})();
+
+
+
+
+
+
+
+
+
+
+ Skip to main
content
+
+
+
+
+
+Back to top
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ Ctrl+K
+
+
+
+
+
+
+
+
+
+
+
-Apache Arrow GLib (C) | Apache Arrow
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+document.write(`<img src="../_static/arrow-dark.png"
class="logo__image only-dark" alt="Apache Arrow v16.0.0 - Home"/>`);
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Specifications
+
+
+
-
-
-
-
-
-
-https://arrow.apache.org/docs/c_glib/; />
-https://arrow.apache.org/docs/c_glib/; />
-
-https://arrow.apache.org/img/arrow-logo_horizontal_black-txt_white-bg.png;
/>
-
-
-
-https://arrow.apache.org/img/arrow-logo_horizontal_black-txt_white-bg.png;
/>
-
-
-
-{"@context":"<a rel="nofollow" href="https://schema.org","@type":"BlogPosting","dateModified":"2024-03-11T12:40:35-04:00","datePublished":"2024-03-11T12:40:35-04:00","description":"Apache">https://schema.org","@type":"BlogPosting","dateModified":"2024-03-11T12:40:35-04:00","datePublished":"2024-03-11T12:40:35-04:00","description":"Apache</a>
Arrow GLib (C) Apache Arrow GLib is a wrapper library for Apache Arrow C++.
Apache Arrow GLib provides C API. Apache Arrow GLib supports GObject
Introspection. It means that you can create language bindings at runtime or
compile time automatically. API reference manuals Apache Arrow GLib Apache
Parquet GLib Gandiva GLib Plasma [...]
-<!-- End Jekyll SEO tag -->
-
-
-<!-- favicons -->
-<link rel="icon" type="image/png" sizes="16x16"
href="/img/favicon-16x1
(arrow) branch main updated: GH-41367: [C++] Replace [[maybe_unused]] with Arrow macro (#41359)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 5ee70ee1bc GH-41367: [C++] Replace [[maybe_unused]] with Arrow macro
(#41359)
5ee70ee1bc is described below
commit 5ee70ee1bc9c8c9f6ede63ea5e6c52e04446fe08
Author: William Ayd
AuthorDate: Sat Apr 27 15:42:30 2024 -0400
GH-41367: [C++] Replace [[maybe_unused]] with Arrow macro (#41359)
### Rationale for this change
This is a follow up to https://github.com/apache/arrow/pull/4 which was
created as an issue in #41367
### What changes are included in this PR?
Replace [[maybe_unused]] with Arrow macro
### Are these changes tested?
Builds cleanly
### Are there any user-facing changes?
No
* GitHub Issue: #41367
Authored-by: Will Ayd
Signed-off-by: Sutou Kouhei
---
cpp/apidoc/Doxyfile | 11 ++-
cpp/cmake_modules/SetupCxxFlags.cmake | 1 +
cpp/src/arrow/array/builder_base.h | 6 +++---
cpp/src/arrow/array/builder_nested.h| 2 +-
cpp/src/arrow/array/builder_primitive.h | 4 ++--
cpp/src/arrow/device.h | 6 +++---
cpp/src/arrow/type.h| 6 +++---
cpp/src/arrow/util/macros.h | 4
8 files changed, 23 insertions(+), 17 deletions(-)
diff --git a/cpp/apidoc/Doxyfile b/cpp/apidoc/Doxyfile
index e19c933cd4..5be93032c0 100644
--- a/cpp/apidoc/Doxyfile
+++ b/cpp/apidoc/Doxyfile
@@ -2168,16 +2168,17 @@ INCLUDE_FILE_PATTERNS =
PREDEFINED = __attribute__(x)= \
__declspec(x)= \
- PARQUET_EXPORT= \
- GANDIVA_EXPORT= \
- ARROW_EXPORT= \
ARROW_ACERO_EXPORT= \
+ ARROW_ARG_UNUSED(x)=x \
+ ARROW_DEPRECATED(x)= \
ARROW_DS_EXPORT= \
ARROW_ENGINE_EXPORT= \
+ ARROW_EXPORT= \
+ ARROW_EXTERN_TEMPLATE= \
ARROW_FLIGHT_EXPORT= \
ARROW_FLIGHT_SQL_EXPORT= \
- ARROW_EXTERN_TEMPLATE= \
- ARROW_DEPRECATED(x)=
+ GANDIVA_EXPORT= \
+ PARQUET_EXPORT=
# If the MACRO_EXPANSION and EXPAND_ONLY_PREDEF tags are set to YES then this
# tag can be used to specify a list of macro names that should be expanded. The
diff --git a/cpp/cmake_modules/SetupCxxFlags.cmake
b/cpp/cmake_modules/SetupCxxFlags.cmake
index d56609c123..ea357b4779 100644
--- a/cpp/cmake_modules/SetupCxxFlags.cmake
+++ b/cpp/cmake_modules/SetupCxxFlags.cmake
@@ -314,6 +314,7 @@ if("${BUILD_WARNING_LEVEL}" STREQUAL "CHECKIN")
set(CXX_COMMON_FLAGS "${CXX_COMMON_FLAGS} -Wall")
set(CXX_COMMON_FLAGS "${CXX_COMMON_FLAGS} -Wextra")
set(CXX_COMMON_FLAGS "${CXX_COMMON_FLAGS} -Wdocumentation")
+set(CXX_COMMON_FLAGS "${CXX_COMMON_FLAGS} -DARROW_WARN_DOCUMENTATION")
if(CMAKE_SYSTEM_NAME STREQUAL "Emscripten")
# size_t is 32 bit in Emscripten wasm32 - ignore conversion errors
set(CXX_COMMON_FLAGS "${CXX_COMMON_FLAGS} -Wno-shorten-64-to-32")
diff --git a/cpp/src/arrow/array/builder_base.h
b/cpp/src/arrow/array/builder_base.h
index e6c0b2d238..3a85318735 100644
--- a/cpp/src/arrow/array/builder_base.h
+++ b/cpp/src/arrow/array/builder_base.h
@@ -175,9 +175,9 @@ class ARROW_EXPORT ArrayBuilder {
/// \brief Append a range of values from an array.
///
/// The given array must be the same type as the builder.
- virtual Status AppendArraySlice([[maybe_unused]] const ArraySpan& array,
- [[maybe_unused]] int64_t offset,
- [[maybe_unused]] int64_t length) {
+ virtual Status AppendArraySlice(const ArraySpan& ARROW_ARG_UNUSED(array),
+ int64_t ARROW_ARG_UNUSED(offset),
+ int64_t ARROW_ARG_UNUSED(length)) {
return Status::NotImplemented("AppendArraySlice for builder for ",
*type());
}
diff --git a/cpp/src/arrow/array/builder_nested.h
b/cpp/src/arrow/array/builder_nested.h
index 9f7b0fcdbc..6089cf04d4 100644
--- a/cpp/src/arrow/array/builder_nested.h
+++ b/cpp/src/arrow/array/builder_nested.h
@@ -248,7 +248,7 @@ class ARROW_EXPORT VarLengthListLikeBuilder : public
ArrayBuilder {
/// \brief Append dimensions for a single list slot.
///
/// ListViewBuilder overrides this to also append the size.
- virtual void UnsafeAppendDimensions(int64_t offset, [[maybe_unused]] int64_t
size) {
+ virtual void UnsafeAppendDimensions(int64_
(arrow-site) branch main updated: [Website] Add new committer: Bryce Mecum (#487)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new 703095a3bd2 [Website] Add new committer: Bryce Mecum (#487) 703095a3bd2 is described below commit 703095a3bd2f205015c5a31c6bb8cb08c8d0443c Author: Nic Crane AuthorDate: Fri Apr 26 18:00:04 2024 -0400 [Website] Add new committer: Bryce Mecum (#487) Reference: https://lists.apache.org/thread/0lo21qcndbyq6nrtjmqxotsk58dwqcfp Add new committer to https://arrow.apache.org/committers/ page --- _data/committers.yml | 4 1 file changed, 4 insertions(+) diff --git a/_data/committers.yml b/_data/committers.yml index 2e2994c9a0f..5705ca33fa6 100644 --- a/_data/committers.yml +++ b/_data/committers.yml @@ -256,6 +256,10 @@ role: Committer alias: cutlerb affiliation: IBM +- name: Bryce Mecum + role: Committer + alias: brycemecum + affiliation: Voltron Data - name: Chao Sun role: Committer alias: sunchao
(arrow-site) branch add-bryce deleted (was ab6407103ec)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch add-bryce in repository https://gitbox.apache.org/repos/asf/arrow-site.git was ab6407103ec Update _data/committers.yml The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(arrow) branch main updated: GH-41327: [Ruby] Show type name in Arrow::Table#to_s (#41328)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new e559a28cc1 GH-41327: [Ruby] Show type name in Arrow::Table#to_s
(#41328)
e559a28cc1 is described below
commit e559a28cc19f87c2b1933bd2f7c9800ba290d5ab
Author: Sutou Kouhei
AuthorDate: Fri Apr 26 17:12:05 2024 +0900
GH-41327: [Ruby] Show type name in Arrow::Table#to_s (#41328)
### Rationale for this change
It's useful to detect type difference.
### What changes are included in this PR?
Add `:show_column_type` option to `Arrow::Table#to_s` and enables it by
default.
This is a backward incompatible change but this'll help users.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
Yes.
**This PR includes breaking changes to public APIs.**
* GitHub Issue: #41327
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
ruby/red-arrow/lib/arrow/field-containable.rb | 2 +-
ruby/red-arrow/lib/arrow/table-formatter.rb | 40 +-
ruby/red-arrow/lib/arrow/table-list-formatter.rb | 6 +-
ruby/red-arrow/lib/arrow/table-table-formatter.rb | 7 +
ruby/red-arrow/test/test-csv-loader.rb| 72 +--
ruby/red-arrow/test/test-group.rb | 13 +
ruby/red-arrow/test/test-schema.rb| 2 +-
ruby/red-arrow/test/test-slicer.rb| 345 +++---
ruby/red-arrow/test/test-struct-data-type.rb | 2 +-
ruby/red-arrow/test/test-table.rb | 535 --
10 files changed, 595 insertions(+), 429 deletions(-)
diff --git a/ruby/red-arrow/lib/arrow/field-containable.rb
b/ruby/red-arrow/lib/arrow/field-containable.rb
index e4dbf4ec26..103e901f5d 100644
--- a/ruby/red-arrow/lib/arrow/field-containable.rb
+++ b/ruby/red-arrow/lib/arrow/field-containable.rb
@@ -29,7 +29,7 @@ module Arrow
return nil if index < 0 or index >= n_fields
get_field(index)
else
-message = "field name or index must be String, Symbol or Integer"
+message = +"field name or index must be String, Symbol or Integer"
message << ": <#{name_or_index.inspect}>"
raise ArgumentError, message
end
diff --git a/ruby/red-arrow/lib/arrow/table-formatter.rb
b/ruby/red-arrow/lib/arrow/table-formatter.rb
index d039679f9a..b93faf09cb 100644
--- a/ruby/red-arrow/lib/arrow/table-formatter.rb
+++ b/ruby/red-arrow/lib/arrow/table-formatter.rb
@@ -24,7 +24,8 @@ module Arrow
attr_reader :head_values
attr_reader :tail_values
attr_reader :sample_values
- def initialize(column, head_values, tail_values)
+ def initialize(table_formatter, column, head_values, tail_values)
+@table_formatter = table_formatter
@column = column
@head_values = head_values
@tail_values = tail_values
@@ -36,6 +37,15 @@ module Arrow
@data_type ||= @column.data_type
end
+ def formatted_data_type_name
+@formatted_data_type_name ||= "(#{data_type.name})"
+ end
+
+ def aligned_data_type_name
+@aligned_data_type_name ||=
+ "%*s" % [aligned_name.size, formatted_data_type_name]
+ end
+
def name
@name ||= @column.name
end
@@ -63,7 +73,7 @@ module Arrow
formatted_value = format_value(value[field_name],
field_value_width)
"#{formatted_name}: #{formatted_value}"
end
- formatted = "{"
+ formatted = +"{"
formatted << formatted_values.join(", ")
formatted << "}"
"%-*s" % [width, formatted]
@@ -90,9 +100,16 @@ module Arrow
end
def format_aligned_name(name, data_type, sample_values)
+if @table_formatter.show_column_type?
+ min_width = formatted_data_type_name.size
+else
+ min_width = 0
+end
case data_type
when TimestampDataType
- "%*s" % [::Time.now.iso8601.size, name]
+ width = ::Time.now.iso8601.size
+ width = min_width if width < min_width
+ "%*s" % [width, name]
when IntegerDataType
have_null = false
have_negative = false
@@ -118,9 +135,12 @@ module Arrow
end
width += 1 if have_negative # Need "-"
width = [width, FORMATTED_NULL.size].max if have_null
+ width = min_width if width < min_width
"%*s" % [width, name]
when FloatDataType, DoubleDataType
- "%*s" % [FLOAT_N_DIGITS, name]
+ width = FLOAT_N_DIGITS
+
(arrow) branch main updated (e559a28cc1 -> 64be7a2d07)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from e559a28cc1 GH-41327: [Ruby] Show type name in Arrow::Table#to_s (#41328) add 64be7a2d07 GH-41333: [C++][CMake] Prefer protobuf-config.cmake to FindProtobuf.cmake (#41360) No new revisions were added by this update. Summary of changes: cpp/cmake_modules/FindProtobufAlt.cmake | 24 +--- 1 file changed, 17 insertions(+), 7 deletions(-)
(arrow) branch main updated (6578c3b360 -> 299eb26e8c)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 6578c3b360 GH-41370: [CI][MATLAB] MATLAB macOS CI workflow fails because of `macos-latest` change to `macos-14` (#41384) add 299eb26e8c GH-41369: [CI][GLib] Don't use /usr/local on macOS (#41387) No new revisions were added by this update. Summary of changes: .github/workflows/ruby.yml | 5 ++--- ci/scripts/c_glib_test.sh | 1 + ci/scripts/ruby_test.sh| 1 + 3 files changed, 4 insertions(+), 3 deletions(-)
(arrow) branch main updated: GH-41340: [C++][CMake][Windows] Remove needless .dll suffix from link libraries (#41341)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 32885c91a1 GH-41340: [C++][CMake][Windows] Remove needless .dll suffix
from link libraries (#41341)
32885c91a1 is described below
commit 32885c91a1c94f1c8530815f4d4b8fc068859de8
Author: Sutou Kouhei
AuthorDate: Thu Apr 25 11:10:25 2024 +0900
GH-41340: [C++][CMake][Windows] Remove needless .dll suffix from link
libraries (#41341)
### Rationale for this change
We should use `.lib` (import library) not `.dll` for linking. So `.dll` is
wrong. (But it seems working... Why...?)
### What changes are included in this PR?
Remove `.dll` from link libraries because CMake generates suitable link
options from library name automatically:
https://cmake.org/cmake/help/latest/command/target_link_libraries.html#command:target_link_libraries
> A plain library name: The generated link line will ask the linker to
search for the library (e.g. `foo` becomes `-lfoo` or `foo.lib`).
### Are these changes tested?
Yes.
### Are there any user-facing changes?
Yes.
* GitHub Issue: #41340
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
cpp/CMakeLists.txt | 2 +-
cpp/src/arrow/CMakeLists.txt | 8
2 files changed, 5 insertions(+), 5 deletions(-)
diff --git a/cpp/CMakeLists.txt b/cpp/CMakeLists.txt
index cc4df6d2fa..df83f56dd2 100644
--- a/cpp/CMakeLists.txt
+++ b/cpp/CMakeLists.txt
@@ -708,7 +708,7 @@ list(APPEND ARROW_TEST_LINK_LIBS ${ARROW_GTEST_GMOCK}
${ARROW_GTEST_GTEST_MAIN})
if(ARROW_BUILD_BENCHMARKS)
set(ARROW_BENCHMARK_LINK_LIBS benchmark::benchmark_main
${ARROW_TEST_LINK_LIBS})
if(WIN32)
-list(APPEND ARROW_BENCHMARK_LINK_LIBS Shlwapi.dll)
+list(APPEND ARROW_BENCHMARK_LINK_LIBS shlwapi)
endif()
endif()
diff --git a/cpp/src/arrow/CMakeLists.txt b/cpp/src/arrow/CMakeLists.txt
index 026bb5c77e..2ef82dd614 100644
--- a/cpp/src/arrow/CMakeLists.txt
+++ b/cpp/src/arrow/CMakeLists.txt
@@ -163,7 +163,7 @@ if(CMAKE_THREAD_LIBS_INIT)
endif()
if(WIN32)
- list(APPEND ARROW_SYSTEM_LINK_LIBS "ws2_32.dll")
+ list(APPEND ARROW_SYSTEM_LINK_LIBS "ws2_32")
endif()
if(NOT WIN32 AND NOT APPLE)
@@ -628,9 +628,9 @@ else()
list(APPEND ARROW_TESTING_STATIC_INSTALL_INTERFACE_LIBS ArrowTesting::gtest)
endif()
if(WIN32)
- list(APPEND ARROW_TESTING_SHARED_LINK_LIBS "ws2_32.dll")
- list(APPEND ARROW_TESTING_STATIC_LINK_LIBS "ws2_32.dll")
- list(APPEND ARROW_TESTING_STATIC_INSTALL_INTERFACE_LIBS "ws2_32.dll")
+ list(APPEND ARROW_TESTING_SHARED_LINK_LIBS "ws2_32")
+ list(APPEND ARROW_TESTING_STATIC_LINK_LIBS "ws2_32")
+ list(APPEND ARROW_TESTING_STATIC_INSTALL_INTERFACE_LIBS "ws2_32")
endif()
set(ARROW_TESTING_SRCS
(arrow-site) branch main updated (50b27395721 -> 346de0b90ab)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git from 50b27395721 [Website] Add `.htaccess` to redirect https://arrow.apache.org/datafusion to https://datafusion.apache.org/ (#505) add 346de0b90ab [Website] Copy .htaccess to deploy site (#506) No new revisions were added by this update. Summary of changes: .github/workflows/deploy.yml | 1 + 1 file changed, 1 insertion(+)
(arrow-site) branch main updated: [Website] Add `.htaccess` to redirect https://arrow.apache.org/datafusion to https://datafusion.apache.org/ (#505)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new 50b27395721 [Website] Add `.htaccess` to redirect https://arrow.apache.org/datafusion to https://datafusion.apache.org/ (#505) 50b27395721 is described below commit 50b273957212efdc79c3cbb57244140e3c146ee7 Author: Andrew Lamb AuthorDate: Wed Apr 24 20:15:31 2024 -0400 [Website] Add `.htaccess` to redirect https://arrow.apache.org/datafusion to https://datafusion.apache.org/ (#505) Closes https://github.com/apache/datafusion/issues/10194 Closes https://github.com/apache/arrow-site/pull/502 Per @kou 's suggestion in https://github.com/apache/arrow-site/pull/502#issuecomment-2073432866, this PR adds a `.htaccess` file with a redirect from all `www.apache.org/datafusion` urls to `datadfusion.apache.org` urls (I think) Documentaiton on these files is here: https://infra.apache.org/project-site.html I don't really know how to test this other than "in production" --- .htaccess | 17 + _includes/header.html | 2 +- 2 files changed, 18 insertions(+), 1 deletion(-) diff --git a/.htaccess b/.htaccess new file mode 100644 index 000..93964e17fe4 --- /dev/null +++ b/.htaccess @@ -0,0 +1,17 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to you under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +# redirect all datafusion URLs to new top level website +Redirect permanent /datafusion https://datafusion.apache.org diff --git a/_includes/header.html b/_includes/header.html index 65f8b5a7d40..6e5af04c89a 100644 --- a/_includes/header.html +++ b/_includes/header.html @@ -58,7 +58,7 @@ ADBC Arrow Flight Arrow Flight SQL -DataFusion +https://datafusion.apache.org;>DataFusion nanoarrow
(arrow-site) branch main updated: Remove .DS_Store (#504)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new 9729c0231ad Remove .DS_Store (#504) 9729c0231ad is described below commit 9729c0231ad611bd7d4ddf2d75a6524639c0f948 Author: Sutou Kouhei AuthorDate: Wed Apr 24 09:20:29 2024 +0900 Remove .DS_Store (#504) --- .DS_Store | Bin 6148 -> 0 bytes 1 file changed, 0 insertions(+), 0 deletions(-) diff --git a/.DS_Store b/.DS_Store deleted file mode 100644 index 940e942902c..000 Binary files a/.DS_Store and /dev/null differ
(arrow) branch main updated (67003f427e -> 80e1d7a85b)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 67003f427e MINOR: [C#] Bump K4os.Compression.LZ4.Streams and System.Runtime.CompilerServices.Unsafe in /csharp (#41216) add 80e1d7a85b GH-41314: [CI][Python] Add a job on ARM64 macOS (#41313) No new revisions were added by this update. Summary of changes: .github/workflows/python.yml | 14 +++--- ci/scripts/python_build.sh | 2 ++ 2 files changed, 13 insertions(+), 3 deletions(-)
(arrow-site) branch main updated: Update Build Instructions (#450)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new 379c024a6bf Update Build Instructions (#450) 379c024a6bf is described below commit 379c024a6bf40007f2d5d0147c97d65aabc9a4d0 Author: Benson Muite AuthorDate: Mon Apr 22 07:48:56 2024 +0300 Update Build Instructions (#450) Remove outdated instructions for building GLib. Refer to source repositories instead. --- README.md | 36 1 file changed, 36 deletions(-) diff --git a/README.md b/README.md index f207c8a3c2b..46946f9e015 100644 --- a/README.md +++ b/README.md @@ -100,42 +100,6 @@ to `_site/` locally by the following command line: JEKYLL_ENV=production bundle exec rake generate ``` -## Updating Code Documentation - -To update the documentation, you can run the script `./dev/gen_apidocs.sh` in -the `apache/arrow` repository. This script will run the code documentation -tools in a fixed environment. - -### C (GLib) - -First, build Apache Arrow C++ and Apache Arrow GLib. This assumes that you have checkouts your forks of `arrow` and `arrow-site` alongside each other in your file system. - -``` -mkdir -p ../cpp/build -cd ../cpp/build -cmake .. -DCMAKE_BUILD_TYPE=debug -make -cd ../../c_glib -./autogen.sh -./configure \ - --with-arrow-cpp-build-dir=$PWD/../cpp/build \ - --with-arrow-cpp-build-type=debug \ - --enable-gtk-doc -LD_LIBRARY_PATH=$PWD/../cpp/build/debug make GTK_DOC_V_XREF=": " -rsync -r doc/reference/html/ ../../arrow-site/asf-site/docs/c_glib/ -``` - -### JavaScript - -``` -cd ../js -npm run doc -rsync -r doc/ ../../arrow-site/asf-site/docs/js -``` - -Then add/commit/push from the `asf-site/` git checkout. - - ## Using Docker If you don't wish to change or install `ruby` and `nodejs` locally, you can use docker to build and preview the site with a command like:
(arrow) branch main updated (16e20b712a -> 25bb627519)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 16e20b712a MINOR: [Release] Update .deb/.rpm changelogs for 16.0.0 add 25bb627519 GH-41095: [C++][FS][Azure] Add support for CopyFile with hierarchical namespace support (#41276) No new revisions were added by this update. Summary of changes: cpp/src/arrow/filesystem/azurefs.cc | 44 ++--- cpp/src/arrow/filesystem/azurefs.h | 8 +++ 2 files changed, 44 insertions(+), 8 deletions(-)
(arrow-site) branch main updated: [Website] Add release note for 16.0.0 (#498)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow-site.git The following commit(s) were added to refs/heads/main by this push: new db1e1f36ec3 [Website] Add release note for 16.0.0 (#498) db1e1f36ec3 is described below commit db1e1f36ec321c419bd8ccc80fb672d0c5b55b1b Author: Raúl Cumplido AuthorDate: Sat Apr 20 23:09:30 2024 +0200 [Website] Add release note for 16.0.0 (#498) --- _data/versions.yml | 28 _release/16.0.0.md | 207 + _release/index.md | 190 3 files changed, 317 insertions(+), 108 deletions(-) diff --git a/_data/versions.yml b/_data/versions.yml index 0b1fe377994..303c8fd1a36 100644 --- a/_data/versions.yml +++ b/_data/versions.yml @@ -16,17 +16,17 @@ # Database of the current version # current: - number: '15.0.2' - pinned_number: '15.0.*' - major_number: '15' - date: 2024-03-18 - git-tag: 'e03105efc38edca4ca429bf967a17b4d0fbebe40' - github-tag-link: 'https://github.com/apache/arrow/releases/tag/apache-arrow-15.0.2' - release-notes: 'https://arrow.apache.org/release/15.0.2.html' - mirrors: 'https://www.apache.org/dyn/closer.lua/arrow/arrow-15.0.2/' - tarball-name: 'apache-arrow-15.0.2.tar.gz' - tarball-url: 'https://www.apache.org/dyn/closer.lua?action=download=arrow/arrow-15.0.2/apache-arrow-15.0.2.tar.gz' - java-artifacts: 'https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.arrow%22%20AND%20v%3A%2215.0.2%22' - asc: 'https://downloads.apache.org/arrow/arrow-15.0.2/apache-arrow-15.0.2.tar.gz.asc' - sha256: 'https://downloads.apache.org/arrow/arrow-15.0.2/apache-arrow-15.0.2.tar.gz.sha256' - sha512: 'https://downloads.apache.org/arrow/arrow-15.0.2/apache-arrow-15.0.2.tar.gz.sha512' + number: '16.0.0' + pinned_number: '16.0.*' + major_number: '16' + date: 2024-04-20 + git-tag: '6a28035c2b49b432dc63f5ee7524d76b4ed2d762' + github-tag-link: 'https://github.com/apache/arrow/releases/tag/apache-arrow-16.0.0' + release-notes: 'https://arrow.apache.org/release/16.0.0.html' + mirrors: 'https://www.apache.org/dyn/closer.lua/arrow/arrow-16.0.0/' + tarball-name: 'apache-arrow-16.0.0.tar.gz' + tarball-url: 'https://www.apache.org/dyn/closer.lua?action=download=arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz' + java-artifacts: 'https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.arrow%22%20AND%20v%3A%2216.0.0%22' + asc: 'https://downloads.apache.org/arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz.asc' + sha256: 'https://downloads.apache.org/arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz.sha256' + sha512: 'https://downloads.apache.org/arrow/arrow-16.0.0/apache-arrow-16.0.0.tar.gz.sha512' diff --git a/_release/16.0.0.md b/_release/16.0.0.md new file mode 100644 index 000..39eafe72324 --- /dev/null +++ b/_release/16.0.0.md @@ -0,0 +1,207 @@ +--- +layout: default +title: Apache Arrow 16.0.0 Release +permalink: /release/16.0.0.html +--- + + +# Apache Arrow 16.0.0 (20 April 2024) + +This is a major release covering more than 1 months of development. + +## Download + +* [**Source Artifacts**][1] +* **Binary Artifacts** + * [For AlmaLinux][2] + * [For Amazon Linux][3] + * [For CentOS][4] + * [For C#][5] + * [For Debian][6] + * [For Python][7] + * [For Ubuntu][8] +* [Git tag][9] + +## Contributors + +This release includes 587 commits from 119 distinct contributors. + +```console +$ git shortlog -sn apache-arrow-15.0.2..apache-arrow-16.0.0 +79 dependabot[bot] +70 Sutou Kouhei +41 Antoine Pitrou +31 Joris Van den Bossche +28 Raúl Cumplido +24 Alenka Frim +19 mwish +14 Felipe Oliveira Carvalho +13 Jacob Wujciak-Jens +12 Dewey Dunnington +11 Dane Pitkin +10 Bryce Mecum +10 Matt Topol + 9 Jonathan Keane + 9 ZhangHuiGui + 8 Vibhatha Lakmal Abeykoon + 7 Rossi Sun + 6 Adam Reeve + 6 David Li + 6 Hyunseok Seo + 6 James Henderson + 6 Thomas Newton + 6 david dali susanibar arce + 5 Dominik Moritz + 5 Laurent Goujon + 5 Weston Pace + 4 Curt Hagenlocher + 4 Divyansh200102 + 4 Gang Wu + 4 Ian Cook + 4 James Duong + 4 abandy + 3 Benjamin Kietzman + 3 Jin Shang + 3 Joel Lubinitsky + 3 Judah Rand + 3 Nic Crane + 3 Rok Mihevc + 3 Rossi(Ruoxi) Sun + 3 Vyas Ramasubramani + 3 Xiansen Chen + 2 Anja Kefala + 2 Gabriel Tomitsuka + 2 Josh Soref + 2 LucasG0 + 2 Marcus D. Hanwell + 2 Michał Górny + 2 Neal Richardson + 2 Paul + 2 Sten Larsson + 2 Zhen Wang + 2 emkornfield + 2 wayne + 1 0x + 1 Adam Curtis + 1 Alex Shcherbakov + 1 Alexander Blazhkov + 1 Ali Khalili + 1 Andrew Grosser + 1 Andrew Lamb + 1 Austin Dickey + 1 Chun Yang + 1 Clay Johnson + 1 Clif Houck + 1 David
(arrow) branch main updated (e80254480b -> 144c5ef0cd)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from e80254480b GH-41247: [Release] Use LC_ALL in binary upload scripts (#41248) add 144c5ef0cd GH-41243: [Release][Packaging] Avoid needless download by "archery crossbow download-artifacts" (#41244) No new revisions were added by this update. Summary of changes: dev/archery/archery/crossbow/cli.py | 12 +++- 1 file changed, 11 insertions(+), 1 deletion(-)
(arrow) branch main updated (be5f5b8f8f -> e80254480b)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from be5f5b8f8f GH-39722: [JS] Clean up packaging (#39723) add e80254480b GH-41247: [Release] Use LC_ALL in binary upload scripts (#41248) No new revisions were added by this update. Summary of changes: dev/release/05-binary-upload.sh | 11 +-- dev/release/binary/runner.sh| 11 +-- 2 files changed, 2 insertions(+), 20 deletions(-)
(arrow) branch main updated (c3fd79f16e -> d49b62d9c4)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from c3fd79f16e GH-41240: [Release][Packaging] Use Debian bookworm for uploading binaries (#41241) add d49b62d9c4 GH-41238: [Release] Use UTF-8 as the default encoding to upload binary (#41242) No new revisions were added by this update. Summary of changes: dev/release/05-binary-upload.sh | 13 +++-- dev/release/binary/runner.sh| 12 +++- 2 files changed, 22 insertions(+), 3 deletions(-)
(arrow) branch main updated: GH-41240: [Release][Packaging] Use Debian bookworm for uploading binaries (#41241)
This is an automated email from the ASF dual-hosted git repository. kou pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git The following commit(s) were added to refs/heads/main by this push: new c3fd79f16e GH-41240: [Release][Packaging] Use Debian bookworm for uploading binaries (#41241) c3fd79f16e is described below commit c3fd79f16e4e580ab4277ec70c3e2fe7b922bbd2 Author: Sutou Kouhei AuthorDate: Wed Apr 17 11:56:42 2024 +0900 GH-41240: [Release][Packaging] Use Debian bookworm for uploading binaries (#41241) ### Rationale for this change Debian bullseye will reach EOL on 2024-07: https://wiki.debian.org/DebianReleases ### What changes are included in this PR? Use bookworm instead. ### Are these changes tested? Yes. I used this for 16.0.0 RC0. ### Are there any user-facing changes? No. * GitHub Issue: #41240 Authored-by: Sutou Kouhei Signed-off-by: Sutou Kouhei --- dev/release/binary/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/dev/release/binary/Dockerfile b/dev/release/binary/Dockerfile index a21b32dd76..bef042fb42 100644 --- a/dev/release/binary/Dockerfile +++ b/dev/release/binary/Dockerfile @@ -15,7 +15,7 @@ # specific language governing permissions and limitations # under the License. -FROM debian:bullseye +FROM debian:bookworm ENV DEBIAN_FRONTEND noninteractive
(arrow) branch main updated (7d19b832b3 -> 61dde71333)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 7d19b832b3 MINOR: [Go] Bump github.com/klauspost/compress from 1.17.7 to 1.17.8 in /go (#41207) add 61dde71333 MINOR: [Go] Bump modernc.org/sqlite from 1.29.5 to 1.29.6 in /go (#41208) No new revisions were added by this update. Summary of changes: go/go.mod | 2 +- go/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
(arrow) branch main updated (12eb5a7d2c -> 7d19b832b3)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 12eb5a7d2c MINOR: [Go] Bump google.golang.org/grpc from 1.62.1 to 1.63.2 in /go (#41103) add 7d19b832b3 MINOR: [Go] Bump github.com/klauspost/compress from 1.17.7 to 1.17.8 in /go (#41207) No new revisions were added by this update. Summary of changes: go/go.mod | 2 +- go/go.sum | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
(arrow) branch main updated (7d184485ae -> 12eb5a7d2c)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 7d184485ae GH-39131: [JS] Add at() for array like types (#40730) add 12eb5a7d2c MINOR: [Go] Bump google.golang.org/grpc from 1.62.1 to 1.63.2 in /go (#41103) No new revisions were added by this update. Summary of changes: go/go.mod | 5 ++--- go/go.sum | 17 ++--- 2 files changed, 8 insertions(+), 14 deletions(-)
(arrow) branch main updated: GH-41227: [CI][Release][GLib][Conda] Unpin gobject-introspection (#41228)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 23bece4e48 GH-41227: [CI][Release][GLib][Conda] Unpin
gobject-introspection (#41228)
23bece4e48 is described below
commit 23bece4e4840758795f12db75ec919f91f21f006
Author: Sutou Kouhei
AuthorDate: Tue Apr 16 13:50:00 2024 +0900
GH-41227: [CI][Release][GLib][Conda] Unpin gobject-introspection (#41228)
### Rationale for this change
Upstream problem https://github.com/conda-forge/glib-feedstock/pull/174 has
been fixed.
### What changes are included in this PR?
Revert pinning.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41227
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
dev/release/verify-release-candidate.sh | 4 +---
1 file changed, 1 insertion(+), 3 deletions(-)
diff --git a/dev/release/verify-release-candidate.sh
b/dev/release/verify-release-candidate.sh
index cf49751e6e..f18b18aaa9 100755
--- a/dev/release/verify-release-candidate.sh
+++ b/dev/release/verify-release-candidate.sh
@@ -831,9 +831,7 @@ test_glib() {
show_header "Build and test C GLib libraries"
# Build and test C GLib
- # We can unpin gobject-introspection after
- # https://github.com/conda-forge/glib-feedstock/pull/174 is merged.
- maybe_setup_conda glib gobject-introspection=1.78.1 meson ninja ruby
+ maybe_setup_conda glib gobject-introspection meson ninja ruby
maybe_setup_virtualenv meson
# Install bundler if doesn't exist
(arrow) branch main updated (09272bf68d -> 2979d69a05)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 09272bf68d GH-41167: [CI][Release][GLib][Conda] Pin gobject-introspection to 1.78.1 (#41181) add 2979d69a05 GH-41176: [C++] Stop defining ARROW_TEST_MEMCHECK in config.h.cmake (#41177) No new revisions were added by this update. Summary of changes: cpp/src/arrow/filesystem/test_util.cc | 3 +-- cpp/src/arrow/util/config.h.cmake | 1 - 2 files changed, 1 insertion(+), 3 deletions(-)
(arrow) branch main updated (5bdc5415f6 -> 09272bf68d)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 5bdc5415f6 GH-41169: [CI][Release] Specify --build-config explicitly on Windows (#41178) add 09272bf68d GH-41167: [CI][Release][GLib][Conda] Pin gobject-introspection to 1.78.1 (#41181) No new revisions were added by this update. Summary of changes: dev/release/verify-release-candidate.sh | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
(arrow) branch main updated (ec2d7cbfb4 -> 5bdc5415f6)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from ec2d7cbfb4 GH-41159: [Go][Parquet] Improvement Parquet BitWriter WriteVlqInt Performance (#41160) add 5bdc5415f6 GH-41169: [CI][Release] Specify --build-config explicitly on Windows (#41178) No new revisions were added by this update. Summary of changes: dev/release/verify-release-candidate.bat | 5 - 1 file changed, 4 insertions(+), 1 deletion(-)
(arrow) branch main updated (0affccc85b -> 92c49481cc)
This is an automated email from the ASF dual-hosted git repository. kou pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/arrow.git from 0affccc85b GH-40968: [C++][Gandiva] add RE2::Options set_dot_nl(true) for Like function (#40970) add 92c49481cc GH-41124: [CI][C++] Don't use CMake 3.29.1 with vcpkg (#41151) No new revisions were added by this update. Summary of changes: ci/scripts/install_cmake.sh | 29 ++--- dev/tasks/macros.jinja| 6 -- dev/tasks/python-wheels/github.osx.yml| 8 dev/tasks/vcpkg-tests/cpp-build-vcpkg.bat | 3 ++- dev/tasks/vcpkg-tests/github.windows.yml | 23 ++- 5 files changed, 50 insertions(+), 19 deletions(-)
(arrow) branch main updated: GH-40968: [C++][Gandiva] add RE2::Options set_dot_nl(true) for Like function (#40970)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 0affccc85b GH-40968: [C++][Gandiva] add RE2::Options set_dot_nl(true)
for Like function (#40970)
0affccc85b is described below
commit 0affccc85b663d60345657f3c708c4298adaf0ea
Author: Ivan Chesnov
AuthorDate: Fri Apr 12 08:14:16 2024 +0300
GH-40968: [C++][Gandiva] add RE2::Options set_dot_nl(true) for Like
function (#40970)
### Rationale for this change
Gandiva function "LIKE" does not always work correctly when the string
contains \n.
String value:
`[function_name: "Space1.protect"\nargs: "passenger_count"\ncolumn_name:
"passenger_count" ]`
Pattern '%Space1%' nor '%Space1.%' do not match.
### What changes are included in this PR?
added flag set_dot_nl(true) to LikeHolder
### Are these changes tested?
add unit tests.
### Are there any user-facing changes?
Yes
**This PR includes breaking changes to public APIs.**
* GitHub Issue: #40968
Lead-authored-by: Ivan Chesnov
Co-authored-by: Ivan Chesnov
Signed-off-by: Sutou Kouhei
---
cpp/src/gandiva/regex_functions_holder.cc | 14 +++
cpp/src/gandiva/regex_functions_holder.h | 3 ++-
cpp/src/gandiva/regex_functions_holder_test.cc | 33 --
3 files changed, 37 insertions(+), 13 deletions(-)
diff --git a/cpp/src/gandiva/regex_functions_holder.cc
b/cpp/src/gandiva/regex_functions_holder.cc
index 03a4af90d8..ef07a9ef0b 100644
--- a/cpp/src/gandiva/regex_functions_holder.cc
+++ b/cpp/src/gandiva/regex_functions_holder.cc
@@ -99,13 +99,14 @@ Result> LikeHolder::Make(const
FunctionNode& node) {
"'like' function requires a string literal as the second
parameter"));
RE2::Options regex_op;
+ regex_op.set_dot_nl(true); // set dotall mode for the regex.
if (node.descriptor()->name() == "ilike") {
regex_op.set_case_sensitive(false); // set case-insensitive for ilike
function.
return Make(std::get(literal->holder()), regex_op);
}
if (node.children().size() == 2) {
-return Make(std::get(literal->holder()));
+return Make(std::get(literal->holder()), regex_op);
} else {
auto escape_char = dynamic_cast(node.children().at(2).get());
ARROW_RETURN_IF(
@@ -118,7 +119,7 @@ Result> LikeHolder::Make(const
FunctionNode& node) {
Status::Invalid(
"'like' function requires a string literal as the third
parameter"));
return Make(std::get(literal->holder()),
-std::get(escape_char->holder()));
+std::get(escape_char->holder()), regex_op);
}
}
@@ -126,7 +127,9 @@ Result> LikeHolder::Make(const
std::string& sql_patt
std::string pcre_pattern;
ARROW_RETURN_NOT_OK(RegexUtil::SqlLikePatternToPcre(sql_pattern,
pcre_pattern));
- auto lholder = std::shared_ptr(new LikeHolder(pcre_pattern));
+ RE2::Options regex_op;
+ regex_op.set_dot_nl(true); // set dotall mode for the regex.
+ auto lholder = std::shared_ptr(new LikeHolder(pcre_pattern,
regex_op));
ARROW_RETURN_IF(!lholder->regex_.ok(),
Status::Invalid("Building RE2 pattern '", pcre_pattern,
"' failed with: ", lholder->regex_.error()));
@@ -135,7 +138,8 @@ Result> LikeHolder::Make(const
std::string& sql_patt
}
Result> LikeHolder::Make(const std::string&
sql_pattern,
- const std::string&
escape_char) {
+ const std::string&
escape_char,
+ RE2::Options regex_op) {
ARROW_RETURN_IF(escape_char.length() > 1,
Status::Invalid("The length of escape char ", escape_char,
" in 'like' function is greater than 1"));
@@ -147,7 +151,7 @@ Result> LikeHolder::Make(const
std::string& sql_patt
ARROW_RETURN_NOT_OK(RegexUtil::SqlLikePatternToPcre(sql_pattern,
pcre_pattern));
}
- auto lholder = std::shared_ptr(new LikeHolder(pcre_pattern));
+ auto lholder = std::shared_ptr(new LikeHolder(pcre_pattern,
regex_op));
ARROW_RETURN_IF(!lholder->regex_.ok(),
Status::Invalid("Building RE2 pattern '", pcre_pattern,
"' failed with: ", lholder->regex_.error()));
diff --git a/cpp/src/gandiva/regex_functions_holder.h
b/cpp/src/gandiva/regex_functions_holder.h
index 36d942510b..354c2b53d9 100644
--- a/cpp/src/gandiva/regex_functions_holder.h
+++ b/cpp/src/gandiv
(arrow) branch main updated: GH-41004: [C++][FS][Azure] Don't run TestGetFileInfoGenerator() with Valgrind (#41163)
This is an automated email from the ASF dual-hosted git repository.
kou pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/arrow.git
The following commit(s) were added to refs/heads/main by this push:
new 6e8ac43081 GH-41004: [C++][FS][Azure] Don't run
TestGetFileInfoGenerator() with Valgrind (#41163)
6e8ac43081 is described below
commit 6e8ac430816b84d295ddf89709c4b42e558b2f7e
Author: Sutou Kouhei
AuthorDate: Fri Apr 12 11:37:32 2024 +0900
GH-41004: [C++][FS][Azure] Don't run TestGetFileInfoGenerator() with
Valgrind (#41163)
### Rationale for this change
`GetFileInfo()` with generator reports false positive memory leak in Azure
SDK for C++.
### What changes are included in this PR?
Don't run `TestGetFileInfoGenerator()` with Valgrind.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
No.
* GitHub Issue: #41004
Authored-by: Sutou Kouhei
Signed-off-by: Sutou Kouhei
---
cpp/src/arrow/filesystem/test_util.cc | 3 ++-
cpp/src/arrow/util/config.h.cmake | 1 +
2 files changed, 3 insertions(+), 1 deletion(-)
diff --git a/cpp/src/arrow/filesystem/test_util.cc
b/cpp/src/arrow/filesystem/test_util.cc
index 19226ce01a..accb7a47ab 100644
--- a/cpp/src/arrow/filesystem/test_util.cc
+++ b/cpp/src/arrow/filesystem/test_util.cc
@@ -33,6 +33,7 @@
#include "arrow/testing/future_util.h"
#include "arrow/testing/gtest_util.h"
#include "arrow/util/async_generator.h"
+#include "arrow/util/config.h"
#include "arrow/util/io_util.h"
#include "arrow/util/key_value_metadata.h"
#include "arrow/util/vector.h"
@@ -752,7 +753,7 @@ void
GenericFileSystemTest::TestGetFileInfoSelector(FileSystem* fs) {
}
void GenericFileSystemTest::TestGetFileInfoGenerator(FileSystem* fs) {
-#ifdef ADDRESS_SANITIZER
+#if defined(ADDRESS_SANITIZER) || defined(ARROW_TEST_MEMCHECK)
if (have_false_positive_memory_leak_with_generator()) {
GTEST_SKIP() << "Filesystem have false positive memory leak with
generator";
}
diff --git a/cpp/src/arrow/util/config.h.cmake
b/cpp/src/arrow/util/config.h.cmake
index 9fbd685084..5ab10c5c49 100644
--- a/cpp/src/arrow/util/config.h.cmake
+++ b/cpp/src/arrow/util/config.h.cmake
@@ -57,6 +57,7 @@
#cmakedefine ARROW_GCS
#cmakedefine ARROW_HDFS
#cmakedefine ARROW_S3
+#cmakedefine ARROW_TEST_MEMCHECK
#cmakedefine ARROW_USE_GLOG
#cmakedefine ARROW_USE_NATIVE_INT128
#cmakedefine ARROW_WITH_BROTLI
