Script 'mail_helper' called by obssrc Hello community, here is the log from the commit of package apache-arrow for openSUSE:Factory checked in at 2024-01-16 21:38:38 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Comparing /work/SRC/openSUSE:Factory/apache-arrow (Old) and /work/SRC/openSUSE:Factory/.apache-arrow.new.9992 (New) ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
Package is "apache-arrow" Tue Jan 16 21:38:38 2024 rev:8 rq:1139093 version:14.0.2 Changes: -------- --- /work/SRC/openSUSE:Factory/apache-arrow/apache-arrow.changes 2024-01-12 23:46:35.761165590 +0100 +++ /work/SRC/openSUSE:Factory/.apache-arrow.new.9992/apache-arrow.changes 2024-01-16 21:38:45.502166222 +0100 @@ -1,0 +2,25 @@ +Mon Jan 15 20:38:45 UTC 2024 - Ben Greiner <c...@bnavigator.de> + +- Update to 14.0.2 + ## New Features and Improvements + * GH-38449 - [Release][Go][macOS] Use local test data if possible + (#38450) + * GH-38591 - [Parquet][C++] Remove redundant open calls in + ParquetFileFormat::GetReaderAsync (#38621) + ## Bug Fixes + * GH-38345 - [Release] Use local test data for verification if + possible (#38362) + * GH-38438 - [C++] Dataset: Trying to fix the async bug in + Parquet dataset (#38466) + * GH-38577 - Reading parquet file behavior change from 13.0.0 to + 14.0.0 + * GH-38618 - [C++] S3FileSystem: fix regression in deleting + explicitly created sub-directories (#38845) + * GH-38861 - [C++] Add missing â-framework Securityâ to + Libs.private in arrow.pc (#38869) + * GH-39072 - [Release][CI] Python3.11-devel is required for the + verification job on AlmaLinux 8 (#39073) + * GH-39074 - [Release][Packaging] Use UTF-8 explicitly for KEYS + (#39082) + +------------------------------------------------------------------- Old: ---- apache-arrow-14.0.1.tar.gz arrow-testing-14.0.1.tar.gz parquet-testing-14.0.1.tar.gz New: ---- apache-arrow-14.0.2.tar.gz arrow-testing-14.0.2.tar.gz parquet-testing-14.0.2.tar.gz ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Other differences: ------------------ ++++++ apache-arrow.spec ++++++ --- /var/tmp/diff_new_pack.38Zvms/_old 2024-01-16 21:38:47.434236661 +0100 +++ /var/tmp/diff_new_pack.38Zvms/_new 2024-01-16 21:38:47.438236807 +0100 @@ -24,14 +24,15 @@ # See git submodule /testing pointing to the correct revision %define arrow_testing_commit 47f7b56b25683202c1fd957668e13f2abafc0f12 # See git submodule /cpp/submodules/parquet-testing pointing to the correct revision -%define parquet_testing_commit e45cd23f784aab3d6bf0701f8f4e621469ed3be7 +%define parquet_testing_commit b2e7cc755159196e3a068c8594f7acbaecfdaaac Name: apache-arrow -Version: 14.0.1 +Version: 14.0.2 Release: 0 Summary: A development platform for in-memory data License: Apache-2.0 AND BSD-3-Clause AND BSD-2-Clause AND MIT Group: Development/Tools/Other URL: https://arrow.apache.org/ +# SourceRepository: https://github.com/apache/arrow Source0: https://github.com/apache/arrow/archive/apache-arrow-%{version}.tar.gz Source1: https://github.com/apache/arrow-testing/archive/%{arrow_testing_commit}.tar.gz#/arrow-testing-%{version}.tar.gz Source2: https://github.com/apache/parquet-testing/archive/%{parquet_testing_commit}.tar.gz#/parquet-testing-%{version}.tar.gz ++++++ apache-arrow-14.0.1.tar.gz -> apache-arrow-14.0.2.tar.gz ++++++ /work/SRC/openSUSE:Factory/apache-arrow/apache-arrow-14.0.1.tar.gz /work/SRC/openSUSE:Factory/.apache-arrow.new.9992/apache-arrow-14.0.2.tar.gz differ: char 14, line 1 ++++++ arrow-testing-14.0.1.tar.gz -> arrow-testing-14.0.2.tar.gz ++++++ ++++ no output (probably identical) ++++++ parquet-testing-14.0.1.tar.gz -> parquet-testing-14.0.2.tar.gz ++++++ diff -urN '--exclude=CVS' '--exclude=.cvsignore' '--exclude=.svn' '--exclude=.svnignore' old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/README.md new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/README.md --- old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/README.md 2023-09-25 18:06:41.000000000 +0200 +++ new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/README.md 2023-03-06 12:29:32.000000000 +0100 @@ -44,7 +44,6 @@ | rle-dict-snappy-checksum.parquet | compressed and dictionary-encoded INT32 and STRING columns in format v2 with a matching CRC | | plain-dict-uncompressed-checksum.parquet | uncompressed and dictionary-encoded INT32 and STRING columns in format v1 with a matching CRC | | rle-dict-uncompressed-corrupt-checksum.parquet | uncompressed and dictionary-encoded INT32 and STRING columns in format v2 with a mismatching CRC | -| large_string_map.brotli.parquet | MAP(STRING, INT32) with a string column chunk of more than 2GB. See [note](#large-string-map) below | TODO: Document what each file is in the table above. @@ -57,15 +56,14 @@ https://github.com/apache/parquet-format/blob/encryption/Encryption.md ``` -Following are the keys and key ids (when using key\_retriever) used to encrypt -the encrypted columns and footer in all the encrypted files: +Following are the keys and key ids (when using key\_retriever) used to encrypt the encrypted columns and footer in the all the encrypted files: * Encrypted/Signed Footer: * key: {0,1,2,3,4,5,6,7,8,9,0,1,2,3,4,5} * key_id: "kf" -* Encrypted column named double_field (including column and offset index): +* Encrypted column named double_field: * key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,0} * key_id: "kc1" -* Encrypted column named float_field (including column and offset index): +* Encrypted column named float_field: * key: {1,2,3,4,5,6,7,8,9,0,1,2,3,4,5,1} * key_id: "kc2" @@ -74,11 +72,10 @@ 2. encrypt\_columns\_and\_footer\_aad.parquet.encrypted -A sample that reads and checks these files can be found at the following tests -in Parquet C++: +A sample that reads and checks these files can be found at the following tests: ``` -cpp/src/parquet/encryption/read-configurations-test.cc -cpp/src/parquet/encryption/test-encryption-util.h +cpp/src/parquet/encryption-read-configurations-test.cc +cpp/src/parquet/test-encryption-util.h ``` The `external_key_material_java.parquet.encrypted` file was encrypted using parquet-mr with @@ -205,21 +202,3 @@ # total_compressed_size: 84 # total_uncompressed_size: 80 ``` - -## Large string map - -The file `large_string_map.brotli.parquet` was generated with: -```python -import pyarrow as pa -import pyarrow.parquet as pq - -arr = pa.array([[("a" * 2**30, 1)]], type = pa.map_(pa.string(), pa.int32())) -arr = pa.chunked_array([arr, arr]) -tab = pa.table({ "arr": arr }) - -pq.write_table(tab, "test.parquet", compression='BROTLI') -``` - -It is meant to exercise reading of structured data where each value -is smaller than 2GB but the combined uncompressed column chunk size -is greater than 2GB. Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/encrypt_columns_and_footer.parquet.encrypted and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/encrypt_columns_and_footer.parquet.encrypted differ Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/encrypt_columns_and_footer_aad.parquet.encrypted and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/encrypt_columns_and_footer_aad.parquet.encrypted differ Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/encrypt_columns_and_footer_ctr.parquet.encrypted and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/encrypt_columns_and_footer_ctr.parquet.encrypted differ Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/encrypt_columns_and_footer_disable_aad_storage.parquet.encrypted differ Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/encrypt_columns_plaintext_footer.parquet.encrypted and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/encrypt_columns_plaintext_footer.parquet.encrypted differ Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/large_string_map.brotli.parquet and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/large_string_map.brotli.parquet differ Binary files old/parquet-testing-e45cd23f784aab3d6bf0701f8f4e621469ed3be7/data/uniform_encryption.parquet.encrypted and new/parquet-testing-b2e7cc755159196e3a068c8594f7acbaecfdaaac/data/uniform_encryption.parquet.encrypted differ
