Re: Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-04 Thread Wayne Xia
+1, verified on my M1 Mac.

Thanks!

On Thu, Jan 5, 2023 at 10:38 AM Kun Liu  wrote:

> +1 (binding)
>
> verified on my Intel Mac
>
> Thanks
>
> Andy Grove  于2023年1月5日周四 08:07写道:
>
> > +1 (binding)
> >
> > Verified on Ubuntu 20.04.4 LTS
> >
> > Thanks, Raphael.
> >
> > On Wed, Jan 4, 2023 at 1:39 PM L. C. Hsieh  wrote:
> >
> > > +1 (binding)
> > >
> > > Verified on M1 Mac.
> > >
> > > The two added patches look good to me.
> > >
> > > Thanks Raphael.
> > >
> > > On Wed, Jan 4, 2023 at 12:31 PM Andrew Lamb 
> > wrote:
> > > >
> > > > +1 (binding)
> > > >
> > > > Thank you Raphael.
> > > >
> > > > I reviewed the individual commits (below) that make up this release
> > > > carefully as well as running the verification script  as follows:
> > > >
> > > > ./dev/release/verify-release-candidate.sh 30.0.1 2
> > > >
> > > > Andrew
> > > >
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/commit/1423afd250634319f5a1f10b71d68f4ce306019c
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/commit/adf70d1b371d0a6364f9139aa1258858841eb99d
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/commit/0093dcf288c5f8e8dece3f8ab538ec1f31c79157
> > > >
> > >
> >
> https://github.com/apache/arrow-rs/commit/4ad6ad6e8ce47259797961c1950b1179a0f72467
> > > >
> > > >
> > > > On Wed, Jan 4, 2023 at 2:58 PM Raphael Taylor-Davies
> > > >  wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > We encountered some issues with the 30.0.0 Arrow Rust Release [5]
> and
> > > so
> > > > > I would like to propose a patch release of 30.0.1 containing two
> > > > > cherry-picked fixes
> > > > >
> > > > > - https://github.com/apache/arrow-rs/pull/3451
> > > > > - https://github.com/apache/arrow-rs/pull/3452
> > > > >
> > > > > This release candidate is based on commit:
> > > > > 4ad6ad6e8ce47259797961c1950b1179a0f72467 [1]
> > > > >
> > > > > The proposed release tarball and signatures are hosted at [2].
> > > > >
> > > > > The changelog is located at [3].
> > > > >
> > > > > Please download, verify checksums and signatures, run the unit
> tests,
> > > > > and vote on the release. There is a script [4] that automates some
> of
> > > > > the verification.
> > > > >
> > > > > The vote will be open for at least 72 hours.
> > > > >
> > > > > [ ] +1 Release this as Apache Arrow Rust
> > > > > [ ] +0
> > > > > [ ] -1 Do not release this as Apache Arrow Rust  because...
> > > > >
> > > > > [1]:
> > > > >
> > > > >
> > >
> >
> https://github.com/apache/arrow-rs/tree/4ad6ad6e8ce47259797961c1950b1179a0f72467
> > > > > [2]:
> > > > >
> > >
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-30.0.1-rc2
> > > > > [3]:
> > > > >
> > > > >
> > >
> >
> https://github.com/apache/arrow-rs/blob/4ad6ad6e8ce47259797961c1950b1179a0f72467/CHANGELOG.md
> > > > > [4]:
> > > > >
> > > > >
> > >
> >
> https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> > > > > [5]: https://github.com/apache/arrow-rs/issues/3455
> > > > >
> > > > > -
> > > > >
> > > > >
> > >
> >
>


Re: Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-04 Thread Kun Liu
+1 (binding)

verified on my Intel Mac

Thanks

Andy Grove  于2023年1月5日周四 08:07写道:

> +1 (binding)
>
> Verified on Ubuntu 20.04.4 LTS
>
> Thanks, Raphael.
>
> On Wed, Jan 4, 2023 at 1:39 PM L. C. Hsieh  wrote:
>
> > +1 (binding)
> >
> > Verified on M1 Mac.
> >
> > The two added patches look good to me.
> >
> > Thanks Raphael.
> >
> > On Wed, Jan 4, 2023 at 12:31 PM Andrew Lamb 
> wrote:
> > >
> > > +1 (binding)
> > >
> > > Thank you Raphael.
> > >
> > > I reviewed the individual commits (below) that make up this release
> > > carefully as well as running the verification script  as follows:
> > >
> > > ./dev/release/verify-release-candidate.sh 30.0.1 2
> > >
> > > Andrew
> > >
> > >
> >
> https://github.com/apache/arrow-rs/commit/1423afd250634319f5a1f10b71d68f4ce306019c
> > >
> >
> https://github.com/apache/arrow-rs/commit/adf70d1b371d0a6364f9139aa1258858841eb99d
> > >
> >
> https://github.com/apache/arrow-rs/commit/0093dcf288c5f8e8dece3f8ab538ec1f31c79157
> > >
> >
> https://github.com/apache/arrow-rs/commit/4ad6ad6e8ce47259797961c1950b1179a0f72467
> > >
> > >
> > > On Wed, Jan 4, 2023 at 2:58 PM Raphael Taylor-Davies
> > >  wrote:
> > >
> > > > Hi,
> > > >
> > > > We encountered some issues with the 30.0.0 Arrow Rust Release [5] and
> > so
> > > > I would like to propose a patch release of 30.0.1 containing two
> > > > cherry-picked fixes
> > > >
> > > > - https://github.com/apache/arrow-rs/pull/3451
> > > > - https://github.com/apache/arrow-rs/pull/3452
> > > >
> > > > This release candidate is based on commit:
> > > > 4ad6ad6e8ce47259797961c1950b1179a0f72467 [1]
> > > >
> > > > The proposed release tarball and signatures are hosted at [2].
> > > >
> > > > The changelog is located at [3].
> > > >
> > > > Please download, verify checksums and signatures, run the unit tests,
> > > > and vote on the release. There is a script [4] that automates some of
> > > > the verification.
> > > >
> > > > The vote will be open for at least 72 hours.
> > > >
> > > > [ ] +1 Release this as Apache Arrow Rust
> > > > [ ] +0
> > > > [ ] -1 Do not release this as Apache Arrow Rust  because...
> > > >
> > > > [1]:
> > > >
> > > >
> >
> https://github.com/apache/arrow-rs/tree/4ad6ad6e8ce47259797961c1950b1179a0f72467
> > > > [2]:
> > > >
> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-30.0.1-rc2
> > > > [3]:
> > > >
> > > >
> >
> https://github.com/apache/arrow-rs/blob/4ad6ad6e8ce47259797961c1950b1179a0f72467/CHANGELOG.md
> > > > [4]:
> > > >
> > > >
> >
> https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> > > > [5]: https://github.com/apache/arrow-rs/issues/3455
> > > >
> > > > -
> > > >
> > > >
> >
>


Re: Apache Arrow Board Report, by Jan 11 2023

2023-01-04 Thread Andrew Lamb
Thank you Jacob and Matthew -- the level of detail in your suggestions
looks just about perfect. ‍♂️

On Wed, Jan 4, 2023 at 12:20 PM Jacob Quinn  wrote:

> I added a few notes on the Julia implementation.
>
> -Jacob
>
> On Tue, Dec 27, 2022 at 2:45 PM Andrew Lamb  wrote:
>
>> Hello Arrow Community,
>>
>> One of the (possibly the only) responsibilities of the PMC chair is to
>> collect information on the project and submit quarterly updates to the ASF
>> board. The next one is due on January 11, 2023
>>
>> Historically[1], Arrow has crowd sourced the content and I plan to
>> continue the tradition.
>>
>> Please feel free to add your comments directly to [2] or reply to this
>> email and I will incorporate your comments.
>>
>> I think it would be especially interesting if anyone from the following
>> implementation communities wanted to provide any updates:
>>
>> ### C++
>> ### C#
>> ### Go
>> ### Java
>> ### JavaScript
>> ### Julia
>> ### Rust
>> ### C (Glib)
>> ### MATLAB
>> ### Python
>> ### R
>> ### Ruby
>>
>> Thank you,
>> ANdrew
>>
>>
>> [1] https://lists.apache.org/thread/w7lwr7t979oqsqb8qz4smtg9wmj9f48s
>> [2]
>> https://docs.google.com/document/d/12ybofzyB8FGlsWV6IxefAUqRDgxFR-Kk53kPk7LuKDY/edit?usp=sharing
>>
>>


Re: Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-04 Thread Andy Grove
+1 (binding)

Verified on Ubuntu 20.04.4 LTS

Thanks, Raphael.

On Wed, Jan 4, 2023 at 1:39 PM L. C. Hsieh  wrote:

> +1 (binding)
>
> Verified on M1 Mac.
>
> The two added patches look good to me.
>
> Thanks Raphael.
>
> On Wed, Jan 4, 2023 at 12:31 PM Andrew Lamb  wrote:
> >
> > +1 (binding)
> >
> > Thank you Raphael.
> >
> > I reviewed the individual commits (below) that make up this release
> > carefully as well as running the verification script  as follows:
> >
> > ./dev/release/verify-release-candidate.sh 30.0.1 2
> >
> > Andrew
> >
> >
> https://github.com/apache/arrow-rs/commit/1423afd250634319f5a1f10b71d68f4ce306019c
> >
> https://github.com/apache/arrow-rs/commit/adf70d1b371d0a6364f9139aa1258858841eb99d
> >
> https://github.com/apache/arrow-rs/commit/0093dcf288c5f8e8dece3f8ab538ec1f31c79157
> >
> https://github.com/apache/arrow-rs/commit/4ad6ad6e8ce47259797961c1950b1179a0f72467
> >
> >
> > On Wed, Jan 4, 2023 at 2:58 PM Raphael Taylor-Davies
> >  wrote:
> >
> > > Hi,
> > >
> > > We encountered some issues with the 30.0.0 Arrow Rust Release [5] and
> so
> > > I would like to propose a patch release of 30.0.1 containing two
> > > cherry-picked fixes
> > >
> > > - https://github.com/apache/arrow-rs/pull/3451
> > > - https://github.com/apache/arrow-rs/pull/3452
> > >
> > > This release candidate is based on commit:
> > > 4ad6ad6e8ce47259797961c1950b1179a0f72467 [1]
> > >
> > > The proposed release tarball and signatures are hosted at [2].
> > >
> > > The changelog is located at [3].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. There is a script [4] that automates some of
> > > the verification.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow Rust
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow Rust  because...
> > >
> > > [1]:
> > >
> > >
> https://github.com/apache/arrow-rs/tree/4ad6ad6e8ce47259797961c1950b1179a0f72467
> > > [2]:
> > >
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-30.0.1-rc2
> > > [3]:
> > >
> > >
> https://github.com/apache/arrow-rs/blob/4ad6ad6e8ce47259797961c1950b1179a0f72467/CHANGELOG.md
> > > [4]:
> > >
> > >
> https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> > > [5]: https://github.com/apache/arrow-rs/issues/3455
> > >
> > > -
> > >
> > >
>


Re: Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-04 Thread L. C. Hsieh
+1 (binding)

Verified on M1 Mac.

The two added patches look good to me.

Thanks Raphael.

On Wed, Jan 4, 2023 at 12:31 PM Andrew Lamb  wrote:
>
> +1 (binding)
>
> Thank you Raphael.
>
> I reviewed the individual commits (below) that make up this release
> carefully as well as running the verification script  as follows:
>
> ./dev/release/verify-release-candidate.sh 30.0.1 2
>
> Andrew
>
> https://github.com/apache/arrow-rs/commit/1423afd250634319f5a1f10b71d68f4ce306019c
> https://github.com/apache/arrow-rs/commit/adf70d1b371d0a6364f9139aa1258858841eb99d
> https://github.com/apache/arrow-rs/commit/0093dcf288c5f8e8dece3f8ab538ec1f31c79157
> https://github.com/apache/arrow-rs/commit/4ad6ad6e8ce47259797961c1950b1179a0f72467
>
>
> On Wed, Jan 4, 2023 at 2:58 PM Raphael Taylor-Davies
>  wrote:
>
> > Hi,
> >
> > We encountered some issues with the 30.0.0 Arrow Rust Release [5] and so
> > I would like to propose a patch release of 30.0.1 containing two
> > cherry-picked fixes
> >
> > - https://github.com/apache/arrow-rs/pull/3451
> > - https://github.com/apache/arrow-rs/pull/3452
> >
> > This release candidate is based on commit:
> > 4ad6ad6e8ce47259797961c1950b1179a0f72467 [1]
> >
> > The proposed release tarball and signatures are hosted at [2].
> >
> > The changelog is located at [3].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. There is a script [4] that automates some of
> > the verification.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow Rust
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow Rust  because...
> >
> > [1]:
> >
> > https://github.com/apache/arrow-rs/tree/4ad6ad6e8ce47259797961c1950b1179a0f72467
> > [2]:
> > https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-30.0.1-rc2
> > [3]:
> >
> > https://github.com/apache/arrow-rs/blob/4ad6ad6e8ce47259797961c1950b1179a0f72467/CHANGELOG.md
> > [4]:
> >
> > https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> > [5]: https://github.com/apache/arrow-rs/issues/3455
> >
> > -
> >
> >


Re: Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-04 Thread Andrew Lamb
+1 (binding)

Thank you Raphael.

I reviewed the individual commits (below) that make up this release
carefully as well as running the verification script  as follows:

./dev/release/verify-release-candidate.sh 30.0.1 2

Andrew

https://github.com/apache/arrow-rs/commit/1423afd250634319f5a1f10b71d68f4ce306019c
https://github.com/apache/arrow-rs/commit/adf70d1b371d0a6364f9139aa1258858841eb99d
https://github.com/apache/arrow-rs/commit/0093dcf288c5f8e8dece3f8ab538ec1f31c79157
https://github.com/apache/arrow-rs/commit/4ad6ad6e8ce47259797961c1950b1179a0f72467


On Wed, Jan 4, 2023 at 2:58 PM Raphael Taylor-Davies
 wrote:

> Hi,
>
> We encountered some issues with the 30.0.0 Arrow Rust Release [5] and so
> I would like to propose a patch release of 30.0.1 containing two
> cherry-picked fixes
>
> - https://github.com/apache/arrow-rs/pull/3451
> - https://github.com/apache/arrow-rs/pull/3452
>
> This release candidate is based on commit:
> 4ad6ad6e8ce47259797961c1950b1179a0f72467 [1]
>
> The proposed release tarball and signatures are hosted at [2].
>
> The changelog is located at [3].
>
> Please download, verify checksums and signatures, run the unit tests,
> and vote on the release. There is a script [4] that automates some of
> the verification.
>
> The vote will be open for at least 72 hours.
>
> [ ] +1 Release this as Apache Arrow Rust
> [ ] +0
> [ ] -1 Do not release this as Apache Arrow Rust  because...
>
> [1]:
>
> https://github.com/apache/arrow-rs/tree/4ad6ad6e8ce47259797961c1950b1179a0f72467
> [2]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-30.0.1-rc2
> [3]:
>
> https://github.com/apache/arrow-rs/blob/4ad6ad6e8ce47259797961c1950b1179a0f72467/CHANGELOG.md
> [4]:
>
> https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh
> [5]: https://github.com/apache/arrow-rs/issues/3455
>
> -
>
>


Subject: [VOTE][RUST] Release Apache Arrow Rust 30.0.1 RC2

2023-01-04 Thread Raphael Taylor-Davies

Hi,

We encountered some issues with the 30.0.0 Arrow Rust Release [5] and so 
I would like to propose a patch release of 30.0.1 containing two 
cherry-picked fixes


- https://github.com/apache/arrow-rs/pull/3451
- https://github.com/apache/arrow-rs/pull/3452

This release candidate is based on commit: 
4ad6ad6e8ce47259797961c1950b1179a0f72467 [1]


The proposed release tarball and signatures are hosted at [2].

The changelog is located at [3].

Please download, verify checksums and signatures, run the unit tests,
and vote on the release. There is a script [4] that automates some of
the verification.

The vote will be open for at least 72 hours.

[ ] +1 Release this as Apache Arrow Rust
[ ] +0
[ ] -1 Do not release this as Apache Arrow Rust  because...

[1]: 
https://github.com/apache/arrow-rs/tree/4ad6ad6e8ce47259797961c1950b1179a0f72467

[2]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-rs-30.0.1-rc2
[3]: 
https://github.com/apache/arrow-rs/blob/4ad6ad6e8ce47259797961c1950b1179a0f72467/CHANGELOG.md
[4]: 
https://github.com/apache/arrow-rs/blob/master/dev/release/verify-release-candidate.sh

[5]: https://github.com/apache/arrow-rs/issues/3455

-



Re: Apache Arrow Board Report, by Jan 11 2023

2023-01-04 Thread Matthew Topol
I added some comments and updates for the Go module. I didn't know how
specific or detailed to get, so let me know if I should elaborate more on
it or something.

--Matt

On Tue, Dec 27, 2022 at 4:45 PM Andrew Lamb  wrote:

> Hello Arrow Community,
>
> One of the (possibly the only) responsibilities of the PMC chair is to
> collect information on the project and submit quarterly updates to the ASF
> board. The next one is due on January 11, 2023
>
> Historically[1], Arrow has crowd sourced the content and I plan to
> continue the tradition.
>
> Please feel free to add your comments directly to [2] or reply to this
> email and I will incorporate your comments.
>
> I think it would be especially interesting if anyone from the following
> implementation communities wanted to provide any updates:
>
> ### C++
> ### C#
> ### Go
> ### Java
> ### JavaScript
> ### Julia
> ### Rust
> ### C (Glib)
> ### MATLAB
> ### Python
> ### R
> ### Ruby
>
> Thank you,
> ANdrew
>
>
> [1] https://lists.apache.org/thread/w7lwr7t979oqsqb8qz4smtg9wmj9f48s
> [2]
> https://docs.google.com/document/d/12ybofzyB8FGlsWV6IxefAUqRDgxFR-Kk53kPk7LuKDY/edit?usp=sharing
>
>


[QUESTION][Parquet][Decimal] Why not implement the INT32/INT64 to store Decimal logical type in parquet file

2023-01-04 Thread Kun Liu
Hi all,
   In the PR https://github.com/apache/arrow-rs/pull/3431, I want to write
decimal data with lower precision to INT32/INT64 in the parquet file.

   The document of arrow c++ about  Reading and writing Parquet files
 requires
`(2) On the write side, a FIXED_LENGTH_BYTE_ARRAY is always emitted.`

   But in the definition of parquet format

for
logical type of decimal, the decimal type can be represented by INT32/INT64
for the lower precision.

   Why we not follow the definition of parquet

for
writing the parquet file?

Thanks
Kun