Re: [VOTE] Migration of parquet-cpp issues to Arrow's issue tracker

2024-05-29 Thread Fokko Driesprong
+1 (non-binding) Op wo 29 mei 2024 om 16:46 schreef Felipe Oliveira Carvalho < felipe...@gmail.com>: > +1 (non-binding) > > On Wed, 29 May 2024 at 11:30 Micah Kornfield > wrote: > > > +1 (non-binding for Parquet, Binding for Arrow if that makes a > difference) > > > > > > > > On Wed, May 29,

Re: [DISCUSS] Migration of parquet-cpp issues to GitHub

2024-05-29 Thread Fokko Driesprong
Hey Rok, Thanks for bringing this up. I'm also very much in favor of Github. Once we've migrated cpp, I think migrating the other repositories is a great idea. Let me know if I can help! Kind regards, Fokko Op wo 29 mei 2024 om 16:03 schreef Rok Mihevc : > On Wed, May 29, 2024 at 3:22 AM Gang

Re: [DISCUSS] Drop Java 8 support

2024-05-17 Thread Fokko Driesprong
I was traveling the last few weeks, so just a follow-up from my end. Fokko, can you elaborate on the discussions held in other OSS projects to > drop Java <17? How did they weigh the benefits/drawbacks for dropping both > Java 8 and 11 LTS versions? I'd also be curious if other projects plan to >

Re: [VOTE][Format] UUID canonical extension type

2024-04-29 Thread Fokko Driesprong
+1 (non-binding) First of all, thanks Rok for working on this  I raised the mentioned issue on GitHub back in December 2022 and I still believe it would be a good addition to the spec. In Iceberg UUIDs are encoded using big endian. For example, the UUID: f79c3e09-677c-4bbd-a479-3f349cb785e7 is

Re: [DISCUSS] Drop Java 8 support

2024-04-25 Thread Fokko Driesprong
Hey Dane, Thanks for bringing this up again. In the dev-list thread you referred to I hesitated to drop Java <17, but it is time. We see several projects that are moving past Java 8, and in the process are also dropping Java 11 since it is not supported anymore

Re: [parquet][Iceberg] Should hive partition keys appear as corresponding columns in the file

2023-11-29 Thread Fokko Driesprong
Hey Haocheng, The partitioning in Iceberg is logical, instead of physical. The directory structure (/dt=2021-03-01/) is there just for convenience, but Iceberg does not rely on the actual directory structure. The partition information is stored in the metadata layer (manifests and manifest list).

Re: [Java][Discuss]: consensus for JDK 8 deprecation

2023-10-11 Thread Fokko Driesprong
r to do backporting to older versions, and for me, I still think the gains of dropping Java 8 support are not that big. Kind regards, Fokko Driesprong Op wo 11 okt 2023 om 06:05 schreef Jacob Wujciak-Jens : > > I cannot estimate the effort to backport large features like the new > layout

Re: [Python][Discuss] PyArrow Dataset as a Python protocol

2023-07-03 Thread Fokko Driesprong
Hey everyone, Chiming in here from the PyIceberg side. I would love to see the protocol as proposed in the PR. I did a small test , and it seems to be quite straightforward to implement and it brings a lot of potential.

[jira] [Created] (ARROW-7688) Bump checkstyle from 8.18 to 8.29

2020-01-27 Thread Fokko Driesprong (Jira)
Fokko Driesprong created ARROW-7688: --- Summary: Bump checkstyle from 8.18 to 8.29 Key: ARROW-7688 URL: https://issues.apache.org/jira/browse/ARROW-7688 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-7572) Enfore Maven 3.3+ as mentioned in README

2020-01-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created ARROW-7572: --- Summary: Enfore Maven 3.3+ as mentioned in README Key: ARROW-7572 URL: https://issues.apache.org/jira/browse/ARROW-7572 Project: Apache Arrow Issue

[jira] [Created] (ARROW-7571) Correct minimal java version on README

2020-01-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created ARROW-7571: --- Summary: Correct minimal java version on README Key: ARROW-7571 URL: https://issues.apache.org/jira/browse/ARROW-7571 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-7570) Fix high severity issues

2020-01-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created ARROW-7570: --- Summary: Fix high severity issues Key: ARROW-7570 URL: https://issues.apache.org/jira/browse/ARROW-7570 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-7568) Bump Apache Avro from 1.9.0 to 1.9.1

2020-01-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created ARROW-7568: --- Summary: Bump Apache Avro from 1.9.0 to 1.9.1 Key: ARROW-7568 URL: https://issues.apache.org/jira/browse/ARROW-7568 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-7567) Bump Checkstyle from 6.19 to 8.18

2020-01-14 Thread Fokko Driesprong (Jira)
Fokko Driesprong created ARROW-7567: --- Summary: Bump Checkstyle from 6.19 to 8.18 Key: ARROW-7567 URL: https://issues.apache.org/jira/browse/ARROW-7567 Project: Apache Arrow Issue Type