Re: [Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY

2024-01-08 Thread wish maple
+1 Best, Xuwei Fu Gang Wu 于2024年1月9日周二 10:58写道: > +1 > > > What should be the way forward? Should I submit a format update > and then one or two implementations thereof? > > Based on my observation of recent format changes, it usually follows > the steps below: > (1) A PR for a format change.

Re: [Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY

2024-01-08 Thread Gang Wu
+1 > What should be the way forward? Should I submit a format update and then one or two implementations thereof? Based on my observation of recent format changes, it usually follows the steps below: (1) A PR for a format change. (2) Two PRs of PoC implementation for feature and

Re: [Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY

2024-01-08 Thread Martin Loncaric
+1 that this is beneficial, especially for 16 bit floats On Mon, Jan 8, 2024, 11:56 Antoine Pitrou wrote: > > Hello all, > > Based on the response received, it seems this addition is > non-controversial and generally considered beneficial. > > What should be the way forward? Should I submit a

Re: [Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY

2024-01-08 Thread Antoine Pitrou
Hello all, Based on the response received, it seems this addition is non-controversial and generally considered beneficial. What should be the way forward? Should I submit a format update and then one or two implementations thereof? Regards Antoine. On Sun, 7 Jan 2024 23:40:11 -0800 Micah

Re: [Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY

2024-01-07 Thread Micah Kornfield
I responded there but generally, this doesn't seem like it imposes a lot of implementation burden and can be useful. On Thu, Dec 14, 2023 at 12:59 PM Antoine Pitrou wrote: > > Hello, > > Just a heads up here so as to reach a wider audience: I've posted a > format addition proposal in >

[Format] Expand BYTE_STREAM_SPLIT to support FIXED_LEN_BYTE_ARRAY

2023-12-14 Thread Antoine Pitrou
Hello, Just a heads up here so as to reach a wider audience: I've posted a format addition proposal in https://issues.apache.org/jira/browse/PARQUET-2414 Excerpt: """ This issue proposed to widen the types supported by the BYTE_STREAM_SPLIT. By allowing the BYTE_STREAM_SPLIT on any