Re: What precombine field really is used for and its future?

2023-04-05 Thread Daniel Kaźmirski
ote: > > > >> Hi Daniel, > >> > >> Thanks for the detailed write-up. > >> > >> I can’t add much to the discussion, other than noting we also recently > ran > >> into the related oddity that we don’t need to define a precombine when >

What precombine field really is used for and its future?

2023-03-31 Thread Daniel Kaźmirski
sible from the design and developer perspective. Best Regards, Daniel Kaźmirski

Schema evolution strategies

2023-03-31 Thread Daniel Kaźmirski
chema on read evolution rules and introduce a new config: hoodie.schema.evolution.strategy: merge [1] or enforce [2] That being said it can be a good idea to preserve reconcile.schema config just for out-of-the box schema evolution scenarios and to preserve behavior. Best Regards, Daniel Kaźmirski

Re: [DISCUSS] Build tool upgrade

2023-02-13 Thread Daniel Kaźmirski
package -DskipTests -Dspark3.3 -Dscala-2.12 [INFO] BUILD SUCCESS [INFO] [INFO] Total time: 3.485 s If anyone would like to try it out: https://github.com/apache/hudi/pull/7935 BR, Daniel pt., 10 lut 2023 o 16:59 Daniel Kaźmirski

Re: [DISCUSS] Build tool upgrade

2023-02-10 Thread Daniel Kaźmirski
t; > > > > > > > Best, > > > > Danny Chan > > > > > > > > Shiyan Xu 于2022年10月1日周六 13:48写道: > > > > > > > > > > Hi all, > > > > > > > > > > I'd like to raise a discussion around the build tool for Hudi. > > > > > > > > > > Maven has been a mature yet slow (10min to build on 2021 macbook > pro) > > > > build > > > > > tool compared to modern ones like gradle or bazel. We all want > faster > > > > > builds, however, we also need to consider the efforts and risks to > > > > upgrade, > > > > > and the developers' feedback on usability. > > > > > > > > > > What do you all think about upgrading to gradle or bazel? Please > > share > > > > your > > > > > thoughts. Thanks. > > > > > > > > > > -- > > > > > Best, > > > > > Shiyan > > > > > > > > > > > > -- > Best, > Shiyan > -- Daniel Kaźmirski

Re: [VOTE] Release 0.13.0, release candidate #1

2023-01-30 Thread Daniel Kaźmirski
> [3] https://dist.apache.org/repos/dist/dev/hudi/KEYS > [4] https://repository.apache.org/content/repositories/orgapachehudi-1110/ > [5] https://github.com/apache/hudi/releases/tag/release-0.13.0-rc1 > -- Daniel Kaźmirski

Apply for contributor permission

2022-06-21 Thread Daniel Kaźmirski
Hi, I would like to contribute to Hudi, could You please grant contributor permission for me? Jira username: kazdy Best Regards, Daniel Kaźmirski

Spark structured streaming and Spark SQL improvements

2022-04-25 Thread Daniel Kaźmirski
. In case of missing columns, reconcile schema functionality can be used. Best Regards, Daniel Kaźmirski