Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread Shiyan Xu
Great news. Congratulations! On Fri, May 22, 2020 at 5:40 PM wangxianghu wrote: > congratulations,great job! > > 发自我的iPhone > > > 在 2020年5月23日,05:59,Sivabalan 写道: > > > > Congrats :) Kudos to Vinoth and the community :) > > > > > >> On Fri, May 22, 2020 at 5:57 PM Mehrotra, Udit > > >>

[DISCUSS] Write failed records

2020-05-22 Thread Shiyan Xu
Hi all, I'd like to bring up this discussion around handling errors in Hudi write paths. https://issues.apache.org/jira/browse/HUDI-648 Trying to gather some feedbacks about the implementation details 1. Error location I'm thinking of writing the failed records to `.hoodie/errors/` for a)

Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread wangxianghu
congratulations,great job! 发自我的iPhone > 在 2020年5月23日,05:59,Sivabalan 写道: > > Congrats :) Kudos to Vinoth and the community :) > > >> On Fri, May 22, 2020 at 5:57 PM Mehrotra, Udit >> wrote: >> >> Congrats Vinoth and to this amazing community on a major milestone ! >> >> On 5/22/20,

Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread Sivabalan
Congrats :) Kudos to Vinoth and the community :) On Fri, May 22, 2020 at 5:57 PM Mehrotra, Udit wrote: > Congrats Vinoth and to this amazing community on a major milestone ! > > On 5/22/20, 10:11 AM, "Pratyaksh Sharma" wrote: > > CAUTION: This email originated from outside of the

Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread Mehrotra, Udit
Congrats Vinoth and to this amazing community on a major milestone ! On 5/22/20, 10:11 AM, "Pratyaksh Sharma" wrote: CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you can confirm the sender and know the content is safe.

Re: Merge on Read table is recreating affected parquet file on every write

2020-05-22 Thread Vinoth Chandar
Hi, Sorry, this slipped through the cracks. By default, the compaction policy would run every 10 delta commits or so. https://hudi.apache.org/docs/configurations.html#withMaxNumDeltaCommitsBeforeCompaction >>but in addition to new log file, i also see that corresponding parquet file is also

Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread Pratyaksh Sharma
That is a great news! Congratulations to the entire community. :) On Fri, May 22, 2020 at 10:03 PM Gary Li wrote: > Huge congrats to the Hudi community! Great job! > > On Fri, May 22, 2020 at 9:30 AM Vinoth Chandar wrote: > > > Folks, I am very happy share that the graduation resolution has

Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread Gary Li
Huge congrats to the Hudi community! Great job! On Fri, May 22, 2020 at 9:30 AM Vinoth Chandar wrote: > Folks, I am very happy share that the graduation resolution has been > approved by the Apache board! > Congratulations everyone! :) > > More to come, as we prepare to exit the incubator. Stay

Re: Apache Hudi Graduation vote on general@incubator

2020-05-22 Thread Vinoth Chandar
Folks, I am very happy share that the graduation resolution has been approved by the Apache board! Congratulations everyone! :) More to come, as we prepare to exit the incubator. Stay tuned!! On Tue, May 19, 2020 at 7:33 PM Balaji Varadarajan wrote: > Terrific job :) We are marching on !! >

Re: Subscribing to commits@

2020-05-22 Thread Pratyaksh Sharma
Yeah, I have also subscribed. On Fri, May 22, 2020 at 1:07 AM Lamber Ken wrote: > thanks, very useful to me. > > +1 recommended it to anyone. > > On 2020/02/28 01:00:36, Vinoth Chandar wrote: > > Folks, > > > > Realized some folks may not have noticed this. But > >

Re: hudi dependency conflicts for test

2020-05-22 Thread Lian Jiang
The root cause is that I need to use java 8 instead of the default java 11 in intellij. Thanks everyone for helping and cheers! On Thu, May 21, 2020 at 1:09 PM Lian Jiang wrote: > The examples in quick start work for me in spark-shell. I am trying to use > scala unit test to make these examples