Contributing to Apache Hudi

2019-08-13 Thread leesf
Hi, I want to contribute to Apache Calcite. Would you please give me the contributor permission? My JIRA ID is xleesf.

Re: Contributing to Apache Hudi

2019-08-13 Thread leesf
Hi, I want to contribute to Apache Hudi. Would you please give me the contributor permission? My JIRA ID is xleesf. leesf 于2019年8月13日周二 下午9:42写道: > Hi, > > I want to contribute to Apache Calcite. > Would you please give me the contributor permission? > My JIRA ID is xleesf. >

Re: Dropping support for Spark 2.2 and lower

2019-09-10 Thread leesf
+1 Y. Ethan Guo 于2019年9月11日周三 上午3:06写道: > +1 we’re on Spark 2.4. > > On Tue, Sep 10, 2019 at 11:22 AM Minh Pham wrote: > > > +1 we are also on 2.3 and want to move to 2.4 > > > > Sent from my iPhone > > > > > On Sep 10, 2019, at 4:22 AM, taher koitawala > wrote: > > > > > > +1 we can drop

Re: ApacheCon NA 19 slides

2019-09-11 Thread leesf
Also, for easy access by others, we can link the talk and slides to Talk & Presentations on this page( https://hudi.apache.org/powered_by.html ) Best Leesf leesf 于2019年9月11日周三 下午6:21写道: > The slides are very detailed and can help others know better about hudi. > Thanks for sharing

Re: ApacheCon NA 19 slides

2019-09-11 Thread leesf
The slides are very detailed and can help others know better about hudi. Thanks for sharing! Best Leesf taher koitawala 于2019年9月11日周三 下午3:26写道: > Hi Vinoth, > Slides look amazing to me. However, shouldn't we give out > some more clarity on Hoodie Index, Compactions and

Re: [VOTE] Release 0.5.0-incubating, release candidate #1

2019-09-14 Thread leesf
+1 (non-binding) - verified checksums and signatures - OK - checked that all pom.xml files point to the same version(0.5.0-incubating-rc1) - OK - built from source(mvn clean install -DskipTests) - OK - ran some tests in IDE - OK Best, Leesf vbal...@apache.org 于2019年9月14日周六 上午6:32写道: >

Re: [VOTE] Release 0.5.0-incubating, release candidate #2

2019-09-17 Thread leesf
+1 (non-binding) - verified checksums and signatures - OK - checked that all pom.xml files point to the same version(0.5.0-incubating-rc2) - OK - built from source(mvn clean install -DskipTests) - OK - ran some tests in IDE - OK Best, Leesf Bhavani Sudha Saktheeswaran 于2019年9月18日周三 下午12:14写道

Re: [PROPOSAL] Hudi Web UI

2019-09-22 Thread leesf
+ 1 to this valuable HIP. And I am also very interested, perhaps together to implement this HIP. Best, Leesf Taher Koitawala 于2019年9月22日周日 下午2:09写道: > Guys it not only includes tables views and admin kind of views(Compactions) > but it also includes 'Metadata lineage' which can help user

Re: [DISCUSS] Intent to RFC: Restructuring and auto-generation of docs

2019-11-13 Thread leesf
+1. It is very practical and thanks for driving the discussion. vinoth and balaji would give your cwiki permission. Best, Leesf vino yang 于2019年11月13日周三 下午5:02写道: > Hi Ethan, > > Thanks for starting this discussion thread. > +1 from my side > > Best, > Vino > > Y Et

Re: [DISCUSS] Simplification of terminologies

2019-11-12 Thread leesf
version parquet file. Best, Leesf Balaji Varadarajan 于2019年11月12日周二 下午3:55写道: > Agree with all 3 changes. The naming now looks more consistent than > earlier. +1 on them > > Depending on whether we are renaming Input formats for (1) and (2) - this > could require some

Re: [DISCUSS] New RFC? Hudi dataset snapshotter

2019-11-12 Thread leesf
+1. and we would discuss it further when design docs are available. Best, Leesf Balaji Varadarajan 于2019年11月12日周二 下午4:17写道: > +1 on the exporter tool idea. > > On Mon, Nov 11, 2019 at 10:36 PM vino yang wrote: > > > Hi Shiyan, > > > > +1 for this proposal, Also,

Re: EMR + HUDI

2019-11-15 Thread leesf
Great news! Thanks Udit and everyone who make it possible. Best, Leesf Sivabalan 于2019年11月16日周六 上午5:17写道: > Great job! Way to go. > > On Fri, Nov 15, 2019 at 11:50 AM Mehrotra, Udit > > wrote: > > > Yes, Hudi is finally officially supported application on AWS EMR. Th

Re: [DISCUSS] Hide Github issues tab and Unified management of issues in JIRA

2019-11-15 Thread leesf
more expensive to maintain two entries. Open to hearing other thoughts. Best, Leesf [1] https://github.com/apache/incubator-hudi/issues/1017 Vinoth Chandar 于2019年11月15日周五 下午8:28写道: > Hi Vino, > > To echo what Nishith was saying, issues is only being used currently for > support

Re: [Discuss] Convenient time for weekly sync meeting

2019-11-06 Thread leesf
Thanks Sudha. Interested. Tue - Thu, 8:30PM - 10:00PM PST Wed - Fri, 3:00AM - 4:30AM PST Y. Ethan Guo 于2019年11月7日周四 上午8:52写道: > I'm interested in attending each weekly meeting. My preferred times: > > Morning: Wed, Fri, 5AM - 7:30AM PT > Evening: Mon - Thu, 8PM - 11PM PT > > > On Wed, Nov 6,

Re: New Committer : bhavanisudha

2019-11-07 Thread leesf
Congrats Sudha. Best, Leesf Balaji Varadarajan 于2019年11月8日周五 上午7:10写道: > Hello Apache Hudi Community, > > The Podling Project Management Committee (PPMC) for Apache Hudi > (Incubating) has invited Bhavani Sudha Saktheeswaran to become a committer > and we are > pleased to ann

Re: [DISCUSS] Rework of new web site

2019-12-15 Thread leesf
Hi Lamber, Thanks for your work, have gone through the new web ui, looks good. Hence +1 from my side. Best, Leesf vino yang 于2019年12月16日周一 上午10:17写道: > Hi Lamber, > > I am not an expert on Jekyll. But big +1 for your proposal to improve the > site. > > Best, > Vino >

Re: [DISCUSS] Next Apache Release

2019-12-11 Thread leesf
meaningful to help the community as much as possible. Best, Leesf Balaji Varadarajan 于2019年12月12日周四 上午1:08写道: > Hello all, > > In the spirit of making Apache Hudi (incubating) releases at regular > cadence, we are starting this thread to kickstart the planning and > preparatory work f

Re: [ANNOUNCE] Apache Hudi (incubating) 0.5.0 released!

2019-10-27 Thread leesf
Thanks a lot for your work Balaji, and everyone that make this release possible. Great work! Best, Leesf Thomas Weise 于2019年10月26日周六 上午3:02写道: > Great to see this first release completed! Thanks Balaji and everyone who > contributed. > > -- > sent from mobile > > On Fri,

Re: [DISCUSS] Rename HIP process to RFC

2019-10-21 Thread leesf
+1 Best, Leesf 于2019年10月22日周二 上午3:40写道: > +1 > > Balaji.V On Monday, October 21, 2019, 11:38:01 AM PDT, Y. Ethan Guo > wrote: > > +1 on RFC. It's good to have a few pages of RFC to get a quick look of an > idea. It doesn't have to be a full standard like some

Re: [DISCUSS] Introduce stricter comment and code style validation rules

2019-11-18 Thread leesf
, Leesf Pratyaksh Sharma 于2019年11月18日周一 下午8:53写道: > Having proper class level and method level comments always makes the life > easier for any new user. > > +1 for points 1,2 and 4. > > On Mon, Nov 18, 2019 at 5:59 PM vino yang wrote: > > > Hi guys, > > >

Re: new committer: leesf/Shaofeng Li

2019-11-04 Thread leesf
Hi all, Thank you very much. Great honor and happy to be here. Best, Leesf Bhavani Sudha 于2019年11月3日周日 下午2:32写道: > @leesf congratulations :) > > On Sat, Nov 2, 2019 at 6:20 PM Y. Ethan Guo > wrote: > > > Congrats, @leesf, great to see this happening! > > > &g

Re: Difference between Apache Hudi and Delta Lake

2019-09-25 Thread leesf
Hi Gurudatt, Here are some docs[1][2] mentioned Hudi and Delta Lake, hope this helps. Best, Leesf [1] http://mail-archives.apache.org/mod_mbox/hudi-dev/201904.mbox/%3ccakw-+5s_ka5oovvm6s7wcnuv5pptl5w6ox_xm4tou1b2cqg...@mail.gmail.com%23E <http://mail-archives.apache.org/mod_mbox/hudi-

Re: [DISCUSS] cleaning up git history from Notice/License changes

2019-10-03 Thread leesf
+1 on cleanup. Best, Leesf Bhavani Sudha Saktheeswaran 于2019年10月4日周五 上午5:53写道: > +1 . Thats a good idea. > > > > On Thu, Oct 3, 2019 at 2:32 PM vbal...@apache.org > wrote: > > > > > +1 on both cleanup. This would keep the git history clean and consistent &g

Re: Re: IDE setup for code formatting

2019-12-23 Thread leesf
After bringing spotless plugin back to project, it would automatically fix comment check error except for import order error, we need to fix this error manually. In Apache Flink/Calcite, we also fix it manually, and will also look for other plugins to fix import order error if exist. Best, Leesf

[REMINDAR] Pick up jira tickets for next release

2019-12-17 Thread leesf
and appreciated to grab some of tickets if interested. If you have any other questions, please let me know. Thanks. Best, Leesf [1] https://issues.apache.org/jira/browse/HUDI-429?jql=project%20%3D%20HUDI%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened%2C%20%22Patch%20Available%22)%20AND

Re: Re: Re:Re: Re: Re:Re: Re: Re: [DISCUSS] Rework of new web site

2019-12-20 Thread leesf
Hi lamber, Thanks for your great work, the new website looks much better. Also if you guys have other companies(logos) needed to add to powered by(Hudi Users)[1], please let lamberken/me know before using new website. Best, Leesf [1] https://lamber-ken.github.io/ lamberken 于2019年12月20日周五 上午9

Re: Hudi/Impala

2020-02-11 Thread leesf
Great news, thanks gary. Bhavani Sudha 于2020年2月12日周三 上午8:36写道: > Really cool. Great work Gary! > > > > On Tue, Feb 11, 2020 at 4:26 PM Vinoth Chandar wrote: > > > Just sending along some good news. > > > > > > > https://github.com/apache/impala/commit/ea0e1def6160d596082b01365fcbbb6e24afb21d >

Re: [DISCUSS] Adding common errors and solutions to FAQs

2020-02-08 Thread leesf
Hi Sivabalan, Thanks for bringing up the discussion. +1 to add a section(would be Common errors and solutions) to FAQ. it will be more convenient to find and solve problems since they are summarized in FAQ page , also slack channel(#general) will be forwarded to ML as discussed. Sivabalan

Re: Updating COW Table

2020-02-25 Thread leesf
You would pass it via option, like option(DataSourceWriteOptions.PAYLOAD_CLASS_OPT_KEY(), EmptyHoodieRecordPayload.class.getName()) selvaraj periyasamy 于2020年2月26日周三 上午2:24写道: > OverwriteWithLatestAvroPayload is used for Delta Streamer. Is there a way > for DataSource Writer? > > please correct

Re: [ANNOUNCE] Code is frozen for next release(0.5.2)

2020-02-29 Thread leesf
+1 on the code freeze and cutting new branch. I would also like to help you if you encounter any issues. Balaji Varadarajan 于2020年3月1日周日 上午1:55写道: > > +1 on cutting the branch. > Vino, let us know in this thread if you run into any problems in the > release process. > Balaji. V > Sent from

[ANNOUNCE] Hudi Weekly Community Update(2020-02-23~20200301)

2020-03-01 Thread leesf
-625 [9] https://jira.apache.org/jira/browse/HUDI-636 Tests [Tests] Adding unit tests for PriorityBasedFileSystemView [10] [10] https://jira.apache.org/jira/browse/HUDI-618 Best, Leesf

Re: Test coverage is now integrated to codecov.io

2020-02-29 Thread leesf
Great job, thanks for your work. Sivabalan 于2020年2月29日周六 下午12:02写道: > Good job! thanks for adding. > > On Fri, Feb 28, 2020 at 5:41 PM vino yang wrote: > > > Hi Ram, > > > > Thanks for your great work to make the code coverage clear. > > > > Best, > > Vino > > > > Vinoth Chandar

[INFORM] Apache Hudi talk at Strata Data & AI Conference

2020-02-29 Thread leesf
hi all, I just noticed that balaji and vinoth will give a talk(Bring stream processing to batch data using Apache Hudi (incubating)) at Strata Data & AI Conference in Mar 15–18, you would attend if interested and checkout it out for more details

[RESULT] [VOTE] Apache Hudi (incubating) 0.5.1 RC1

2020-01-25 Thread leesf
I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 3 of which are binding: * Balaji Varadarajan (binding) * Vinoth Chandar (binding) * Suneel Marthi (binding) * Bhavani Sudha * Mehrotra, Udit * vino yang * leesf There are no disapproving votes

[ANNOUNCE] Hudi Weekly Community Update (2020-01-20 ~ 2020-01-27)

2020-01-26 Thread leesf
Dear community, Nice to share Hudi community weekly update for 2020-01-20 ~ 2020-01-27 with updates on development, features. The community is mainly focus on the releasing 0.5.1-incubating(including some docs update) this week. Development [Relase] Hudi 0.5.1-incubating RC1 has been cut and

Re: Datasource Writer Schema Evolution

2020-02-05 Thread leesf
quot;).load("/tmp/hudi/drivers/*")` to get schema merged from 20200205 and 20200206, and it shows the added column, I do not know whether it is a common soulution but it solves the problem. Best, Leesf ` Igor Basko 于2020年2月5日周三 下午3:33写道: > Hi All, > I've tried to write data with som

Re: [DISCUSS] Jira integration in slack ?

2020-02-05 Thread leesf
valuability, and will make it more searchable for users. Best, Leesf vino yang 于2020年2月5日周三 下午10:32写道: > Hi Vinoth, > > >> I was actually thinking about a slack to mailing list (only for > #general) > >> integration, where threads are mirrored to the mailing list for ease o

Re: Datasource Writer Schema Evolution

2020-02-06 Thread leesf
5写道: > Thanks a lot for the answer. > I was sure Hudi would store the latest schema, instead of merging it from > all the files. > > On Thu, 6 Feb 2020 at 01:10, leesf wrote: > > > Hi Igor, > > > > It is because the Spark ParquetFileFormat infer schema from the parquet &

[ANNOUNCE] Apache Hudi (incubating) 0.5.1 released

2020-01-31 Thread leesf
like to thank IPMC members and community for taking the time to review and verify, and making this release possible! Best, Leesf

Re: Reporting Hudi usage

2020-02-07 Thread leesf
+1, also forwarded it to hudi china user group. Vinoth Chandar 于2020年2月8日周六 上午5:59写道: > +1 Please take a moment to do this! > > On Fri, Feb 7, 2020 at 12:31 AM Bhavani Sudha > wrote: > > > Hello all, > > > > If you are using Hudi, it would be great to hear from you and have you > > share with

Re: [VOTE] Release 0.5.1-incubating, release candidate #1

2020-01-24 Thread leesf
+1 (non-binding) -Verified checksums and signatures - OK -Ran `mvn clean install -DskipTests` in my local -OK -Ran some tests in IDE -OK Best, Leesf vino yang 于2020年1月24日周五 上午10:28写道: > +1 (non-binding) > > - Ran the `mvn package` in my local. - OK > - Reviewed release note. -

Re: [ANNOUNCE] Hudi Weekly Community Update (2020-01-28 ~ 2020-02-03)

2020-02-02 Thread leesf
Hi Nicholas, Thanks for doing this. Great job. Best, Leesf 蒋晓峰 于2020年2月3日周一 上午12:47写道: > Dear community, > > > Nice to share Hudi community weekly update for 2020-01-28 ~ 2020-02-03 > with updates on development, features, improvement, tests. The community is > mainly focu

[DISCUSS] Next Apache Release(0.5.2)

2020-02-18 Thread leesf
5.1> 2> Release Guide: Release Guide < https://cwiki.apache.org/confluence/display/HUDI/Apache+Hudi+%28incubating%29+-+Release+Guide > Thanks, Leesf (On behalf of Apache Hudi PPMC)

Re: Discussion Thread: HUDI File Listing and Query Planning Improvements

2020-02-18 Thread leesf
+1 from me, query improvement will indeed make hudi more advanced. Vinoth Chandar 于2020年2月19日周三 上午3:17写道: > +1 on this as well. Also happy to collaborate on the RFC itself and help it > make progress.. > > >> For a column in the dataset, min/max range per Parquet file can be > maintained >

Re: [DISCUSS] Next Apache Release(0.5.2)

2020-02-18 Thread leesf
ing items here. > > - Fix the NOTICE issue > > - Confirm with someone (mentors or incubator or asf docs) on what more > > needs to be done, to be ASF compliant.. > > - We could also start tagging JIRAs with 0.5.2, with the above focus. > > > > > > > >

[ANNOUNCE] Hudi Weekly Community Update(2020-02-03 ~ 2020-02-09)

2020-02-09 Thread leesf
Bugs [Utilities] Close KafkaConsumer every time[13] [13] https://issues.apache.org/jira/browse/HUDI-596 Best, Leesf

[ANNOUNCE] Hudi weekly Community Update(2020-02-09 ~ 2020-02-16)

2020-02-16 Thread leesf
/jira/browse/HUDI-514 [3] https://jira.apache.org/jira/browse/HUDI-571 Bugs [CLI] CLI counts small file inserts as updates [4] [4] https://jira.apache.org/jira/browse/HUDI-574 Best, Leesf

Re: Re: Please welcome our new PPMCs and Committer

2020-02-15 Thread leesf
Thanks you guys, it is really a great honor for me and I am very excited. Really happy to participate in such a nice community, also will continue making hudi a better data lake project. Best, Leesf lamberken 于2020年2月15日周六 下午2:50写道: > > > Congratulations to Leesf, Vino Yang and Siva

[ANNOUNCE] Hudi Weekly Community Update (2020-01-05 ~ 2020-01-12)

2020-01-12 Thread leesf
Dear community, Nice to share Hudi community weekly update for 2020-01-05 ~ 2020-01-12 with updates on develpment, features, bug fixes. Development [Terminologies simplification] A full version to introduce the design and architecture of HUDI has been written[1], and you are welcome to

[DISCUSS] Delay code freeze date for next release until Jan 19th (Sunday)

2020-01-15 Thread leesf
Jan 19th, thus Sunday this week. what do you think? Thanks. Best, Leesf [1] https://issues.apache.org/jira/browse/HUDI-537 https://issues.apache.org/jira/browse/HUDI-535 https://issues.apache.org/jira/browse/HUDI-509 https://issues.apache.org/jira/browse/HUDI-403 https://issues.apache.org/jira

Re: [DISCUSS] Rename the name of hudi-hadoop-mr module

2020-01-15 Thread leesf
Thanks vino for bringing up the discussion. +1 to rename the module name as the name is not very suitable, and hudi-query-common/hudi-query-bundle sounds resonable. Best, Leesf vino yang 于2020年1月16日周四 下午1:56写道: > Hi guys, > > I want to start a proposal about refactoring t

Re: Dec 17, 2019 Meeting notes

2020-01-15 Thread leesf
in the meeting but wouldn't participate due to network issues? Or we would still use hangouts since it is also good in practice if no other people want to participate.:) Best, Leesf Sivabalan 于2019年12月18日周三 下午2:30写道: > AgendaStatus Updates > > Blockers, Progress towards next releases, thing

Re: [DISCUSS] Delay code freeze date for next release until Jan 19th (Sunday)

2020-01-15 Thread leesf
> I assume you meant UTC-8  Sure :)

[ANNOUNCE] Hudi Weekly Community Update (2020-01-12 ~ 2020-01-19)

2020-01-19 Thread leesf
://issues.apache.org/jira/browse/HUDI-530 [11] https://issues.apache.org/jira/browse/HUDI-535 [12] https://issues.apache.org/jira/browse/HUDI-552 Best, Leesf

[NOTIFICATION] Code is frozen for next release(0.5.1)

2020-01-20 Thread leesf
Hi all, I hereby inform you that the code is frozen now as scheduled. All blockers are resolved with the help of our community, special thanks to @vinoth and @balaji for their effort to get all blockers on land. And 0.5.1-RC1 will be sent in the next few days, thanks you. Best, Leesf

[VOTE] Release 0.5.1-incubating, release candidate #1

2020-01-22 Thread leesf
y approval, with at least 3 PMC affirmative votes. Thanks, Leesf [1] https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12322822=12346183 [2] https://dist.apache.org/repos/dist/dev/incubator/hudi/hudi-0.5.1-incubating-rc1/ [3] https://dist.apache.org/repos/dist/dev/incubator/hudi//KEYS

Re: [SUPPORT] hudi-integ-test fails after adding licenses

2020-01-22 Thread leesf
Update: seems like would be fixed via https://github.com/apache/incubator-hudi/pull/1273, and verified in my own travis https://api.travis-ci.org/v3/job/640530602/log.txt leesf 于2020年1月23日周四 上午12:35写道: > Hi all, > > After merging the PR(https://github.com/apache/incubator-hudi/

Re: [SUPPORT] hudi-integ-test fails after adding licenses

2020-01-22 Thread leesf
-f /usr/hive/data/input/presto-batch1.commands > > > On Wed, Jan 22, 2020 at 12:17 PM leesf wrote: > > > Update: seems like would be fixed via > > https://github.com/apache/incubator-hudi/pull/1273, and verified in my > own > > travis https://api.travis-ci.org/v3/job/6

Would not Stage source releases on dist.apache.org

2020-01-20 Thread leesf
://cwiki.apache.org/confluence/display/HUDI/Apache+Hudi+%28incubating%29+-+Release+Guide Best, Leesf

Re: Would not Stage source releases on dist.apache.org

2020-01-20 Thread leesf
Hi balaji, I would not find entrypoint to create a folder under dev/incubator/hudi, have no permissions? Please advise. Thanks. Balaji Varadarajan 于2020年1月21日周二 下午2:14写道: > > Hi Leesf, > THe staging directories are intentionally empty. The directories > corresponding to 0.5.

Re: Would not Stage source releases on dist.apache.org

2020-01-20 Thread leesf
Works after using *svn checkout https://dist.apache.org/repos/dist/dev/incubator/hudi <https://dist.apache.org/repos/dist/dev/incubator/hudi> without * *--depth=immediates* leesf 于2020年1月21日周二 下午3:07写道: > Hi balaji, > > I would not find entrypoint to create a folder under dev

[ANNOUNCE] Code freeze date for Apache Hudi 0.5.1 release

2020-01-09 Thread leesf
problems with the plan, please let us know. Thanks. Best, Leesf [1] https://lists.apache.org/thread.html/r14291a41be93ff178f22faa292d5e2a09fc7c294b7d89216c132083a%40%3Cdev.hudi.apache.org%3E

Re: [DISCUSS] Code freeze date for next release(0.5.1)

2020-01-09 Thread leesf
Thanks all for your participation. there are five +1 and no -1, hence I assume we have reached a consensus. So I will announce the feature freeze date on the dev mailing list. Best, Leesf Y Ethan Guo 于2020年1月9日周四 下午2:09写道: > +1 on the timeline > > On Wed, Jan 8, 2020 at 6:01 PM

[Workflow] Redo log statements using SLF4J

2020-01-02 Thread leesf
branch. Any thoughts? Best, Leesf [1] https://issues.apache.org/jira/browse/HUDI-233 [2] https://github.com/apache/incubator-hudi/pull/1168 https://github.com/apache/incubator-hudi/pull/1163 https://github.com/apache/incubator-hudi/pull/1161 https://github.com/apache/incubator

Re: [Workflow] Redo log statements using SLF4J

2020-01-03 Thread leesf
Thanks @vino, @pratyaksh and @vinoth, will redo log statement In this way. Best, Leesf Vinoth Chandar 于2020年1月3日周五 下午11:57写道: > +1 as well .. > > On Fri, Jan 3, 2020 at 12:09 AM Pratyaksh Sharma > wrote: > > > Hi, > > > > I will volunteer for the testing and

Re: Contribution guidelines

2020-01-04 Thread leesf
+1 the guide is very comprehensive and useful. New contributors will benefit a lot after reading the guide in full . Thanks Vinoth for your work. Best, Leesf nishith agarwal 于2020年1月4日周六 上午9:18写道: > +1 This is really nice and exhaustive > > On Mon, Dec 30, 2019 at 9:44 PM Sivabal

Re: [DISCUSS] Hudi weekly community update

2020-01-05 Thread leesf
Hi Nicholas, Agree with you that more developers would involve in and are highly welcomed to support "Hudi weekly community update", we could create a slack channel to gather developers after finishing the discussion. Best, Leesf 蒋晓峰 于2020年1月6日周一 上午12:09写道: > Hi leesf, &g

Re: [DISCUSS] Hudi weekly community update

2020-01-07 Thread leesf
ate to the dev mailing list? And maybe add > a link from the archive to the slack. > > On Tue, Jan 7, 2020 at 4:13 PM leesf wrote: > > > > Thank you all for your feedback, have created weekly-community-update > > channel in slack, you would join the channel if you are inter

Re: [DISCUSS] Hudi weekly community update

2020-01-07 Thread leesf
Thank you all for your feedback, have created weekly-community-update channel in slack, you would join the channel if you are interst in participating and we could assign weekly community update tasks there. Best, Leesf Nishith 于2020年1月8日周三 上午6:35写道: > +1, great idea, an easy way for fo

[DISCUSS] Code freeze date for next release(0.5.1)

2020-01-08 Thread leesf
] and Migrating to Scala 2.12[6], which are important for runing Hudi on Google Cloud, and we incline to get them on land. What do you think about the proposed code freeze date? Glad to hear your thoughts. Best, Leesf [1] https://cwiki.apache.org/confluence/display/HUDI/20191210+Weekly+Sync+Minutes [2

[ANNOUNCE] Hudi Weekly Community Update(2020-03-03~20200308)

2020-03-08 Thread leesf
/HUDI-671 Best, Leesf

Re: New Committer: lamber-ken

2020-04-07 Thread leesf
Congrats lamber-ken, well deserved! Balaji Varadarajan 于2020年4月8日周三 上午6:45写道: > Many Congratulations Lamber-Ken. Well deserved !! > Balaji.V > On Tuesday, April 7, 2020, 02:23:51 PM PDT, Y Ethan Guo < > ethan.guoyi...@gmail.com> wrote: > > Congrats!!! > > On Tue, Apr 7, 2020 at 2:22 PM

Re: New PPMC Member : Bhavani Sudha

2020-04-07 Thread leesf
Congrats sudha, well deserved! Balaji Varadarajan 于2020年4月8日周三 上午6:55写道: > Congratulations Sudha :) Well deserved. Welcome to PPMC. > Balaji.V > > On Tuesday, April 7, 2020, 03:04:37 PM PDT, Gary Li < > yanjia.gary...@gmail.com> wrote: > > Congrats Sudha! Appreciated all the work you

[ANNOUNCE] Hudi Weekly Update(2020-04-05 ~ 2020-04-12)

2020-04-12 Thread leesf
://jira.apache.org/jira/browse/HUDI-740 [10] https://jira.apache.org/jira/browse/HUDI-738 [11] https://jira.apache.org/jira/browse/HUDI-758 [12] https://jira.apache.org/jira/browse/HUDI-568 [13] https://jira.apache.org/jira/browse/HUDI-700 Best, Leesf

Re: contributor permission request

2020-04-12 Thread leesf
Done and welcome to Hudi community! cooper 于2020年4月12日周日 下午8:57写道: > Hi, I want to contribute to Apache Hudi. Would you please give me the > contributor permission? My JIRA ID is lichangfu >

[ANNOUNCE] Hudi Weekly Update(2020-04-12 ~ 2020-04-19)

2020-04-19 Thread leesf
://jira.apache.org/jira/browse/HUDI-741 [16] https://jira.apache.org/jira/browse/HUDI-799 [17] https://jira.apache.org/jira/browse/HUDI-698 [18] https://jira.apache.org/jira/browse/HUDI-780 [19] https://jira.apache.org/jira/browse/HUDI-798 Best, Leesf

[ANNOUNCE] Hudi Weekly Community Update(2020-03-08~20200315)

2020-03-15 Thread leesf
unit-tests for HUDI metrics [10] [Tests] Added test cases for TestDiskBasedMap [11] [Tests] Improve exporter tests [12] [10] https://issues.apache.org/jira/browse/HUDI-688 [11] https://issues.apache.org/jira/browse/HUDI-670 [12] https://issues.apache.org/jira/browse/HUDI-344 Best, Leesf

Re: [VOTE] Release 0.5.2-incubating, release candidate #1

2020-03-13 Thread leesf
+1 (binding) - verified checksum and signature [OK] - mvn clean install -DskipTests [OK] - ran quickstart [OK] Best, Leesf Sivabalan 于2020年3月14日周六 上午7:39写道: > +1 (non-binding) > > - Verified checksums and signatures [OK] > - Verified NOTICE, DISCLAIME, LICENSE files exist [OK] &g

Re: Apply for contributor permission

2020-03-16 Thread leesf
done and welcome :) Zy 于2020年3月15日周日 下午11:41写道: > Hi, > > I want to contribute to Apache Hudi. Would you please give me the > contributor permission? My JIRA ID is jerryzhao1423. > > > > >

[ANNOUNCE] Hudi Weekly Community Update(2020-03-29 ~ 2020-04-05)

2020-04-05 Thread leesf
://jira.apache.org/jira/browse/HUDI-742 [10] https://jira.apache.org/jira/browse/HUDI-717 [11] https://jira.apache.org/jira/browse/HUDI-562 Best, Leesf

[ANNOUNCE] Hudi Weekly Community Update(2020-03-22 ~ 2020-03-29)

2020-03-29 Thread leesf
-663 [15] https://jira.apache.org/jira/browse/HUDI-697 Best, Leesf

[ANNOUNCE] Hudi Weekly Update(2020-0419 ~ 2020-04-26)

2020-04-26 Thread leesf
/HUDI-785 [19] https://issues.apache.org/jira/browse/HUDI-821 [20] https://issues.apache.org/jira/browse/HUDI-816 [21] https://issues.apache.org/jira/browse/HUDI-795 [22] https://issues.apache.org/jira/browse/HUDI-809 Best, Leesf

Re: Generic Types of HoodieRecordPayload

2020-04-22 Thread leesf
hi tison, It is always better to make the codebase more clear, so it would be great if you would do an investigation. tison 于2020年4月22日周三 下午2:42写道: > Hi Vinoth, > > >much of the code actually does not depend on the templatized type at all > > Agree. > > Let's say I'm ok with untyped

Re: [DISCUSS] Support popular metrics reporter

2020-04-22 Thread leesf
+1 Vinoth Chandar 于2020年4月22日周三 下午2:24写道: > +1 from me as well > > On Mon, Apr 20, 2020 at 9:37 PM vino yang wrote: > > > Hi Raymond, > > > > Thanks for opening this discussion. > > > > IMHO, as Hudi's user base grows, we need to enhance our metrics reporter. > > From an ecological point of

Re: [ATTN] JUnit 5 adoption

2020-04-22 Thread leesf
Thanks for the reminder, I upgraded the to junit5 for the PR https://github.com/apache/incubator-hudi/pull/1536 and will take an eye on when reviewing PRs. Bhavani Sudha 于2020年4月22日周三 下午3:31写道: > +1. Thanks for the update Raymond and great work on the migration. > > -Sudha > > On Tue, Apr 21,

Re: [DISCUSS] moving blog from cwiki to website

2020-04-22 Thread leesf
+1 vino yang 于2020年4月22日周三 下午1:50写道: > +1 from my side. > > Pratyaksh Sharma 于2020年4月22日周三 下午1:38写道: > > > +1 > > > > I have seen other Apache projects having blogs on their website like > Apache > > Pinot. > > > > On Wed, Apr 22, 2020 at 11:05 AM Bhavani Sudha Saktheeswaran > > wrote: > > >

Re: [Discussion] Abstraction for HoodieInputFormat and RecordReader

2020-04-22 Thread leesf
Hi gary, Thanks for your proposal, I read the input format codebase before and thought it would be optimized, will take a look at the design doc when get a chance and feedback. Gary Li 于2020年4月22日周三 上午5:43写道: > Hi Folks, > > I’d like to bring up a discussion regarding the better read support

Re: [Discussion] Abstract common meta sync module support multiple meta service

2020-04-28 Thread leesf
+1 from me as well. Vinoth Chandar 于2020年4月28日周二 上午3:48写道: > +1 > > Will get around to reviewing this more closely this week. > > On Mon, Apr 27, 2020 at 11:11 AM Gary Li wrote: > > > Hi Wei, > > > > Thanks for the proposal. +1 from my side. This is definitely a very > useful > > feature. > >

Re: [DISCUSS] Readiness for graduation to TLP

2020-04-28 Thread leesf
+1 vino yang 于2020年4月28日周二 下午5:39写道: > +1 > > Best, > Vino > > Bhavani Sudha 于2020年4月28日周二 下午2:48写道: > > > +1 to pursue graduation. I certainly think we are ready. Will chime in on > > voting thread when you start it. > > > > Thanks, > > Sudha > > > > On Mon, Apr 27, 2020 at 10:06 PM Vinoth

[ANNOUNCE] Hudi Weekly Update(2020-05-10 ~ 2020-05-17)

2020-05-17 Thread leesf
://issues.apache.org/jira/browse/HUDI-902 [19] https://issues.apache.org/jira/browse/HUDI-811 [20] https://issues.apache.org/jira/browse/HUDI-701 Best, Leesf

Re: [VOTE] Apache Hudi graduation to top level project

2020-05-06 Thread leesf
+1 lamber-ken 于2020年5月7日周四 上午8:28写道: > +1 > > > > > > > > > > > > > > > > > > At 2020-05-07 04:55:48, "Vinoth Chandar" wrote: > >Hello all, > > > >Per our discussion on the dev mailing list ( > > >

[ANNOUNCE] Hudi Weekly Update(2020-05-03 ~ 2020-05-10)

2020-05-10 Thread leesf
://jira.apache.org/jira/browse/HUDI-812 [11] https://jira.apache.org/jira/browse/HUDI-704 Best, Leesf

Re: [Online Meetup] Apache Kylin × Apache Hudi Meetup, Mar. 14, 2020

2020-03-20 Thread leesf
and Apache Kylin https://drive.google.com/open?id=1Pk_WdFxfEZxMMfAOn0R8-m3ALkcN6G9e Vinoth Chandar 于2020年3月12日周四 下午2:31写道: > This is awesome.. Please be sure to add the talk to our website page as > well once the slides are up! > > > > On Wed, Mar 11, 2020 at 4:27 AM vino yang wro

Re: [Online Meetup] Apache Kylin × Apache Hudi Meetup, Mar. 14, 2020

2020-03-21 Thread leesf
sorry pratyaksh, it may mainly for chinese developers. :) Pratyaksh Sharma 于2020年3月20日周五 下午6:05写道: > Cannot follow it properly due to language issues. :) > > On Fri, Mar 20, 2020 at 3:05 PM leesf wrote: > > > PDF is now available. Please check it out. > > > &

Re: [VOTE] Release 0.5.2-incubating, release candidate #2

2020-03-21 Thread leesf
+1 (binding) - verified checksum and signature [OK] - mvn clean install -DskipTests [OK] - checked the modules in https://repository.apache.org/content/repositories/orgapachehudi-1019/org/apache/hudi/ [OK] Best, Leesf vino yang 于2020年3月21日周六 下午5:20写道: > Hi everyone, > > > We h

[ANNOUNCE] Hudi Weekly Community Update(2020-03-15~2020-03-22)

2020-03-22 Thread leesf
715 [10] https://issues.apache.org/jira/browse/HUDI-539 [11] https://issues.apache.org/jira/browse/HUDI-694 [12] https://issues.apache.org/jira/browse/HUDI-695 [13] https://issues.apache.org/jira/browse/HUDI-400 Best, Leesf

Re: [Online Meetup] Apache Kylin × Apache Hudi Meetup, Mar. 14, 2020

2020-03-22 Thread leesf
ries :) > > > > On Sat, Mar 21, 2020 at 2:47 PM leesf wrote: > > > > > sorry pratyaksh, it may mainly for chinese developers. :) > > > > > > Pratyaksh Sharma 于2020年3月20日周五 下午6:05写道: > > > > > > > Cannot follow it pro

Re: [Discussion] hudi support log append scenario with better write and asynchronous compaction

2020-05-19 Thread leesf
+1 from me, also I updated the RFC-19, please take another look when you get a chance. Vinoth Chandar 于2020年5月20日周三 上午1:43写道: > Bear with me for 1-2 days.. Will circle around on this.. This is a dear > topic to me as well :) > > On Tue, May 19, 2020 at 9:21 AM Shiyan Xu > wrote: > > > Hi Wei,

[ANNOUNCE] Hudi Community Weekly Update (2020-05-17 ~ 2020-05-24)

2020-05-24 Thread leesf
/browse/HUDI-863 [10] https://jira.apache.org/jira/browse/HUDI-888 [11] https://jira.apache.org/jira/browse/HUDI-705 [12] https://jira.apache.org/jira/browse/HUDI-706 [13] https://jira.apache.org/jira/browse/HUDI-803 [14] https://jira.apache.org/jira/browse/HUDI-707 Best, Leesf

Re: [DISCUSS] Add Github and Twitter Widget on Hudi's official website

2020-05-03 Thread leesf
+1 Vinoth Chandar 于2020年5月2日周六 上午12:05写道: > +1 these are the the little things that matter :) > > On Fri, May 1, 2020 at 2:28 AM wangxianghu wrote: > > > Hi vino, > > That’s a good idea, Adding the Github to Hudi’s official website will > make > > it more convenient to get Hudi's source code,

  1   2   3   >