Re: [DISCUSS] Logos on project front page.

2020-05-12 Thread vino yang
+1 to follow the best practices.

vbal...@apache.org  于2020年5月13日周三 上午10:31写道:

>
> I agree on following the best practices.
> Balaji.VOn Tuesday, May 12, 2020, 06:52:59 PM PDT, Vinoth Chandar <
> vin...@apache.org> wrote:
>
>  Hello all,
>
> This was raised during the graduation discussion. We have been referred to
> [1]. The doc ends saying. "These best practices for linking to outside
> pages on project websites are meant as suggestions for projects. PMCs are
> free to adopt (or not) any of these suggestions for their sites.".
>
> But I would prefer to play by the best practices if we can..
>
> Can you all chime in with your thoughts?
>
>
>
> [1] https://www.apache.org/foundation/marks/linking
>


Re: [DISCUSS] should we do a 0.5.3 patch set release ?

2020-05-12 Thread Bhavani Sudha
Thank you all. I created a jira here -
https://jira.apache.org/jira/browse/HUDI-890 that tracks the list of
patches going into this release. So far I am able to cherry pick these
commits and get a successful local run of tests.

Let us aim to code freeze by end of this week (May 16th EOD) for more
patches that can go into 0.5.3 release.

Please respond if you think there are more candidate PRs (criteria: perf
improvements/bug fixes) that can be included in 0.5.3.

Thanks,
Sudha

On Thu, May 7, 2020 at 4:16 PM Minjeong Noh  wrote:

>
> https://github.com/apache/incubator-hudi/commit/dbc9acd23a4eb208c7cd458bb3adaf54731d4145
> <
> https://github.com/apache/incubator-hudi/commit/dbc9acd23a4eb208c7cd458bb3adaf54731d4145>
>
>
> On 2020/05/06 20:31:00, Vinoth Chandar  wrote:
> > Hi Sudha,>
> >
> > +1 on the overall idea.. I tried to pick out few of these PRs that are>
> >
> >  - Small enough to apply easily>
> >  - Have limited scope, fixing pointed problems>
> >  - Have high impact on performance or usability>
> >
> > [HUDI-799] Use appropriate FS when loading configs>
> >
> https://github.com/apache/incubator-hudi/commit/acb1ada2f756b49d9f9a0aa152f99fcc9e86dde7>
>
> >
> > [HUDI-713] Fix conversion of Spark array of struct type to Avro schema>
> >
> https://github.com/apache/incubator-hudi/commit/ce0a4c64d07d6eea926d1bfb92b69ae387b88f50>
>
> >
> > [HUDI-656][Performance] Return a dummy Spark relation after writing>
> >
> https://github.com/apache/incubator-hudi/commit/c40a0d4e91896dece51969f5308016ecb3aa635c>
>
> >
> > [HUDI-850] Avoid unnecessary listings in incremental cleaning mode>
> >
> https://github.com/apache/incubator-hudi/commit/506447fd4fde4cd922f7aa8f4e17a7f0dc97>
>
> >
> > [HUDI-724] Parallelize getSmallFiles for partitions>
> >
> https://github.com/apache/incubator-hudi/commit/1f5b0c77d6c87a936f2d34287ec6a1df1cb18b33>
>
> >
> > [HUDI-607] Fix to allow creation/syncing of Hive tables partitioned>
> >
> https://github.com/apache/incubator-hudi/commit/2d040145810b8b14c59c5882f9115698351039d1>
>
> >
> > Add constructor to HoodieROTablePathFilter>
> >
> https://github.com/apache/incubator-hudi/commit/418f9bb2e91ed6c02077d36e49a47f0c8d08303a>
>
> >
> > [HUDI-539] Make ROPathFilter conf member serializable>
> >
> https://github.com/apache/incubator-hudi/commit/e3019031d8fff60df4fec82eac3fd5c044011635>
>
> >
> > Add changes for presto mor queries>
> >
> https://github.com/apache/incubator-hudi/commit/e21441ad8317f302fed947c414e059a332e4d1ef>
>
> >
> > [HUDI-782] Add support of Aliyun object storage service.>
> >
> https://github.com/apache/incubator-hudi/commit/5d717a28f45137bea71dffa31b0ae7ccbf1bda00>
>
> >
> >
> > Please chime in with your thoughts, as well.>
> >
> > I think there are some bug fixes in the pending PRs as well. esp from
> Alex>
> > and Pratyaksh .>
> >
> > Thanks>
> > Vinoth>
> >
> >
> > On Tue, May 5, 2020 at 9:33 PM Bhavani Sudha >
> > wrote:>
> >
> > > Hello all,>
> > >>
> > > I am wondering if we should do a 0.5.3 release by backporting all
> minor to>
> > > medium bug fixes (that are in master already) to 0.5.2 and do a minor>
> > > release ? That way we can use some time to reserve 0.6.0 release for
> all>
> > > major features that are upcoming and/or almost there. Please share
> your>
> > > thoughts. If you agree also please share the list of fixes that you
> know of>
> > > that can go into 0.5.3.>
> > >>
> > > Thanks,>
> > > Sudha>
> > >>
> >


Re: [DISCUSS] Logos on project front page.

2020-05-12 Thread vbal...@apache.org
 
I agree on following the best practices.
Balaji.VOn Tuesday, May 12, 2020, 06:52:59 PM PDT, Vinoth Chandar 
 wrote:  
 
 Hello all,

This was raised during the graduation discussion. We have been referred to
[1]. The doc ends saying. "These best practices for linking to outside
pages on project websites are meant as suggestions for projects. PMCs are
free to adopt (or not) any of these suggestions for their sites.".

But I would prefer to play by the best practices if we can..

Can you all chime in with your thoughts?



[1] https://www.apache.org/foundation/marks/linking
  

[DISCUSS] Logos on project front page.

2020-05-12 Thread Vinoth Chandar
Hello all,

This was raised during the graduation discussion. We have been referred to
[1]. The doc ends saying. "These best practices for linking to outside
pages on project websites are meant as suggestions for projects. PMCs are
free to adopt (or not) any of these suggestions for their sites.".

But I would prefer to play by the best practices if we can..

Can you all chime in with your thoughts?



[1] https://www.apache.org/foundation/marks/linking


Re: [DISCUSS] Why add unit tests for hudi-cli module

2020-05-12 Thread hddong
This is mainly a function test, not a parameter test.
Also, ensure that all base commands are executed successfully.


Re: [DISCUSS] Why add unit tests for hudi-cli module

2020-05-12 Thread Vinoth Chandar
+1
People rely on CLI to operate on Hudi datasets. So having some tests there,
would definitely be useful

On Tue, May 12, 2020 at 12:39 PM Shiyan Xu 
wrote:

> Hi, the tests in hudi-cli are more of functional tests. They are conducive
> to verifying features in cli module are working. Though not covering all
> options, it is always better to have some assuring passing tests than none,
> isn't it? :)
>
> On Tue, May 12, 2020 at 8:31 AM hmantu  wrote:
>
> > hi all,
> >
> >
> >
> > I can not understand why add so many tests for hudi-cli module? We know
> > that each
> > command has many options, unit tests can not cover all of these options,
> > and each
> > module has thier own unit tests, so I think they are redundant, any
> > thoughs?
> >
> >
> >
> >
> >
> > Thanks
>


Re: [DISCUSS] Why add unit tests for hudi-cli module

2020-05-12 Thread Shiyan Xu
Hi, the tests in hudi-cli are more of functional tests. They are conducive
to verifying features in cli module are working. Though not covering all
options, it is always better to have some assuring passing tests than none,
isn't it? :)

On Tue, May 12, 2020 at 8:31 AM hmantu  wrote:

> hi all,
>
>
>
> I can not understand why add so many tests for hudi-cli module? We know
> that each
> command has many options, unit tests can not cover all of these options,
> and each
> module has thier own unit tests, so I think they are redundant, any
> thoughs?
>
>
>
>
>
> Thanks


[DISCUSS] Why add unit tests for hudi-cli module

2020-05-12 Thread hmantu
hi all, 



I can not understand why add so many tests for hudi-cli module? We know that 
each 
command has many options, unit tests can not cover all of these options, and 
each
module has thier own unit tests, so I think they are redundant, any thoughs?





Thanks