Re: [DISCUSS] Rework of new web site

2019-12-15 Thread leesf
Hi Lamber,

Thanks for your work, have gone through the new web ui, looks good.
Hence +1 from my side.

Best,
Leesf

vino yang  于2019年12月16日周一 上午10:17写道:

> Hi Lamber,
>
> I am not an expert on Jekyll. But big +1 for your proposal to improve the
> site.
>
> Best,
> Vino
>
> Vinoth Chandar  于2019年12月16日周一 上午3:15写道:
>
> > Thanks for taking the time to improve the site. Will review closely and
> get
> > back to you.
> >
> > On Sun, Dec 15, 2019 at 11:02 AM lamberken  wrote:
> >
> > >
> > >
> > > Hello, everyone.
> > >
> > >
> > > Compare to the web site of Delta Lake[1] and Apache Iceberg[2], they
> may
> > > looks better than hudi project[3].
> > >
> > >
> > > I delved into our web ui and try to improve it, I learned that hudi web
> > ui
> > > is based on jekyll-doc[4] theme
> > > which is not active. So it needs us to find a new active theme.
> > >
> > >
> > > So I try my best to find a free and beatiful theme in the past.
> > > Fortunately, I found a suitable theme
> > > in the huge amount of themes(check them one by one). It is
> > > minimal-mistakes[5], it's very popular and 100% free.
> > >
> > >
> > > Based on minimal theme, I rework a basic new web ui framework. I adjust
> > > some css styles, nav bars and etc..
> > > If you are interested in this, please visit
> https://lamber-ken.github.io
> > > for a quick overview.
> > >
> > >
> > > I’m looking forward to your reply, thanks!
> > >
> > >
> > > [1] https://delta.io
> > > [2] https://iceberg.apache.org
> > > [3] http://hudi.apache.org
> > > [4] https://github.com/tomjoht/documentation-theme-jekyll
> > > [5] https://github.com/mmistakes/minimal-mistakes
> > >
> > >
> > > best,
> > > lamber-ken
> > >
> > >
> >
>


Re: Re:Re: [DISCUSS] RFC-12 : Efficient migration of large parquet tables to Apache Hudi

2019-12-15 Thread Sivabalan
Nice one Balaji. have left few comments. Overall looks good :)

On Sun, Dec 15, 2019 at 9:30 AM Balaji Varadarajan
 wrote:

>  Hi Nicholas,
> Once I get high level comments on the RFC,  we can have concrete subtasks
> around this.
> Balaji.V On Saturday, December 14, 2019, 07:04:52 PM PST, 蒋晓峰 <
> programg...@163.com> wrote:
>
>  Hi Balaji,
> About plan of "Efficient migration of large parquet tables to Apache
> Hudi", have you split the plan into multiple subtasks?
> Thanks,
> Nicholas
>
>
> At 2019-12-14 00:18:12, "Vinoth Chandar"  wrote:
> >+1 (per asf policy)
> >
> >+100 per my own excitement :) .. Happy to review this!
> >
> >On Fri, Dec 13, 2019 at 3:07 AM Balaji Varadarajan 
> >wrote:
> >
> >> With Apache Hudi growing in popularity, one of the fundamental
> challenges
> >> for users has been about efficiently migrating their historical
> datasets to
> >> Apache Hudi. Apache Hudi maintains per record metadata to perform core
> >> operations such as upserts and incremental pull. To take advantage of
> >> Hudi’s upsert and incremental processing support, users would need to
> >> rewrite their whole dataset to make it a Hudi table. This RFC provides a
> >> mechanism to efficiently migrate their datasets without the need to
> rewrite
> >> the entire dataset.
> >>
> >>  Please find the link for the RFC below.
> >>
> >>
> >>
> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+12+%3A+Efficient+Migration+of+Large+Parquet+Tables+to+Apache+Hudi
> >>
> >> Please review and let me know your thoughts.
> >>
> >> Thanks,
> >> Balaji.V
> >>
>



-- 
Regards,
-Sivabalan


Re: [DISCUSS] Rework of new web site

2019-12-15 Thread vino yang
Hi Lamber,

I am not an expert on Jekyll. But big +1 for your proposal to improve the
site.

Best,
Vino

Vinoth Chandar  于2019年12月16日周一 上午3:15写道:

> Thanks for taking the time to improve the site. Will review closely and get
> back to you.
>
> On Sun, Dec 15, 2019 at 11:02 AM lamberken  wrote:
>
> >
> >
> > Hello, everyone.
> >
> >
> > Compare to the web site of Delta Lake[1] and Apache Iceberg[2], they may
> > looks better than hudi project[3].
> >
> >
> > I delved into our web ui and try to improve it, I learned that hudi web
> ui
> > is based on jekyll-doc[4] theme
> > which is not active. So it needs us to find a new active theme.
> >
> >
> > So I try my best to find a free and beatiful theme in the past.
> > Fortunately, I found a suitable theme
> > in the huge amount of themes(check them one by one). It is
> > minimal-mistakes[5], it's very popular and 100% free.
> >
> >
> > Based on minimal theme, I rework a basic new web ui framework. I adjust
> > some css styles, nav bars and etc..
> > If you are interested in this, please visit https://lamber-ken.github.io
> > for a quick overview.
> >
> >
> > I’m looking forward to your reply, thanks!
> >
> >
> > [1] https://delta.io
> > [2] https://iceberg.apache.org
> > [3] http://hudi.apache.org
> > [4] https://github.com/tomjoht/documentation-theme-jekyll
> > [5] https://github.com/mmistakes/minimal-mistakes
> >
> >
> > best,
> > lamber-ken
> >
> >
>


Re: [DISCUSS] Rework of new web site

2019-12-15 Thread Vinoth Chandar
Thanks for taking the time to improve the site. Will review closely and get
back to you.

On Sun, Dec 15, 2019 at 11:02 AM lamberken  wrote:

>
>
> Hello, everyone.
>
>
> Compare to the web site of Delta Lake[1] and Apache Iceberg[2], they may
> looks better than hudi project[3].
>
>
> I delved into our web ui and try to improve it, I learned that hudi web ui
> is based on jekyll-doc[4] theme
> which is not active. So it needs us to find a new active theme.
>
>
> So I try my best to find a free and beatiful theme in the past.
> Fortunately, I found a suitable theme
> in the huge amount of themes(check them one by one). It is
> minimal-mistakes[5], it's very popular and 100% free.
>
>
> Based on minimal theme, I rework a basic new web ui framework. I adjust
> some css styles, nav bars and etc..
> If you are interested in this, please visit https://lamber-ken.github.io
> for a quick overview.
>
>
> I’m looking forward to your reply, thanks!
>
>
> [1] https://delta.io
> [2] https://iceberg.apache.org
> [3] http://hudi.apache.org
> [4] https://github.com/tomjoht/documentation-theme-jekyll
> [5] https://github.com/mmistakes/minimal-mistakes
>
>
> best,
> lamber-ken
>
>


[DISCUSS] Rework of new web site

2019-12-15 Thread lamberken


Hello, everyone.


Compare to the web site of Delta Lake[1] and Apache Iceberg[2], they may looks 
better than hudi project[3].


I delved into our web ui and try to improve it, I learned that hudi web ui is 
based on jekyll-doc[4] theme
which is not active. So it needs us to find a new active theme.


So I try my best to find a free and beatiful theme in the past. Fortunately, I 
found a suitable theme 
in the huge amount of themes(check them one by one). It is minimal-mistakes[5], 
it's very popular and 100% free.


Based on minimal theme, I rework a basic new web ui framework. I adjust some 
css styles, nav bars and etc..
If you are interested in this, please visit https://lamber-ken.github.io for a 
quick overview.


I’m looking forward to your reply, thanks!


[1] https://delta.io
[2] https://iceberg.apache.org
[3] http://hudi.apache.org
[4] https://github.com/tomjoht/documentation-theme-jekyll
[5] https://github.com/mmistakes/minimal-mistakes


best,
lamber-ken



Re: Re:Re: [DISCUSS] RFC-12 : Efficient migration of large parquet tables to Apache Hudi

2019-12-15 Thread Balaji Varadarajan
 Hi Nicholas,
Once I get high level comments on the RFC,  we can have concrete subtasks 
around this. 
Balaji.V On Saturday, December 14, 2019, 07:04:52 PM PST, 蒋晓峰 
 wrote:  
 
 Hi Balaji,
About plan of "Efficient migration of large parquet tables to Apache Hudi", 
have you split the plan into multiple subtasks?
Thanks,
Nicholas


At 2019-12-14 00:18:12, "Vinoth Chandar"  wrote:
>+1 (per asf policy)
>
>+100 per my own excitement :) .. Happy to review this!
>
>On Fri, Dec 13, 2019 at 3:07 AM Balaji Varadarajan 
>wrote:
>
>> With Apache Hudi growing in popularity, one of the fundamental challenges
>> for users has been about efficiently migrating their historical datasets to
>> Apache Hudi. Apache Hudi maintains per record metadata to perform core
>> operations such as upserts and incremental pull. To take advantage of
>> Hudi’s upsert and incremental processing support, users would need to
>> rewrite their whole dataset to make it a Hudi table. This RFC provides a
>> mechanism to efficiently migrate their datasets without the need to rewrite
>> the entire dataset.
>>
>>  Please find the link for the RFC below.
>>
>>
>> https://cwiki.apache.org/confluence/display/HUDI/RFC+-+12+%3A+Efficient+Migration+of+Large+Parquet+Tables+to+Apache+Hudi
>>
>> Please review and let me know your thoughts.
>>
>> Thanks,
>> Balaji.V
>>