Thanks Taher, great job! Will have another look soon. Best, Vino On 09/24/2019
02:15, Taher Koitawala wrote: Hi All, Hip has been migrated to
confluence. Please take a look.
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=130027233
Regards, Taher Koitawala On Mon, Sep 23, 2019 at 10:17 PM Taher Koitawala
<[email protected]> wrote: > Yup got it. Thanks Vinoth > > On Mon, Sep 23,
2019, 10:02 PM Vinoth Chandar <[email protected]> wrote: > >> Now? >> >> On
Mon, Sep 23, 2019 at 9:05 AM Taher Koitawala <[email protected]> >> wrote: >>
>> > Hey Vinoth still the same. No perms >> > >> > On Mon, Sep 23, 2019 at 9:24
PM Vinoth Chandar <[email protected]> >> wrote: >> > >> > > thats correct. you
should have perms now. >> > > >> > > On Sun, Sep 22, 2019 at 11:06 PM Taher
Koitawala <[email protected]> >> > > wrote: >> > > >> > > > Hi Vinoth, >> > >
> I do not have access on confluence to create a page >> in >> >
the >> > > > HIP section or even copy the HIP template. Please can you give >>
access? >> > My >> > > > id is taherk77. >> > > > >> > > > Regards, >> > > >
Taher Koitawala >> > > > >> > > > On Sun, Sep 22, 2019 at 6:34 PM Vinoth
Chandar <[email protected]> >> > > wrote: >> > > > >> > > > > Taher, can we
please move the HIP to the cWiki space as documented >> > here >> > > > > >> >
> > > >> > > > >> > > >> > >>
https://cwiki.apache.org/confluence/display/HUDI/Hudi+Improvement+Plan+Details+and+Process
>> > > > > >> > > > > >> > > > > Would love to take a pass at it. This will
definitely improve >> > > usability.. >> > > > > >> > > > > @leesf I think we
can use the standalone timeline server bundle >> you >> > > > worked >> > > > >
on, and have a central timeline server for all Hudi jobs within >> your >> > >
> org.. >> > > > > Then, if you host an UI endpoint on that server, we can
visualize >> > much >> > > of >> > > > > what Tahen put up on the doc.
thoughts? >> > > > > >> > > > > On Sun, Sep 22, 2019 at 4:07 AM Taher Koitawala
< >> [email protected]> >> > > > > wrote: >> > > > > >> > > > > > Hi Leesf, >>
> > > > > Thank you for your interest. HIP already has been >> > > >
implemented >> > > > > in >> > > > > > terms of design and components we need
to see. The link is given >> > > below. >> > > > > > Please free to chime in,
to add and implement. >> > > > > > >> > > > > > >> > > > > > >> > > > > >> > >
> >> > > >> > >>
https://docs.google.com/document/d/1oEjukuaK2ltqiD0sjVs5IUzvDzilWF0viwMASXTdEd4/edit?usp=sharing
>> > > > > > >> > > > > > Regards, >> > > > > > Taher Koitawala >> > > > > >
>> > > > > > On Sun, Sep 22, 2019, 3:26 PM leesf <[email protected]> >>
wrote: >> > > > > > >> > > > > > > + 1 to this valuable HIP. >> > > > > > > And
I am also very interested, perhaps together to implement >> this >> > > > HIP.
>> > > > > > > >> > > > > > > Best, >> > > > > > > Leesf >> > > > > > > >> > >
> > > > Taher Koitawala <[email protected]> 于2019年9月22日周日 下午2:09写道： >> > > > >
> > >> > > > > > > > Guys it not only includes tables views and admin kind of
>> > > > > > > views(Compactions) >> > > > > > > > but it also includes
'Metadata lineage' which can help users >> > know >> > > > how >> > > > > > >
this >> > > > > > > > Hudi dataset merged and also another strong feature is >>
creating >> > > > > > > > DeltaStreamer jobs through the webui and having >>
DeltaStreamer >> > > > > > > > templates(Makes sharing jobs easy). I think
those are really >> > > really >> > > > > > > strong >> > > > > > > > features.
>> > > > > > > > >> > > > > > > > >> > > > > > > > Regards, >> > > > > > > >
Taher Koitawala >> > > > > > > > >> > > > > > > > On Sun, Sep 22, 2019, 9:52 AM
Bhavani Sudha Saktheeswaran >> > > > > > > > <[email protected]> wrote:
>> > > > > > > > >> > > > > > > > > +1 for adding web ui. The web ui viz for
table configs >> would >> > be >> > > > > > pretty >> > > > > > > > > useful
for easy debugging. >> > > > > > > > > >> > > > > > > > > >> > > > > > > > > >>
> > > > > > > > >> > > > > > > > > On Sat, Sep 21, 2019 at 7:35 PM Vinoth
Chandar < >> > > > [email protected]> >> > > > > > > > wrote: >> > > > > > > >
> >> > > > > > > > > > +1 will take a look at the doc for specifics in a few >>
days. >> > > > > > > > > > >> > > > > > > > > > On Sat, Sep 21, 2019 at 7:18 PM
vino yang < >> > > > [email protected] >> > > > > > >> > > > > > > > wrote:
>> > > > > > > > > > >> > > > > > > > > > > +1 to introduce Hudi web UI. Great
suggestion! On >> > > 09/21/2019 >> > > > > > 12:24, >> > > > > > > > > Minh >>
> > > > > > > > > > Pham wrote: +1. I think an admin UI will help with >> > > >
reusability >> > > > > > > alot. >> > > > > > > > On >> > > > > > > > > > >
Fri, Sep 20, 2019 at 8:32 PM Vinay Patil < >> > > > > >
[email protected]> >> > > > > > > > > > wrote: >> > > > > > > > > > > >
Hi Taher, > > I really liked this idea, these >> details >> > > will >> > > >
be >> > > > > > > > > valuable >> > > > > > > > > > to >> > > > > > > > > > >
checkout on Web > UI. > > +1 > > Regards, > Vinay >> Patil > >> > > > > >> > >
> > On >> > > > > > > Fri, >> > > > > > > > > Sep >> > > > > > > > > > > 20,
2019 at 3:28 PM Taher Koitawala < >> [email protected]> >> > > >> > > > > >
wrote: >> > > > > > > > >> > > > > > > > > >> > > > > > > > > > >> > > > > > >
> > > > Hi All, > > A HIP has been created by me >> > > proposing a >>
> > > > > Hudi >> > > > > > > > Web >> > > > > > > > > UI >> > > > > > > > > >
> with a lot > of > > helpful features. The major >> > motivation >> > > of >>
> > > > > this >> > > > > > > > > > proposal >> > > > > > > > > > > is that at
the > > moment, users have depend on >> Spark's >> > > > > > > configuration >>
> > > > > > > > to >> > > > > > > > > > a >> > > > > > > > > > > metrics >
collection > > system to see Hudi metrics. >> > > >> > > >> > > > >> > > > > >
> > > > Also, >> > > > > > > > > > > a lot of metadata about Hudi that the user
doesn't >> find >> > > > >> > > > > > easily >> > > > > > > > > after >> > > >
> > > > > > > creating tables will be put up on the UI. Please check >> > the
>> > > > >> > > > > >> > > > > > > > document >> > > > > > > > > > for >> > > >
> > > > > > > a detailed explanation. > > > > > > > >> > > > > > > > > > > >> >
> > > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > >
>> > > > > >> > > > >> > > >> > >>
https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1oEjukuaK2ltqiD0sjVs5IUzvDzilWF0viwMASXTdEd4_edit-3Fusp-3Dsharing&d=DwIBaQ&c=r2dcLCtU9q6n0vrtnDw9vg&r=oyPDRKU5b-LuEWWyf8gacx4mFFydIGdyS50OKdxizX0&m=aL8qpmWcgJ5Kv3y-xHJIfAXDqt-1yIXEwTidVJTcqHI&s=cF3VNnlSaNRsN4t2bSmA8XcNfZefvxZhd8KCbtxpqyE&e=
>> > > > > > > > > > > > > > > Regards, > > Taher Koitawala > > > >> > > > > >
> > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > >> > > > > > >> > >
> > >> > > > >> > > >> > >> >
