Taher, can we please move the HIP to the cWiki space as documented here https://cwiki.apache.org/confluence/display/HUDI/Hudi+Improvement+Plan+Details+and+Process
Would love to take a pass at it. This will definitely improve usability.. @leesf I think we can use the standalone timeline server bundle you worked on, and have a central timeline server for all Hudi jobs within your org.. Then, if you host an UI endpoint on that server, we can visualize much of what Tahen put up on the doc. thoughts? On Sun, Sep 22, 2019 at 4:07 AM Taher Koitawala <[email protected]> wrote: > Hi Leesf, > Thank you for your interest. HIP already has been implemented in > terms of design and components we need to see. The link is given below. > Please free to chime in, to add and implement. > > > https://docs.google.com/document/d/1oEjukuaK2ltqiD0sjVs5IUzvDzilWF0viwMASXTdEd4/edit?usp=sharing > > Regards, > Taher Koitawala > > On Sun, Sep 22, 2019, 3:26 PM leesf <[email protected]> wrote: > > > + 1 to this valuable HIP. > > And I am also very interested, perhaps together to implement this HIP. > > > > Best, > > Leesf > > > > Taher Koitawala <[email protected]> 于2019年9月22日周日 下午2:09写道: > > > > > Guys it not only includes tables views and admin kind of > > views(Compactions) > > > but it also includes 'Metadata lineage' which can help users know how > > this > > > Hudi dataset merged and also another strong feature is creating > > > DeltaStreamer jobs through the webui and having DeltaStreamer > > > templates(Makes sharing jobs easy). I think those are really really > > strong > > > features. > > > > > > > > > Regards, > > > Taher Koitawala > > > > > > On Sun, Sep 22, 2019, 9:52 AM Bhavani Sudha Saktheeswaran > > > <[email protected]> wrote: > > > > > > > +1 for adding web ui. The web ui viz for table configs would be > pretty > > > > useful for easy debugging. > > > > > > > > > > > > > > > > > > > > On Sat, Sep 21, 2019 at 7:35 PM Vinoth Chandar <[email protected]> > > > wrote: > > > > > > > > > +1 will take a look at the doc for specifics in a few days. > > > > > > > > > > On Sat, Sep 21, 2019 at 7:18 PM vino yang <[email protected]> > > > wrote: > > > > > > > > > > > +1 to introduce Hudi web UI. Great suggestion! On 09/21/2019 > 12:24, > > > > Minh > > > > > > Pham wrote: +1. I think an admin UI will help with reusability > > alot. > > > On > > > > > > Fri, Sep 20, 2019 at 8:32 PM Vinay Patil < > [email protected]> > > > > > wrote: > > > > > > > Hi Taher, > > I really liked this idea, these details will be > > > > valuable > > > > > to > > > > > > checkout on Web > UI. > > +1 > > Regards, > Vinay Patil > > > On > > Fri, > > > > Sep > > > > > > 20, 2019 at 3:28 PM Taher Koitawala <[email protected]> > > wrote: > > > > > > > > > > > > > > > > > > Hi All, > > A HIP has been created by me proposing a > Hudi > > > Web > > > > UI > > > > > > with a lot > of > > helpful features. The major motivation of > this > > > > > proposal > > > > > > is that at the > > moment, users have depend on Spark's > > configuration > > > > to > > > > > a > > > > > > metrics > collection > > system to see Hudi metrics. > > > > > > > > > Also, > > > > > > a lot of metadata about Hudi that the user doesn't find > > > easily > > > > after > > > > > > creating tables will be put up on the UI. Please check the > > > > > document > > > > > for > > > > > > a detailed explanation. > > > > > > > > > > > > > > > > > > > > > > > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__docs.google.com_document_d_1oEjukuaK2ltqiD0sjVs5IUzvDzilWF0viwMASXTdEd4_edit-3Fusp-3Dsharing&d=DwIBaQ&c=r2dcLCtU9q6n0vrtnDw9vg&r=oyPDRKU5b-LuEWWyf8gacx4mFFydIGdyS50OKdxizX0&m=aL8qpmWcgJ5Kv3y-xHJIfAXDqt-1yIXEwTidVJTcqHI&s=cF3VNnlSaNRsN4t2bSmA8XcNfZefvxZhd8KCbtxpqyE&e= > > > > > > > > > > Regards, > > Taher Koitawala > > > > > > > > > > > > > > > > > >
