Re: [DISCUSS] Diagnostic reporter

2022-10-14 Thread Forward Xu
+1, Thanks Shiyan Xu and Zhang Yue, This is a very useful function. Best, Forward sagar sumit 于2022年9月12日周一 18:39写道: > Thanks Zhang Yue for drafting the RFC. > It's an interesting read! I have left some comments. > > While exposing certain info such as "sample_hoodie_key", > we have to

Re: [DISCUSS] Diagnostic reporter

2022-09-12 Thread sagar sumit
Thanks Zhang Yue for drafting the RFC. It's an interesting read! I have left some comments. While exposing certain info such as "sample_hoodie_key", we have to consider masking/obfuscation. Looking forward to the implementation. Regards, Sagar On Wed, Sep 7, 2022 at 1:49 PM Yue Zhang wrote:

Re: [DISCUSS] Diagnostic reporter

2022-09-07 Thread Yue Zhang
Hi Hudi, Just raise a RFC about this diagnostic reporter https://github.com/apache/hudi/pull/6600. PLEASE feel free to leave any comments or concerns if you are interested! | | Yue Zhang | | zhangyue921...@163.com | On 08/4/2022 19:38,Yue Zhang wrote: Hi Shiyan and everyone, This is

Re: [DISCUSS] Diagnostic reporter

2022-08-05 Thread Shiyan Xu
Sure, Zhang Yue, feel free to initiate the RFC! On Fri, Aug 5, 2022 at 4:57 AM 田昕峣 (Xinyao Tian) wrote: > Hi Shiyan and everyone, > > > Definitely this feature is very important. We really need to gather error > infos to fix bugs more efficiently. > > > If there’s any thing I could help please

Re: [DISCUSS] Diagnostic reporter

2022-08-05 Thread Xinyao Tian
Hi Shiyan and everyone, Definitely this feature is very important. We really need to gather error infos to fix bugs more efficiently. If there’s any thing I could help please feel free to let me know :) Regards, Xinyao Hi Shiyan and everyone, This is a great idea! As one of Hudi user, I

Re: [DISCUSS] Diagnostic reporter

2022-08-04 Thread Yue Zhang
Hi Shiyan and everyone, This is a great idea! As one of Hudi user, I also struggle to Hudi troubleshooting sometimes. With this feature, it will definitely be able to reduce the burden. So I volunteer to draft a discuss and maybe raise a RFC about if you don't mind. Thanks :) | | Yue

Re: [DISCUSS] Diagnostic reporter

2022-08-02 Thread 冯健
Maybe we can start this with an audit feature? Since we need some sort of "images" to represent “facts”, can create an identity of a writer to link them. and in this audit file, we can label each operation with IP, environment, platform, version, write config and etc. On Sun, 31 Jul 2022 at

Re: [DISCUSS] Diagnostic reporter

2022-07-30 Thread Shiyan Xu
To bubble this up On Wed, Jun 15, 2022 at 11:47 PM Vinoth Chandar wrote: > +1 from me. > > It will be very useful if we can have something that can gather > troubleshooting info easily. > This part takes a while currently. > > On Mon, May 30, 2022 at 9:52 AM Shiyan Xu > wrote: > > > Hi all, >

Re: [DISCUSS] Diagnostic reporter

2022-06-15 Thread Vinoth Chandar
+1 from me. It will be very useful if we can have something that can gather troubleshooting info easily. This part takes a while currently. On Mon, May 30, 2022 at 9:52 AM Shiyan Xu wrote: > Hi all, > > When troubleshooting Hudi jobs in users' environments, we always ask users > to share

[DISCUSS] Diagnostic reporter

2022-05-30 Thread Shiyan Xu
Hi all, When troubleshooting Hudi jobs in users' environments, we always ask users to share configs, environment info, check spark UI, etc. Here is an RFC idea: can we extend the Hudi metrics system and make a diagnostic reporter? It can be turned on like a normal metrics reporter. it should