Re:Re: Re: [DISCUSS] split source of kafka partition by count

2023-04-06 Thread 孔维
Hi, vinoth, I created a PR(https://github.com/apache/hudi/pull/8376) for this feature, could you help review it? BR, Kong At 2023-04-05 00:19:20, "Vinoth Chandar" wrote: >Look forward to this! could really help backfill/rebootstrap scenarios. > >On Tue, Apr 4, 2023 at 9:18 AM

Re:Re: Re: DISCUSS

2023-03-24 Thread 吕虎
Hi Vinoth, I am very happy to receive your reply. Here are some of my thoughts。 At 2023-03-21 23:32:44, "Vinoth Chandar" wrote: >>but when it is used for data expansion, it still involves the need to >redistribute the data records of some data files, thus affecting the >performance. >but

Re:Re: Re: [DISCUSS] Improve the merge performance for cow

2020-02-28 Thread lamberken
Hi vinoth, Thanks for reviewing the initial design :) I know there are many problems at present(e.g shuffling, parallelism issue). We can discussed the practicability of the idea first. > ExternalSpillableMap itself was not the issue right, the serialization was Right, the new design will

Re:Re: Re: [DISCUSS] Relocate spark-avro dependency by maven-shade-plugin

2020-02-19 Thread lamberken
@Vinoth, glad to see your reply. >> SchemaConverters does import things like types I checked the git history of package "org.apache.spark.sql.types", it hasn't changed in a year, means that spark does not change types often. >> let's have a flag in maven to skip Good suggestion. bundling

Re:Re: Re: [DISCUSS] Redraw of hudi data lake architecture diagram on langing page

2020-01-23 Thread lamberken
Thanks you all. :) Hi @nishith, good catch. I fixed it. https://github.com/apache/incubator-hudi/pull/1276/files?short_path=55fa8a8#diff-55fa8a81e6bf8c8d9d11d293b41511b5 Thanks Lamber-Ken At 2020-01-24 04:43:02, "nishith agarwal" wrote: >+1 looks great > >Nit : I see that the old

Re:Re: Re: [DISCUSS] Rework of new web site

2019-12-16 Thread lamberken
Hi Vinoth, 1, I'll update the site content this week, clean some useless templete codes, adjust the content etc... It will take a little long time for syncing the content. 2, I will adjust the style as much as I can to keep the theming blue and white. When the above work is completed, I

Re:Re: Re: [DISCUSS] Refactor of the configuration framework of hudi project

2019-12-11 Thread lamberken
Hi, On 1,2. Yes, you are right, moving the getter to the component level Config class itself. On 3, HoodieWriteConfig can also set value through ConfigOption, small code snippets. From the bellow snippets, we can see that clients need to know each component's builders and also call

Re:Re: Re:[DISCUSS] Scaling community support

2019-12-08 Thread lamberken
Okay, thanks for reminding me, I'll see earlier discuss thread. At 2019-12-09 14:09:56, "Vinoth Chandar" wrote: Please see an earlier discuss thread on the same topic - GH issues. Lets please keep this thread to discuss support process, not logistics, if I may say so :) On Sun, Dec 8,