Hi Gurudatt, We can try to integrate with other frameworks, either directly with other computing engines or indirectly.
But as Vinoth said, our first task is to decouple Spark from the design. After HUDI-538 is completed, these goals will be easier to achieve. Best, Vino Vinoth Chandar <[email protected]> 于2020年2月10日周一 下午4:14写道： > Hi Gurudatt, > > Thanks for bringing this up again. We have discussed this at length > before.. it's a long thread with a lot of good points. > > http://mail-archives.apache.org/mod_mbox/hudi-dev/201908.mbox/%3cCAA_=o7Bj=gfeoc4wzo42f1wmzhquw6f3t3qnbwvnwgvyx1t...@mail.gmail.com%3e > > > The gist is : if we can get away by simply creating abstractions, we can > attempt that first.. We will soon find out I guess, as we embark on > HUDI-538 > > Thanks > Vinoth > > On Fri, Feb 7, 2020 at 1:26 AM Gurudatt Kulkarni <[email protected]> > wrote: > > > Hi All, > > > > I am just putting out my thoughts based on my primitive knowledge about > > Beam/Hudi. I saw some discussions around making Hudi compatible with > Flink. > > Is it possible to make Hudi compatible with Beam, in turn making Hudi > > compatible with Spark/ Flink /(Others)? Is it worth exploring in this > > direction? > > > > Regards, > > Gurudatt > > >
