Re: [PROPOSAL] Leveraging SQL TableProviders for Cross-Language IOs
A belated but very enthusiastic +1 to this proposal. Added some comments to the doc. On Thu, Jan 16, 2020 at 9:05 AM Kenneth Knowles wrote: > > Nice! This is quite clever. > > Kenn > > On Mon, Jan 13, 2020 at 5:08 PM Chamikara Jayalath > wrote: >> >> Thanks Brian. Added some comments. >> >> On Mon, Jan 13, 2020 at 2:25 PM Brian Hulette wrote: >>> >>> Hi everyone, >>> I have a proposal that I think can unify two problem sets: >>> 1) adding more IOs for Beam SQL, and >>> 2) making more (Row-based) Java IOs available in Python as cross-language >>> transforms >>> >>> The basic idea is to create a single cross-language transform that exposes >>> all Beam SQL IOs via the TableProvider interface. A design document is >>> available here: https://s.apache.org/xlang-table-provider >>> >>> Please take a look and let me know what you think. Thanks! >>> Brian
Re: [PROPOSAL] Leveraging SQL TableProviders for Cross-Language IOs
Nice! This is quite clever. Kenn On Mon, Jan 13, 2020 at 5:08 PM Chamikara Jayalath wrote: > Thanks Brian. Added some comments. > > On Mon, Jan 13, 2020 at 2:25 PM Brian Hulette wrote: > >> Hi everyone, >> I have a proposal that I think can unify two problem sets: >> 1) adding more IOs for Beam SQL, and >> 2) making more (Row-based) Java IOs available in Python as >> cross-language transforms >> >> The basic idea is to create a single cross-language transform that >> exposes all Beam SQL IOs via the TableProvider interface. A design document >> is available here: https://s.apache.org/xlang-table-provider >> >> Please take a look and let me know what you think. Thanks! >> Brian >> >
Re: [PROPOSAL] Leveraging SQL TableProviders for Cross-Language IOs
Thanks Brian. Added some comments. On Mon, Jan 13, 2020 at 2:25 PM Brian Hulette wrote: > Hi everyone, > I have a proposal that I think can unify two problem sets: > 1) adding more IOs for Beam SQL, and > 2) making more (Row-based) Java IOs available in Python as > cross-language transforms > > The basic idea is to create a single cross-language transform that exposes > all Beam SQL IOs via the TableProvider interface. A design document is > available here: https://s.apache.org/xlang-table-provider > > Please take a look and let me know what you think. Thanks! > Brian >
[PROPOSAL] Leveraging SQL TableProviders for Cross-Language IOs
Hi everyone, I have a proposal that I think can unify two problem sets: 1) adding more IOs for Beam SQL, and 2) making more (Row-based) Java IOs available in Python as cross-language transforms The basic idea is to create a single cross-language transform that exposes all Beam SQL IOs via the TableProvider interface. A design document is available here: https://s.apache.org/xlang-table-provider Please take a look and let me know what you think. Thanks! Brian