Re: Go IOs ?

2019-10-28 Thread Chamikara Jayalath
On Mon, Oct 28, 2019 at 9:15 AM Robert Burke wrote: > There are IOs that work [1], but they haven't been vetted for production > use (performance, overhead etc) just yet. As such, I don't recommend > putting them on the site at this time. Of course, folks a free to discuss > and disagree with me

Re: Go IOs ?

2019-10-28 Thread Robert Burke
There are IOs that work [1], but they haven't been vetted for production use (performance, overhead etc) just yet. As such, I don't recommend putting them on the site at this time. Of course, folks a free to discuss and disagree with me on that :). The Go SDK doesn't yet have a way of scaling

Re: Go IOs ?

2019-10-28 Thread Chamikara Jayalath
Seems like we have several file-based IO connectors and datastore here: https://github.com/apache/beam/tree/master/sdks/go/pkg/beam/io We should definitely add these to the list. I guess bulk of IOs will be supported through cross-language transforms framework when we have that for Go SDK.

Go IOs ?

2019-10-27 Thread Austin Bennett
Hi All, https://beam.apache.org/documentation/io/built-in/ Only includes Ios for Java and Python. I have heard talk of a Go SDK :-) Are there working IOs? If yes, should they also be on that page? Thanks, Austin