This PR has been submitted and Watch is available.
Next PR https://github.com/apache/beam/pull/3607 is in review for adding
TextIO.read().watchForNewFiles()! (will extend it to Avro and provide
utility transforms for authors of similar IOs)
On Wed, Jul 19, 2017 at 8:37 PM Eugene Kirpichov
Hi all,
A PR for this is in review https://github.com/apache/beam/pull/3565
I'm very excited about this, because:
- I think it turned out to be a very neat API and I'm looking forward to
people coming up with more use cases for it
- I was pleasantly surprised by being able to come up with a good
Hi all,
Please take a look at this short proposal that came out of implementing
http://s.apache.org/textio-sdf. I think it's a nice generalization. I would
welcome comments on the proposed API, or corner cases of semantics that I
haven't thought about, or more generalizations, etc.
