Need advice: PubsubIO external transform PR

2019-08-17 Thread Chad Dombrova
Hi all, I've got a PR[1] for adding external transform support to PubsubIO so that it will work with python and go pipelines on Flink, and I am *so* close, but I've run into questions that the code cannot answer: I need a human now. The brief summary is

Is it too late to switch to Java 8 time for the schema aware Row and Beam SQL?

2019-08-17 Thread Alex Van Boxel
I know it's probably futile, but the more I'm working on features that are related to schema awareness I'm getting a bit frustrated about the lack of precision of the joda instance. As soon as we have a conversion to the DateTime I need to drop precession, this happens with the Protobuf timestamp

Re: StateNamespaces.global() != StateNamespaces.window(GlobalWindowCoder, GlobalWindow)

2019-08-17 Thread Jan Lukavský
Hi Kenn, cool, thanks for explanation. The name is maybe a little misleading then, because the model uses word "global" for global-windowed scope, but that is absolutely minor issue. Jan On 8/16/19 10:57 PM, Kenneth Knowles wrote: Actually, this is not a bug. The "global" namespace is for