Re: Support ZetaSQL as a new SQL dialect in BeamSQL

2019-08-03 Thread Manu Zhang
> > A question to the community, does the size of the change require any > process besides the usual PR reviews? > I think so. This is a big change and has come as kind of a surprise (sorry if I've missed previous discussions). Rui, could you explain more on how things will play out between

Re: [PROPOSAL] An initial Schema API in Python

2019-08-03 Thread Chad Dombrova
Hi, This looks like a great feature. Is there a plan to eventually support custom field types? I assume adding support for dataclasses in python 3.7+ should be trivial to do in a follow up PR. Do you see any complications with that? The main advantage that dataclasses have over NamedTuple in

Re: Neat Beam integration - Ananas Analytics Desktop

2019-08-03 Thread Chad Dombrova
Very cool. Anyone know if it supports the portability framework, and thus python? I see a few indicators that the answer is likely “no”. On Fri, Jul 26, 2019 at 12:22 PM Kenneth Knowles wrote: > One colleague pointed me to this project and another tweeted about it [1]. > I see it was

Re: [BEAM-7819] -python - parsing message_id from PubSub message to the PubSubMessage attributes property

2019-08-03 Thread Matthew Darwin
So I wasn't paying attention to the message after trying to upload the python docker image (permissions issue) which meant when I ran the dataflow, it couldn't find the docker image. Digging in the stackdriver logs indicated this, and the job was just stuck in a loop waiting for the image.