Turns out much of the work was completed to populate and consume the urn +
payloads.
I have deprecated the single "url" field in enviornment with
https://github.com/apache/beam/pull/8213 which will allow us to close of
BEAM-5433.
On Mon, Apr 1, 2019 at 1:48 PM Lukasz Cwik wrote:
> Yes, need to
Yes, need to use the new fields everywhere and then deprecate the old
fields.
On Mon, Apr 1, 2019 at 1:33 PM Kenneth Knowles wrote:
>
>
> On Mon, Apr 1, 2019 at 8:59 AM Lukasz Cwik wrote:
>
>> To clarify, docker isn't the only environment type we are using. We have
>> a process based and
On Mon, Apr 1, 2019 at 8:59 AM Lukasz Cwik wrote:
> To clarify, docker isn't the only environment type we are using. We have a
> process based and "existing" environment mode that don't fit the current
> protobuf and is being worked around.
>
Ah, understood.
> The idea would be to move to a
To clarify, docker isn't the only environment type we are using. We have a
process based and "existing" environment mode that don't fit the current
protobuf and is being worked around.
The idea would be to move to a URN + payload model like our PTransforms and
coders with a docker specific one.
On Thu, Mar 28, 2019 at 9:30 AM Lukasz Cwik wrote:
> The intention is that these kinds of hints such as CPU and/or memory
> should be embedded in the environment specification that is associated with
> the transforms that need resource hints.
>
> The environment spec is woefully ill prepared as
The intention is that these kinds of hints such as CPU and/or memory should
be embedded in the environment specification that is associated with the
transforms that need resource hints.
The environment spec is woefully ill prepared as it only has a docker URL
right now.
On Thu, Mar 28, 2019 at
A question came over the beam-go slack that I wasn't able to answer, in
particular for Dataflow*, is there a way to increase how much of a Portable
FnAPI worker is dedicated for the SDK side, vs the Runner side?
My assumption is that runners should manage it, and have the Runner Harness
side be
