Kenneth Knowles created BEAM-2600:
-------------------------------------
Summary: Artifact for Python SDK harness that can be referenced in
pipeline definition
Key: BEAM-2600
URL: https://issues.apache.org/jira/browse/BEAM-2600
Project: Beam
Issue Type: New Feature
Components: sdk-py
Reporter: Kenneth Knowles
Assignee: Ahmet Altay
In order to build a pipeline that invokes a Python UDF, we need to be able to
construct something like this:
{code}
SdkFunctionSpec {
environment = <python SDK harness>,
spec = {
urn = <python SDK pickled DoFn>,
data = <pickled DoFn>
}
}
{code}
I do not know that there exists anything we can put for "<python SDK harness>"
today. For prototyping, it could be just a symbol that runners have to know.
But eventually it should be something that runners can instantiate without
knowing anything about the SDK that put it there.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
