Ben Sidhom created BEAM-3673: -------------------------------- Summary: FlinkRunner: Harness manager for connecting operators to SDK Harnesses Key: BEAM-3673 URL: https://issues.apache.org/jira/browse/BEAM-3673 Project: Beam Issue Type: Sub-task Components: runner-flink Reporter: Ben Sidhom Assignee: Aljoscha Krettek
SDK harnesses require a common set of gRPC services to operate. The role of the harness manager is to multiplex data streams and auxiliary data between SDK environments and operators within a given job. Note that multiple operators may communicate with a single SDK environment to amortize container initialization cost. Environments are _not_ shared between different jobs. The initial implementation will shell out to local docker, but the harness manager should eventually support working with externally-managed environments (e.g., created by Kubernetes). -- This message was sent by Atlassian JIRA (v7.6.3#76005)