[jira] [Created] (BEAM-5703) Migrate Python streaming and portable integration tests to use a staged dataflow worker jar

2018-10-10 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5703: --- Summary: Migrate Python streaming and portable integration tests to use a staged dataflow worker jar Key: BEAM-5703 URL: https://issues.apache.org/jira/browse/BEAM-5703

[jira] [Resolved] (BEAM-5699) Migrate Go integration test to use a staged dataflow worker jar

2018-10-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-5699. - Resolution: Fixed Fix Version/s: 2.9.0 > Migrate Go integration test to use a staged

[jira] [Created] (BEAM-5699) Migrate Go integration test to use a staged dataflow worker jar

2018-10-09 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5699: --- Summary: Migrate Go integration test to use a staged dataflow worker jar Key: BEAM-5699 URL: https://issues.apache.org/jira/browse/BEAM-5699 Project: Beam

[jira] [Created] (BEAM-5698) Migrate Dataflow tests to use a staged dataflow worker jar

2018-10-09 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5698: --- Summary: Migrate Dataflow tests to use a staged dataflow worker jar Key: BEAM-5698 URL: https://issues.apache.org/jira/browse/BEAM-5698 Project: Beam Issue

[jira] [Assigned] (BEAM-5637) Python support for custom dataflow worker jar

2018-10-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-5637: --- Assignee: Ruoyun Huang > Python support for custom dataflow worker jar >

[jira] [Created] (BEAM-5686) Remove DataflowRunnerHarness shim again

2018-10-09 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5686: --- Summary: Remove DataflowRunnerHarness shim again Key: BEAM-5686 URL: https://issues.apache.org/jira/browse/BEAM-5686 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-5689) Remove artifact naming constraint for portable Dataflow job

2018-10-09 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5689: --- Summary: Remove artifact naming constraint for portable Dataflow job Key: BEAM-5689 URL: https://issues.apache.org/jira/browse/BEAM-5689 Project: Beam Issue

[jira] [Updated] (BEAM-5637) Python support for custom dataflow worker jar

2018-10-03 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5637: Description: One of the slightly subtle aspects is that we would need to ignore one of the staged

[jira] [Updated] (BEAM-5636) Java support for custom dataflow worker jar

2018-10-03 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5636: Description: One of the slightly subtle aspects is that we would need to ignore one of the staged

[jira] [Created] (BEAM-5637) Python support for custom dataflow worker jar

2018-10-03 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5637: --- Summary: Python support for custom dataflow worker jar Key: BEAM-5637 URL: https://issues.apache.org/jira/browse/BEAM-5637 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-5326) SDK support for custom dataflow worker jar

2018-10-03 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5326: Summary: SDK support for custom dataflow worker jar (was: Support for custom dataflow worker jar)

[jira] [Created] (BEAM-5636) Java support for custom dataflow worker jar

2018-10-03 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5636: --- Summary: Java support for custom dataflow worker jar Key: BEAM-5636 URL: https://issues.apache.org/jira/browse/BEAM-5636 Project: Beam Issue Type: Sub-task

[jira] [Updated] (BEAM-5634) Bring Dataflow Java Worker Code into Beam

2018-10-03 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5634: Description: Discussion:

[jira] [Resolved] (BEAM-2880) Artifact server proxies

2018-09-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2880. - Resolution: Won't Fix Fix Version/s: Not applicable > Artifact server proxies >

[jira] [Commented] (BEAM-5440) Add option to mount a directory inside SDK harness containers

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624222#comment-16624222 ] Henning Rohde commented on BEAM-5440: - This is something that I think makes sense and is userful for

[jira] [Updated] (BEAM-5447) Support running user pipelines with the Universal Local Runner in Go.

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5447: Component/s: sdk-go > Support running user pipelines with the Universal Local Runner in Go. >

[jira] [Assigned] (BEAM-2901) Containerize ULR

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-2901: --- Assignee: Daniel Oliveira > Containerize ULR > > > Key:

[jira] [Resolved] (BEAM-2900) ULR: configurable container/process management

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2900. - Resolution: Won't Fix Fix Version/s: Not applicable Obsolete now that we're adding direct

[jira] [Resolved] (BEAM-2884) Dataflow runs portable pipelines

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2884. - Resolution: Fixed Fix Version/s: 2.8.0 All SDKs have a Dataflow-specific job-submission

[jira] [Updated] (BEAM-3514) Use portable WindowIntoPayload in DataflowRunner

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-3514: Issue Type: Task (was: Sub-task) Parent: (was: BEAM-2884) > Use portable

[jira] [Assigned] (BEAM-2769) Java SDK support for submitting a Portable Pipeline

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-2769: --- Assignee: Ankur Goenka > Java SDK support for submitting a Portable Pipeline >

[jira] [Commented] (BEAM-2769) Java SDK support for submitting a Portable Pipeline

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624181#comment-16624181 ] Henning Rohde commented on BEAM-2769: - [~angoenka] Isn't this done a long time ago? > Java SDK

[jira] [Assigned] (BEAM-2880) Artifact server proxies

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-2880: --- Assignee: Henning Rohde > Artifact server proxies > --- > >

[jira] [Resolved] (BEAM-2882) S3 artifact server proxy

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2882. - Resolution: Won't Do Fix Version/s: Not applicable > S3 artifact server proxy >

[jira] [Commented] (BEAM-2880) Artifact server proxies

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623884#comment-16623884 ] Henning Rohde commented on BEAM-2880: - Based on the portable Flink runner work, it seems these proxies

[jira] [Resolved] (BEAM-2863) Add support for Side Inputs over the Fn API

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2863. - Resolution: Fixed Fix Version/s: 2.8.0 > Add support for Side Inputs over the Fn API >

[jira] [Updated] (BEAM-3419) Enable iterable side input for beam runners.

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-3419: Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-2863) > Enable iterable

[jira] [Updated] (BEAM-2928) ULR support for portable side input

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-2928: Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-2863) > ULR support for

[jira] [Updated] (BEAM-3080) Improve the side input materialization for the DirectRunner/ULR from iterable to storing the multimap directly

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-3080: Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-2863) > Improve the side

[jira] [Assigned] (BEAM-2928) ULR support for portable side input

2018-09-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-2928: --- Assignee: Daniel Oliveira (was: Luke Cwik) > ULR support for portable side input >

[jira] [Resolved] (BEAM-3286) Go SDK support for portable side input

2018-09-19 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-3286. - Resolution: Fixed Fix Version/s: 2.8.0 > Go SDK support for portable side input >

[jira] [Assigned] (BEAM-2947) SDK harnesses should be able to indicate panic in FnAPI

2018-09-18 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-2947: --- Assignee: (was: Henning Rohde) > SDK harnesses should be able to indicate panic in FnAPI

[jira] [Assigned] (BEAM-5350) Running autocomplete.go on dataflow fails

2018-09-18 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-5350: --- Assignee: (was: Henning Rohde) > Running autocomplete.go on dataflow fails >

[jira] [Assigned] (BEAM-5391) Use repeated fields for model for ordering of input/output/etc maps

2018-09-14 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-5391: --- Assignee: (was: Kenneth Knowles) > Use repeated fields for model for ordering of

[jira] [Created] (BEAM-5391) Use repeated fields for model for ordering of input/output/etc maps

2018-09-14 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5391: --- Summary: Use repeated fields for model for ordering of input/output/etc maps Key: BEAM-5391 URL: https://issues.apache.org/jira/browse/BEAM-5391 Project: Beam

[jira] [Commented] (BEAM-5288) Modify Environment to support non-dockerized SDK harness deployments

2018-09-13 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614237#comment-16614237 ] Henning Rohde commented on BEAM-5288: - If we're reusing the container contract (which I think is

[jira] [Commented] (BEAM-5354) Side Inputs seems to be non-working in the sdk-go

2018-09-13 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613736#comment-16613736 ] Henning Rohde commented on BEAM-5354: - Technically, the side input feature on Dataflow is not

[jira] [Commented] (BEAM-5357) Go check for IsWorkerCompatibleBinary is wrong

2018-09-11 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611406#comment-16611406 ] Henning Rohde commented on BEAM-5357: - De-prioritizing now that [~ptomasroos]'s fix is in. > Go check

[jira] [Updated] (BEAM-5357) Go check for IsWorkerCompatibleBinary is wrong

2018-09-11 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5357: Priority: Major (was: Critical) > Go check for IsWorkerCompatibleBinary is wrong >

[jira] [Commented] (BEAM-5253) Go SDK PubSub example currently broken

2018-09-11 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611017#comment-16611017 ] Henning Rohde commented on BEAM-5253: - Great. Thanks for investigating! Opened

[jira] [Created] (BEAM-5357) Go check for IsWorkerCompatibleBinary is wrong

2018-09-11 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5357: --- Summary: Go check for IsWorkerCompatibleBinary is wrong Key: BEAM-5357 URL: https://issues.apache.org/jira/browse/BEAM-5357 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-5253) Go SDK PubSub example currently broken

2018-09-11 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610861#comment-16610861 ] Henning Rohde commented on BEAM-5253: - "go run" is expected to work. Would you mind trying to make

[jira] [Commented] (BEAM-5350) Running autocomplete.go on dataflow fails

2018-09-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609984#comment-16609984 ] Henning Rohde commented on BEAM-5350: - Tomas -- do you want to re-purpose this JIRA to remove (or

[jira] [Assigned] (BEAM-5253) Go SDK PubSub example currently broken

2018-09-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-5253: --- Assignee: Robert Burke (was: Henning Rohde) > Go SDK PubSub example currently broken >

[jira] [Commented] (BEAM-5253) Go SDK PubSub example currently broken

2018-09-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609968#comment-16609968 ] Henning Rohde commented on BEAM-5253: - I've been testing on mac with cross-compiling to linux/amd64

[jira] [Commented] (BEAM-5350) Running autocomplete.go on dataflow fails

2018-09-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609950#comment-16609950 ] Henning Rohde commented on BEAM-5350: - That is a really awesome idea. Thanks for taking that on!

[jira] [Commented] (BEAM-5350) Running autocomplete.go on dataflow fails

2018-09-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609622#comment-16609622 ] Henning Rohde commented on BEAM-5350: - The Go autocomplete example is a stub from a long time ago. It

[jira] [Commented] (BEAM-5253) Go SDK PubSub example currently broken

2018-09-10 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609612#comment-16609612 ] Henning Rohde commented on BEAM-5253: - Looking at the PR: https://github.com/apache/beam/pull/6357

[jira] [Assigned] (BEAM-5340) [beam_PostCommit_Python_Verify][test_hourly_team_score_it][Flake] Failed to install packages

2018-09-07 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-5340: --- Assignee: Ahmet Altay (was: Henning Rohde) >

[jira] [Resolved] (BEAM-5327) Go support for custom dataflow worker jar

2018-09-06 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-5327. - Resolution: Fixed Fix Version/s: 2.8.0 > Go support for custom dataflow worker jar >

[jira] [Updated] (BEAM-5326) Support for custom dataflow worker jar

2018-09-05 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-5326: Description: Doc:

[jira] [Created] (BEAM-5327) Go support for custom dataflow worker jar

2018-09-05 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5327: --- Summary: Go support for custom dataflow worker jar Key: BEAM-5327 URL: https://issues.apache.org/jira/browse/BEAM-5327 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-5326) Support for custom dataflow worker jar

2018-09-05 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-5326: --- Summary: Support for custom dataflow worker jar Key: BEAM-5326 URL: https://issues.apache.org/jira/browse/BEAM-5326 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-5253) Go SDK PubSub example currently broken

2018-09-05 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-5253. - Resolution: Not A Bug Fix Version/s: Not applicable > Go SDK PubSub example currently

[jira] [Commented] (BEAM-5288) Modify Environment to support non-dockerized SDK harness deployments

2018-09-04 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603454#comment-16603454 ] Henning Rohde commented on BEAM-5288: - Clarifying question [~mxm] [~angoenka]: what is the semantics

[jira] [Commented] (BEAM-5253) Go SDK PubSub example currently broken

2018-08-31 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599425#comment-16599425 ] Henning Rohde commented on BEAM-5253: - [~seanhagen] It looks like project doesn't have access to one

[jira] [Assigned] (BEAM-4424) Improvements to hooks module

2018-08-31 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-4424: --- Assignee: (was: Bill Neubauer) > Improvements to hooks module >

[jira] [Assigned] (BEAM-4124) Support elements larger than 4 MB

2018-08-31 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-4124: --- Assignee: (was: Bill Neubauer) > Support elements larger than 4 MB >

[jira] [Assigned] (BEAM-4017) Go session runner should write multiple files

2018-08-31 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-4017: --- Assignee: (was: Bill Neubauer) > Go session runner should write multiple files >

[jira] [Commented] (BEAM-5253) Go SDK PubSub example currently broken

2018-08-31 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16599220#comment-16599220 ] Henning Rohde commented on BEAM-5253: - [~seanhagen]: (1) The direct runner doesn't support pubsub (or

[jira] [Assigned] (BEAM-2930) Flink support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-2930: --- Assignee: Thomas Weise > Flink support for portable side input >

[jira] [Closed] (BEAM-4683) Integrate support for timers using the portability APIs into Spark

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-4683. --- Resolution: Later Fix Version/s: Not applicable > Integrate support for timers using the

[jira] [Commented] (BEAM-3672) FlinkRunner: Implement an Artifact service using the Flink DistributedCache

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589062#comment-16589062 ] Henning Rohde commented on BEAM-3672: - Moving this to a separate task, if it's optional and not

[jira] [Updated] (BEAM-3672) FlinkRunner: Implement an Artifact service using the Flink DistributedCache

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-3672: Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-2889) > FlinkRunner:

[jira] [Resolved] (BEAM-2951) Containerize job proxy

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2951. - Resolution: Won't Fix Fix Version/s: Not applicable We'll containerize each runner/runner

[jira] [Commented] (BEAM-2886) Portable pipeline submission proxy

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589051#comment-16589051 ] Henning Rohde commented on BEAM-2886: - I think this issue should be resolved, given we are going with

[jira] [Resolved] (BEAM-2886) Portable pipeline submission proxy

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-2886. - Resolution: Fixed Fix Version/s: 2.7.0 > Portable pipeline submission proxy >

[jira] [Updated] (BEAM-2885) Local Dataflow proxy for portable job submission

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-2885: Summary: Local Dataflow proxy for portable job submission (was: Support job+artifact APIs locally)

[jira] [Updated] (BEAM-2885) Local Dataflow proxy for portable job submission

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-2885: Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-2884) > Local Dataflow

[jira] [Closed] (BEAM-2932) Spark support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2932. --- Resolution: Later Fix Version/s: Not applicable > Spark support for portable side input >

[jira] [Closed] (BEAM-2920) Spark support for portable user state

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2920. --- Resolution: Later Fix Version/s: Not applicable > Spark support for portable user state >

[jira] [Closed] (BEAM-2909) Spark supports portable progress reporting

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2909. --- Resolution: Later Fix Version/s: Not applicable > Spark supports portable progress reporting >

[jira] [Closed] (BEAM-2921) Gearpump support for portable user state

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2921. --- Resolution: Later Fix Version/s: Not applicable > Gearpump support for portable user state >

[jira] [Closed] (BEAM-2910) Gearpump supports portable progress reporting

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2910. --- Resolution: Later Fix Version/s: Not applicable > Gearpump supports portable progress

[jira] [Closed] (BEAM-2933) Gearpump support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2933. --- Resolution: Later Fix Version/s: Not applicable > Gearpump support for portable side input >

[jira] [Closed] (BEAM-2931) Apex support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2931. --- Resolution: Later Fix Version/s: Not applicable > Apex support for portable side input >

[jira] [Closed] (BEAM-2908) Apex supports portable progress reporting

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2908. --- Resolution: Later Fix Version/s: Not applicable > Apex supports portable progress reporting >

[jira] [Closed] (BEAM-2919) Apex support for portable user state

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2919. --- Resolution: Later Fix Version/s: Not applicable > Apex support for portable user state >

[jira] [Closed] (BEAM-2936) JStorm support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2936. --- Resolution: Later Fix Version/s: Not applicable > JStorm support for portable side input >

[jira] [Closed] (BEAM-2924) JStorm support for portable user state

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2924. --- Resolution: Later Fix Version/s: Not applicable > JStorm support for portable user state >

[jira] [Closed] (BEAM-2913) JStorm supports portable progress reporting

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2913. --- Resolution: Later Fix Version/s: Not applicable > JStorm supports portable progress reporting

[jira] [Closed] (BEAM-2923) MapReduce support for portable user state

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2923. --- Resolution: Later Fix Version/s: Not applicable > MapReduce support for portable user state >

[jira] [Closed] (BEAM-2912) MapReduce supports portable progress reporting

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2912. --- Resolution: Later Fix Version/s: Not applicable > MapReduce supports portable progress

[jira] [Closed] (BEAM-2935) MapReduce support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2935. --- Resolution: Later Fix Version/s: Not applicable > MapReduce support for portable side input >

[jira] [Closed] (BEAM-2922) Tez support for portable user state

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2922. --- Resolution: Later Fix Version/s: Not applicable > Tez support for portable user state >

[jira] [Closed] (BEAM-2911) Tez supports portable progress reporting

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2911. --- Resolution: Later Fix Version/s: Not applicable > Tez supports portable progress reporting >

[jira] [Closed] (BEAM-2934) Tez support for portable side input

2018-08-22 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde closed BEAM-2934. --- Resolution: Later Fix Version/s: Not applicable > Tez support for portable side input >

[jira] [Assigned] (BEAM-3532) Add Distinct cookbook example to Go SDK

2018-08-21 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-3532: --- Assignee: (was: Willy Lulciuc) > Add Distinct cookbook example to Go SDK >

[jira] [Commented] (BEAM-4636) Make beam.Run() (and/or friends) thread-safe.

2018-08-14 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580469#comment-16580469 ] Henning Rohde commented on BEAM-4636: - I understand. I'm suggesting that you use the dataflowlib

[jira] [Updated] (BEAM-4699) BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest flake

2018-08-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-4699: Issue Type: Bug (was: New Feature) >

[jira] [Assigned] (BEAM-4699) BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest flake

2018-08-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-4699: --- Assignee: Ankur Goenka (was: Henning Rohde) >

[jira] [Resolved] (BEAM-4636) Make beam.Run() (and/or friends) thread-safe.

2018-08-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-4636. - Resolution: Fixed Fix Version/s: 2.7.0 > Make beam.Run() (and/or friends) thread-safe. >

[jira] [Updated] (BEAM-4699) BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest flake

2018-08-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-4699: Labels: portability (was: ) > BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest

[jira] [Commented] (BEAM-4636) Make beam.Run() (and/or friends) thread-safe.

2018-08-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575337#comment-16575337 ] Henning Rohde commented on BEAM-4636: - [~exm] I think this should be fixed. I also refactored the Go

[jira] [Resolved] (BEAM-3917) Pipeline roots are not computed correctly for CoGBK

2018-08-02 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-3917. - Resolution: Fixed Fix Version/s: 2.7.0 > Pipeline roots are not computed correctly for

[jira] [Resolved] (BEAM-4813) Make Go Dataflow translation use protos directly

2018-08-02 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-4813. - Resolution: Fixed Fix Version/s: 2.7.0 > Make Go Dataflow translation use protos directly

[jira] [Commented] (BEAM-4826) Flink runner sends bad flatten to SDK

2018-08-01 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566235#comment-16566235 ] Henning Rohde commented on BEAM-4826: - Dataflow drops the flatten altogether. > Flink runner sends

[jira] [Commented] (BEAM-4826) Flink runner sends bad flatten to SDK

2018-08-01 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566219#comment-16566219 ] Henning Rohde commented on BEAM-4826: - Yeah - unused outputs from ParDo is fine. As you say, they may

[jira] [Assigned] (BEAM-4826) Flink runner sends bad flatten to SDK

2018-08-01 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde reassigned BEAM-4826: --- Assignee: Ankur Goenka (was: Aljoscha Krettek) > Flink runner sends bad flatten to SDK >

[jira] [Created] (BEAM-4826) Flink runner sends bad flatten to SDK

2018-07-19 Thread Henning Rohde (JIRA)
Henning Rohde created BEAM-4826: --- Summary: Flink runner sends bad flatten to SDK Key: BEAM-4826 URL: https://issues.apache.org/jira/browse/BEAM-4826 Project: Beam Issue Type: Bug

  1   2   3   4   5   >