[jira] [Updated] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3189: --- Affects Version/s: (was: 2.2.0) 2.3.0 > Python Fnapi - Worker speedup >

[jira] [Updated] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3189: --- Labels: performance portability (was: portability) > Python Fnapi - Worker speedup >

[jira] [Created] (BEAM-3189) Python Fnapi - Worker speedup

Ankur Goenka created BEAM-3189: -- Summary: Python Fnapi - Worker speedup Key: BEAM-3189 URL: https://issues.apache.org/jira/browse/BEAM-3189 Project: Beam Issue Type: Bug Components:

[jira] [Updated] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3189: --- Component/s: (was: sdk-java-harness) sdk-py-harness > Python Fnapi - Worker

[jira] [Updated] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3189: --- Description: Beam Python SDK is couple of magnitude slower than Java SDK when it comes to stream

[jira] [Assigned] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-3189: -- Assignee: Ankur Goenka (was: Valentyn Tymofieiev) > Python Fnapi - Worker speedup >

[jira] [Updated] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3189: --- Issue Type: Improvement (was: Bug) > Python Fnapi - Worker speedup > - >

[jira] [Created] (BEAM-3260) Honor Python SDK log level while logging

Ankur Goenka created BEAM-3260: -- Summary: Honor Python SDK log level while logging Key: BEAM-3260 URL: https://issues.apache.org/jira/browse/BEAM-3260 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-3239) Enable debug server for python sdk workers

Ankur Goenka created BEAM-3239: -- Summary: Enable debug server for python sdk workers Key: BEAM-3239 URL: https://issues.apache.org/jira/browse/BEAM-3239 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261211#comment-16261211 ] Ankur Goenka commented on BEAM-3230: Initial skimming of the logs reveal unknown option

[jira] [Created] (BEAM-3230) beam_PerformanceTests_Python is failing

Ankur Goenka created BEAM-3230: -- Summary: beam_PerformanceTests_Python is failing Key: BEAM-3230 URL: https://issues.apache.org/jira/browse/BEAM-3230 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261688#comment-16261688 ] Ankur Goenka commented on BEAM-3230: The default worker container image for fnapi seems to be

[jira] [Assigned] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-3230: -- Assignee: Ankur Goenka (was: Ahmet Altay) > beam_PerformanceTests_Python is failing >

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261776#comment-16261776 ] Ankur Goenka commented on BEAM-3230: The jenkins build timeout. Doubling the timeout to 20min by

[jira] [Comment Edited] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261776#comment-16261776 ] Ankur Goenka edited comment on BEAM-3230 at 11/22/17 12:51 AM: --- The jenkins

[jira] [Comment Edited] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261776#comment-16261776 ] Ankur Goenka edited comment on BEAM-3230 at 11/22/17 12:50 AM: --- The jenkins

[jira] [Comment Edited] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261776#comment-16261776 ] Ankur Goenka edited comment on BEAM-3230 at 11/22/17 12:50 AM: --- The jenkins

[jira] [Comment Edited] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261776#comment-16261776 ] Ankur Goenka edited comment on BEAM-3230 at 11/22/17 12:50 AM: --- The jenkins

[jira] [Created] (BEAM-3135) Adding futures dependency to beam python SDK

Ankur Goenka created BEAM-3135: -- Summary: Adding futures dependency to beam python SDK Key: BEAM-3135 URL: https://issues.apache.org/jira/browse/BEAM-3135 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-3135) Adding futures dependency to beam python SDK

[ https://issues.apache.org/jira/browse/BEAM-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3135: --- Description:

[jira] [Created] (BEAM-3155) Python SDKHarness does not use separate thread for progress reporting

Ankur Goenka created BEAM-3155: -- Summary: Python SDKHarness does not use separate thread for progress reporting Key: BEAM-3155 URL: https://issues.apache.org/jira/browse/BEAM-3155 Project: Beam

[jira] [Updated] (BEAM-3189) Python Fnapi - Worker speedup

[ https://issues.apache.org/jira/browse/BEAM-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3189: --- External issue URL: https://docs.google.com/document/d/1mHFaNgHA71RVGLVNrGrHIlWHgJb4tKCJ2qQzS13REY8 >

[jira] [Commented] (BEAM-3075) Document getting started for python sdk developers

[ https://issues.apache.org/jira/browse/BEAM-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16231655#comment-16231655 ] Ankur Goenka commented on BEAM-3075: Hi [~altay] I can take a shot at it. > Document getting started

[jira] [Commented] (BEAM-2594) Python shim for submitting to the ULR

[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467864#comment-16467864 ] Ankur Goenka commented on BEAM-2594: [~jkff] [~bsidhom] Based on the current state of Python SDK, this

[jira] [Created] (BEAM-4289) How to express "Job Update" in portable Beam

Ankur Goenka created BEAM-4289: -- Summary: How to express "Job Update" in portable Beam Key: BEAM-4289 URL: https://issues.apache.org/jira/browse/BEAM-4289 Project: Beam Issue Type: Improvement

[jira] [Resolved] (BEAM-3883) Python SDK stages artifacts when talking to job server

[ https://issues.apache.org/jira/browse/BEAM-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-3883. Resolution: Fixed Fix Version/s: 2.5.0 > Python SDK stages artifacts when talking to job

[jira] [Commented] (BEAM-4448) --sdk_location seems to be a required parameter now in the Apache Beam Python SDK when using the DataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-4448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505250#comment-16505250 ] Ankur Goenka commented on BEAM-4448: This was fixed internally. [~lcwik] Do we need to keep this bug

[jira] [Resolved] (BEAM-4290) ArtifactStagingService that stages to a distributed filesystem

[ https://issues.apache.org/jira/browse/BEAM-4290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-4290. Resolution: Fixed Fix Version/s: 2.6.0 > ArtifactStagingService that stages to a distributed

[jira] [Assigned] (BEAM-4067) Java: FlinkPortableTestRunner: runs portably via self-started local Flink

[ https://issues.apache.org/jira/browse/BEAM-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-4067: -- Assignee: Ankur Goenka > Java: FlinkPortableTestRunner: runs portably via self-started local

[jira] [Commented] (BEAM-4219) Make Portable ULR use workerId in GRPC channel

[ https://issues.apache.org/jira/browse/BEAM-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460003#comment-16460003 ] Ankur Goenka commented on BEAM-4219: cc: [~lcwik] > Make Portable ULR use workerId in GRPC channel >

[jira] [Created] (BEAM-4219) Make Portable ULR use workerId in GRPC channel

Ankur Goenka created BEAM-4219: -- Summary: Make Portable ULR use workerId in GRPC channel Key: BEAM-4219 URL: https://issues.apache.org/jira/browse/BEAM-4219 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-4149) Java SDK Harness should populate worker id in control plane headers

[ https://issues.apache.org/jira/browse/BEAM-4149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459046#comment-16459046 ] Ankur Goenka commented on BEAM-4149: Is the workaround good enough or should we fix it now? > Java SDK

[jira] [Commented] (BEAM-4149) Java SDK Harness should populate worker id in control plane headers

[ https://issues.apache.org/jira/browse/BEAM-4149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459279#comment-16459279 ] Ankur Goenka commented on BEAM-4149: In reference to 

[jira] [Updated] (BEAM-3418) Python Fnapi - Multiprocess worker

[ https://issues.apache.org/jira/browse/BEAM-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3418: --- Issue Type: Improvement (was: Bug) > Python Fnapi - Multiprocess worker >

[jira] [Created] (BEAM-3418) Python Fnapi - Multiprocess worker

Ankur Goenka created BEAM-3418: -- Summary: Python Fnapi - Multiprocess worker Key: BEAM-3418 URL: https://issues.apache.org/jira/browse/BEAM-3418 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3411) Test apache_beam.examples.wordcount_it_test.WordCountIT times out

[ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314279#comment-16314279 ] Ankur Goenka commented on BEAM-3411: We missed catching a case where progress report for an

[jira] [Comment Edited] (BEAM-3411) Test apache_beam.examples.wordcount_it_test.WordCountIT times out

[ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314279#comment-16314279 ] Ankur Goenka edited comment on BEAM-3411 at 1/6/18 1:48 AM: We missed catching

[jira] [Comment Edited] (BEAM-3411) Test apache_beam.examples.wordcount_it_test.WordCountIT times out

[ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16314279#comment-16314279 ] Ankur Goenka edited comment on BEAM-3411 at 1/6/18 1:47 AM: We missed catching

[jira] [Created] (BEAM-3389) Clean receive queue in dataplane

Ankur Goenka created BEAM-3389: -- Summary: Clean receive queue in dataplane Key: BEAM-3389 URL: https://issues.apache.org/jira/browse/BEAM-3389 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-3389) Clean receive queue in dataplane

[ https://issues.apache.org/jira/browse/BEAM-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-3389: -- Assignee: Ankur Goenka (was: Ahmet Altay) > Clean receive queue in dataplane >

[jira] [Closed] (BEAM-3389) Clean receive queue in dataplane

[ https://issues.apache.org/jira/browse/BEAM-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka closed BEAM-3389. -- Resolution: Fixed Fix Version/s: 2.3.0 > Clean receive queue in dataplane >

[jira] [Updated] (BEAM-3418) Python Fnapi - Multiprocess worker

[ https://issues.apache.org/jira/browse/BEAM-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3418: --- Labels: performance portability (was: ) > Python Fnapi - Multiprocess worker >

[jira] [Closed] (BEAM-3239) Enable debug server for python sdk workers

[ https://issues.apache.org/jira/browse/BEAM-3239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka closed BEAM-3239. -- Resolution: Fixed Fix Version/s: 2.3.0 > Enable debug server for python sdk workers >

[jira] [Closed] (BEAM-3155) Python SDKHarness does not use separate thread for progress reporting

[ https://issues.apache.org/jira/browse/BEAM-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka closed BEAM-3155. -- Resolution: Fixed Fix Version/s: 2.3.0 > Python SDKHarness does not use separate thread for

[jira] [Closed] (BEAM-3135) Adding futures dependency to beam python SDK

[ https://issues.apache.org/jira/browse/BEAM-3135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka closed BEAM-3135. -- Resolution: Fixed Fix Version/s: 2.3.0 > Adding futures dependency to beam python SDK >

[jira] [Resolved] (BEAM-3486) Progress reporting for python sdk fix

[ https://issues.apache.org/jira/browse/BEAM-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-3486. Resolution: Fixed > Progress reporting for python sdk fix > - >

[jira] [Resolved] (BEAM-3411) Test apache_beam.examples.wordcount_it_test.WordCountIT times out

[ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-3411. Resolution: Fixed Fix Version/s: 2.3.0 > Test

[jira] [Commented] (BEAM-3411) Test apache_beam.examples.wordcount_it_test.WordCountIT times out

[ https://issues.apache.org/jira/browse/BEAM-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16338151#comment-16338151 ] Ankur Goenka commented on BEAM-3411: [https://builds.apache.org/job/beam_PostCommit_Python_Verify/]  is

[jira] [Updated] (BEAM-3486) Progress reporting for python sdk fix

[ https://issues.apache.org/jira/browse/BEAM-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3486: --- Issue Type: Bug (was: Improvement) > Progress reporting for python sdk fix >

[jira] [Updated] (BEAM-3486) Progress reporting for python sdk fix

[ https://issues.apache.org/jira/browse/BEAM-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3486: --- Description: Python sdk was not reporting progress correctly (was:

[jira] [Updated] (BEAM-3486) Progress reporting for python sdk fix

[ https://issues.apache.org/jira/browse/BEAM-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-3486: --- Labels: (was: newbie) > Progress reporting for python sdk fix >

[jira] [Resolved] (BEAM-4748) Flaky post-commit test org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactServicesTest.putArtifactsMultipleFilesConcurrentlyTest

[ https://issues.apache.org/jira/browse/BEAM-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-4748. Resolution: Duplicate Fix Version/s: 2.7.0 > Flaky post-commit test >

[jira] [Commented] (BEAM-4748) Flaky post-commit test org.apache.beam.runners.fnexecution.artifact.BeamFileSystemArtifactServicesTest.putArtifactsMultipleFilesConcurrentlyTest

[ https://issues.apache.org/jira/browse/BEAM-4748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562415#comment-16562415 ] Ankur Goenka commented on BEAM-4748: This flaky test was fixed in

[jira] [Updated] (BEAM-5041) Java Fn SDK Harness skips unprocessed pCollections

[ https://issues.apache.org/jira/browse/BEAM-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-5041: --- Description: Java Sdk Harness used pCollections to keep track of computed consumers

[jira] [Updated] (BEAM-5041) Java Fn SDK Harness skips unprocessed pCollections

[ https://issues.apache.org/jira/browse/BEAM-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-5041: --- Description: Java Sdk Harness used pCollections to keep track of computed consumers

[jira] [Updated] (BEAM-5041) Java Fn SDK Harness skips unprocessed pCollections

[ https://issues.apache.org/jira/browse/BEAM-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-5041: --- Description: Java Sdk Harness used pCollections to keep track of computed consumers

[jira] [Created] (BEAM-5041) Java Fn SDK Harness skips unprocessed pCollections

Ankur Goenka created BEAM-5041: -- Summary: Java Fn SDK Harness skips unprocessed pCollections Key: BEAM-5041 URL: https://issues.apache.org/jira/browse/BEAM-5041 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-5041) Java Fn SDK Harness skips unprocessed pCollections

[ https://issues.apache.org/jira/browse/BEAM-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-5041: --- Description: Java Sdk Harness used pCollections to keep track of computed consumers

[jira] [Created] (BEAM-5022) Move beam-sdks-java-fn-execution#createPortableValidatesRunnerTask to BeamGradlePlugin

Ankur Goenka created BEAM-5022: -- Summary: Move beam-sdks-java-fn-execution#createPortableValidatesRunnerTask to BeamGradlePlugin Key: BEAM-5022 URL: https://issues.apache.org/jira/browse/BEAM-5022

[jira] [Created] (BEAM-5023) BeamFnDataGrpcClient should pass the worker_id when connecting to the RunnerHarness

Ankur Goenka created BEAM-5023: -- Summary: BeamFnDataGrpcClient should pass the worker_id when connecting to the RunnerHarness Key: BEAM-5023 URL: https://issues.apache.org/jira/browse/BEAM-5023 Project:

[jira] [Commented] (BEAM-4826) Flink runner sends bad flatten to SDK

[ https://issues.apache.org/jira/browse/BEAM-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565838#comment-16565838 ] Ankur Goenka commented on BEAM-4826: I see.  The split of flatten is ok. I will see how we can

[jira] [Resolved] (BEAM-4067) Java: FlinkPortableTestRunner: runs portably via self-started local Flink

[ https://issues.apache.org/jira/browse/BEAM-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-4067. Resolution: Fixed Fix Version/s: 2.7.0 > Java: FlinkPortableTestRunner: runs portably via

[jira] [Commented] (BEAM-4067) Java: FlinkPortableTestRunner: runs portably via self-started local Flink

[ https://issues.apache.org/jira/browse/BEAM-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566051#comment-16566051 ] Ankur Goenka commented on BEAM-4067: This feature is implemented in 

[jira] [Resolved] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-4147. Resolution: Resolved Fix Version/s: 2.6.0 We have a working ArtifactStaging and

[jira] [Commented] (BEAM-3230) beam_PerformanceTests_Python is failing

[ https://issues.apache.org/jira/browse/BEAM-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566065#comment-16566065 ] Ankur Goenka commented on BEAM-3230: [~tvalentyn] The latest fail is

[jira] [Commented] (BEAM-5022) Move beam-sdks-java-fn-execution#createPortableValidatesRunnerTask to BeamModulePlugin

[ https://issues.apache.org/jira/browse/BEAM-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566055#comment-16566055 ] Ankur Goenka commented on BEAM-5022: Addressed as part of [https://github.com/apache/beam/pull/6073]

[jira] [Commented] (BEAM-4826) Flink runner sends bad flatten to SDK

[ https://issues.apache.org/jira/browse/BEAM-4826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566224#comment-16566224 ] Ankur Goenka commented on BEAM-4826: [~herohde] Quick question. What do you mean by "Dataflow removes

[jira] [Created] (BEAM-5090) Use topological sort during ProcessBundle in Java SDKHarness

Ankur Goenka created BEAM-5090: -- Summary: Use topological sort during ProcessBundle in Java SDKHarness Key: BEAM-5090 URL: https://issues.apache.org/jira/browse/BEAM-5090 Project: Beam Issue

[jira] [Comment Edited] (BEAM-5110) Reconile Flink JVM singleton management with deployment

[ https://issues.apache.org/jira/browse/BEAM-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578840#comment-16578840 ] Ankur Goenka edited comment on BEAM-5110 at 8/13/18 7:56 PM: - I agree. We

[jira] [Commented] (BEAM-5110) Reconile Flink JVM singleton management with deployment

[ https://issues.apache.org/jira/browse/BEAM-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578840#comment-16578840 ] Ankur Goenka commented on BEAM-5110: I agree. We should provide control SDKHarness container instances

[jira] [Created] (BEAM-5155) Custom sdk_location parameter not working with fn_api

Ankur Goenka created BEAM-5155: -- Summary: Custom sdk_location parameter not working with fn_api Key: BEAM-5155 URL: https://issues.apache.org/jira/browse/BEAM-5155 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-4130) Portable Flink runner JobService entry point in a Docker container

[ https://issues.apache.org/jira/browse/BEAM-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-4130: -- Assignee: Maximilian Michels (was: Ankur Goenka) > Portable Flink runner JobService entry

[jira] [Commented] (BEAM-5110) Reconile Flink JVM singleton management with deployment

[ https://issues.apache.org/jira/browse/BEAM-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580554#comment-16580554 ] Ankur Goenka commented on BEAM-5110: With the worker_id introduction, fn_api is capable of supporting

[jira] [Comment Edited] (BEAM-5110) Reconile Flink JVM singleton management with deployment

[ https://issues.apache.org/jira/browse/BEAM-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580554#comment-16580554 ] Ankur Goenka edited comment on BEAM-5110 at 8/14/18 11:47 PM: -- With the

[jira] [Commented] (BEAM-5110) Reconile Flink JVM singleton management with deployment

[ https://issues.apache.org/jira/browse/BEAM-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573688#comment-16573688 ] Ankur Goenka commented on BEAM-5110: We can invert the class loading order using 

[jira] [Comment Edited] (BEAM-5110) Reconile Flink JVM singleton management with deployment

[ https://issues.apache.org/jira/browse/BEAM-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573688#comment-16573688 ] Ankur Goenka edited comment on BEAM-5110 at 8/8/18 6:43 PM: We can invert the

[jira] [Updated] (BEAM-5090) Use topological sort during ProcessBundle in Java SDKHarness

[ https://issues.apache.org/jira/browse/BEAM-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-5090: --- Description: In reference to comment

[jira] [Updated] (BEAM-5090) Use topological sort during ProcessBundle in Java SDKHarness

[ https://issues.apache.org/jira/browse/BEAM-5090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka updated BEAM-5090: --- Description: In reference to comment

[jira] [Resolved] (BEAM-4699) BeamFileSystemArtifactServicesTest.putArtifactsSingleSmallFileTest flake

[ https://issues.apache.org/jira/browse/BEAM-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-4699. Resolution: Duplicate Fix Version/s: 2.7.0 The issue is a duplicate of BEAM-4810 Please re

[jira] [Commented] (BEAM-5190) Python pipeline options are not picked correctly by PortableRunner

[ https://issues.apache.org/jira/browse/BEAM-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588483#comment-16588483 ] Ankur Goenka commented on BEAM-5190: cc: [~thw] This blocks the worker_thread option on python 

[jira] [Created] (BEAM-5190) Python pipeline options are not picked correctly by PortableRunner

Ankur Goenka created BEAM-5190: -- Summary: Python pipeline options are not picked correctly by PortableRunner Key: BEAM-5190 URL: https://issues.apache.org/jira/browse/BEAM-5190 Project: Beam

[jira] [Commented] (BEAM-5190) Python pipeline options are not picked correctly by PortableRunner

[ https://issues.apache.org/jira/browse/BEAM-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588549#comment-16588549 ] Ankur Goenka commented on BEAM-5190: Options are rewritten to URN causing the issue.

[jira] [Commented] (BEAM-5180) Broken FileResultCoder via parseSchema change

[ https://issues.apache.org/jira/browse/BEAM-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591973#comment-16591973 ] Ankur Goenka commented on BEAM-5180: >From the java.net.URI docs, A hierarchical URI is subject to

[jira] [Comment Edited] (BEAM-5180) Broken FileResultCoder via parseSchema change

[ https://issues.apache.org/jira/browse/BEAM-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591973#comment-16591973 ] Ankur Goenka edited comment on BEAM-5180 at 8/25/18 10:06 PM: -- >From the 

[jira] [Commented] (BEAM-5180) Broken FileResultCoder via parseSchema change

[ https://issues.apache.org/jira/browse/BEAM-5180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592727#comment-16592727 ] Ankur Goenka commented on BEAM-5180: That's correct. HDFS file URIs in this case do not have authority

[jira] [Created] (BEAM-5218) Add the portable test name to the pipeline name for easy debugging

Ankur Goenka created BEAM-5218: -- Summary: Add the portable test name to the pipeline name for easy debugging Key: BEAM-5218 URL: https://issues.apache.org/jira/browse/BEAM-5218 Project: Beam

[jira] [Resolved] (BEAM-5155) Custom sdk_location parameter not working with fn_api

[ https://issues.apache.org/jira/browse/BEAM-5155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka resolved BEAM-5155. Resolution: Fixed Fix Version/s: 2.7.0 > Custom sdk_location parameter not working with

[jira] [Created] (BEAM-5166) Add support for upper bound and optimum concurrency in SDK

Ankur Goenka created BEAM-5166: -- Summary: Add support for upper bound and optimum concurrency in SDK Key: BEAM-5166 URL: https://issues.apache.org/jira/browse/BEAM-5166 Project: Beam Issue

[jira] [Created] (BEAM-5167) Use concurrency information from SDK Harness in Flink Portable Runner

Ankur Goenka created BEAM-5167: -- Summary: Use concurrency information from SDK Harness in Flink Portable Runner Key: BEAM-5167 URL: https://issues.apache.org/jira/browse/BEAM-5167 Project: Beam

[jira] [Commented] (BEAM-5190) Python pipeline options are not picked correctly by PortableRunner

[ https://issues.apache.org/jira/browse/BEAM-5190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589865#comment-16589865 ] Ankur Goenka commented on BEAM-5190: Yes, The more interesting stack is on the Python SDK side where 

[jira] [Created] (BEAM-5194) Pipeline options with multi value are not deserialized correctly from map

Ankur Goenka created BEAM-5194: -- Summary: Pipeline options with multi value are not deserialized correctly from map Key: BEAM-5194 URL: https://issues.apache.org/jira/browse/BEAM-5194 Project: Beam

[jira] [Assigned] (BEAM-5194) Pipeline options with multi value are not deserialized correctly from map

[ https://issues.apache.org/jira/browse/BEAM-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-5194: -- Assignee: Ankur Goenka (was: Ahmet Altay) > Pipeline options with multi value are not

[jira] [Comment Edited] (BEAM-5156) Apache Beam on dataflow runner can't find Tensorflow for workers

[ https://issues.apache.org/jira/browse/BEAM-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589137#comment-16589137 ] Ankur Goenka edited comment on BEAM-5156 at 8/22/18 5:17 PM: - Check the thread

[jira] [Commented] (BEAM-5156) Apache Beam on dataflow runner can't find Tensorflow for workers

[ https://issues.apache.org/jira/browse/BEAM-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589137#comment-16589137 ] Ankur Goenka commented on BEAM-5156: Check the thread

[jira] [Created] (BEAM-5219) Expose OutboundMessage in PubSub client

Ankur Goenka created BEAM-5219: -- Summary: Expose OutboundMessage in PubSub client Key: BEAM-5219 URL: https://issues.apache.org/jira/browse/BEAM-5219 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-5219) Expose OutboundMessage in PubSub client

[ https://issues.apache.org/jira/browse/BEAM-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-5219: -- Assignee: Ankur Goenka (was: Chamikara Jayalath) > Expose OutboundMessage in PubSub client >

[jira] [Assigned] (BEAM-4834) Validate cycles in org.apache.beam.runners.core.construction.graph.Network before doing topological sort

[ https://issues.apache.org/jira/browse/BEAM-4834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Goenka reassigned BEAM-4834: -- Assignee: Ankur Goenka (was: Kenneth Knowles) > Validate cycles in

[jira] [Created] (BEAM-4834) Validate cycles in org.apache.beam.runners.core.construction.graph.Network before doing topological sort

Ankur Goenka created BEAM-4834: -- Summary: Validate cycles in org.apache.beam.runners.core.construction.graph.Network before doing topological sort Key: BEAM-4834 URL: https://issues.apache.org/jira/browse/BEAM-4834

[jira] [Created] (BEAM-4810) Flaky test BeamFileSystemArtifactServicesTest

Ankur Goenka created BEAM-4810: -- Summary: Flaky test BeamFileSystemArtifactServicesTest Key: BEAM-4810 URL: https://issues.apache.org/jira/browse/BEAM-4810 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-5273) Local file system does not work as expected on Portability Framework with Docker

Ankur Goenka created BEAM-5273: -- Summary: Local file system does not work as expected on Portability Framework with Docker Key: BEAM-5273 URL: https://issues.apache.org/jira/browse/BEAM-5273 Project:

  1   2   >