[jira] [Created] (BEAM-4166) FnApiDoFnRunner doesn't invoke setup/teardown

2018-04-24 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4166: -- Summary: FnApiDoFnRunner doesn't invoke setup/teardown Key: BEAM-4166 URL: https://issues.apache.org/jira/browse/BEAM-4166 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3456) Enable large scale JdbcIOIT Performance Test

2018-04-24 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16451246#comment-16451246 ] Eugene Kirpichov commented on BEAM-3456: Nice! Did we observe an improvement here a

[jira] [Commented] (BEAM-4166) FnApiDoFnRunner doesn't invoke setup/teardown

2018-04-24 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16451250#comment-16451250 ] Eugene Kirpichov commented on BEAM-4166: Actually we do have test coverage for this

[jira] [Closed] (BEAM-4146) Python SDK sets environment in portable pipelines

2018-04-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4146. -- Resolution: Duplicate Fix Version/s: Not applicable > Python SDK sets environment in porta

[jira] [Closed] (BEAM-4071) Portable Runner Job API shim

2018-04-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4071. -- Resolution: Fixed Fix Version/s: 2.5.0 > Portable Runner Job API shim > --

[jira] [Commented] (BEAM-4130) Portable Flink runner entry point

2018-04-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16453265#comment-16453265 ] Eugene Kirpichov commented on BEAM-4130: Clarification: we want the entry point to

[jira] [Created] (BEAM-4179) Go code should get standard URNs from proto annotations

2018-04-26 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4179: -- Summary: Go code should get standard URNs from proto annotations Key: BEAM-4179 URL: https://issues.apache.org/jira/browse/BEAM-4179 Project: Beam Issue

[jira] [Commented] (BEAM-4179) Go code should get standard URNs from proto annotations

2018-04-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16455575#comment-16455575 ] Eugene Kirpichov commented on BEAM-4179: Here's what I got so far https://gist.git

[jira] [Created] (BEAM-4180) Remove the Payload suffix from model protos

2018-04-26 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4180: -- Summary: Remove the Payload suffix from model protos Key: BEAM-4180 URL: https://issues.apache.org/jira/browse/BEAM-4180 Project: Beam Issue Type: Sub-ta

[jira] [Updated] (BEAM-4071) Java: PortableRunner - p.run() via given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4071: --- Summary: Java: PortableRunner - p.run() via given JobService (was: Portable Runner Job API shi

[jira] [Created] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4204: -- Summary: Python: PortableRunner - p.run() via given JobService Key: BEAM-4204 URL: https://issues.apache.org/jira/browse/BEAM-4204 Project: Beam Issue Ty

[jira] [Created] (BEAM-4205) Java: WordCount runs against manually started Flink at master

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4205: -- Summary: Java: WordCount runs against manually started Flink at master Key: BEAM-4205 URL: https://issues.apache.org/jira/browse/BEAM-4205 Project: Beam

[jira] [Created] (BEAM-4206) Python: WordCount runs against manually started Flink at master

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4206: -- Summary: Python: WordCount runs against manually started Flink at master Key: BEAM-4206 URL: https://issues.apache.org/jira/browse/BEAM-4206 Project: Beam

[jira] [Created] (BEAM-4207) Java: script for running set of ValidatesRunner tests against given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4207: -- Summary: Java: script for running set of ValidatesRunner tests against given JobService Key: BEAM-4207 URL: https://issues.apache.org/jira/browse/BEAM-4207 Projec

[jira] [Created] (BEAM-4208) Python: Script for running a set of ValidatesRunner tests against given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4208: -- Summary: Python: Script for running a set of ValidatesRunner tests against given JobService Key: BEAM-4208 URL: https://issues.apache.org/jira/browse/BEAM-4208 P

[jira] [Commented] (BEAM-4130) Portable Flink runner entry point

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459285#comment-16459285 ] Eugene Kirpichov commented on BEAM-4130: Further clarification: the entry point, li

[jira] [Updated] (BEAM-4130) Portable Flink runner JobService entry point in a Docker container

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4130: --- Summary: Portable Flink runner JobService entry point in a Docker container (was: Portable Fli

[jira] [Created] (BEAM-4209) Java: PortableRunner: p.run() starts a given JobService docker container and runs through it

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4209: -- Summary: Java: PortableRunner: p.run() starts a given JobService docker container and runs through it Key: BEAM-4209 URL: https://issues.apache.org/jira/browse/BEAM-4209

[jira] [Created] (BEAM-4210) Python: PortableRunner: p.run() starts a given JobService docker container and runs through it

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4210: -- Summary: Python: PortableRunner: p.run() starts a given JobService docker container and runs through it Key: BEAM-4210 URL: https://issues.apache.org/jira/browse/BEAM-4210

[jira] [Updated] (BEAM-4067) Java: FlinkPortableTestRunner: runs portably via self-started local Flink

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4067: --- Summary: Java: FlinkPortableTestRunner: runs portably via self-started local Flink (was: Add p

[jira] [Commented] (BEAM-4067) Add portable Flink test runner

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459299#comment-16459299 ] Eugene Kirpichov commented on BEAM-4067: Clarification: this should probably go thr

[jira] [Created] (BEAM-4211) Python: FlinkPortableTestRunner: runs portably via self-started local Flink

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4211: -- Summary: Python: FlinkPortableTestRunner: runs portably via self-started local Flink Key: BEAM-4211 URL: https://issues.apache.org/jira/browse/BEAM-4211 Project:

[jira] [Created] (BEAM-4212) Flink portable ValidatesRunner tests continuously run on Jenkins

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4212: -- Summary: Flink portable ValidatesRunner tests continuously run on Jenkins Key: BEAM-4212 URL: https://issues.apache.org/jira/browse/BEAM-4212 Project: Beam

[jira] [Updated] (BEAM-4176) Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4176: --- Summary: Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner

[jira] [Created] (BEAM-4213) Python: Portable batch Flink runner passes all ValidatesRunner tests

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4213: -- Summary: Python: Portable batch Flink runner passes all ValidatesRunner tests Key: BEAM-4213 URL: https://issues.apache.org/jira/browse/BEAM-4213 Project: Beam

[jira] [Created] (BEAM-4214) Python ValidatesRunner test coverage is very poor

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4214: -- Summary: Python ValidatesRunner test coverage is very poor Key: BEAM-4214 URL: https://issues.apache.org/jira/browse/BEAM-4214 Project: Beam Issue Type:

[jira] [Updated] (BEAM-4213) Python: Portable batch Flink runner passes all ValidatesRunner tests

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4213: --- Description: Like BEAM-4176, but 1) for Python; 2) there is no baseline; 3) the set of Validate

[jira] [Closed] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4204. -- Resolution: Duplicate Fix Version/s: Not applicable This appears to be a dupe of BEAM-3792

[jira] [Created] (BEAM-4216) Flink: Staged artifacts are delivered to the SDK container

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4216: -- Summary: Flink: Staged artifacts are delivered to the SDK container Key: BEAM-4216 URL: https://issues.apache.org/jira/browse/BEAM-4216 Project: Beam Iss

[jira] [Created] (BEAM-4217) Java SDK stages artifacts when talking to job server

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4217: -- Summary: Java SDK stages artifacts when talking to job server Key: BEAM-4217 URL: https://issues.apache.org/jira/browse/BEAM-4217 Project: Beam Issue Typ

[jira] [Commented] (BEAM-3714) JdbcIO.read() should create a forward-only, read-only result set

2018-05-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16459818#comment-16459818 ] Eugene Kirpichov commented on BEAM-3714: JB, what's the reason for reassigning this

[jira] [Closed] (BEAM-4144) SplittableParDoProcessFnTest has had a masked failure

2018-05-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4144. -- Resolution: Fixed Fix Version/s: 2.5.0 > SplittableParDoProcessFnTest has had a masked fai

[jira] [Closed] (BEAM-4217) Java SDK stages artifacts when talking to job server

2018-05-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4217. -- Resolution: Fixed Fix Version/s: 2.5.0 Per Ben, this is already done in the Job API shim.

[jira] [Reopened] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-05-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reopened BEAM-4204: Assignee: Eugene Kirpichov (was: Robert Bradshaw) universal_local_runner does more than ju

[jira] [Updated] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

2018-05-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4147: --- Summary: Abstractions for artifact delivery via arbitrary storage backends (was: Artifact sour

[jira] [Commented] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

2018-05-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16461703#comment-16461703 ] Eugene Kirpichov commented on BEAM-4147: This covers an ArtifactStagingService and

[jira] [Created] (BEAM-4242) Wait.on() is O(n)

2018-05-05 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4242: -- Summary: Wait.on() is O(n) Key: BEAM-4242 URL: https://issues.apache.org/jira/browse/BEAM-4242 Project: Beam Issue Type: Bug Components: sdk-ja

[jira] [Closed] (BEAM-4242) Wait.on() is O(n)

2018-05-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4242. -- Resolution: Fixed Fix Version/s: 2.5.0 > Wait.on() is O(n) > - > >

[jira] [Commented] (BEAM-2594) Python shim for submitting to the ULR

2018-05-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469772#comment-16469772 ] Eugene Kirpichov commented on BEAM-2594: I think this Jira is misformulated. We nee

[jira] [Updated] (BEAM-2594) Python shim for submitting to a JobService

2018-05-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-2594: --- Summary: Python shim for submitting to a JobService (was: Python shim for submitting to the UL

[jira] [Closed] (BEAM-2597) FlinkRunner ExecutableStage batch operator

2018-05-11 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2597. -- Resolution: Fixed Fix Version/s: 2.5.0 > FlinkRunner ExecutableStage batch operator >

[jira] [Created] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-05-11 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4281: -- Summary: GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky Key: BEAM-4281 URL: https://issues.apache.org/jira/browse/BEAM-4281

[jira] [Closed] (BEAM-3515) Use portable ParDoPayload for SDF in DataflowRunner

2018-05-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3515. -- Resolution: Fixed Fix Version/s: 2.5.0 > Use portable ParDoPayload for SDF in DataflowRunn

[jira] [Updated] (BEAM-4287) SplittableDoFn: splitAtFraction() API for Java

2018-05-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4287: --- Summary: SplittableDoFn: splitAtFraction() API for Java (was: SplittableDoFn: splitAtFraction(

[jira] [Created] (BEAM-4287) SplittableDoFn: splitAtFraction() API

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4287: -- Summary: SplittableDoFn: splitAtFraction() API Key: BEAM-4287 URL: https://issues.apache.org/jira/browse/BEAM-4287 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4288: -- Summary: SplittableDoFn: splitAtFraction() API for Python Key: BEAM-4288 URL: https://issues.apache.org/jira/browse/BEAM-4288 Project: Beam Issue Type: B

[jira] [Assigned] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

2018-05-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4267: -- Assignee: Ben Sidhom (was: Axel Magnuson) > Implement a reusable library that can run a

[jira] [Created] (BEAM-4290) ArtifactStagingService that stages to a distributed filesystem

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4290: -- Summary: ArtifactStagingService that stages to a distributed filesystem Key: BEAM-4290 URL: https://issues.apache.org/jira/browse/BEAM-4290 Project: Beam

[jira] [Created] (BEAM-4291) ArtifactRetrievalService that retrieves artifacts from a distributed filesystem

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4291: -- Summary: ArtifactRetrievalService that retrieves artifacts from a distributed filesystem Key: BEAM-4291 URL: https://issues.apache.org/jira/browse/BEAM-4291 Proje

[jira] [Commented] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479874#comment-16479874 ] Eugene Kirpichov commented on BEAM-2588: Now it remains to create a Flink-specific

[jira] [Comment Edited] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479874#comment-16479874 ] Eugene Kirpichov edited comment on BEAM-2588 at 5/17/18 11:26 PM: ---

[jira] [Assigned] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2588: -- Assignee: Robert Bradshaw (was: Axel Magnuson) > Portable Flink Runner Job API > --

[jira] [Commented] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16479875#comment-16479875 ] Eugene Kirpichov commented on BEAM-2588: Axel said Robert is going to work on this.

[jira] [Created] (BEAM-4375) Gradle doesn't run tests under RunWith(Enclosed.class)

2018-05-21 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4375: -- Summary: Gradle doesn't run tests under RunWith(Enclosed.class) Key: BEAM-4375 URL: https://issues.apache.org/jira/browse/BEAM-4375 Project: Beam Issue T

[jira] [Commented] (BEAM-4016) Direct runner incorrect lifecycle, @SplitRestriction should execute after @Setup on SplittableDoFn

2018-04-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437961#comment-16437961 ] Eugene Kirpichov commented on BEAM-4016: Yeah it's the desired order. The fix is to

[jira] [Comment Edited] (BEAM-4016) Direct runner incorrect lifecycle, @SplitRestriction should execute after @Setup on SplittableDoFn

2018-04-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16437961#comment-16437961 ] Eugene Kirpichov edited comment on BEAM-4016 at 4/13/18 9:29 PM:

[jira] [Commented] (BEAM-4075) Verify that the Build works on MacOS

2018-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16438550#comment-16438550 ] Eugene Kirpichov commented on BEAM-4075: I'm running the build on MacOS. It worked

[jira] [Assigned] (BEAM-3268) getPerDestinationOutputFilenames() is getting processed before write is finished on dataflow runner

2018-04-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3268: -- Assignee: Eugene Kirpichov (was: Reuven Lax) > getPerDestinationOutputFilenames() is ge

[jira] [Assigned] (BEAM-3859) Add an override to read from an Unbounded Source via Impulse and ParDo

2018-04-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3859: -- Assignee: Eugene Kirpichov > Add an override to read from an Unbounded Source via Impuls

[jira] [Commented] (BEAM-3268) getPerDestinationOutputFilenames() is getting processed before write is finished on dataflow runner

2018-04-18 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16442731#comment-16442731 ] Eugene Kirpichov commented on BEAM-3268: They are, if it's fused with another ParDo

[jira] [Commented] (BEAM-4016) Direct runner incorrect lifecycle, @SplitRestriction should execute after @Setup on SplittableDoFn

2018-04-18 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16443139#comment-16443139 ] Eugene Kirpichov commented on BEAM-4016: Can you clarify about calling it more time

[jira] [Assigned] (BEAM-3970) Java SDK harness supports window_into

2018-04-19 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3970: -- Assignee: Eugene Kirpichov (was: Luke Cwik) > Java SDK harness supports window_into > -

[jira] [Closed] (BEAM-4098) Handle WindowInto in the Java SDK Harness

2018-04-19 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4098. -- Resolution: Duplicate Fix Version/s: Not applicable > Handle WindowInto in the Java SDK Ha

[jira] [Closed] (BEAM-3714) JdbcIO.read() should create a forward-only, read-only result set

2018-04-20 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3714. -- Resolution: Fixed Fix Version/s: 2.5.0 > JdbcIO.read() should create a forward-only, read-

[jira] [Commented] (BEAM-4096) BigQueryIO ValueProvider support for Method and Triggering Frequency

2018-04-22 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16447521#comment-16447521 ] Eugene Kirpichov commented on BEAM-4096: Quick comment: making Method a ValueProvid

[jira] [Closed] (BEAM-3499) Watch can make no progress if a single poll takes more than checkpoint interval

2018-02-06 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3499. -- Resolution: Fixed Fix Version/s: 2.3.0 > Watch can make no progress if a single poll takes

[jira] [Created] (BEAM-3683) Support BigQuery column-based time partitioning

2018-02-09 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3683: -- Summary: Support BigQuery column-based time partitioning Key: BEAM-3683 URL: https://issues.apache.org/jira/browse/BEAM-3683 Project: Beam Issue Type: Bu

[jira] [Created] (BEAM-3684) Update well-known coder URNs in Go SDK

2018-02-09 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3684: -- Summary: Update well-known coder URNs in Go SDK Key: BEAM-3684 URL: https://issues.apache.org/jira/browse/BEAM-3684 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-3696) MQTT IO should compute watermark and ack messages outside of finalizeCheckpoint method

2018-02-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3696: -- Assignee: Jean-Baptiste Onofré (was: Reuven Lax) > MQTT IO should compute watermark and

[jira] [Closed] (BEAM-3647) Default Coder/Reading Coder From File

2018-02-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3647. -- Resolution: Duplicate Fix Version/s: 2.1.0 I believe this is a duplicate of BEAM-3615 that

[jira] [Created] (BEAM-3697) Add errorprone to maven and gradle builds

2018-02-13 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3697: -- Summary: Add errorprone to maven and gradle builds Key: BEAM-3697 URL: https://issues.apache.org/jira/browse/BEAM-3697 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3698) Support SDF over Fn API

2018-02-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16362952#comment-16362952 ] Eugene Kirpichov commented on BEAM-3698: CC: [~herohde] > Support SDF over Fn API

[jira] [Created] (BEAM-3698) Support SDF over Fn API

2018-02-13 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3698: -- Summary: Support SDF over Fn API Key: BEAM-3698 URL: https://issues.apache.org/jira/browse/BEAM-3698 Project: Beam Issue Type: Bug Components:

[jira] [Closed] (BEAM-2607) Enforce that SDF must return stop() after a failed tryClaim() call

2018-02-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2607. -- Resolution: Fixed Fix Version/s: 2.3.0 This was recently fixed. > Enforce that SDF must r

[jira] [Closed] (BEAM-65) SplittableDoFn

2018-02-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-65. Resolution: Fixed Fix Version/s: 2.2.0 SDF has been available in the Beam model and implemented

[jira] [Updated] (BEAM-3647) Default Coder/Reading Coder From File

2018-02-15 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-3647: --- Fix Version/s: (was: 2.1.0) > Default Coder/Reading Coder From File >

[jira] [Reopened] (BEAM-3647) Default Coder/Reading Coder From File

2018-02-15 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reopened BEAM-3647: Assignee: Anton Kedin I see. My apologies, I misunderstood the question. Assigning to [~ked

[jira] [Created] (BEAM-3714) JdbcIO.read() should create a forward-only, read-only result set

2018-02-15 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3714: -- Summary: JdbcIO.read() should create a forward-only, read-only result set Key: BEAM-3714 URL: https://issues.apache.org/jira/browse/BEAM-3714 Project: Beam

[jira] [Closed] (BEAM-3683) Support BigQuery column-based time partitioning

2018-02-20 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3683. -- Resolution: Fixed Fix Version/s: 2.4.0 > Support BigQuery column-based time partitioning >

[jira] [Assigned] (BEAM-2939) Fn API streaming SDF support

2018-02-23 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2939: -- Assignee: Eugene Kirpichov > Fn API streaming SDF support >

[jira] [Closed] (BEAM-3698) Support SDF over Fn API

2018-02-23 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3698. -- Resolution: Duplicate Fix Version/s: Not applicable > Support SDF over Fn API > --

[jira] [Commented] (BEAM-2939) Fn API streaming SDF support

2018-02-23 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375125#comment-16375125 ] Eugene Kirpichov commented on BEAM-2939: Proposed design: https://s.apache.org/beam

[jira] [Created] (BEAM-3741) Proto changes for splitting over Fn API

2018-02-23 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3741: -- Summary: Proto changes for splitting over Fn API Key: BEAM-3741 URL: https://issues.apache.org/jira/browse/BEAM-3741 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-3742) Support for running a streaming SDF in Python SDK

2018-02-23 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3742: -- Summary: Support for running a streaming SDF in Python SDK Key: BEAM-3742 URL: https://issues.apache.org/jira/browse/BEAM-3742 Project: Beam Issue Type:

[jira] [Created] (BEAM-3743) Support for SDF splitting protocol in ULR

2018-02-23 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3743: -- Summary: Support for SDF splitting protocol in ULR Key: BEAM-3743 URL: https://issues.apache.org/jira/browse/BEAM-3743 Project: Beam Issue Type: Sub-task

[jira] [Closed] (BEAM-1542) Need Source/Sink for Spanner

2018-02-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1542. -- Resolution: Fixed Fix Version/s: 2.1.0 This has been in usable shape since 2.1.0. > Need

[jira] [Closed] (BEAM-1581) JSON source and sink

2018-02-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1581. -- Resolution: Won't Fix Fix Version/s: Not applicable AFAICT this has been superseded with A

[jira] [Commented] (BEAM-3714) JdbcIO.read() should create a forward-only, read-only result set

2018-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16381382#comment-16381382 ] Eugene Kirpichov commented on BEAM-3714: Hey Innocent, thanks for taking this! I'll

[jira] [Commented] (BEAM-3714) JdbcIO.read() should create a forward-only, read-only result set

2018-03-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16382636#comment-16382636 ] Eugene Kirpichov commented on BEAM-3714: The point of JdbcIO.read() is typically to

[jira] [Commented] (BEAM-2639) Unbounded Source for MongoDB

2018-03-04 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16385450#comment-16385450 ] Eugene Kirpichov commented on BEAM-2639: Consider doing this using Splittable DoFn

[jira] [Commented] (BEAM-3778) Very poor performance of side inputs when input is finely sharded

2018-03-05 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386874#comment-16386874 ] Eugene Kirpichov commented on BEAM-3778: Meanwhile, BigQueryIO per se can circumven

[jira] [Created] (BEAM-3778) Very poor performance of side inputs when input is finely sharded

2018-03-05 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3778: -- Summary: Very poor performance of side inputs when input is finely sharded Key: BEAM-3778 URL: https://issues.apache.org/jira/browse/BEAM-3778 Project: Beam

[jira] [Commented] (BEAM-3778) Very poor performance of side inputs when input is finely sharded

2018-03-05 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16386884#comment-16386884 ] Eugene Kirpichov commented on BEAM-3778: More precisely: [https://github.com/apach

[jira] [Commented] (BEAM-3796) Implement TypedWrite extending WriteFilesResult for XmlIO

2018-03-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16390712#comment-16390712 ] Eugene Kirpichov commented on BEAM-3796: I don't think this is worth doing. FileIO.

[jira] [Created] (BEAM-4557) Propagate keyed-ness of PValues properly in ReferenceRunner

2018-06-13 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4557: -- Summary: Propagate keyed-ness of PValues properly in ReferenceRunner Key: BEAM-4557 URL: https://issues.apache.org/jira/browse/BEAM-4557 Project: Beam I

[jira] [Commented] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-06-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511810#comment-16511810 ] Eugene Kirpichov commented on BEAM-4281: Will be fixed by https://github.com/apach

[jira] [Assigned] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-06-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4281: -- Assignee: Eugene Kirpichov (was: Thomas Groh) > GrpcDataServiceTest.testMessageReceive

[jira] [Closed] (BEAM-4473) Flaky org.apache.beam.runners.direct.portable.ReferenceRunnerTest.pipelineExecution

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4473. -- Resolution: Fixed Fix Version/s: 2.6.0 Fixed in https://github.com/apache/beam/pull/5585

[jira] [Closed] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4281. -- Resolution: Fixed Fix Version/s: 2.6.0 > GrpcDataServiceTest.testMessageReceivedBySingleC

[jira] [Closed] (BEAM-4291) ArtifactRetrievalService that retrieves artifacts from a distributed filesystem

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4291. -- Resolution: Fixed Fix Version/s: 2.6.0 > ArtifactRetrievalService that retrieves artifact

  1   2   3   4   5   6   7   >