[jira] [Closed] (BEAM-2370) BigQuery Insert with Partition Decorator throwing error

2017-12-11 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2370. -- Resolution: Duplicate Fix Version/s: 2.2.0 > BigQuery Insert with Partition Decorator

[jira] [Created] (BEAM-3323) Create a generator of finite-but-unbounded PCollection's for integration testing

2017-12-11 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3323: -- Summary: Create a generator of finite-but-unbounded PCollection's for integration testing Key: BEAM-3323 URL: https://issues.apache.org/jira/browse/BEAM-3323

[jira] [Commented] (BEAM-3323) Create a generator of finite-but-unbounded PCollection's for integration testing

2017-12-11 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286911#comment-16286911 ] Eugene Kirpichov commented on BEAM-3323: That's a pretty good idea. Yes it does, though only in

[jira] [Commented] (BEAM-3323) Create a generator of finite-but-unbounded PCollection's for integration testing

2017-12-11 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16286863#comment-16286863 ] Eugene Kirpichov commented on BEAM-3323: I think the other big inconvenient thing about TestStream

[jira] [Commented] (BEAM-793) JdbcIO can create a deadlock when parallelism is greater than 1

2017-10-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16219480#comment-16219480 ] Eugene Kirpichov commented on BEAM-793: --- This appears to be a MySQL issue where it can hit deadlocks

[jira] [Commented] (BEAM-2370) BigQuery Insert with Partition Decorator throwing error

2017-10-31 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226983#comment-16226983 ] Eugene Kirpichov commented on BEAM-2370: I think this is a duplicate of

[jira] [Closed] (BEAM-3054) org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest is flaky

2017-10-31 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3054. -- Resolution: Fixed Fix Version/s: 2.3.0 >

[jira] [Closed] (BEAM-2979) Race condition between KafkaIO.UnboundedKafkaReader.getWatermark() and KafkaIO.UnboundedKafkaReader.advance()

2017-10-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2979. -- Resolution: Fixed Fix Version/s: (was: 2.3.0) 2.2.0 > Race

[jira] [Commented] (BEAM-3054) org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest is flaky

2017-10-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226096#comment-16226096 ] Eugene Kirpichov commented on BEAM-3054: This appears to be because Elasticsearch uses the Lucene

[jira] [Created] (BEAM-3122) WriteFiles windowed writes don't work with session windows

2017-10-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3122: -- Summary: WriteFiles windowed writes don't work with session windows Key: BEAM-3122 URL: https://issues.apache.org/jira/browse/BEAM-3122 Project: Beam

[jira] [Assigned] (BEAM-3054) org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest is flaky

2017-10-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3054: -- Assignee: Eugene Kirpichov (was: Etienne Chauchot) >

[jira] [Created] (BEAM-3130) View.asMap() causes a ClassCastException in Apex runner

2017-10-31 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3130: -- Summary: View.asMap() causes a ClassCastException in Apex runner Key: BEAM-3130 URL: https://issues.apache.org/jira/browse/BEAM-3130 Project: Beam Issue

[jira] [Updated] (BEAM-4287) SplittableDoFn: splitAtFraction() API for Java

2018-05-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4287: --- Summary: SplittableDoFn: splitAtFraction() API for Java (was: SplittableDoFn:

[jira] [Created] (BEAM-4287) SplittableDoFn: splitAtFraction() API

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4287: -- Summary: SplittableDoFn: splitAtFraction() API Key: BEAM-4287 URL: https://issues.apache.org/jira/browse/BEAM-4287 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4288: -- Summary: SplittableDoFn: splitAtFraction() API for Python Key: BEAM-4288 URL: https://issues.apache.org/jira/browse/BEAM-4288 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

2018-05-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4267: -- Assignee: Ben Sidhom (was: Axel Magnuson) > Implement a reusable library that can run

[jira] [Created] (BEAM-4290) ArtifactStagingService that stages to a distributed filesystem

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4290: -- Summary: ArtifactStagingService that stages to a distributed filesystem Key: BEAM-4290 URL: https://issues.apache.org/jira/browse/BEAM-4290 Project: Beam

[jira] [Created] (BEAM-4291) ArtifactRetrievalService that retrieves artifacts from a distributed filesystem

2018-05-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4291: -- Summary: ArtifactRetrievalService that retrieves artifacts from a distributed filesystem Key: BEAM-4291 URL: https://issues.apache.org/jira/browse/BEAM-4291

[jira] [Closed] (BEAM-4242) Wait.on() is O(n)

2018-05-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4242. -- Resolution: Fixed Fix Version/s: 2.5.0 > Wait.on() is O(n) > - > >

[jira] [Updated] (BEAM-2594) Python shim for submitting to a JobService

2018-05-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-2594: --- Summary: Python shim for submitting to a JobService (was: Python shim for submitting to the

[jira] [Commented] (BEAM-2594) Python shim for submitting to the ULR

2018-05-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469772#comment-16469772 ] Eugene Kirpichov commented on BEAM-2594: I think this Jira is misformulated. We need a Jira for a

[jira] [Closed] (BEAM-3515) Use portable ParDoPayload for SDF in DataflowRunner

2018-05-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3515. -- Resolution: Fixed Fix Version/s: 2.5.0 > Use portable ParDoPayload for SDF in

[jira] [Created] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-05-11 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4281: -- Summary: GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky Key: BEAM-4281 URL: https://issues.apache.org/jira/browse/BEAM-4281

[jira] [Closed] (BEAM-2597) FlinkRunner ExecutableStage batch operator

2018-05-11 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2597. -- Resolution: Fixed Fix Version/s: 2.5.0 > FlinkRunner ExecutableStage batch operator >

[jira] [Created] (BEAM-4242) Wait.on() is O(n)

2018-05-05 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4242: -- Summary: Wait.on() is O(n) Key: BEAM-4242 URL: https://issues.apache.org/jira/browse/BEAM-4242 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-4375) Gradle doesn't run tests under RunWith(Enclosed.class)

2018-05-21 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4375: -- Summary: Gradle doesn't run tests under RunWith(Enclosed.class) Key: BEAM-4375 URL: https://issues.apache.org/jira/browse/BEAM-4375 Project: Beam Issue

[jira] [Commented] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

2018-05-22 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484476#comment-16484476 ] Eugene Kirpichov commented on BEAM-4267: Woohoo! Now I think it just remains to hook up side

[jira] [Commented] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479874#comment-16479874 ] Eugene Kirpichov commented on BEAM-2588: Now it remains to create a Flink-specific JobInvoker

[jira] [Comment Edited] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479874#comment-16479874 ] Eugene Kirpichov edited comment on BEAM-2588 at 5/17/18 11:26 PM: -- Now it

[jira] [Assigned] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-2588: -- Assignee: Robert Bradshaw (was: Axel Magnuson) > Portable Flink Runner Job API >

[jira] [Commented] (BEAM-2588) Portable Flink Runner Job API

2018-05-17 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16479875#comment-16479875 ] Eugene Kirpichov commented on BEAM-2588: Axel said Robert is going to work on this. > Portable

[jira] [Commented] (BEAM-4473) Flaky org.apache.beam.runners.direct.portable.ReferenceRunnerTest.pipelineExecution

2018-06-08 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16506482#comment-16506482 ] Eugene Kirpichov commented on BEAM-4473: I think the bug is that at

[jira] [Closed] (BEAM-4149) Java SDK Harness should populate worker id in control plane headers

2018-06-18 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4149. -- Resolution: Duplicate Fix Version/s: Not applicable > Java SDK Harness should populate

[jira] [Commented] (BEAM-4145) Java SDK Harness populates control request headers with worker id

2018-06-18 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16516491#comment-16516491 ] Eugene Kirpichov commented on BEAM-4145: I'll take over tgroh's PR since he's currently

[jira] [Assigned] (BEAM-4145) Java SDK Harness populates control request headers with worker id

2018-06-18 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4145: -- Assignee: Eugene Kirpichov (was: Thomas Groh) > Java SDK Harness populates control

[jira] [Created] (BEAM-4557) Propagate keyed-ness of PValues properly in ReferenceRunner

2018-06-13 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4557: -- Summary: Propagate keyed-ness of PValues properly in ReferenceRunner Key: BEAM-4557 URL: https://issues.apache.org/jira/browse/BEAM-4557 Project: Beam

[jira] [Commented] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-06-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511810#comment-16511810 ] Eugene Kirpichov commented on BEAM-4281: Will be fixed by 

[jira] [Assigned] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-06-13 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4281: -- Assignee: Eugene Kirpichov (was: Thomas Groh) >

[jira] [Closed] (BEAM-4281) GrpcDataServiceTest.testMessageReceivedBySingleClientWhenThereAreMultipleClients is flaky

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4281. -- Resolution: Fixed Fix Version/s: 2.6.0 >

[jira] [Closed] (BEAM-4473) Flaky org.apache.beam.runners.direct.portable.ReferenceRunnerTest.pipelineExecution

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4473. -- Resolution: Fixed Fix Version/s: 2.6.0 Fixed in https://github.com/apache/beam/pull/5585

[jira] [Closed] (BEAM-4291) ArtifactRetrievalService that retrieves artifacts from a distributed filesystem

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4291. -- Resolution: Fixed Fix Version/s: 2.6.0 > ArtifactRetrievalService that retrieves

[jira] [Closed] (BEAM-4216) Flink: Staged artifacts are delivered to the SDK container

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4216. -- Resolution: Fixed Fix Version/s: 2.6.0 > Flink: Staged artifacts are delivered to the

[jira] [Closed] (BEAM-2588) Portable Flink Runner Job API

2018-06-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2588. -- Resolution: Fixed Fix Version/s: 2.6.0 > Portable Flink Runner Job API >

[jira] [Closed] (BEAM-4689) Dataflow cannot deserialize SplittableParDo DoFns

2018-06-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4689. -- Resolution: Fixed Fix Version/s: 2.6.0 > Dataflow cannot deserialize SplittableParDo

[jira] [Closed] (BEAM-4267) Implement a reusable library that can run an ExecutableStage with a given Environment

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4267. -- Resolution: Fixed Fix Version/s: 2.6.0 I think we're good here :) > Implement a

[jira] [Assigned] (BEAM-4205) Java: WordCount runs against manually started Flink at master

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4205: -- Assignee: Ankur Goenka > Java: WordCount runs against manually started Flink at master

[jira] [Commented] (BEAM-4206) Python: WordCount runs against manually started Flink at master

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16522982#comment-16522982 ] Eugene Kirpichov commented on BEAM-4206: Robert and Axel are working on this, and it's *that*

[jira] [Assigned] (BEAM-4206) Python: WordCount runs against manually started Flink at master

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4206: -- Assignee: Axel Magnuson (was: Aljoscha Krettek) > Python: WordCount runs against

[jira] [Closed] (BEAM-3833) Java SDK harness should detect SDF ProcessFn and proactively checkpoint it

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3833. -- Resolution: Fixed Fix Version/s: 2.6.0 https://github.com/apache/beam/pull/5566 > Java

[jira] [Closed] (BEAM-3743) Support for SDF splitting protocol in ULR

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3743. -- Resolution: Fixed Fix Version/s: 2.6.0 https://github.com/apache/beam/pull/5566 >

[jira] [Closed] (BEAM-3741) Proto changes for splitting over Fn API

2018-06-25 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3741. -- Resolution: Fixed Fix Version/s: 2.5.0 > Proto changes for splitting over Fn API >

[jira] [Closed] (BEAM-2826) Need to generate a single XML file when write is performed on small amount of data

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2826. -- Resolution: Fixed Fix Version/s: 2.2.0 This is indeed addressed by FileIO.write which I

[jira] [Closed] (BEAM-2883) Poor error message when forgetting to specify a Datastore project.

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2883. -- Resolution: Fixed Fix Version/s: Not applicable Fixed a long time ago. > Poor error

[jira] [Commented] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530528#comment-16530528 ] Eugene Kirpichov commented on BEAM-1841: (especially because there is already a transform for

[jira] [Closed] (BEAM-3595) Normalize URNs across SDKs and runners.

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3595. -- Resolution: Fixed Fix Version/s: 2.5.0 Yeah this was done to a sufficient degree some

[jira] [Assigned] (BEAM-3874) Switch AvroIO sink default codec to Snappy

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3874: -- Assignee: (was: Eugene Kirpichov) > Switch AvroIO sink default codec to Snappy >

[jira] [Assigned] (BEAM-4064) ClassCastExeption when reading Avro files using specific records with org.apache.avro.util.Utf8 fields

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4064: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > ClassCastExeption when reading

[jira] [Closed] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1841. -- Resolution: Won't Fix Fix Version/s: Not applicable Probably not worth investing more

[jira] [Closed] (BEAM-1190) FileBasedSource should ignore files that matched the glob but don't exist

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1190. -- Resolution: Won't Fix Fix Version/s: Not applicable This is an old issue, proposing a

[jira] [Closed] (BEAM-2751) Write PCollection elements to individual files

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2751. -- Resolution: Fixed Fix Version/s: 2.2.0 This can be done closely enough using

[jira] [Closed] (BEAM-2682) Merge AvroIOTest and AvroIOTransformTest

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2682. -- Resolution: Fixed Fix Version/s: Not applicable Was fixed a long time ago. > Merge

[jira] [Assigned] (BEAM-3834) Python SDK harness should detect SDF ProcessFn and proactively checkpoint it

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3834: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Python SDK harness should

[jira] [Assigned] (BEAM-3837) Python SDK harness should understand a BundleSplitRequest and respond with a BundleSplit before bundle finishes

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3837: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Python SDK harness should

[jira] [Assigned] (BEAM-3742) Support for running a streaming SDF in Python SDK

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3742: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Support for running a

[jira] [Assigned] (BEAM-3857) Dynamic output support for python

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3857: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > Dynamic output support for

[jira] [Closed] (BEAM-4166) FnApiDoFnRunner doesn't invoke setup/teardown

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4166. -- Resolution: Fixed Fix Version/s: 2.5.0 > FnApiDoFnRunner doesn't invoke setup/teardown >

[jira] [Closed] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4204. -- Resolution: Fixed Fix Version/s: (was: Not applicable) 2.5.0 >

[jira] [Assigned] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4204: -- Assignee: Ankur Goenka (was: Eugene Kirpichov) > Python: PortableRunner - p.run() via

[jira] [Closed] (BEAM-3268) getPerDestinationOutputFilenames() is getting processed before write is finished on dataflow runner

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3268. -- Resolution: Fixed Fix Version/s: 2.5.0 > getPerDestinationOutputFilenames() is getting

[jira] [Closed] (BEAM-1824) Adapter for running SDF on a statically known input as a Source

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1824. -- Resolution: Won't Fix Fix Version/s: Not applicable At this point it's better to just

[jira] [Closed] (BEAM-217) BoundedSource.splitAtFraction should be splitAfterFraction

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-217. - Resolution: Won't Fix Not worth investing into BoundedSource anymore. But SDF will get this right.

[jira] [Assigned] (BEAM-3945) TFRecord Performance Tests doesn't work on hdfs

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3945: -- Assignee: Udi Meiri (was: Eugene Kirpichov) > TFRecord Performance Tests doesn't work

[jira] [Closed] (BEAM-3907) Clarify how watermark is estimated for watchForNewFiles() transforms

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-3907. -- Resolution: Fixed Fix Version/s: 2.6.0 This will not need clarification since I fixed a

[jira] [Assigned] (BEAM-4288) SplittableDoFn: splitAtFraction() API for Python

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4288: -- Assignee: Chamikara Jayalath (was: Eugene Kirpichov) > SplittableDoFn:

[jira] [Assigned] (BEAM-4372) Need an undeprecated Reshuffle transform

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-4372: -- Assignee: Yueyang Qiu (was: Eugene Kirpichov) > Need an undeprecated Reshuffle

[jira] [Assigned] (BEAM-3194) Support annotating that a DoFn requires stable / deterministic input for replay/retry

2018-07-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-3194: -- Assignee: Yueyang Qiu (was: Eugene Kirpichov) > Support annotating that a DoFn

[jira] [Closed] (BEAM-4144) SplittableParDoProcessFnTest has had a masked failure

2018-05-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4144. -- Resolution: Fixed Fix Version/s: 2.5.0 > SplittableParDoProcessFnTest has had a masked

[jira] [Closed] (BEAM-4217) Java SDK stages artifacts when talking to job server

2018-05-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4217. -- Resolution: Fixed Fix Version/s: 2.5.0 Per Ben, this is already done in the Job API shim.

[jira] [Reopened] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-05-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reopened BEAM-4204: Assignee: Eugene Kirpichov (was: Robert Bradshaw) universal_local_runner does more than

[jira] [Updated] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

2018-05-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4147: --- Summary: Abstractions for artifact delivery via arbitrary storage backends (was: Artifact

[jira] [Commented] (BEAM-4147) Abstractions for artifact delivery via arbitrary storage backends

2018-05-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16461703#comment-16461703 ] Eugene Kirpichov commented on BEAM-4147: This covers an ArtifactStagingService and

[jira] [Created] (BEAM-4179) Go code should get standard URNs from proto annotations

2018-04-26 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4179: -- Summary: Go code should get standard URNs from proto annotations Key: BEAM-4179 URL: https://issues.apache.org/jira/browse/BEAM-4179 Project: Beam Issue

[jira] [Created] (BEAM-4180) Remove the Payload suffix from model protos

2018-04-26 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4180: -- Summary: Remove the Payload suffix from model protos Key: BEAM-4180 URL: https://issues.apache.org/jira/browse/BEAM-4180 Project: Beam Issue Type:

[jira] [Commented] (BEAM-4179) Go code should get standard URNs from proto annotations

2018-04-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455575#comment-16455575 ] Eugene Kirpichov commented on BEAM-4179: Here's what I got so far

[jira] [Commented] (BEAM-4130) Portable Flink runner entry point

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16459285#comment-16459285 ] Eugene Kirpichov commented on BEAM-4130: Further clarification: the entry point, like JobService

[jira] [Created] (BEAM-4209) Java: PortableRunner: p.run() starts a given JobService docker container and runs through it

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4209: -- Summary: Java: PortableRunner: p.run() starts a given JobService docker container and runs through it Key: BEAM-4209 URL: https://issues.apache.org/jira/browse/BEAM-4209

[jira] [Created] (BEAM-4210) Python: PortableRunner: p.run() starts a given JobService docker container and runs through it

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4210: -- Summary: Python: PortableRunner: p.run() starts a given JobService docker container and runs through it Key: BEAM-4210 URL: https://issues.apache.org/jira/browse/BEAM-4210

[jira] [Created] (BEAM-4212) Flink portable ValidatesRunner tests continuously run on Jenkins

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4212: -- Summary: Flink portable ValidatesRunner tests continuously run on Jenkins Key: BEAM-4212 URL: https://issues.apache.org/jira/browse/BEAM-4212 Project: Beam

[jira] [Created] (BEAM-4217) Java SDK stages artifacts when talking to job server

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4217: -- Summary: Java SDK stages artifacts when talking to job server Key: BEAM-4217 URL: https://issues.apache.org/jira/browse/BEAM-4217 Project: Beam Issue

[jira] [Created] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4204: -- Summary: Python: PortableRunner - p.run() via given JobService Key: BEAM-4204 URL: https://issues.apache.org/jira/browse/BEAM-4204 Project: Beam Issue

[jira] [Created] (BEAM-4207) Java: script for running set of ValidatesRunner tests against given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4207: -- Summary: Java: script for running set of ValidatesRunner tests against given JobService Key: BEAM-4207 URL: https://issues.apache.org/jira/browse/BEAM-4207

[jira] [Created] (BEAM-4208) Python: Script for running a set of ValidatesRunner tests against given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4208: -- Summary: Python: Script for running a set of ValidatesRunner tests against given JobService Key: BEAM-4208 URL: https://issues.apache.org/jira/browse/BEAM-4208

[jira] [Updated] (BEAM-4130) Portable Flink runner JobService entry point in a Docker container

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4130: --- Summary: Portable Flink runner JobService entry point in a Docker container (was: Portable

[jira] [Created] (BEAM-4213) Python: Portable batch Flink runner passes all ValidatesRunner tests

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4213: -- Summary: Python: Portable batch Flink runner passes all ValidatesRunner tests Key: BEAM-4213 URL: https://issues.apache.org/jira/browse/BEAM-4213 Project: Beam

[jira] [Updated] (BEAM-4176) Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4176: --- Summary: Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner

[jira] [Created] (BEAM-4205) Java: WordCount runs against manually started Flink at master

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4205: -- Summary: Java: WordCount runs against manually started Flink at master Key: BEAM-4205 URL: https://issues.apache.org/jira/browse/BEAM-4205 Project: Beam

[jira] [Created] (BEAM-4211) Python: FlinkPortableTestRunner: runs portably via self-started local Flink

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4211: -- Summary: Python: FlinkPortableTestRunner: runs portably via self-started local Flink Key: BEAM-4211 URL: https://issues.apache.org/jira/browse/BEAM-4211 Project:

[jira] [Closed] (BEAM-4204) Python: PortableRunner - p.run() via given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-4204. -- Resolution: Duplicate Fix Version/s: Not applicable This appears to be a dupe of

[jira] [Created] (BEAM-4216) Flink: Staged artifacts are delivered to the SDK container

2018-04-30 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-4216: -- Summary: Flink: Staged artifacts are delivered to the SDK container Key: BEAM-4216 URL: https://issues.apache.org/jira/browse/BEAM-4216 Project: Beam

[jira] [Updated] (BEAM-4071) Java: PortableRunner - p.run() via given JobService

2018-04-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-4071: --- Summary: Java: PortableRunner - p.run() via given JobService (was: Portable Runner Job API

<    1   2   3   4   5   6   7   >