[jira] [Updated] (BEAM-717) KafkaIO should comply with style guide: explicit type parameters and use of AutoValue

2017-02-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-717: -- Summary: KafkaIO should comply with style guide: explicit type parameters and use of AutoValue

[jira] [Created] (BEAM-1416) Write transform should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1416: -- Summary: Write transform should comply with PTransform style guide Key: BEAM-1416 URL: https://issues.apache.org/jira/browse/BEAM-1416 Project: Beam

[jira] [Created] (BEAM-1419) Flatten should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1419: -- Summary: Flatten should comply with PTransform style guide Key: BEAM-1419 URL: https://issues.apache.org/jira/browse/BEAM-1419 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1402) Make TextIO and AvroIO use best-practice types.

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15856841#comment-15856841 ] Eugene Kirpichov commented on BEAM-1402: More specifically, the necessary changes are: - Specify

[jira] [Created] (BEAM-1415) PubsubIO should comply with PTransfrom style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1415: -- Summary: PubsubIO should comply with PTransfrom style guide Key: BEAM-1415 URL: https://issues.apache.org/jira/browse/BEAM-1415 Project: Beam Issue

[jira] [Created] (BEAM-1423) Sample should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1423: -- Summary: Sample should comply with PTransform style guide Key: BEAM-1423 URL: https://issues.apache.org/jira/browse/BEAM-1423 Project: Beam Issue Type:

[jira] [Created] (BEAM-1422) ParDo should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1422: -- Summary: ParDo should comply with PTransform style guide Key: BEAM-1422 URL: https://issues.apache.org/jira/browse/BEAM-1422 Project: Beam Issue Type:

[jira] [Created] (BEAM-1421) Latest should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1421: -- Summary: Latest should comply with PTransform style guide Key: BEAM-1421 URL: https://issues.apache.org/jira/browse/BEAM-1421 Project: Beam Issue Type:

[jira] [Created] (BEAM-1418) MapElements and FlatMapElements should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1418: -- Summary: MapElements and FlatMapElements should comply with PTransform style guide Key: BEAM-1418 URL: https://issues.apache.org/jira/browse/BEAM-1418 Project:

[jira] [Created] (BEAM-1414) CountingInput should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1414: -- Summary: CountingInput should comply with PTransform style guide Key: BEAM-1414 URL: https://issues.apache.org/jira/browse/BEAM-1414 Project: Beam Issue

[jira] [Created] (BEAM-1417) Count should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1417: -- Summary: Count should comply with PTransform style guide Key: BEAM-1417 URL: https://issues.apache.org/jira/browse/BEAM-1417 Project: Beam Issue Type:

[jira] [Created] (BEAM-1427) BigQueryIO should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1427: -- Summary: BigQueryIO should comply with PTransform style guide Key: BEAM-1427 URL: https://issues.apache.org/jira/browse/BEAM-1427 Project: Beam Issue

[jira] [Created] (BEAM-1426) SortValues should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1426: -- Summary: SortValues should comply with PTransform style guide Key: BEAM-1426 URL: https://issues.apache.org/jira/browse/BEAM-1426 Project: Beam Issue

[jira] [Commented] (BEAM-1417) Count should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857136#comment-15857136 ] Eugene Kirpichov commented on BEAM-1417: This might be not such a good idea since returning a

[jira] [Closed] (BEAM-1354) TextIO should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1354. -- Resolution: Duplicate Fix Version/s: Not applicable Just noticed that Reuven has already

[jira] [Created] (BEAM-1428) KinesisIO should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1428: -- Summary: KinesisIO should comply with PTransform style guide Key: BEAM-1428 URL: https://issues.apache.org/jira/browse/BEAM-1428 Project: Beam Issue

[jira] [Assigned] (BEAM-1402) Make TextIO and AvroIO use best-practice types.

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1402: -- Assignee: Reuven Lax (was: Davor Bonaci) > Make TextIO and AvroIO use best-practice

[jira] [Created] (BEAM-1424) ToString should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1424: -- Summary: ToString should comply with PTransform style guide Key: BEAM-1424 URL: https://issues.apache.org/jira/browse/BEAM-1424 Project: Beam Issue

[jira] [Commented] (BEAM-1417) Count should comply with PTransform style guide

2017-02-08 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15858796#comment-15858796 ] Eugene Kirpichov commented on BEAM-1417: PR https://github.com/apache/beam/pull/1943 > Count

[jira] [Assigned] (BEAM-1417) Count should comply with PTransform style guide

2017-02-08 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1417: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > Count should comply with PTransform

[jira] [Assigned] (BEAM-1421) Latest should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1421: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > Latest should comply with PTransform

[jira] [Assigned] (BEAM-1416) Write transform should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1416: -- Assignee: Eugene Kirpichov (was: Daniel Halperin) > Write transform should comply with

[jira] [Commented] (BEAM-1416) Write transform should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857178#comment-15857178 ] Eugene Kirpichov commented on BEAM-1416: https://github.com/apache/beam/pull/1943 > Write

[jira] [Assigned] (BEAM-1420) GroupByKey should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1420: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > GroupByKey should comply with

[jira] [Commented] (BEAM-1424) ToString should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857183#comment-15857183 ] Eugene Kirpichov commented on BEAM-1424: https://github.com/apache/beam/pull/1943 > ToString

[jira] [Commented] (BEAM-1426) SortValues should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15857184#comment-15857184 ] Eugene Kirpichov commented on BEAM-1426: https://github.com/apache/beam/pull/1943 > SortValues

[jira] [Assigned] (BEAM-1423) Sample should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1423: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > Sample should comply with PTransform

[jira] [Assigned] (BEAM-1424) ToString should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1424: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > ToString should comply with

[jira] [Assigned] (BEAM-1426) SortValues should comply with PTransform style guide

2017-02-07 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1426: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > SortValues should comply with

[jira] [Commented] (BEAM-1323) Add parallelism/splitting in JdbcIO

2017-01-26 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15840015#comment-15840015 ] Eugene Kirpichov commented on BEAM-1323: I don't think there's a generic way to automatically split

[jira] (BEAM-1353) Beam should comply with PTransform style guide

2017-01-30 Thread Eugene Kirpichov (JIRA)
Title: Message Title Eugene Kirpichov created an issue

[jira] (BEAM-1354) TextIO should comply with PTransform style guide

2017-01-30 Thread Eugene Kirpichov (JIRA)
Title: Message Title Eugene Kirpichov created an issue

[jira] (BEAM-1354) TextIO should comply with PTransform style guide

2017-01-30 Thread Eugene Kirpichov (JIRA)
Title: Message Title Eugene Kirpichov updated an issue

[jira] (BEAM-1355) HDFS IO should comply with PTransform style guide

2017-01-30 Thread Eugene Kirpichov (JIRA)
Title: Message Title Eugene Kirpichov created an issue

[jira] [Created] (BEAM-1314) DoFn per-key lifecycle (Setup/Teardown)

2017-01-25 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1314: -- Summary: DoFn per-key lifecycle (Setup/Teardown) Key: BEAM-1314 URL: https://issues.apache.org/jira/browse/BEAM-1314 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1551) Allow PAssert#that to take a message

2017-02-27 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886281#comment-15886281 ] Eugene Kirpichov commented on BEAM-1551: Note that a similar change was done in

[jira] [Created] (BEAM-1579) Runners should verify that PT overrides converged

2017-02-28 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1579: -- Summary: Runners should verify that PT overrides converged Key: BEAM-1579 URL: https://issues.apache.org/jira/browse/BEAM-1579 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1417) Count should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889575#comment-15889575 ] Eugene Kirpichov commented on BEAM-1417: Actual backward-incompatible changes made: Made classes

[jira] [Closed] (BEAM-1417) Count should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1417. -- > Count should comply with PTransform style guide > ---

[jira] [Closed] (BEAM-1423) Sample should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1423. -- > Sample should comply with PTransform style guide >

[jira] [Closed] (BEAM-1421) Latest should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1421. -- > Latest should comply with PTransform style guide >

[jira] [Closed] (BEAM-1420) GroupByKey should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1420. -- > GroupByKey should comply with PTransform style guide >

[jira] [Closed] (BEAM-1419) Flatten should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1419. -- > Flatten should comply with PTransform style guide >

[jira] [Commented] (BEAM-1419) Flatten should comply with PTransform style guide

2017-02-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889580#comment-15889580 ] Eugene Kirpichov commented on BEAM-1419: Actually renamed to Flatten.Iterables and

[jira] [Commented] (BEAM-1260) PAssert should capture the assertion site

2017-01-10 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816390#comment-15816390 ] Eugene Kirpichov commented on BEAM-1260: PR https://github.com/apache/beam/pull/1753 does this >

[jira] [Created] (BEAM-1260) PAssert should capture the assertion site

2017-01-10 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1260: -- Summary: PAssert should capture the assertion site Key: BEAM-1260 URL: https://issues.apache.org/jira/browse/BEAM-1260 Project: Beam Issue Type:

[jira] [Created] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

2016-12-31 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1235: -- Summary: BigQueryIO doesn't show the load job error to the user Key: BEAM-1235 URL: https://issues.apache.org/jira/browse/BEAM-1235 Project: Beam Issue

[jira] [Updated] (BEAM-1235) BigQueryIO doesn't show the load job error to the user

2016-12-31 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-1235: --- Description: When a BigQuery load job fails, we only say that it failed, but don't show the

[jira] [Commented] (BEAM-730) Remove Reshuffle transform in favor of Redistribute.byKey()

2016-12-31 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15789788#comment-15789788 ] Eugene Kirpichov commented on BEAM-730: --- Partial solution for one case:

[jira] [Created] (BEAM-1234) Consider a hint ParDo.withHighFanout()

2016-12-31 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1234: -- Summary: Consider a hint ParDo.withHighFanout() Key: BEAM-1234 URL: https://issues.apache.org/jira/browse/BEAM-1234 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1225) Add a ToString transform in Java SDK

2016-12-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15783782#comment-15783782 ] Eugene Kirpichov commented on BEAM-1225: Why is it so common? The toString method is generally

[jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators

2017-03-23 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15939312#comment-15939312 ] Eugene Kirpichov commented on BEAM-1148: One option is to let PAssert output the failures (or

[jira] [Created] (BEAM-1820) Source.getDefaultOutputCoder() should be @Nullable

2017-03-27 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1820: -- Summary: Source.getDefaultOutputCoder() should be @Nullable Key: BEAM-1820 URL: https://issues.apache.org/jira/browse/BEAM-1820 Project: Beam Issue

[jira] [Commented] (BEAM-1841) FileBasedSource should better handle when set of files grows while job is running

2017-03-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949552#comment-15949552 ] Eugene Kirpichov commented on BEAM-1841: Dataflow runner kinda sorta partially addresses this, but

[jira] [Closed] (BEAM-1242) convert older IO/Sources to use standard ReadTransform style

2017-03-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1242. -- Resolution: Duplicate Fix Version/s: First stable release > convert older IO/Sources to

[jira] [Updated] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

2017-03-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-1841: --- Summary: FileBasedSource should have safeguards for when set of files grows while job is

[jira] [Commented] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

2017-03-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949580#comment-15949580 ] Eugene Kirpichov commented on BEAM-1841: By the way, I think the number 100 in this message is

[jira] [Assigned] (BEAM-1841) FileBasedSource should better handle when set of files grows while job is running

2017-03-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1841: -- Assignee: Eugene Kirpichov (was: Davor Bonaci) > FileBasedSource should better handle

[jira] [Commented] (BEAM-1841) FileBasedSource should have safeguards for when set of files grows while job is running

2017-03-30 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949723#comment-15949723 ] Eugene Kirpichov commented on BEAM-1841: Actually it's not wrong, since those 100 bundles are

[jira] [Created] (BEAM-1784) DataflowPipelineJob.cancel() should be idempotent

2017-03-22 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1784: -- Summary: DataflowPipelineJob.cancel() should be idempotent Key: BEAM-1784 URL: https://issues.apache.org/jira/browse/BEAM-1784 Project: Beam Issue Type:

[jira] [Closed] (BEAM-1822) Improve handling of eventually-consistent filepatterns

2017-03-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1822. -- Resolution: Duplicate Fix Version/s: Not applicable > Improve handling of

[jira] [Created] (BEAM-1822) Improve handling of eventually-consistent filepatterns

2017-03-28 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1822: -- Summary: Improve handling of eventually-consistent filepatterns Key: BEAM-1822 URL: https://issues.apache.org/jira/browse/BEAM-1822 Project: Beam Issue

[jira] [Created] (BEAM-1824) Adapter for running SDF on a statically known input as a BoundedSource

2017-03-28 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1824: -- Summary: Adapter for running SDF on a statically known input as a BoundedSource Key: BEAM-1824 URL: https://issues.apache.org/jira/browse/BEAM-1824 Project: Beam

[jira] [Assigned] (BEAM-60) FileBasedSource/IOChannelFactory: Custom glob expansion

2017-03-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-60: Assignee: (was: Pei He) > FileBasedSource/IOChannelFactory: Custom glob expansion >

[jira] [Commented] (BEAM-60) FileBasedSource/IOChannelFactory: Custom glob expansion

2017-03-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-60?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15946172#comment-15946172 ] Eugene Kirpichov commented on BEAM-60: -- BEAM-1822 probably justifies raising the priority of this.

[jira] [Closed] (BEAM-707) Migrate PubsubIO/PubsubUnboundedSource/PubsubUnboundedSink to use AutoValue to reduce boilerplate

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-707. - Resolution: Duplicate Fix Version/s: Not applicable > Migrate

[jira] [Reopened] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reopened BEAM-717: --- It remains to also rid it of using Coder's for serialization. > Change KafkaIO API to be

[jira] [Closed] (BEAM-73) IO design pattern: Decouple Parsers and Coders

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-73?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-73. Resolution: Duplicate The only remaining instance of this is in KafkaIO, handled by BEAM-1573. > IO

[jira] [Closed] (BEAM-709) Migrate CountingSource/CountingInput to use AutoValue to reduce boilerplate

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-709. - Resolution: Duplicate Fix Version/s: Not applicable > Migrate CountingSource/CountingInput

[jira] [Commented] (BEAM-447) Stop referring to types with Bound/Unbound

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947688#comment-15947688 ] Eugene Kirpichov commented on BEAM-447: --- Remaining instances: TextIO, AvroIO (handled by

[jira] [Resolved] (BEAM-717) Change KafkaIO API to be consistent with style guide

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov resolved BEAM-717. --- Resolution: Duplicate > Change KafkaIO API to be consistent with style guide >

[jira] [Closed] (BEAM-710) Migrate Read/Write to use AutoValue to reduce boilerplate

2017-03-29 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-710. - Resolution: Won't Fix Fix Version/s: Not applicable Not worth it - Read and Write have only

[jira] [Closed] (BEAM-1422) ParDo should comply with PTransform style guide

2017-03-28 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1422. -- Resolution: Fixed > ParDo should comply with PTransform style guide >

[jira] [Closed] (BEAM-1425) Window should comply with PTransform style guide

2017-03-31 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1425. -- Resolution: Fixed Assignee: Eugene Kirpichov > Window should comply with PTransform style

[jira] [Commented] (BEAM-1069) Add CountingInput Transform to python sdk

2017-03-24 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15940535#comment-15940535 ] Eugene Kirpichov commented on BEAM-1069: Please take note of

[jira] [Commented] (BEAM-1418) MapElements and FlatMapElements should comply with PTransform style guide

2017-03-20 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15932805#comment-15932805 ] Eugene Kirpichov commented on BEAM-1418: It'd be great to get rid of the suffix, but then it would

[jira] [Commented] (BEAM-1582) ResumeFromCheckpointStreamingTest flakes with what appears as a second firing.

2017-03-16 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929222#comment-15929222 ] Eugene Kirpichov commented on BEAM-1582: Still happening and failing precommits quite often. >

[jira] [Closed] (BEAM-1427) BigQueryIO should comply with PTransform style guide

2017-03-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1427. -- Resolution: Fixed Fix Version/s: (was: First stable release) Not

[jira] [Created] (BEAM-1855) Support Splittable DoFn in Flink runner

2017-04-01 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1855: -- Summary: Support Splittable DoFn in Flink runner Key: BEAM-1855 URL: https://issues.apache.org/jira/browse/BEAM-1855 Project: Beam Issue Type: New

[jira] [Resolved] (BEAM-1855) Support Splittable DoFn in Flink runner

2017-04-01 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov resolved BEAM-1855. Resolution: Fixed Fix Version/s: First stable release > Support Splittable DoFn in

[jira] [Closed] (BEAM-1418) MapElements and FlatMapElements should comply with PTransform style guide

2017-04-12 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1418. -- Resolution: Fixed > MapElements and FlatMapElements should comply with PTransform style guide >

[jira] [Created] (BEAM-1903) Splittable DoFn should report watermarks via ProcessContext

2017-04-06 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1903: -- Summary: Splittable DoFn should report watermarks via ProcessContext Key: BEAM-1903 URL: https://issues.apache.org/jira/browse/BEAM-1903 Project: Beam

[jira] [Created] (BEAM-1904) Remove DoFn.ProcessContinuation

2017-04-06 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1904: -- Summary: Remove DoFn.ProcessContinuation Key: BEAM-1904 URL: https://issues.apache.org/jira/browse/BEAM-1904 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1581) JSON source and sink

2017-04-05 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957450#comment-15957450 ] Eugene Kirpichov commented on BEAM-1581: Aviem - all you're saying makes sense in general, but

[jira] [Commented] (BEAM-1581) JSON source and sink

2017-04-05 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957586#comment-15957586 ] Eugene Kirpichov commented on BEAM-1581: I guess I'm suggesting that, like you said, perhaps we

[jira] [Created] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1983: -- Summary: SDF should properly support windowed side inputs Key: BEAM-1983 URL: https://issues.apache.org/jira/browse/BEAM-1983 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969733#comment-15969733 ] Eugene Kirpichov commented on BEAM-1983: ...which means that really, we *must* explode windows

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969727#comment-15969727 ] Eugene Kirpichov commented on BEAM-1983: ...which is challenging cause ProcessFn currently

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969724#comment-15969724 ] Eugene Kirpichov commented on BEAM-1983: One more thing to be on the lookout for in test coverage:

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969678#comment-15969678 ] Eugene Kirpichov commented on BEAM-1983: CC: [~aljoscha] [~kenn] [~thomasWeise] [~tgroh] > SDF

[jira] [Updated] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-1983: --- Issue Type: Bug (was: New Feature) > SDF should properly support windowed side inputs >

[jira] [Assigned] (BEAM-1414) CountingInput should comply with PTransform style guide

2017-04-20 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1414: -- Assignee: Eugene Kirpichov > CountingInput should comply with PTransform style guide >

[jira] [Updated] (BEAM-1415) PubsubIO should comply with PTransform style guide

2017-04-20 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-1415: --- Summary: PubsubIO should comply with PTransform style guide (was: PubsubIO should comply with

[jira] [Assigned] (BEAM-1415) PubsubIO should comply with PTransfrom style guide

2017-04-20 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov reassigned BEAM-1415: -- Assignee: Eugene Kirpichov > PubsubIO should comply with PTransfrom style guide >

[jira] [Closed] (BEAM-1355) HDFS IO should comply with PTransform style guide

2017-04-19 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1355. -- Resolution: Won't Fix Fix Version/s: First stable release I'm closing this as Won't Fix

[jira] [Created] (BEAM-2016) Delete HDFSFileSource/Sink

2017-04-19 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-2016: -- Summary: Delete HDFSFileSource/Sink Key: BEAM-2016 URL: https://issues.apache.org/jira/browse/BEAM-2016 Project: Beam Issue Type: Task

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

2017-04-19 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15975164#comment-15975164 ] Eugene Kirpichov commented on BEAM-2005: After this is done, and before the first stable release,

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-15 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970016#comment-15970016 ] Eugene Kirpichov commented on BEAM-1983: Yeah, I understand that much better now. I suppose we can

[jira] [Closed] (BEAM-1428) KinesisIO should comply with PTransform style guide

2017-04-22 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-1428. -- Resolution: Fixed Fix Version/s: First stable release > KinesisIO should comply with

[jira] [Commented] (BEAM-1660) withCoder() error in JdbcIO JavaDoc example

2017-03-09 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15903124#comment-15903124 ] Eugene Kirpichov commented on BEAM-1660: Agreed about the coder issue: we should take advantage of

  1   2   3   4   5   6   7   >