[jira] [Commented] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-11-29 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705589#comment-15705589 ] Maximilian Michels commented on BEAM-506: - +1 > Fill in the documentation/runners/flink port

[jira] [Commented] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-11-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15705595#comment-15705595 ] ASF GitHub Bot commented on BEAM-506: - GitHub user aljoscha opened a pull request: https

[jira] [Assigned] (BEAM-506) Fill in the documentation/runners/flink portion of the website

2016-11-29 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek reassigned BEAM-506: - Assignee: Aljoscha Krettek (was: James Malone) > Fill in the documentation/runners/fl

[jira] [Created] (BEAM-1059) Create ExecIO

2016-11-29 Thread JIRA
Jean-Baptiste Onofré created BEAM-1059: -- Summary: Create ExecIO Key: BEAM-1059 URL: https://issues.apache.org/jira/browse/BEAM-1059 Project: Beam Issue Type: New Feature

[jira] [Resolved] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-29 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1052. - Resolution: Fixed Fix Version/s: 0.4.0-incubating > UnboundedSource splitId uniqueness bre

[jira] [Commented] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704876#comment-15704876 ] ASF GitHub Bot commented on BEAM-1052: -- Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704575#comment-15704575 ] ASF GitHub Bot commented on BEAM-1052: -- GitHub user aviemzur opened a pull request: https

[jira] [Updated] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-28 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1052: Description: We use a "running-id" to identify source splits, but we reiterate for each source

[jira] [Updated] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-28 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1052: Description: We use a "running-id" to identify source splits, but we reiterate for each source

[jira] [Updated] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-28 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1052: Description: We use a "running-id" to identify source splits, but we reiterate for each source

[jira] [Resolved] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

2016-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1006. Resolution: Fixed > splitKeysToFilter method is creating a bad query str

[jira] [Commented] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704476#comment-15704476 ] ASF GitHub Bot commented on BEAM-1006: -- Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-551) Support Dynamic PipelineOptions

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704249#comment-15704249 ] ASF GitHub Bot commented on BEAM-551: - Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-551) Support Dynamic PipelineOptions

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704186#comment-15704186 ] ASF GitHub Bot commented on BEAM-551: - Github user asfgit closed the pull request at: https

[jira] [Resolved] (BEAM-1058) mvn clean verify is not tested

2016-11-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1058. --- Resolution: Incomplete Fix Version/s: (was: 0.4.0-incubating

[jira] [Commented] (BEAM-1058) mvn clean verify is not tested

2016-11-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15704168#comment-15704168 ] Daniel Halperin commented on BEAM-1058: --- Temporarily closing -- the issue I ran into at HEAD may have

[jira] [Created] (BEAM-1058) mvn clean verify is not tested

2016-11-28 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1058: - Summary: mvn clean verify is not tested Key: BEAM-1058 URL: https://issues.apache.org/jira/browse/BEAM-1058 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1032) Starter archetype pipeline has no runner on its classpath

2016-11-28 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703831#comment-15703831 ] Davor Bonaci commented on BEAM-1032: Thanks [~swegner]. Fixed? > Starter archetype pipeline

[jira] [Commented] (BEAM-278) Add I/O section

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703771#comment-15703771 ] ASF GitHub Bot commented on BEAM-278: - GitHub user melap opened a pull request: https://github.com

[jira] [Commented] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703751#comment-15703751 ] ASF GitHub Bot commented on BEAM-1009: -- GitHub user peihe opened a pull request: https

[jira] [Commented] (BEAM-1041) IOChannelFactory: supports for recursively remove().

2016-11-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703677#comment-15703677 ] Daniel Halperin commented on BEAM-1041: --- Can this be done entirely IOCF-independently

[jira] [Commented] (BEAM-1021) DatastoreIO for python

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703611#comment-15703611 ] ASF GitHub Bot commented on BEAM-1021: -- Github user vikkyrk closed the pull request at: https

[jira] [Commented] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703565#comment-15703565 ] ASF GitHub Bot commented on BEAM-1009: -- Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703431#comment-15703431 ] ASF GitHub Bot commented on BEAM-894: - Github user peihe closed the pull request at: https

[jira] [Commented] (BEAM-1036) Support for new State API in FlinkRunner

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703354#comment-15703354 ] ASF GitHub Bot commented on BEAM-1036: -- GitHub user aljoscha opened a pull request: https

[jira] [Commented] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703315#comment-15703315 ] ASF GitHub Bot commented on BEAM-1009: -- GitHub user peihe opened a pull request: https

[jira] [Commented] (BEAM-1057) JDBC tests fail to run on slow network

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703243#comment-15703243 ] ASF GitHub Bot commented on BEAM-1057: -- GitHub user dkulp opened a pull request: https

[jira] [Created] (BEAM-1057) JDBC tests fail to run on slow network

2016-11-28 Thread Daniel Kulp (JIRA)
Daniel Kulp created BEAM-1057: - Summary: JDBC tests fail to run on slow network Key: BEAM-1057 URL: https://issues.apache.org/jira/browse/BEAM-1057 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1056) Reference beam version only once in Archetypes

2016-11-28 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1056: - Summary: Reference beam version only once in Archetypes Key: BEAM-1056 URL: https://issues.apache.org/jira/browse/BEAM-1056 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-1032) Starter archetype pipeline has no runner on its classpath

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703189#comment-15703189 ] ASF GitHub Bot commented on BEAM-1032: -- Github user asfgit closed the pull request at: https

[jira] [Closed] (BEAM-23) User-facing state and timers for ParDo(DoFn)

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-23. --- Resolution: Duplicate Fix Version/s: Not applicable > User-facing state and timers for ParDo(D

[jira] [Updated] (BEAM-41) State for "Set" data, supporting efficient membership checks

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-41?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-41: Issue Type: New Feature (was: Sub-task) Parent: (was: BEAM-23) > State for "S

[jira] [Updated] (BEAM-42) State for "Map" data, supporting efficient key lookup, etc.

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-42?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-42: Issue Type: New Feature (was: Sub-task) Parent: (was: BEAM-23) > State for "M

[jira] [Commented] (BEAM-25) Add user-ready API for interacting with state

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703141#comment-15703141 ] ASF GitHub Bot commented on BEAM-25: Github user asfgit closed the pull request at: https

[jira] [Updated] (BEAM-27) Add user-ready API for interacting with timers

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-27?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-27: Issue Type: New Feature (was: Sub-task) Parent: (was: BEAM-23) > Add user-ready

[jira] [Updated] (BEAM-37) Run DoFnWithContext without conversion to vanilla DoFn

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-37?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-37: Issue Type: New Feature (was: Sub-task) Parent: (was: BEAM-23) > Run DoFnWithCont

[jira] [Commented] (BEAM-1055) Display Data keys on Python are inconsistent

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703118#comment-15703118 ] ASF GitHub Bot commented on BEAM-1055: -- GitHub user pabloem opened a pull request: https

[jira] [Commented] (BEAM-646) Get runners out of the apply()

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702974#comment-15702974 ] ASF GitHub Bot commented on BEAM-646: - GitHub user tgroh opened a pull request: https://github.com

[jira] [Commented] (BEAM-991) DatastoreIO Write should flush early for large batches

2016-11-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702845#comment-15702845 ] Daniel Halperin commented on BEAM-991: -- Hi [~JoshuaFox], [~vikasrk], I agree with Vikas, though I

[jira] [Created] (BEAM-1055) Display Data keys on Python are inconsistent

2016-11-28 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1055: --- Summary: Display Data keys on Python are inconsistent Key: BEAM-1055 URL: https://issues.apache.org/jira/browse/BEAM-1055 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1054) Language specific IO docs

2016-11-28 Thread Melissa Pashniak (JIRA)
Melissa Pashniak created BEAM-1054: -- Summary: Language specific IO docs Key: BEAM-1054 URL: https://issues.apache.org/jira/browse/BEAM-1054 Project: Beam Issue Type: Task

[jira] [Commented] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

2016-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702741#comment-15702741 ] Jean-Baptiste Onofré commented on BEAM-1006: Sorry, I've missing this Jira. The PR looks good

[jira] [Resolved] (BEAM-795) org.apache.beam.sdk.io.ReadTest.testStreamingPrimitiveDisplayData failing in Dataflow RunnableOnService

2016-11-28 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-795. -- Resolution: Fixed Fix Version/s: Not applicable

[jira] [Commented] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702717#comment-15702717 ] ASF GitHub Bot commented on BEAM-230: - GitHub user kennknowles opened a pull request: https

[jira] [Reopened] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reopened BEAM-230: -- Assignee: Kenneth Knowles (was: Thomas Groh) > Remove WindowedValue#valueInEmptyWind

[jira] [Commented] (BEAM-230) Remove WindowedValue#valueInEmptyWindows

2016-11-28 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702714#comment-15702714 ] Kenneth Knowles commented on BEAM-230: -- This wasn't actually removed completely. > Rem

[jira] [Commented] (BEAM-975) Issue with MongoDBIO

2016-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702604#comment-15702604 ] Jean-Baptiste Onofré commented on BEAM-975: --- I would like to include this for 0.4.0-incubating

[jira] [Updated] (BEAM-975) Issue with MongoDBIO

2016-11-28 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-975: -- Fix Version/s: 0.4.0-incubating > Issue with MongoD

[jira] [Commented] (BEAM-425) Add Elasticsearch IO

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702538#comment-15702538 ] ASF GitHub Bot commented on BEAM-425: - GitHub user echauchot opened a pull request: https

[jira] [Commented] (BEAM-1053) ApexGroupByKeyOperator serialization issues

2016-11-28 Thread Sandeep Deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15702249#comment-15702249 ] Sandeep Deshmukh commented on BEAM-1053: The serialization failure is observed for activeTimers

[jira] [Created] (BEAM-1053) ApexGroupByKeyOperator serialization issues

2016-11-28 Thread Sandeep Deshmukh (JIRA)
Sandeep Deshmukh created BEAM-1053: -- Summary: ApexGroupByKeyOperator serialization issues Key: BEAM-1053 URL: https://issues.apache.org/jira/browse/BEAM-1053 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1050) PipelineResult.State is not set to FAILED in when a streaming job fails

2016-11-28 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15701400#comment-15701400 ] ASF GitHub Bot commented on BEAM-1050: -- GitHub user staslev opened a pull request: https

[jira] [Resolved] (BEAM-1049) Upgrade default spark version to 1.6.3

2016-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1049. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Upgrade default sp

[jira] [Commented] (BEAM-1049) Upgrade default spark version to 1.6.3

2016-11-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15700059#comment-15700059 ] ASF GitHub Bot commented on BEAM-1049: -- Github user asfgit closed the pull request at: https

[jira] [Created] (BEAM-1052) UnboundedSource splitId uniqueness breaks if more than one source is used.

2016-11-27 Thread Amit Sela (JIRA)
Amit Sela created BEAM-1052: --- Summary: UnboundedSource splitId uniqueness breaks if more than one source is used. Key: BEAM-1052 URL: https://issues.apache.org/jira/browse/BEAM-1052 Project: Beam

[jira] [Assigned] (BEAM-649) Pipeline "actions" should use foreachRDD via ParDo.

2016-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-649: - Assignee: Jean-Baptiste Onofré > Pipeline "actions" should use f

[jira] [Assigned] (BEAM-648) Persist and restore Aggergator values in case of recovery from failure

2016-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-648: - Assignee: Jean-Baptiste Onofré > Persist and restore Aggergator values in c

[jira] [Created] (BEAM-1051) Extend the TestSparkRunner with its own TransformTranslator containing test evaluators

2016-11-27 Thread JIRA
Jean-Baptiste Onofré created BEAM-1051: -- Summary: Extend the TestSparkRunner with its own TransformTranslator containing test evaluators Key: BEAM-1051 URL: https://issues.apache.org/jira/browse/BEAM-1051

[jira] [Commented] (BEAM-1050) PipelineResult.State is not set to FAILED in when a streaming job fails

2016-11-27 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699605#comment-15699605 ] Stas Levin commented on BEAM-1050: -- I see that the code has changed since (the relevant snipped is below

[jira] [Created] (BEAM-1050) PipelineResult.State is not set to FAILED in when a streaming job fails

2016-11-27 Thread Stas Levin (JIRA)
Stas Levin created BEAM-1050: Summary: PipelineResult.State is not set to FAILED in when a streaming job fails Key: BEAM-1050 URL: https://issues.apache.org/jira/browse/BEAM-1050 Project: Beam

[jira] [Resolved] (BEAM-851) Identify streaming pipelines implicitly.

2016-11-27 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-851. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Identify streaming pipelines implici

[jira] [Commented] (BEAM-851) Identify streaming pipelines implicitly.

2016-11-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699550#comment-15699550 ] ASF GitHub Bot commented on BEAM-851: - Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-1049) Upgrade default spark version to 1.6.3

2016-11-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15699492#comment-15699492 ] ASF GitHub Bot commented on BEAM-1049: -- GitHub user iemejia opened a pull request: https

[jira] [Assigned] (BEAM-1049) Upgrade default spark version to 1.6.3

2016-11-27 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-1049: -- Assignee: Ismaël Mejía (was: Amit Sela) > Upgrade default spark version to 1.

[jira] [Created] (BEAM-1049) Upgrade default spark version to 1.6.3

2016-11-27 Thread JIRA
Ismaël Mejía created BEAM-1049: -- Summary: Upgrade default spark version to 1.6.3 Key: BEAM-1049 URL: https://issues.apache.org/jira/browse/BEAM-1049 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-932) Findbugs doesn't pass in Spark runner

2016-11-26 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-932: --- Assignee: Ismaël Mejía (was: Amit Sela) > Findbugs doesn't pass in Spark run

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

2016-11-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15697736#comment-15697736 ] ASF GitHub Bot commented on BEAM-498: - Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-800) DoFnLifeCycleManager should hold DoFnInvoker, not DoFn/OldDoFn

2016-11-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15697262#comment-15697262 ] ASF GitHub Bot commented on BEAM-800: - Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-1034) Every run of "mvn" in extensions/sorter leaves 65mb of stuff in tmp

2016-11-25 Thread Mitch Shanklin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15696839#comment-15696839 ] Mitch Shanklin commented on BEAM-1034: -- Thanks for the fyi [~davor] I also have a PR out: https

[jira] [Commented] (BEAM-851) Identify streaming pipelines implicitly.

2016-11-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15695932#comment-15695932 ] ASF GitHub Bot commented on BEAM-851: - GitHub user iemejia opened a pull request: https

[jira] [Assigned] (BEAM-851) Identify streaming pipelines implicitly.

2016-11-25 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-851: - Assignee: Ismaël Mejía (was: Jean-Baptiste Onofré) > Identify streaming pipelines implici

[jira] [Commented] (BEAM-835) add Intellij instructions to the contribution guide

2016-11-25 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15695779#comment-15695779 ] ASF GitHub Bot commented on BEAM-835: - GitHub user minudika opened a pull request: https

[jira] [Closed] (BEAM-110) Use SDK implementation for HadoopIO in contrib/hadoop

2016-11-25 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-110. -- Resolution: Duplicate Fix Version/s: Not applicable > Use SDK implementation for HadoopIO in cont

[jira] [Updated] (BEAM-18) Add support for new Beam Sink API

2016-11-25 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-18: -- Description: Support Beam Sinks via Spark {{foreach}} API, Spark's native sinks (if / where) possible

[jira] [Commented] (BEAM-110) Use SDK implementation for HadoopIO in contrib/hadoop

2016-11-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15695093#comment-15695093 ] Davor Bonaci commented on BEAM-110: --- Yes, I think this is obsolete. Spark runner's support for Source API

[jira] [Commented] (BEAM-980) Document how to configure the DAG created by Apex Runner

2016-11-24 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694643#comment-15694643 ] Thomas Weise commented on BEAM-980: --- [~sandeepdeshmukh] can you take this up? > Document how to config

[jira] [Commented] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2016-11-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693403#comment-15693403 ] ASF GitHub Bot commented on BEAM-956: - Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2016-11-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693377#comment-15693377 ] Amit Sela commented on BEAM-1048: - To clarify - calling `rdd.count()` on the read input RDD creates a batch

[jira] [Updated] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2016-11-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-1048: Assignee: Kobi Salant (was: Amit Sela) > Spark Runner streaming batch duration does not include durat

[jira] [Created] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2016-11-24 Thread Kobi Salant (JIRA)
Kobi Salant created BEAM-1048: - Summary: Spark Runner streaming batch duration does not include duration of reading from source Key: BEAM-1048 URL: https://issues.apache.org/jira/browse/BEAM-1048

[jira] [Commented] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2016-11-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692922#comment-15692922 ] ASF GitHub Bot commented on BEAM-956: - GitHub user aljoscha opened a pull request: https

[jira] [Commented] (BEAM-959) IO validation messages need improvement

2016-11-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692765#comment-15692765 ] ASF GitHub Bot commented on BEAM-959: - Github user asfgit closed the pull request at: https

[jira] [Resolved] (BEAM-1034) Every run of "mvn" in extensions/sorter leaves 65mb of stuff in tmp

2016-11-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1034. Resolution: Fixed Fix Version/s: 0.4.0-incubating > Every run of &

[jira] [Commented] (BEAM-1034) Every run of "mvn" in extensions/sorter leaves 65mb of stuff in tmp

2016-11-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692530#comment-15692530 ] ASF GitHub Bot commented on BEAM-1034: -- Github user asfgit closed the pull request at: https

[jira] [Commented] (BEAM-959) IO validation messages need improvement

2016-11-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692379#comment-15692379 ] Jean-Baptiste Onofré commented on BEAM-959: --- Kenneth validated the change on the {{JdbcIO}}. I

[jira] [Updated] (BEAM-959) IO validation messages need improvement

2016-11-23 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-959: -- Summary: IO validation messages need improvement (was: JdbcIO validation messages need

[jira] [Commented] (BEAM-1047) DataflowRunner: support regionalization.

2016-11-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691886#comment-15691886 ] ASF GitHub Bot commented on BEAM-1047: -- GitHub user peihe opened a pull request: https

[jira] [Commented] (BEAM-147) Introduce an easy API for pipeline metrics

2016-11-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691848#comment-15691848 ] ASF GitHub Bot commented on BEAM-147: - GitHub user pabloem reopened a pull request: https

[jira] [Commented] (BEAM-1043) Dependency problems found in runner-apex

2016-11-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691720#comment-15691720 ] ASF GitHub Bot commented on BEAM-1043: -- Github user aaltay closed the pull request at: https

[jira] [Updated] (BEAM-1047) DataflowRunner: support regionalization.

2016-11-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1047: - Description: Tracking bug. > DataflowRunner: support regionalizat

[jira] [Created] (BEAM-1047) DataflowRunner: support regionalization.

2016-11-23 Thread Pei He (JIRA)
Pei He created BEAM-1047: Summary: DataflowRunner: support regionalization. Key: BEAM-1047 URL: https://issues.apache.org/jira/browse/BEAM-1047 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-1021) DatastoreIO for python

2016-11-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691670#comment-15691670 ] ASF GitHub Bot commented on BEAM-1021: -- GitHub user vikkyrk opened a pull request: https

[jira] [Created] (BEAM-1046) Travis (Linux) failing for python sdk

2016-11-23 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1046: - Summary: Travis (Linux) failing for python sdk Key: BEAM-1046 URL: https://issues.apache.org/jira/browse/BEAM-1046 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1043) Dependency problems found in runner-apex

2016-11-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691654#comment-15691654 ] ASF GitHub Bot commented on BEAM-1043: -- GitHub user aaltay opened a pull request: https

[jira] [Commented] (BEAM-1045) Windows OS compatibilities

2016-11-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691580#comment-15691580 ] Pei He commented on BEAM-1045: -- Other usages of * are: https://github.com/apache/incubator-beam/blob/master

[jira] [Created] (BEAM-1045) Windows OS compatibilities

2016-11-23 Thread Pei He (JIRA)
Pei He created BEAM-1045: Summary: Windows OS compatibilities Key: BEAM-1045 URL: https://issues.apache.org/jira/browse/BEAM-1045 Project: Beam Issue Type: Sub-task Reporter: Pei He

[jira] [Updated] (BEAM-59) IOChannelFactory rethinking/redesign

2016-11-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-59: --- Description: Right now, FileBasedSource and FileBasedSink communication is mediated by IOChannelFactory

[jira] [Updated] (BEAM-1041) IOChannelFactory: supports for recursively remove().

2016-11-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1041: - Issue Type: Sub-task (was: New Feature) Parent: BEAM-59 > IOChannelFactory: supports for recursiv

[jira] [Updated] (BEAM-1041) IOChannelFactory: supports for recursively remove().

2016-11-23 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1041: - Issue Type: New Feature (was: Bug) > IOChannelFactory: supports for recursively rem

[jira] [Created] (BEAM-1044) tests run before install fails

2016-11-23 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1044: - Summary: tests run before install fails Key: BEAM-1044 URL: https://issues.apache.org/jira/browse/BEAM-1044 Project: Beam Issue Type: Bug Components

<    6   7   8   9   10   11   12   13   14   15   >