[jira] [Resolved] (BEAM-606) Create MqttIO

2016-12-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-606. --- Resolution: Fixed Fix Version/s: 0.5.0-incubating > Create MqttIO >

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Apex #99

2016-12-22 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1207) Incompatible httpclient version being used with apex runner in YARN mode

2016-12-22 Thread Pramod Immaneni (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15772081#comment-15772081 ] Pramod Immaneni commented on BEAM-1207: --- For now, I will add it to profile just to not cause any

[jira] [Commented] (BEAM-1090) High memory usage error

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771981#comment-15771981 ] ASF GitHub Bot commented on BEAM-1090: -- Github user aaltay closed the pull request at:

[GitHub] incubator-beam pull request #1692: [BEAM-1090] Skip the test_memory_usage te...

2016-12-22 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-1185) Remove the word Pipeline from the name of all PipelineRunner implementations

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771979#comment-15771979 ] ASF GitHub Bot commented on BEAM-1185: -- Github user aaltay closed the pull request at:

[3/4] incubator-beam git commit: Add a depracated warning about BlockingDataflowRunner.

2016-12-22 Thread robertwb
Add a depracated warning about BlockingDataflowRunner. Updated TestDataflowRunner to inherit from DataflowRunner. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fd5bf2cd Tree:

[jira] [Created] (BEAM-1211) Improve Coder efficiency in outer context for StandardCoder

2016-12-22 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1211: - Summary: Improve Coder efficiency in outer context for StandardCoder Key: BEAM-1211 URL: https://issues.apache.org/jira/browse/BEAM-1211 Project: Beam

[3/5] incubator-beam git commit: Use CountingSource in ForceStreamingTest

2016-12-22 Thread dhalperi
Use CountingSource in ForceStreamingTest Removes the requirement to have a FakeUnboundedSource, plus the read is fully specified. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6d972629 Tree:

[2/5] incubator-beam git commit: BEAM-1203 Fixed exception when creating zip entries during Apex YARN launch

2016-12-22 Thread dhalperi
BEAM-1203 Fixed exception when creating zip entries during Apex YARN launch Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/07a07280 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/07a07280

[4/5] incubator-beam git commit: Add Parameters to finishSpecifying

2016-12-22 Thread dhalperi
Add Parameters to finishSpecifying Remove the need to use getProducingTransformInternal in TypedPValue. Ensure that all nodes are finished specifying before a call to TransformHierarchy#visit. This ensures that all nodes are fully specified without requiring the Pipeline or Runner to do so

[jira] [Commented] (BEAM-370) Remove the .named() methods from PTransforms and sub-classes

2016-12-22 Thread Frances Perry (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771289#comment-15771289 ] Frances Perry commented on BEAM-370: Can this issue be closed? > Remove the .named() methods from

[jira] [Commented] (BEAM-1112) Python E2E Integration Test Framework - Batch Only

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771275#comment-15771275 ] ASF GitHub Bot commented on BEAM-1112: -- Github user markflyhigh closed the pull request at:

[GitHub] incubator-beam pull request #1639: [BEAM-1112] Python E2E Test Framework And...

2016-12-22 Thread markflyhigh
Github user markflyhigh closed the pull request at: https://github.com/apache/incubator-beam/pull/1639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-1207) Incompatible httpclient version being used with apex runner in YARN mode

2016-12-22 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15771245#comment-15771245 ] Vlad Rozov commented on BEAM-1207: -- Such solution looks a little bit hacky to me. Classes that exist prior

[GitHub] incubator-beam pull request #1690: Merge remote-tracking branch 'origin/mast...

2016-12-22 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1690: Merge remote-tracking branch 'origin/mast...

2016-12-22 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Closes #1268

2016-12-22 Thread robertwb
Closes #1268 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8d821414 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8d821414 Diff:

[GitHub] incubator-beam pull request #1688: Update python sdk pom.xml version to 0.5....

2016-12-22 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1688 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-1082) Use use_standard_sql flag everywhere instead of use_legacy_sql

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770859#comment-15770859 ] ASF GitHub Bot commented on BEAM-1082: -- Github user sb2nov closed the pull request at:

[jira] [Assigned] (BEAM-1208) Visibility of Sum.SumIntegerFn/Sum.SumDoubleFn/Sum.SumYYYFn should be reduced

2016-12-22 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-1208: --- Assignee: Luke Cwik (was: Davor Bonaci) > Visibility of

[jira] [Updated] (BEAM-1206) PCollections used as a sideInput are unnecessarily re-evaluated.

2016-12-22 Thread Ryan Skraba (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Skraba updated BEAM-1206: -- Description: The SparkRunner keeps track of "leaf" transforms in the job graph and ensures that they

[GitHub] incubator-beam pull request #1686: Fixing postcomit error caused by PR 1526.

2016-12-22 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/incubator-beam/pull/1686 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1688: Update python sdk pom.xml version to 0.5....

2016-12-22 Thread aaltay
GitHub user aaltay reopened a pull request: https://github.com/apache/incubator-beam/pull/1688 Update python sdk pom.xml version to 0.5.0-incubating-SNAPSHOT You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam

[jira] [Commented] (BEAM-1207) Incompatible httpclient version being used with apex runner in YARN mode

2016-12-22 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770762#comment-15770762 ] Thomas Weise commented on BEAM-1207: Since the user dependencies come first in the Hadoop class path,

[jira] [Commented] (BEAM-1207) Incompatible httpclient version being used with apex runner in YARN mode

2016-12-22 Thread Vlad Rozov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770736#comment-15770736 ] Vlad Rozov commented on BEAM-1207: -- maven excludes httpclient 4.3.5 from the dependency due to conflict

[jira] [Commented] (BEAM-758) Per-step, per-execution nonce

2016-12-22 Thread Sam McVeety (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770738#comment-15770738 ] Sam McVeety commented on BEAM-758: -- [~dhalp...@google.com] I'm not sure of another mechanism that would

[jira] [Commented] (BEAM-1210) PipelineRunners should receive a copy of PipelineOptions rather than the original Options

2016-12-22 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770714#comment-15770714 ] Thomas Groh commented on BEAM-1210: --- It is significantly easier to understand the scope of options and

[jira] [Commented] (BEAM-1112) Python E2E Integration Test Framework - Batch Only

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770673#comment-15770673 ] ASF GitHub Bot commented on BEAM-1112: -- Github user markflyhigh closed the pull request at:

[GitHub] incubator-beam pull request #1639: [BEAM-1112] Python E2E Test Framework And...

2016-12-22 Thread markflyhigh
GitHub user markflyhigh reopened a pull request: https://github.com/apache/incubator-beam/pull/1639 [BEAM-1112] Python E2E Test Framework And Wordcount E2E Test Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Commented] (BEAM-1112) Python E2E Integration Test Framework - Batch Only

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770674#comment-15770674 ] ASF GitHub Bot commented on BEAM-1112: -- GitHub user markflyhigh reopened a pull request:

[GitHub] incubator-beam pull request #1639: [BEAM-1112] Python E2E Test Framework And...

2016-12-22 Thread markflyhigh
Github user markflyhigh closed the pull request at: https://github.com/apache/incubator-beam/pull/1639 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1688: Update python sdk pom.xml version to 0.5....

2016-12-22 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/incubator-beam/pull/1688 Update python sdk pom.xml version to 0.5.0-incubating-SNAPSHOT You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/incubator-beam

Build failed in Jenkins: beam_PostCommit_Python_Verify #911

2016-12-22 Thread Apache Jenkins Server
See Changes: [lcwik] Add experiments alias for DebugOptions -- [...truncated 2482 lines...] Traceback (most recent call last): File

[1/2] incubator-beam git commit: Add experiments alias for DebugOptions

2016-12-22 Thread lcwik
Repository: incubator-beam Updated Branches: refs/heads/python-sdk 7c5382b33 -> c8a8bb21e Add experiments alias for DebugOptions Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/df663884 Tree:

[2/2] incubator-beam git commit: Add experiments alias for DebugOptions

2016-12-22 Thread lcwik
Add experiments alias for DebugOptions This closes #1682 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c8a8bb21 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c8a8bb21 Diff:

[jira] [Created] (BEAM-1209) GcsUtil can try to execute empty batches in some cases.

2016-12-22 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1209: - Summary: GcsUtil can try to execute empty batches in some cases. Key: BEAM-1209 URL: https://issues.apache.org/jira/browse/BEAM-1209 Project: Beam Issue

[jira] [Created] (BEAM-1208) Visibility of Sum.SumIntegerFn/Sum.SumDoubleFn/Sum.SumYYYFn should be reduced

2016-12-22 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-1208: --- Summary: Visibility of Sum.SumIntegerFn/Sum.SumDoubleFn/Sum.SumYYYFn should be reduced Key: BEAM-1208 URL: https://issues.apache.org/jira/browse/BEAM-1208 Project: Beam

[jira] [Commented] (BEAM-1205) Auto set "enableAbandonedNodeEnforcement" in TestPipeline

2016-12-22 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770623#comment-15770623 ] Thomas Groh commented on BEAM-1205: --- If a user fails to include the {{DirectRunner}} on the classpath,

[jira] [Commented] (BEAM-1205) Auto set "enableAbandonedNodeEnforcement" in TestPipeline

2016-12-22 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770602#comment-15770602 ] Stas Levin commented on BEAM-1205: -- I see, thanks for commenting. So {{if (!sCrashingRunner ||

[jira] [Commented] (BEAM-1205) Auto set "enableAbandonedNodeEnforcement" in TestPipeline

2016-12-22 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770573#comment-15770573 ] Thomas Groh commented on BEAM-1205: --- I really like this idea, but there are a couple of things we should

[jira] [Created] (BEAM-1207) Incompatible httpclient version being used with apex runner in YARN mode

2016-12-22 Thread Pramod Immaneni (JIRA)
Pramod Immaneni created BEAM-1207: - Summary: Incompatible httpclient version being used with apex runner in YARN mode Key: BEAM-1207 URL: https://issues.apache.org/jira/browse/BEAM-1207 Project: Beam

[jira] [Created] (BEAM-1206) PCollections used as a sideInput are unnecessarily re-evaluated.

2016-12-22 Thread Ryan Skraba (JIRA)
Ryan Skraba created BEAM-1206: - Summary: PCollections used as a sideInput are unnecessarily re-evaluated. Key: BEAM-1206 URL: https://issues.apache.org/jira/browse/BEAM-1206 Project: Beam Issue

[jira] [Commented] (BEAM-1017) Add RedisIO

2016-12-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15770171#comment-15770171 ] ASF GitHub Bot commented on BEAM-1017: -- GitHub user jbonofre opened a pull request:

[GitHub] incubator-beam pull request #1687: [BEAM-1017] Add RedisIO

2016-12-22 Thread jbonofre
GitHub user jbonofre opened a pull request: https://github.com/apache/incubator-beam/pull/1687 [BEAM-1017] Add RedisIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is formatted like:

[jira] [Created] (BEAM-1205) Auto set "enableAbandonedNodeEnforcement" in TestPipeline

2016-12-22 Thread Stas Levin (JIRA)
Stas Levin created BEAM-1205: Summary: Auto set "enableAbandonedNodeEnforcement" in TestPipeline Key: BEAM-1205 URL: https://issues.apache.org/jira/browse/BEAM-1205 Project: Beam Issue Type:

Build failed in Jenkins: beam_PostCommit_Python_Verify #909

2016-12-22 Thread Apache Jenkins Server
See -- [...truncated 2482 lines...] Traceback (most recent call last): File "