[jira] [Commented] (BEAM-1789) window can't not use in spark cluster module

2017-04-11 Thread tianyou (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965466#comment-15965466 ] tianyou commented on BEAM-1789: --- [~amitsela] Hello, Do you test the above code in cluster mo

[jira] [Commented] (BEAM-1946) Add IO module for restful api

2017-04-11 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965425#comment-15965425 ] Jean-Baptiste Onofré commented on BEAM-1946: I already have a proto on this (wa

Build failed in Jenkins: beam_PerformanceTests_Dataflow #298

2017-04-11 Thread Apache Jenkins Server
See Changes: [dhalperi] Triggers: handle missing case -- [...truncated 254.70 KB...] ! 3419835...f293534 refs/pull/2431/merge -> origin/pr/2431/merge (unabl

[jira] [Assigned] (BEAM-1946) Add IO module for restful api

2017-04-11 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reassigned BEAM-1946: -- Assignee: Jean-Baptiste Onofré (was: Davor Bonaci) > Add IO module for restful

[jira] [Created] (BEAM-1946) Add IO module for restful api

2017-04-11 Thread JiJun Tang (JIRA)
JiJun Tang created BEAM-1946: Summary: Add IO module for restful api Key: BEAM-1946 URL: https://issues.apache.org/jira/browse/BEAM-1946 Project: Beam Issue Type: New Feature Components

[GitHub] beam-site pull request #208: Add JSON as a planned IO to built-in IOs page.

2017-04-11 Thread aviemzur
GitHub user aviemzur opened a pull request: https://github.com/apache/beam-site/pull/208 Add JSON as a planned IO to built-in IOs page. R: @iemejia You can merge this pull request into a Git repository by running: $ git pull https://github.com/aviemzur/beam-site add-json-to-i

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2813

2017-04-11 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2812

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1944) Add Source Watermark Metrics in Spark runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1944: -- Summary: Add Source Watermark Metrics in Spark runner Key: BEAM-1944 URL: https://issues.apache.org/jira/browse/BEAM-1944 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1945) Add Source Watermark Metrics in Apex runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1945: -- Summary: Add Source Watermark Metrics in Apex runner Key: BEAM-1945 URL: https://issues.apache.org/jira/browse/BEAM-1945 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1943) Add Source Watermark Metrics in Dataflow runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1943: -- Summary: Add Source Watermark Metrics in Dataflow runner Key: BEAM-1943 URL: https://issues.apache.org/jira/browse/BEAM-1943 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1942) Add Source Watermark Metrics in Flink Runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1942: -- Summary: Add Source Watermark Metrics in Flink Runner Key: BEAM-1942 URL: https://issues.apache.org/jira/browse/BEAM-1942 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1941) Add Source Watermark Metrics in Runners

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1941: -- Summary: Add Source Watermark Metrics in Runners Key: BEAM-1941 URL: https://issues.apache.org/jira/browse/BEAM-1941 Project: Beam Issue Type: New Feature

[2/2] beam git commit: This closes #2504

2017-04-11 Thread dhalperi
This closes #2504 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/82f2f2cf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/82f2f2cf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/82f2f2cf Branch: refs/heads/maste

[GitHub] beam pull request #2504: Triggers: handle missing case

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2504 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Triggers: handle missing case

2017-04-11 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master ccf247c1d -> 82f2f2cff Triggers: handle missing case Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e7f43372 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e7f433

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2811

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1799) IO ITs: simplify data loading design pattern

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965239#comment-15965239 ] ASF GitHub Bot commented on BEAM-1799: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #2507: [BEAM-1799] JdbcIOIT now uses writeThenRead style

2017-04-11 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2507 [BEAM-1799] JdbcIOIT now uses writeThenRead style Removes JdbcTestDataSet's main, since it is no longer necessary for loading data. Be sure to do all of the following to help us incorporate

[jira] [Commented] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965231#comment-15965231 ] ASF GitHub Bot commented on BEAM-1937: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2506: [BEAM-1937] Free PTransform Names if they are being...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2506 [BEAM-1937] Free PTransform Names if they are being Replaced Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965227#comment-15965227 ] Thomas Groh commented on BEAM-1937: --- This is due to the fact that a reapplied transform g

[jira] [Resolved] (BEAM-1912) Move HashingFn into io/common so it can be used by other tests

2017-04-11 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk resolved BEAM-1912. Resolution: Fixed Fix Version/s: First stable release > Move HashingFn into io/common so it ca

[jira] [Created] (BEAM-1940) Add Capabilities info to "Built-in I/O Transforms" page

2017-04-11 Thread Stephen Sisk (JIRA)
Stephen Sisk created BEAM-1940: -- Summary: Add Capabilities info to "Built-in I/O Transforms" page Key: BEAM-1940 URL: https://issues.apache.org/jira/browse/BEAM-1940 Project: Beam Issue Type: Im

Build failed in Jenkins: beam_PerformanceTests_Dataflow #297

2017-04-11 Thread Apache Jenkins Server
See Changes: [tgroh] Fix build breaks caused by overlaps between b615013 and c08b7b1 [robertwb] Ignore more python build artifacts. [tgroh] Remove Orderdness of Input, Output expansions [tgroh] Im

[jira] [Commented] (BEAM-115) Beam Runner API

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965150#comment-15965150 ] ASF GitHub Bot commented on BEAM-115: - GitHub user tgroh opened a pull request: htt

[GitHub] beam pull request #2505: [BEAM-115] Represent a Pipeline via a list of Top-l...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2505 [BEAM-115] Represent a Pipeline via a list of Top-level Transforms Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR ti

[GitHub] beam pull request #2504: Triggers: handle missing case

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2504 Triggers: handle missing case R: @tgroh You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam reshuffle-trigger Alternatively you can r

[jira] [Commented] (BEAM-1722) Get PubsubIO and the remaining parts of the GCP IOs out of the core SDK

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965122#comment-15965122 ] ASF GitHub Bot commented on BEAM-1722: -- GitHub user iemejia opened a pull request:

[GitHub] beam pull request #2503: [BEAM-1722] Move PubsubIO into the google-cloud-pla...

2017-04-11 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/2503 [BEAM-1722] Move PubsubIO into the google-cloud-platform module Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR tit

[jira] [Commented] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965116#comment-15965116 ] ASF GitHub Bot commented on BEAM-1928: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2502: [BEAM-1928] Permit the Transform of an AppliedPTran...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2502 [BEAM-1928] Permit the Transform of an AppliedPTransform to be null Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR t

[GitHub] beam pull request #2499: HIFIO Cassandra tests were failing if run twice in ...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2499 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Clean HFIOWithEmbeddedCassandraTest before Execution

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master a2d328a2d -> ccf247c1d Clean HFIOWithEmbeddedCassandraTest before Execution HIFIO Cassandra tests were failing if run twice in a row without a clean Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache

[2/2] beam git commit: This closes #2499

2017-04-11 Thread tgroh
This closes #2499 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ccf247c1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ccf247c1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ccf247c1 Branch: refs/heads/maste

[jira] [Created] (BEAM-1939) Consider serializing standard coders via URN + Class name

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1939: - Summary: Consider serializing standard coders via URN + Class name Key: BEAM-1939 URL: https://issues.apache.org/jira/browse/BEAM-1939 Project: Beam Issue Type: Bu

[jira] [Assigned] (BEAM-1722) Get PubsubIO and the remaining parts of the GCP IOs out of the core SDK

2017-04-11 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-1722: -- Assignee: Ismaël Mejía > Get PubsubIO and the remaining parts of the GCP IOs out of the core SDK

[jira] [Created] (BEAM-1938) Side Inputs should be part of the expanded inputs

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1938: - Summary: Side Inputs should be part of the expanded inputs Key: BEAM-1938 URL: https://issues.apache.org/jira/browse/BEAM-1938 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1938) Side Inputs should be part of the expanded inputs

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965072#comment-15965072 ] ASF GitHub Bot commented on BEAM-1938: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2501: [BEAM-1938] Update Signature of PTransformOverrideF...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2501 [BEAM-1938] Update Signature of PTransformOverrideFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is fo

[2/2] beam git commit: This closes #2498

2017-04-11 Thread dhalperi
This closes #2498 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a2d328a2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a2d328a2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a2d328a2 Branch: refs/heads/maste

[GitHub] beam pull request #2498: DataflowRunner: remove dead code

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2498 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: DataflowRunner: remove dead code

2017-04-11 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 132d4c55d -> a2d328a2d DataflowRunner: remove dead code It is not possible to try to use an unbounded source in batch mode any more, as the runner will automatically enable streaming mode. Project: http://git-wip-us.apache.org/repos/asf/b

[GitHub] beam pull request #2496: Throw specialized exception in value providers

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2496 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Throw specialized exception in value providers

2017-04-11 Thread altay
Repository: beam Updated Branches: refs/heads/master 17a41ab10 -> 132d4c55d Throw specialized exception in value providers Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ee92b964 Tree: http://git-wip-us.apache.org/repos/asf

[2/2] beam git commit: This closes #2496

2017-04-11 Thread altay
This closes #2496 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/132d4c55 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/132d4c55 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/132d4c55 Branch: refs/heads/maste

[jira] [Commented] (BEAM-1196) Serialize/deserialize Pipeline/TransformHierarchy to Runner API Protos

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965032#comment-15965032 ] ASF GitHub Bot commented on BEAM-1196: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2495: [BEAM-1196] DataflowRunner: send windowing strategy...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2495 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #2495

2017-04-11 Thread dhalperi
This closes #2495 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/17a41ab1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/17a41ab1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/17a41ab1 Branch: refs/heads/maste

[1/2] beam git commit: DataflowRunner: send windowing strategy using Runner API proto

2017-04-11 Thread dhalperi
b/runners/google-cloud-dataflow-java/pom.xml index d0d86e6..a57744c 100644 --- a/runners/google-cloud-dataflow-java/pom.xml +++ b/runners/google-cloud-dataflow-java/pom.xml @@ -33,7 +33,7 @@ jar - beam-master-20170410 + beam-master-20170411 1 6 @@ -114,6 +11

[GitHub] beam pull request #2497: DataflowRunner misc cleanups

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #2497

2017-04-11 Thread dhalperi
This closes #2497 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bef2d373 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bef2d373 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bef2d373 Branch: refs/heads/maste

[1/2] beam git commit: DataflowRunner misc cleanups

2017-04-11 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 7587d29f5 -> bef2d3738 DataflowRunner misc cleanups Bad use of format string, very old debugging assert Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3fb3a0c5 Tree: htt

[jira] [Updated] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-11 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1937: -- Attachment: wordcount renumbered.png > PipelineSurgery renumbers already-unique transforms >

[jira] [Created] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1937: - Summary: PipelineSurgery renumbers already-unique transforms Key: BEAM-1937 URL: https://issues.apache.org/jira/browse/BEAM-1937 Project: Beam Issue Type:

[GitHub] beam pull request #2500: [BEAM-1915] Removes use of OldDoFn from Apex

2017-04-11 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2500 [BEAM-1915] Removes use of OldDoFn from Apex This is the last occurrence of OldDoFn in the Beam repository outside of OldDoFn itself. It's also used in the Dataflow worker, but it can be delete

[jira] [Commented] (BEAM-1915) Remove OldDoFn dependency in ApexGroupByKeyOperator

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15965009#comment-15965009 ] ASF GitHub Bot commented on BEAM-1915: -- GitHub user jkff opened a pull request: h

[GitHub] beam pull request #2499: HIFIO Cassandra tests were failing if run twice in ...

2017-04-11 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2499 HIFIO Cassandra tests were failing if run twice in a row without a clean Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2809

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1936) Allow user provided function to extract custom timestamp from payload in pubsubIO

2017-04-11 Thread Keith Berkoben (JIRA)
Keith Berkoben created BEAM-1936: Summary: Allow user provided function to extract custom timestamp from payload in pubsubIO Key: BEAM-1936 URL: https://issues.apache.org/jira/browse/BEAM-1936 Project

[GitHub] beam pull request #2498: DataflowRunner: remove dead code

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2498 DataflowRunner: remove dead code It is not possible to try to use an unbounded source in batch mode any more, as the runner will automatically enable streaming mode. R: @tgroh You can

[jira] [Assigned] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-184: Assignee: (was: Thomas Groh) > Using Merging Windows and/or Triggers without a downstream aggrega

[jira] [Resolved] (BEAM-1508) PInput, POutput#expand should not be ordered

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1508. --- Resolution: Fixed Fix Version/s: First stable release > PInput, POutput#expand should not be ord

[GitHub] beam pull request #2497: DataflowRunner misc cleanups

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2497 DataflowRunner misc cleanups Bad use of format string, very old debugging assert R: @tgroh You can merge this pull request into a Git repository by running: $ git pull https://github.

[jira] [Resolved] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1935. --- Resolution: Fixed Fix Version/s: First stable release > DirectRunner Cancel should never throw a

[jira] [Commented] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964938#comment-15964938 ] ASF GitHub Bot commented on BEAM-1935: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2493: [BEAM-1935] Improve Work Rejection handling

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2493 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: This closes #2493

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 7c169a614 -> 7587d29f5 This closes #2493 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7587d29f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7587d29f Diff: htt

[2/2] beam git commit: Improve Work Rejection handling

2017-04-11 Thread tgroh
Improve Work Rejection handling The timing between checking for a shutdown state and submitting work is racy. Re-check to see if a work rejection is acceptable because the underlying executor is shut down before throwing a RejectedExecutionException. Project: http://git-wip-us.apache.org/repos/a

[GitHub] beam pull request #2496: Throw specialized exception in value providers

2017-04-11 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2496 Throw specialized exception in value providers Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted li

[GitHub] beam pull request #2495: DataflowRunner: send windowing strategy using Runne...

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2495 DataflowRunner: send windowing strategy using Runner API proto You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam proto-runner Alter

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2808

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1508) PInput, POutput#expand should not be ordered

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964874#comment-15964874 ] ASF GitHub Bot commented on BEAM-1508: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2430: [BEAM-1508] Remove Orderdness of Input, Output expa...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2430 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[3/4] beam git commit: Remove Orderdness of Input, Output expansions

2017-04-11 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/0e5737fd/runners/direct-java/src/test/java/org/apache/beam/runners/direct/DirectGraphVisitorTest.java -- diff --git a/runners/direct-java/src/test/java/org/apache/beam/runners/direc

[1/4] beam git commit: This closes #2430

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master a5a5bf946 -> 7c169a614 This closes #2430 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7c169a61 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7c169a61 Diff: htt

[4/4] beam git commit: Remove Orderdness of Input, Output expansions

2017-04-11 Thread tgroh
Remove Orderdness of Input, Output expansions This brings the PInput and POutput expansion signatures back in line with the Runner API. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0e5737fd Tree: http://git-wip-us.apache.org

[2/4] beam git commit: Remove Orderdness of Input, Output expansions

2017-04-11 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/0e5737fd/sdks/java/core/src/test/java/org/apache/beam/sdk/runners/TransformHierarchyTest.java -- diff --git a/sdks/java/core/src/test/java/org/apache/beam/sdk/runners/TransformHiera

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #3258

2017-04-11 Thread Apache Jenkins Server
See

[1/2] beam git commit: Ignore more python build artifacts.

2017-04-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 77712c936 -> a5a5bf946 Ignore more python build artifacts. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1683578 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/

[GitHub] beam pull request #2494: Ignore more python build artifacts.

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2494 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: Closes #2494

2017-04-11 Thread robertwb
Closes #2494 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a5a5bf94 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a5a5bf94 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a5a5bf94 Branch: refs/heads/master Com

[GitHub] beam pull request #2494: Ignore more python build artifacts.

2017-04-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/2494 Ignore more python build artifacts. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-04-11 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964799#comment-15964799 ] Davor Bonaci commented on BEAM-1832: Done. Welcome [~rekhajoshm]! > Potentially unclos

[jira] [Assigned] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-04-11 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1832: -- Assignee: Rekha Joshi > Potentially unclosed OutputStream in ApexYarnLauncher >

[jira] [Commented] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15964790#comment-15964790 ] ASF GitHub Bot commented on BEAM-1935: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2493: [BEAM-1935] Improve Work Rejection handling

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2493 [BEAM-1935] Improve Work Rejection handling Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] beam pull request #2492: Fix build breaks caused by overlaps between b615013...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2492 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: This closes #2492

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 38cf23ebe -> 77712c936 This closes #2492 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77712c93 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/77712c93 Diff: htt

[2/2] beam git commit: Fix build breaks caused by overlaps between b615013 and c08b7b1

2017-04-11 Thread tgroh
Fix build breaks caused by overlaps between b615013 and c08b7b1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/732610d8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/732610d8 Diff: http://git-wip-us.apache.org/repos/as

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3257

2017-04-11 Thread Apache Jenkins Server
See -- [...truncated 1.26 MB...] 2017-04-11T18:19:01.482 [INFO] Downloaded: https://repo.maven.apache.org/maven2/org/apache/curator/curator-framework/2.6.0/curator-fram

[jira] [Created] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1935: - Summary: DirectRunner Cancel should never throw a RejectedExecutionException Key: BEAM-1935 URL: https://issues.apache.org/jira/browse/BEAM-1935 Project: Beam Iss

[jira] [Created] (BEAM-1934) Code examples for CoGroupByKey

2017-04-11 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1934: --- Summary: Code examples for CoGroupByKey Key: BEAM-1934 URL: https://issues.apache.org/jira/browse/BEAM-1934 Project: Beam Issue Type: Improvement Components:

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2807

2017-04-11 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2492: Fix build breaks caused by overlaps between b615013...

2017-04-11 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2492 Fix build breaks caused by overlaps between b615013 and c08b7b1 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [] Make sure the PR title

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3254

2017-04-11 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3256

2017-04-11 Thread Apache Jenkins Server
See Changes: [tgroh] Remove Jdk1.8-tests/.toDelete -- [...truncated 1.23 MB...] 2017-04-11T17:59:35.877 [INFO] Downloaded: https://repo.maven.apache.org/

Build failed in Jenkins: beam_PerformanceTests_Dataflow #296

2017-04-11 Thread Apache Jenkins Server
See Changes: [dhalperi] PubsubIO: remove support for BoundedReader [dhalperi] Move HashingFn to io/common, switch to better hash [iemejia] Flip dependency edge between Dataflow runner and IO-GCP [

[jira] [Created] (BEAM-1933) Revisit Runner API PCollection unique_name

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1933: - Summary: Revisit Runner API PCollection unique_name Key: BEAM-1933 URL: https://issues.apache.org/jira/browse/BEAM-1933 Project: Beam Issue Type: Bug Com

[jira] [Resolved] (BEAM-260) WindowMappingFn: Know the getSideInputWindow upper bound to release side input resources

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-260. -- Resolution: Fixed Fix Version/s: First stable release > WindowMappingFn: Know the getSideInputWindo

  1   2   >