[jira] [Created] (BEAM-1946) Add IO module for restful api

2017-04-11 Thread JiJun Tang (JIRA)
JiJun Tang created BEAM-1946: Summary: Add IO module for restful api Key: BEAM-1946 URL: https://issues.apache.org/jira/browse/BEAM-1946 Project: Beam Issue Type: New Feature

[GitHub] beam-site pull request #208: Add JSON as a planned IO to built-in IOs page.

2017-04-11 Thread aviemzur
GitHub user aviemzur opened a pull request: https://github.com/apache/beam-site/pull/208 Add JSON as a planned IO to built-in IOs page. R: @iemejia You can merge this pull request into a Git repository by running: $ git pull https://github.com/aviemzur/beam-site

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2813

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1944) Add Source Watermark Metrics in Spark runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1944: -- Summary: Add Source Watermark Metrics in Spark runner Key: BEAM-1944 URL: https://issues.apache.org/jira/browse/BEAM-1944 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1945) Add Source Watermark Metrics in Apex runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1945: -- Summary: Add Source Watermark Metrics in Apex runner Key: BEAM-1945 URL: https://issues.apache.org/jira/browse/BEAM-1945 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1943) Add Source Watermark Metrics in Dataflow runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1943: -- Summary: Add Source Watermark Metrics in Dataflow runner Key: BEAM-1943 URL: https://issues.apache.org/jira/browse/BEAM-1943 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1942) Add Source Watermark Metrics in Flink Runner

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1942: -- Summary: Add Source Watermark Metrics in Flink Runner Key: BEAM-1942 URL: https://issues.apache.org/jira/browse/BEAM-1942 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1941) Add Source Watermark Metrics in Runners

2017-04-11 Thread Jingsong Lee (JIRA)
Jingsong Lee created BEAM-1941: -- Summary: Add Source Watermark Metrics in Runners Key: BEAM-1941 URL: https://issues.apache.org/jira/browse/BEAM-1941 Project: Beam Issue Type: New Feature

[2/2] beam git commit: This closes #2504

2017-04-11 Thread dhalperi
This closes #2504 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/82f2f2cf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/82f2f2cf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/82f2f2cf Branch:

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2811

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1799) IO ITs: simplify data loading design pattern

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965239#comment-15965239 ] ASF GitHub Bot commented on BEAM-1799: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #2507: [BEAM-1799] JdbcIOIT now uses writeThenRead style

2017-04-11 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2507 [BEAM-1799] JdbcIOIT now uses writeThenRead style Removes JdbcTestDataSet's main, since it is no longer necessary for loading data. Be sure to do all of the following to help us

[jira] [Commented] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965231#comment-15965231 ] ASF GitHub Bot commented on BEAM-1937: -- GitHub user tgroh opened a pull request:

[jira] [Resolved] (BEAM-1912) Move HashingFn into io/common so it can be used by other tests

2017-04-11 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk resolved BEAM-1912. Resolution: Fixed Fix Version/s: First stable release > Move HashingFn into io/common so it

[jira] [Commented] (BEAM-115) Beam Runner API

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965150#comment-15965150 ] ASF GitHub Bot commented on BEAM-115: - GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2505: [BEAM-115] Represent a Pipeline via a list of Top-l...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2505 [BEAM-115] Represent a Pipeline via a list of Top-level Transforms Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2504: Triggers: handle missing case

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2504 Triggers: handle missing case R: @tgroh You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam reshuffle-trigger Alternatively you can

[jira] [Commented] (BEAM-1722) Get PubsubIO and the remaining parts of the GCP IOs out of the core SDK

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965122#comment-15965122 ] ASF GitHub Bot commented on BEAM-1722: -- GitHub user iemejia opened a pull request:

[GitHub] beam pull request #2503: [BEAM-1722] Move PubsubIO into the google-cloud-pla...

2017-04-11 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/2503 [BEAM-1722] Move PubsubIO into the google-cloud-platform module Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

[jira] [Commented] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965116#comment-15965116 ] ASF GitHub Bot commented on BEAM-1928: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2502: [BEAM-1928] Permit the Transform of an AppliedPTran...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2502 [BEAM-1928] Permit the Transform of an AppliedPTransform to be null Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2499: HIFIO Cassandra tests were failing if run twice in ...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2499 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Clean HFIOWithEmbeddedCassandraTest before Execution

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master a2d328a2d -> ccf247c1d Clean HFIOWithEmbeddedCassandraTest before Execution HIFIO Cassandra tests were failing if run twice in a row without a clean Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[2/2] beam git commit: This closes #2499

2017-04-11 Thread tgroh
This closes #2499 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ccf247c1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ccf247c1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ccf247c1 Branch:

[jira] [Assigned] (BEAM-1722) Get PubsubIO and the remaining parts of the GCP IOs out of the core SDK

2017-04-11 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-1722: -- Assignee: Ismaël Mejía > Get PubsubIO and the remaining parts of the GCP IOs out of the core

[jira] [Created] (BEAM-1938) Side Inputs should be part of the expanded inputs

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1938: - Summary: Side Inputs should be part of the expanded inputs Key: BEAM-1938 URL: https://issues.apache.org/jira/browse/BEAM-1938 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1938) Side Inputs should be part of the expanded inputs

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965072#comment-15965072 ] ASF GitHub Bot commented on BEAM-1938: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2501: [BEAM-1938] Update Signature of PTransformOverrideF...

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2501 [BEAM-1938] Update Signature of PTransformOverrideFactory Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[2/2] beam git commit: This closes #2498

2017-04-11 Thread dhalperi
This closes #2498 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a2d328a2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a2d328a2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a2d328a2 Branch:

[GitHub] beam pull request #2498: DataflowRunner: remove dead code

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2498 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: DataflowRunner: remove dead code

2017-04-11 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 132d4c55d -> a2d328a2d DataflowRunner: remove dead code It is not possible to try to use an unbounded source in batch mode any more, as the runner will automatically enable streaming mode. Project:

[GitHub] beam pull request #2496: Throw specialized exception in value providers

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2496 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2496

2017-04-11 Thread altay
This closes #2496 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/132d4c55 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/132d4c55 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/132d4c55 Branch:

[jira] [Commented] (BEAM-1196) Serialize/deserialize Pipeline/TransformHierarchy to Runner API Protos

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965032#comment-15965032 ] ASF GitHub Bot commented on BEAM-1196: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2495: [BEAM-1196] DataflowRunner: send windowing strategy...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2495 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2495

2017-04-11 Thread dhalperi
This closes #2495 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/17a41ab1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/17a41ab1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/17a41ab1 Branch:

[1/2] beam git commit: DataflowRunner: send windowing strategy using Runner API proto

2017-04-11 Thread dhalperi
diff --git a/runners/google-cloud-dataflow-java/pom.xml b/runners/google-cloud-dataflow-java/pom.xml index d0d86e6..a57744c 100644 --- a/runners/google-cloud-dataflow-java/pom.xml +++ b/runners/google-cloud-dataflow-java/pom.xml @@ -33,7 +33,7 @@ jar - beam-master-20170410 + beam-

[GitHub] beam pull request #2497: DataflowRunner misc cleanups

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2497 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-11 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1937: - Summary: PipelineSurgery renumbers already-unique transforms Key: BEAM-1937 URL: https://issues.apache.org/jira/browse/BEAM-1937 Project: Beam Issue Type:

[GitHub] beam pull request #2500: [BEAM-1915] Removes use of OldDoFn from Apex

2017-04-11 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2500 [BEAM-1915] Removes use of OldDoFn from Apex This is the last occurrence of OldDoFn in the Beam repository outside of OldDoFn itself. It's also used in the Dataflow worker, but it can be

[jira] [Commented] (BEAM-1915) Remove OldDoFn dependency in ApexGroupByKeyOperator

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15965009#comment-15965009 ] ASF GitHub Bot commented on BEAM-1915: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #2499: HIFIO Cassandra tests were failing if run twice in ...

2017-04-11 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2499 HIFIO Cassandra tests were failing if run twice in a row without a clean Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2809

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1936) Allow user provided function to extract custom timestamp from payload in pubsubIO

2017-04-11 Thread Keith Berkoben (JIRA)
Keith Berkoben created BEAM-1936: Summary: Allow user provided function to extract custom timestamp from payload in pubsubIO Key: BEAM-1936 URL: https://issues.apache.org/jira/browse/BEAM-1936

[GitHub] beam pull request #2498: DataflowRunner: remove dead code

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2498 DataflowRunner: remove dead code It is not possible to try to use an unbounded source in batch mode any more, as the runner will automatically enable streaming mode. R: @tgroh You

[jira] [Assigned] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-184: Assignee: (was: Thomas Groh) > Using Merging Windows and/or Triggers without a downstream

[jira] [Resolved] (BEAM-1508) PInput, POutput#expand should not be ordered

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1508. --- Resolution: Fixed Fix Version/s: First stable release > PInput, POutput#expand should not be

[GitHub] beam pull request #2497: DataflowRunner misc cleanups

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2497 DataflowRunner misc cleanups Bad use of format string, very old debugging assert R: @tgroh You can merge this pull request into a Git repository by running: $ git pull

[jira] [Resolved] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1935. --- Resolution: Fixed Fix Version/s: First stable release > DirectRunner Cancel should never throw

[jira] [Commented] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964938#comment-15964938 ] ASF GitHub Bot commented on BEAM-1935: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2493: [BEAM-1935] Improve Work Rejection handling

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2493 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: This closes #2493

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 7c169a614 -> 7587d29f5 This closes #2493 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7587d29f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7587d29f Diff:

[2/2] beam git commit: Improve Work Rejection handling

2017-04-11 Thread tgroh
Improve Work Rejection handling The timing between checking for a shutdown state and submitting work is racy. Re-check to see if a work rejection is acceptable because the underlying executor is shut down before throwing a RejectedExecutionException. Project:

[GitHub] beam pull request #2496: Throw specialized exception in value providers

2017-04-11 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2496 Throw specialized exception in value providers Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2495: DataflowRunner: send windowing strategy using Runne...

2017-04-11 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2495 DataflowRunner: send windowing strategy using Runner API proto You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam proto-runner

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2808

2017-04-11 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1508) PInput, POutput#expand should not be ordered

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964874#comment-15964874 ] ASF GitHub Bot commented on BEAM-1508: -- Github user asfgit closed the pull request at:

[3/4] beam git commit: Remove Orderdness of Input, Output expansions

2017-04-11 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/0e5737fd/runners/direct-java/src/test/java/org/apache/beam/runners/direct/DirectGraphVisitorTest.java -- diff --git

[GitHub] beam pull request #2430: [BEAM-1508] Remove Orderdness of Input, Output expa...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2430 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/4] beam git commit: This closes #2430

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master a5a5bf946 -> 7c169a614 This closes #2430 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7c169a61 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7c169a61 Diff:

[4/4] beam git commit: Remove Orderdness of Input, Output expansions

2017-04-11 Thread tgroh
Remove Orderdness of Input, Output expansions This brings the PInput and POutput expansion signatures back in line with the Runner API. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0e5737fd Tree:

[2/4] beam git commit: Remove Orderdness of Input, Output expansions

2017-04-11 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/0e5737fd/sdks/java/core/src/test/java/org/apache/beam/sdk/runners/TransformHierarchyTest.java -- diff --git

Jenkins build is back to normal : beam_PostCommit_Java_MavenInstall #3258

2017-04-11 Thread Apache Jenkins Server
See

[1/2] beam git commit: Ignore more python build artifacts.

2017-04-11 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 77712c936 -> a5a5bf946 Ignore more python build artifacts. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1683578 Tree:

[2/2] beam git commit: Closes #2494

2017-04-11 Thread robertwb
Closes #2494 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a5a5bf94 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a5a5bf94 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a5a5bf94 Branch: refs/heads/master

[GitHub] beam pull request #2494: Ignore more python build artifacts.

2017-04-11 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/2494 Ignore more python build artifacts. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Commented] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-04-11 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964799#comment-15964799 ] Davor Bonaci commented on BEAM-1832: Done. Welcome [~rekhajoshm]! > Potentially unclosed OutputStream

[jira] [Assigned] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-04-11 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1832: -- Assignee: Rekha Joshi > Potentially unclosed OutputStream in ApexYarnLauncher >

[jira] [Commented] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964790#comment-15964790 ] ASF GitHub Bot commented on BEAM-1935: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2493: [BEAM-1935] Improve Work Rejection handling

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2493 [BEAM-1935] Improve Work Rejection handling Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] beam pull request #2492: Fix build breaks caused by overlaps between b615013...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2492 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: This closes #2492

2017-04-11 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 38cf23ebe -> 77712c936 This closes #2492 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/77712c93 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/77712c93 Diff:

[2/2] beam git commit: Fix build breaks caused by overlaps between b615013 and c08b7b1

2017-04-11 Thread tgroh
Fix build breaks caused by overlaps between b615013 and c08b7b1 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/732610d8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/732610d8 Diff:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3257

2017-04-11 Thread Apache Jenkins Server
See -- [...truncated 1.26 MB...] 2017-04-11T18:19:01.482 [INFO] Downloaded:

[jira] [Created] (BEAM-1935) DirectRunner Cancel should never throw a RejectedExecutionException

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1935: - Summary: DirectRunner Cancel should never throw a RejectedExecutionException Key: BEAM-1935 URL: https://issues.apache.org/jira/browse/BEAM-1935 Project: Beam

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2807

2017-04-11 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2492: Fix build breaks caused by overlaps between b615013...

2017-04-11 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2492 Fix build breaks caused by overlaps between b615013 and c08b7b1 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [] Make sure the PR title

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3254

2017-04-11 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3256

2017-04-11 Thread Apache Jenkins Server
See Changes: [tgroh] Remove Jdk1.8-tests/.toDelete -- [...truncated 1.23 MB...] 2017-04-11T17:59:35.877 [INFO] Downloaded:

Build failed in Jenkins: beam_PerformanceTests_Dataflow #296

2017-04-11 Thread Apache Jenkins Server
See Changes: [dhalperi] PubsubIO: remove support for BoundedReader [dhalperi] Move HashingFn to io/common, switch to better hash [iemejia] Flip dependency edge between Dataflow runner and IO-GCP

[jira] [Created] (BEAM-1933) Revisit Runner API PCollection unique_name

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1933: - Summary: Revisit Runner API PCollection unique_name Key: BEAM-1933 URL: https://issues.apache.org/jira/browse/BEAM-1933 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-260) WindowMappingFn: Know the getSideInputWindow upper bound to release side input resources

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-260. -- Resolution: Fixed Fix Version/s: First stable release > WindowMappingFn: Know the

[jira] [Commented] (BEAM-260) WindowMappingFn: Know the getSideInputWindow upper bound to release side input resources

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964694#comment-15964694 ] Thomas Groh commented on BEAM-260: -- This is supported in the Java SDK. I've filed

[GitHub] beam pull request #2491: Remove Jdk1.8-tests/.toDelete

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2491 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2491: Remove Jdk1.8-tests/.toDelete

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2491 Remove Jdk1.8-tests/.toDelete Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3255

2017-04-11 Thread Apache Jenkins Server
See Changes: [dhalperi] Improve HadoopInputFormatIO DisplayData and Cassandra tests -- [...truncated 508.32 KB...] 2017-04-11T17:30:22.243 [INFO]

[GitHub] beam-site pull request #207: remove extra streaming refs in capability matri...

2017-04-11 Thread melap
GitHub user melap opened a pull request: https://github.com/apache/beam-site/pull/207 remove extra streaming refs in capability matrix: Flink state/timers these streaming references seem to be out of place after PR 198 R: @aljoscha You can merge this pull request into a

[jira] [Created] (BEAM-1931) The DirectRunner should garbage collect PCollectionView contents

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1931: - Summary: The DirectRunner should garbage collect PCollectionView contents Key: BEAM-1931 URL: https://issues.apache.org/jira/browse/BEAM-1931 Project: Beam Issue

[jira] [Assigned] (BEAM-819) The DirectRunner can complete before reporting the results of all ModelEnforcements

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-819: Assignee: (was: Thomas Groh) > The DirectRunner can complete before reporting the results of all

[jira] [Assigned] (BEAM-436) DirectRunner RunnableOnService tempLocation configuration insufficient

2017-04-11 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-436: Assignee: (was: Thomas Groh) > DirectRunner RunnableOnService tempLocation configuration

[GitHub] beam pull request #2460: Hifio Cassandra and Elasticsearch Part2 fixes

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2460 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964671#comment-15964671 ] ASF GitHub Bot commented on BEAM-1928: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2490: [BEAM-1928] Use SdkComponents in WindowingStrategy....

2017-04-11 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2490 [BEAM-1928] Use SdkComponents in WindowingStrategy.toProto Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[2/2] beam git commit: This closes #2460

2017-04-11 Thread dhalperi
This closes #2460 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d255fa25 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d255fa25 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d255fa25 Branch:

[1/2] beam git commit: Improve HadoopInputFormatIO DisplayData and Cassandra tests

2017-04-11 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 8beea73c1 -> d255fa25f Improve HadoopInputFormatIO DisplayData and Cassandra tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c08b7b17 Tree:

[jira] [Commented] (BEAM-1930) Abstract Coder translation from Runner API Protos

2017-04-11 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964647#comment-15964647 ] Luke Cwik commented on BEAM-1930: - I think with Jackson/ObjectMapper you could do the same thing and have

[jira] [Created] (BEAM-1930) Abstract Coder translation from Runner API Protos

2017-04-11 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1930: - Summary: Abstract Coder translation from Runner API Protos Key: BEAM-1930 URL: https://issues.apache.org/jira/browse/BEAM-1930 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-04-11 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15964638#comment-15964638 ] ASF GitHub Bot commented on BEAM-1928: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2487: [BEAM-1928] Add Coder utilities for Proto conversio...

2017-04-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2487 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2487

2017-04-11 Thread tgroh
This closes #2487 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8beea73c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8beea73c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8beea73c Branch:

  1   2   >