[jira] [Commented] (BEAM-1265) Add streaming support to DirectRunner

2017-02-10 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861542#comment-15861542 ] Ahmet Altay commented on BEAM-1265: --- Re: Johan This issue is for adding streaming support to the

[1/2] beam git commit: BEAM-1443: Preserve window duplication on window assignment.

2017-02-10 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 9c4a784bb -> caaa64dc6 BEAM-1443: Preserve window duplication on window assignment. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/71264671 Tree:

[jira] [Commented] (BEAM-298) Make TestPipeline implement the TestRule interface

2017-02-10 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861795#comment-15861795 ] Neville Li commented on BEAM-298: - As a result of this change I need to include {{junit}} in my dependencies

[jira] [Created] (BEAM-1461) duplication with StartBundle and prepareForProcessing in DoFn

2017-02-10 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-1461: Summary: duplication with StartBundle and prepareForProcessing in DoFn Key: BEAM-1461 URL: https://issues.apache.org/jira/browse/BEAM-1461 Project: Beam Issue

[jira] [Created] (BEAM-1460) Change ToString Method Name

2017-02-10 Thread Jesse Anderson (JIRA)
Jesse Anderson created BEAM-1460: Summary: Change ToString Method Name Key: BEAM-1460 URL: https://issues.apache.org/jira/browse/BEAM-1460 Project: Beam Issue Type: Improvement

[GitHub] beam pull request #1975: [BEAM-1460] Changed name of ToString.of() to elemen...

2017-02-10 Thread eljefe6a
GitHub user eljefe6a opened a pull request: https://github.com/apache/beam/pull/1975 [BEAM-1460] Changed name of ToString.of() to elements() Changed name of ToString.of() to ToString.elements(). You can merge this pull request into a Git repository by running: $ git pull

[jira] [Comment Edited] (BEAM-298) Make TestPipeline implement the TestRule interface

2017-02-10 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861795#comment-15861795 ] Neville Li edited comment on BEAM-298 at 2/10/17 8:08 PM: -- As a result of this

[jira] [Commented] (BEAM-1460) Change ToString Method Name

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861813#comment-15861813 ] ASF GitHub Bot commented on BEAM-1460: -- GitHub user eljefe6a opened a pull request:

[3/3] beam-site git commit: This closes #147

2017-02-10 Thread altay
This closes #147 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/a1e2a39f Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/a1e2a39f Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/a1e2a39f

[1/3] beam-site git commit: Add new Managing Python Pipeline Dependencies page

2017-02-10 Thread altay
Repository: beam-site Updated Branches: refs/heads/asf-site 703e0bb2b -> a1e2a39f6 Add new Managing Python Pipeline Dependencies page Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/2dd2c59c Tree:

[2/3] beam-site git commit: Regenerate website

2017-02-10 Thread altay
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/e627b278 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/e627b278 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/e627b278

[GitHub] beam-site pull request #147: Add new Managing Python Pipeline Dependencies p...

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/147 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Add ReplacementOutput

2017-02-10 Thread tgroh
Repository: beam Updated Branches: refs/heads/master caaa64dc6 -> effca63f9 Add ReplacementOutput This is used to construct mappings between the original and replacement PValues in an output, in order to permit the Pipeline to replace all of the outputs generated by replacement transforms

[2/2] beam git commit: This closes #1939

2017-02-10 Thread tgroh
This closes #1939 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/effca63f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/effca63f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/effca63f Branch:

[jira] [Commented] (BEAM-646) Get runners out of the apply()

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861627#comment-15861627 ] ASF GitHub Bot commented on BEAM-646: - GitHub user tgroh opened a pull request:

[GitHub] beam pull request #1973: [BEAM-646] Add ParDo Matchers to PTransformMatchers

2017-02-10 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/1973 [BEAM-646] Add ParDo Matchers to PTransformMatchers Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Created] (BEAM-1459) Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters.

2017-02-10 Thread Pablo Estrada (JIRA)
Pablo Estrada created BEAM-1459: --- Summary: Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters. Key: BEAM-1459 URL: https://issues.apache.org/jira/browse/BEAM-1459

[jira] [Commented] (BEAM-1458) Checkpoint support in Beam

2017-02-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861511#comment-15861511 ] Aljoscha Krettek commented on BEAM-1458: Flink snapshots/checkpoints are different from how the

[GitHub] beam-site pull request #153: processBatch() is now called processBundle()

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/153 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/3] beam-site git commit: Regenerate website

2017-02-10 Thread dhalperi
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/703e0bb2 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/703e0bb2 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/703e0bb2

[jira] [Commented] (BEAM-1443) Re-windowing should preserve the duplicity following sliding-window-like assignment

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861589#comment-15861589 ] ASF GitHub Bot commented on BEAM-1443: -- Github user asfgit closed the pull request at:

[GitHub] beam-site pull request #151: Add back composite transforms anchor to fix bro...

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/151 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/3] beam-site git commit: Closes #151

2017-02-10 Thread dhalperi
Closes #151 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/29ddf776 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/29ddf776 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/29ddf776 Branch:

[3/3] beam-site git commit: Regenerate website

2017-02-10 Thread dhalperi
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/0b277be1 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/0b277be1 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/0b277be1

[1/3] beam-site git commit: Add back composite transforms anchor to fix broken links

2017-02-10 Thread dhalperi
Repository: beam-site Updated Branches: refs/heads/asf-site c9a64d3b9 -> 0b277be13 Add back composite transforms anchor to fix broken links Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/c4392699 Tree:

[GitHub] beam pull request #1974: [BEAM-1459] Adding setters for CounterUpdate in the...

2017-02-10 Thread pabloem
GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/1974 [BEAM-1459] Adding setters for CounterUpdate in the dataflow runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the

[2/2] beam git commit: Closes #1959

2017-02-10 Thread robertwb
Closes #1959 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/caaa64dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/caaa64dc Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/caaa64dc Branch: refs/heads/master

[2/3] beam-site git commit: processBatch() is now called processBundle()

2017-02-10 Thread dhalperi
processBatch() is now called processBundle() Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/3fd072a1 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/3fd072a1 Diff:

[jira] [Commented] (BEAM-1459) Dataflow runner has deprecated metricsUpdates in favor of counterUpdates. Add setters.

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861646#comment-15861646 ] ASF GitHub Bot commented on BEAM-1459: -- GitHub user pabloem opened a pull request:

[2/2] beam git commit: Attach original traceback in direct runner failure.

2017-02-10 Thread robertwb
Attach original traceback in direct runner failure. This will make it much easier to debug pipelines. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5fba260d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5fba260d

[1/2] beam git commit: Closes #1970

2017-02-10 Thread robertwb
Repository: beam Updated Branches: refs/heads/master effca63f9 -> 51ef0009a Closes #1970 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/51ef0009 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/51ef0009 Diff:

[jira] [Commented] (BEAM-759) PipelineResult needs waitToFinish() and cancel()

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861881#comment-15861881 ] ASF GitHub Bot commented on BEAM-759: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-1458) Checkpoint support in Beam

2017-02-10 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861876#comment-15861876 ] Rafal Wojdyla commented on BEAM-1458: - [~aljoscha] thanks for the comment. Correct - in this case we

[jira] [Commented] (BEAM-59) IOChannelFactory rethinking/redesign

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861954#comment-15861954 ] ASF GitHub Bot commented on BEAM-59: GitHub user peihe opened a pull request:

[GitHub] beam pull request #1977: [BEAM-59] GcsUtil: refactor and expose getObject() ...

2017-02-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1977 [BEAM-59] GcsUtil: refactor and expose getObject() and listObjects() APIs. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] beam pull request #1970: Attach original traceback in direct runner failure.

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1970 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1971: [BEAM-646] Construct Pipeline Nodes after Pipeline#...

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1971 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-646) Get runners out of the apply()

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861897#comment-15861897 ] ASF GitHub Bot commented on BEAM-646: - Github user asfgit closed the pull request at:

[1/2] beam git commit: Remove unneeded version for direct-runner dependency (must inherit from parent)

2017-02-10 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master b1c1c83e7 -> aac4da171 Remove unneeded version for direct-runner dependency (must inherit from parent) Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5a0aa4e0 Tree:

[GitHub] beam pull request #1976: Remove unneeded version for direct-runner dependenc...

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1976 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #1976

2017-02-10 Thread dhalperi
This closes #1976 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/aac4da17 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/aac4da17 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/aac4da17 Branch:

[2/2] beam git commit: This closes #1956

2017-02-10 Thread altay
This closes #1956 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f124081f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f124081f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f124081f Branch:

[GitHub] beam pull request #1956: [BEAM-759] Remove blocking dataflow runner

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1956 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Remove blocking dataflow runner

2017-02-10 Thread altay
Repository: beam Updated Branches: refs/heads/master 51ef0009a -> f124081f5 Remove blocking dataflow runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9c2c08dc Tree:

[2/2] beam git commit: Construct Pipeline Nodes after Pipeline#run

2017-02-10 Thread tgroh
Construct Pipeline Nodes after Pipeline#run Before-run is not compatible with Pipeline Surgery Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7ba6a147 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7ba6a147 Diff:

[GitHub] beam pull request #1978: [BEAM-1463] Updates BigQuery read transform to hand...

2017-02-10 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/beam/pull/1978 [BEAM-1463] Updates BigQuery read transform to handle 'null' fields properly for DirectRunner Updates BigQuery read transform so that DirectRunner handles 'null' fields properly.

[06/11] beam git commit: Remove label from windowInto

2017-02-10 Thread altay
Remove label from windowInto Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/44d6501d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/44d6501d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/44d6501d Branch:

[GitHub] beam pull request #1958: [Beam-1280] remove label arguments from ptransforms

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1958 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[07/11] beam git commit: Remove label guessing from CallablePTransform

2017-02-10 Thread altay
Remove label guessing from CallablePTransform Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e67384c8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e67384c8 Diff:

[01/11] beam git commit: Remove fn_or_label argument from Map and Filter

2017-02-10 Thread altay
Repository: beam Updated Branches: refs/heads/master 9a84d3a87 -> af02b8c32 Remove fn_or_label argument from Map and Filter Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9804a5c2 Tree:

[09/11] beam git commit: Remove label guessing from PValue

2017-02-10 Thread altay
Remove label guessing from PValue Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fe39ae1e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fe39ae1e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/fe39ae1e Branch:

[03/11] beam git commit: Remove label_or_fn from CombineGlobally

2017-02-10 Thread altay
Remove label_or_fn from CombineGlobally Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/109ead9d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/109ead9d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/109ead9d

[GitHub] beam pull request #1981: [BEAM-782] support runner names to be partial or ca...

2017-02-10 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1981 [BEAM-782] support runner names to be partial or case insensitive R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily:

[jira] [Commented] (BEAM-1463) Update BigQuery read transform to handle 'null' values properly for DirectRunner

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862137#comment-15862137 ] ASF GitHub Bot commented on BEAM-1463: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-1464) Make sure all tests use the TestPipeline class

2017-02-10 Thread Sourabh Bajaj (JIRA)
Sourabh Bajaj created BEAM-1464: --- Summary: Make sure all tests use the TestPipeline class Key: BEAM-1464 URL: https://issues.apache.org/jira/browse/BEAM-1464 Project: Beam Issue Type:

[1/2] beam git commit: Fix invalid pattern in KafkaIO shade

2017-02-10 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 65af217a6 -> 9a84d3a87 Fix invalid pattern in KafkaIO shade Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/23f57908 Tree:

[jira] [Resolved] (BEAM-1463) Update BigQuery read transform to handle 'null' values properly for DirectRunner

2017-02-10 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-1463. -- Resolution: Fixed Fix Version/s: Not applicable > Update BigQuery read transform

[08/11] beam git commit: Remove label from Flatten

2017-02-10 Thread altay
Remove label from Flatten Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5b0d8830 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5b0d8830 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5b0d8830 Branch:

[11/11] beam git commit: This closes #1958

2017-02-10 Thread altay
This closes #1958 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/af02b8c3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/af02b8c3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/af02b8c3 Branch:

[05/11] beam git commit: Remove fn_or_label argument from FlatMap

2017-02-10 Thread altay
Remove fn_or_label argument from FlatMap Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5af68f05 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5af68f05 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5af68f05

[jira] [Commented] (BEAM-1464) Make sure all tests use the TestPipeline class

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862148#comment-15862148 ] ASF GitHub Bot commented on BEAM-1464: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #1955: [BEAM-1185] Remove references to PipelineRunner

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1955 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #1955

2017-02-10 Thread altay
This closes #1955 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/65af217a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/65af217a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/65af217a Branch:

[jira] [Resolved] (BEAM-1430) PartitionFn should access only the element and not the context

2017-02-10 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj resolved BEAM-1430. - Resolution: Fixed Fix Version/s: Not applicable > PartitionFn should access only the

[GitHub] beam pull request #1980: [BEAM-1464] All test should use TestPipeline

2017-02-10 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/1980 [BEAM-1464] All test should use TestPipeline R: @aaltay PTAL Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[jira] [Commented] (BEAM-1464) Make sure all tests use the TestPipeline class

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862064#comment-15862064 ] ASF GitHub Bot commented on BEAM-1464: -- GitHub user sb2nov opened a pull request:

[1/2] beam git commit: Updates BigQuery read transform so that DirectRunner handles 'null' fields properly.

2017-02-10 Thread altay
Repository: beam Updated Branches: refs/heads/master af02b8c32 -> a2826195b Updates BigQuery read transform so that DirectRunner handles 'null' fields properly. Before this change, for DirectRunner, a record (dictionary) returned by BigQuery read transform will not contain keys for fields

[GitHub] beam pull request #1978: [BEAM-1463] Updates BigQuery read transform to hand...

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #1980: [BEAM-1464] All test should use TestPipeline

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1980 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-1464] All test should use TestPipeline instead of specifying DirectRunner

2017-02-10 Thread altay
Repository: beam Updated Branches: refs/heads/master a2826195b -> 3acdd956f [BEAM-1464] All test should use TestPipeline instead of specifying DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0f3a24ac Tree:

[1/2] beam git commit: [BEAM-59] GcsUtil: refactor and expose getObject() and listObjects() APIs.

2017-02-10 Thread pei
Repository: beam Updated Branches: refs/heads/master a9bcdcedf -> 5fe11a2fc [BEAM-59] GcsUtil: refactor and expose getObject() and listObjects() APIs. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/51a8c37a Tree:

[jira] [Commented] (BEAM-298) Make TestPipeline implement the TestRule interface

2017-02-10 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862201#comment-15862201 ] Neville Li commented on BEAM-298: - That didn't work for me. I had to add it as a {compile} scope. > Make

[jira] [Comment Edited] (BEAM-298) Make TestPipeline implement the TestRule interface

2017-02-10 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862201#comment-15862201 ] Neville Li edited comment on BEAM-298 at 2/11/17 4:12 AM: -- That didn't work for me.

[2/2] beam git commit: This closes #1977

2017-02-10 Thread pei
This closes #1977 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5fe11a2f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5fe11a2f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5fe11a2f Branch:

[jira] [Commented] (BEAM-59) IOChannelFactory rethinking/redesign

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862277#comment-15862277 ] ASF GitHub Bot commented on BEAM-59: GitHub user peihe opened a pull request:

[jira] [Commented] (BEAM-59) IOChannelFactory rethinking/redesign

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1586#comment-1586 ] ASF GitHub Bot commented on BEAM-59: Github user asfgit closed the pull request at:

[1/2] beam git commit: [BEAM-59] Beam FileSystem: initial set of methods and their implementation for local and gcs.

2017-02-10 Thread pei
Repository: beam Updated Branches: refs/heads/master 3acdd956f -> a9bcdcedf [BEAM-59] Beam FileSystem: initial set of methods and their implementation for local and gcs. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[2/2] beam git commit: This closes #1808

2017-02-10 Thread pei
This closes #1808 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a9bcdced Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a9bcdced Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a9bcdced Branch:

[jira] [Assigned] (BEAM-1465) No natural place to flush outputs in FileBasedWriter

2017-02-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1465: --- Assignee: Daniel Halperin (was: Davor Bonaci) > No natural place to flush outputs in FileBasedWriter

[jira] [Created] (BEAM-1465) No natural place to flush outputs in FileBasedWriter

2017-02-10 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1465: --- Summary: No natural place to flush outputs in FileBasedWriter Key: BEAM-1465 URL: https://issues.apache.org/jira/browse/BEAM-1465 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1393) Update Flink Runner to Flink 1.2.0

2017-02-10 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862290#comment-15862290 ] Jingsong Lee commented on BEAM-1393: Totally agree! {{AbstractStreamOperator}} will check the type of

[jira] [Created] (BEAM-1458) Checkpoint support in beam

2017-02-10 Thread Rafal Wojdyla (JIRA)
Rafal Wojdyla created BEAM-1458: --- Summary: Checkpoint support in beam Key: BEAM-1458 URL: https://issues.apache.org/jira/browse/BEAM-1458 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-1458) Checkpoint support in Beam

2017-02-10 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla updated BEAM-1458: Summary: Checkpoint support in Beam (was: Checkpoint support in beam) > Checkpoint support in Beam

[jira] [Commented] (BEAM-1393) Update Flink Runner to Flink 1.2.0

2017-02-10 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860992#comment-15860992 ] Jingsong Lee commented on BEAM-1393: Good point! The processing of pushed-back events is indeed a

[jira] [Commented] (BEAM-1393) Update Flink Runner to Flink 1.2.0

2017-02-10 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861079#comment-15861079 ] Aljoscha Krettek commented on BEAM-1393: Yes, your analysis is spot on! I think what we can do is

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #2593

2017-02-10 Thread Apache Jenkins Server
See -- [...truncated 8429 lines...] message: "Message" log_location: "LoggerName" thread: "12345" >, (BeamFnLoggingClientTest.java:72)\n\tat

[GitHub] beam pull request #1939: [BEAM-646] Add ReplacementOutput

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1939 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-646) Get runners out of the apply()

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861608#comment-15861608 ] ASF GitHub Bot commented on BEAM-646: - Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

2017-02-10 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-1457: --- Summary: Enable rat plugin and findbugs plugin in default build Key: BEAM-1457 URL: https://issues.apache.org/jira/browse/BEAM-1457 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

2017-02-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861391#comment-15861391 ] Aviem Zur commented on BEAM-1457: - I ran a quick test on my laptop to see how much time they add to the

[jira] [Updated] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

2017-02-10 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1457: Description: Today, maven rat plugin and findbugs plugin only run when `release` profile is specified.

[jira] [Commented] (BEAM-1437) Spark runner StreamingListeners are not recoverable.

2017-02-10 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15861438#comment-15861438 ] ASF GitHub Bot commented on BEAM-1437: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-1437) Spark runner StreamingListeners are not recoverable.

2017-02-10 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1437. - Resolution: Fixed Fix Version/s: 0.6.0 > Spark runner StreamingListeners are not recoverable. >

[GitHub] beam pull request #1962: [BEAM-1437] Spark runner StreamingListeners are not...

2017-02-10 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/1962 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is