[GitHub] beam pull request #3223: [BEAM-2354] Add a ReadStringsFromPubSub/WriteString...

2017-05-24 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3223 [BEAM-2354] Add a ReadStringsFromPubSub/WriteStringsToPubSub PTransform Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure

[jira] [Commented] (BEAM-2354) Add streaming support to Python DataflowRunner

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16024145#comment-16024145 ] ASF GitHub Bot commented on BEAM-2354: -- GitHub user lukecwik opened a pull request:

Build failed in Jenkins: beam_PostCommit_Python_Verify #2313

2017-05-24 Thread Apache Jenkins Server
See -- [...truncated 42.31 KB...] Processing ./target/.tox/dist/apache-beam-2.1.0.dev.zip Collecting avro<2.0.0,>=1.8.1 (from apache-beam==2.1.0.dev0) Collecting

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #2168

2017-05-24 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3222: [BEAM-115] Unify Java and Python WindowingStragegy ...

2017-05-24 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3222 [BEAM-115] Unify Java and Python WindowingStragegy representations. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the

[jira] [Commented] (BEAM-115) Beam Runner API

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023946#comment-16023946 ] ASF GitHub Bot commented on BEAM-115: - GitHub user robertwb opened a pull request:

[jira] [Closed] (BEAM-2321) gRPC configuration failure using DataflowRunner and Bigtable

2017-05-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2321. - Resolution: Not A Problem Fix Version/s: Not applicable > gRPC configuration failure using

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #2926

2017-05-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2321) gRPC configuration failure using DataflowRunner and Bigtable

2017-05-24 Thread Nigel Kilmer (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023922#comment-16023922 ] Nigel Kilmer commented on BEAM-2321: Yeah, you're correct, this is not actually a bug. I recreated the

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #50

2017-05-24 Thread Apache Jenkins Server
See Changes: [klk] Rename PCollections to PCollectionTranslation [klk] Rename PTransforms to PTransformTranslation [klk] Rename ParDos to ParDoTranslation [klk] Rename

[jira] [Resolved] (BEAM-2338) GCS filepattern wildcard broken in Python SDK

2017-05-24 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-2338. -- Resolution: Fixed > GCS filepattern wildcard broken in Python SDK >

Build failed in Jenkins: beam_PostCommit_Python_Verify #2312

2017-05-24 Thread Apache Jenkins Server
See Changes: [robertwb] Automatically generate Python proto and grpc files. [robertwb] Remove auto-generated proto and grpc files. [robertwb] A couple of worker fixes. [robertwb] Adding a snippet

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread Mairbek Khadikov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023881#comment-16023881 ] Mairbek Khadikov commented on BEAM-1542: Created https://github.com/apache/beam-site/pull/252 >

[GitHub] beam-site pull request #252: Added Cloud Spanner Connector

2017-05-24 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam-site/pull/252 Added Cloud Spanner Connector You can merge this pull request into a Git repository by running: $ git pull https://github.com/mairbek/beam-site patch-1 Alternatively you can review and

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023868#comment-16023868 ] Stephen Sisk commented on BEAM-1542: hi! Mind adding this to the built-in IO transforms page? It's a

[jira] [Commented] (BEAM-2361) Add TikaIO to the list of in-progress transforms

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023864#comment-16023864 ] ASF GitHub Bot commented on BEAM-2361: -- Github user asfgit closed the pull request at:

[GitHub] beam-site pull request #250: [BEAM-2361] Add TikaIO to the list of in-progre...

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/250 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/3] beam-site git commit: This closes #250

2017-05-24 Thread altay
This closes #250 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/f03fb601 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/f03fb601 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/f03fb601

[2/3] beam-site git commit: Regenerate website

2017-05-24 Thread altay
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/047a2107 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/047a2107 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/047a2107

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark #2167

2017-05-24 Thread Apache Jenkins Server
See Changes: [robertwb] A couple of worker fixes. [robertwb] Adding a snippet for metrics -- [...truncated 486.14 KB...]

[jira] [Commented] (BEAM-2328) Introduce Apache Tika Input component

2017-05-24 Thread Sergey Beryozkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023826#comment-16023826 ] Sergey Beryozkin commented on BEAM-2328: Sorry for a bit of a noise, I spotted in the docs that the

[GitHub] beam-site pull request #251: [BEAM-2360] Add Beam Runner Guide

2017-05-24 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam-site/pull/251 [BEAM-2360] Add Beam Runner Guide I did a quick port of the doc at https://s.apache.org/beam-runner-guide. I wanted to open this early, because there are technical issues to address:

[jira] [Issue Comment Deleted] (BEAM-2328) Introduce Apache Tika Input component

2017-05-24 Thread Sergey Beryozkin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Beryozkin updated BEAM-2328: --- Comment: was deleted (was: Hi, pull request #250 has been created. thanks) > Introduce Apache

[jira] [Commented] (BEAM-2360) Add guide for writing a Beam runner

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023820#comment-16023820 ] ASF GitHub Bot commented on BEAM-2360: -- GitHub user kennknowles opened a pull request:

[jira] [Created] (BEAM-2361) Add TikaIO to the list of in-progress transforms

2017-05-24 Thread Sergey Beryozkin (JIRA)
Sergey Beryozkin created BEAM-2361: -- Summary: Add TikaIO to the list of in-progress transforms Key: BEAM-2361 URL: https://issues.apache.org/jira/browse/BEAM-2361 Project: Beam Issue Type:

[jira] [Updated] (BEAM-2360) Add guide for writing a Beam runner

2017-05-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2360: -- Issue Type: Wish (was: Bug) > Add guide for writing a Beam runner >

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2925

2017-05-24 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2360) Add guide for writing a Beam runner

2017-05-24 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2360: - Summary: Add guide for writing a Beam runner Key: BEAM-2360 URL: https://issues.apache.org/jira/browse/BEAM-2360 Project: Beam Issue Type: Bug

[GitHub] beam pull request #3221: [BEAM-1542] SpannerIO sink updates

2017-05-24 Thread mairbek
GitHub user mairbek opened a pull request: https://github.com/apache/beam/pull/3221 [BEAM-1542] SpannerIO sink updates Unit and integration test. Logical mutation size estimation. Be sure to do all of the following to help us incorporate your contribution quickly

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023791#comment-16023791 ] ASF GitHub Bot commented on BEAM-1542: -- GitHub user mairbek opened a pull request:

[GitHub] beam pull request #3200: Adding a snippet for metrics

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3200 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: Closes #3200

2017-05-24 Thread robertwb
Closes #3200 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0d19f9f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c0d19f9f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c0d19f9f Branch: refs/heads/master

[1/2] beam git commit: Adding a snippet for metrics

2017-05-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 4084f71a1 -> c0d19f9f7 Adding a snippet for metrics Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f32cacb7 Tree:

[2/2] beam git commit: Closes #3170

2017-05-24 Thread robertwb
Closes #3170 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4084f71a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4084f71a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4084f71a Branch: refs/heads/master

[GitHub] beam pull request #3170: A couple of worker fixes.

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3170 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: A couple of worker fixes.

2017-05-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 24fb4cda6 -> 4084f71a1 A couple of worker fixes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e9cb40dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e9cb40dc

[3/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/c2e85daa/sdks/python/apache_beam/runners/api/beam_fn_api_pb2_grpc.py -- diff --git a/sdks/python/apache_beam/runners/api/beam_fn_api_pb2_grpc.py

[1/6] beam git commit: Closes #3214

2017-05-24 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 539e229fe -> 24fb4cda6 Closes #3214 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/24fb4cda Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/24fb4cda Diff:

[4/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/c2e85daa/sdks/python/apache_beam/runners/api/beam_fn_api_pb2.py -- diff --git a/sdks/python/apache_beam/runners/api/beam_fn_api_pb2.py

[2/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
http://git-wip-us.apache.org/repos/asf/beam/blob/c2e85daa/sdks/python/apache_beam/runners/api/beam_runner_api_pb2.py -- diff --git a/sdks/python/apache_beam/runners/api/beam_runner_api_pb2.py

[GitHub] beam pull request #3214: Automatically generate proto files for Python

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3214 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[6/6] beam git commit: Automatically generate Python proto and grpc files.

2017-05-24 Thread robertwb
Automatically generate Python proto and grpc files. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bb2b7064 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bb2b7064 Diff:

[5/6] beam git commit: Remove auto-generated proto and grpc files.

2017-05-24 Thread robertwb
Remove auto-generated proto and grpc files. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c2e85daa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c2e85daa Diff:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3205

2017-05-24 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #2923

2017-05-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023709#comment-16023709 ] Daniel Halperin commented on BEAM-1542: --- Thanks [~guymolinari]! Your original sink has now been

[jira] [Assigned] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1542: - Assignee: Mairbek Khadikov (was: Guy Molinari) > Need Source/Sink for Spanner >

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023694#comment-16023694 ] ASF GitHub Bot commented on BEAM-1542: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023695#comment-16023695 ] ASF GitHub Bot commented on BEAM-1542: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2166: BEAM-1542 : Added SpannerIO Data Sink for Cloud Spa...

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2166 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3146: [BEAM-1542] Takeover #2166 with initial support for...

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3146 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[5/7] beam git commit: Fix spanner dependency management

2017-05-24 Thread dhalperi
Fix spanner dependency management Also minor cleanup alphabetization in root pom.xml Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8871eadc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8871eadc Diff:

[6/7] beam git commit: Delete SpannerCSVLoader

2017-05-24 Thread dhalperi
Delete SpannerCSVLoader This is not appropriate for examples. SpannerIO should be well-javadoced and integration tested. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/216b972b Tree:

[2/7] beam git commit: Refine Spanner API tests

2017-05-24 Thread dhalperi
Refine Spanner API tests And remove outdated Bigtable comment Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/65e740ed Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/65e740ed Diff:

[3/7] beam git commit: Minor style, compilation, javadoc fixups

2017-05-24 Thread dhalperi
Minor style, compilation, javadoc fixups Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e53dc915 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e53dc915 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e53dc915

[7/7] beam git commit: This closes #3146

2017-05-24 Thread dhalperi
This closes #3146 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/539e229f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/539e229f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/539e229f Branch:

[1/7] beam git commit: SpannerIO.Write cleanup and style fixes

2017-05-24 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 0637df1bc -> 539e229fe SpannerIO.Write cleanup and style fixes * Rename to Write to match the rest of the SDK. * Convert to AutoValue, delete toString. * Drop .writeTo(), instead use .write() as default constructor. * Temporarily drop

[4/7] beam git commit: Initial implementation of SpannerIO.Write

2017-05-24 Thread dhalperi
Initial implementation of SpannerIO.Write This closes #2166. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9cd6c3bd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9cd6c3bd Diff:

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2309

2017-05-24 Thread Apache Jenkins Server
See

[GitHub] beam-site pull request #250: [BEAM-2328] Add TikaIO to the list of in-progre...

2017-05-24 Thread sberyozkin
GitHub user sberyozkin opened a pull request: https://github.com/apache/beam-site/pull/250 [BEAM-2328] Add TikaIO to the list of in-progress transforms You can merge this pull request into a Git repository by running: $ git pull https://github.com/sberyozkin/beam-site patch-2

[jira] [Commented] (BEAM-2333) Rehydrate Pipeline from Runner API proto

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023604#comment-16023604 ] ASF GitHub Bot commented on BEAM-2333: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3216: [BEAM-2333] Runner API translation renames

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3216 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[9/9] beam git commit: This closes #3216: [BEAM-2333] Runner API translation renames

2017-05-24 Thread kenn
This closes #3216: [BEAM-2333] Runner API translation renames Rename Triggers to TriggerTranslation Rename WindowingStrategies to WindowingStrategyTranslation Rename Coders to CoderTranslation Rename ReadTranslator to ReadTranslation Rename WindowIntoTranslator to WindowIntoTranslation

[4/9] beam git commit: Rename PCollections to PCollectionTranslation

2017-05-24 Thread kenn
Rename PCollections to PCollectionTranslation This is to give a standard and obvious suffix for all our helper classes for translating to/from Runner API protos. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/940819e2 Tree:

[3/9] beam git commit: Rename ParDos to ParDoTranslation

2017-05-24 Thread kenn
Rename ParDos to ParDoTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/44609383 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/44609383 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/44609383 Branch:

[1/9] beam git commit: Rename Triggers to TriggerTranslation

2017-05-24 Thread kenn
Repository: beam Updated Branches: refs/heads/master 6418bcfcb -> 0637df1bc Rename Triggers to TriggerTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4fa38e2d Tree:

[7/9] beam git commit: Rename PTransforms to PTransformTranslation

2017-05-24 Thread kenn
Rename PTransforms to PTransformTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9b6728e2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9b6728e2 Diff:

[8/9] beam git commit: Rename ReadTranslator to ReadTranslation

2017-05-24 Thread kenn
Rename ReadTranslator to ReadTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b35e91d4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b35e91d4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b35e91d4

[6/9] beam git commit: Rename Coders to CoderTranslation

2017-05-24 Thread kenn
Rename Coders to CoderTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7e37b703 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7e37b703 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7e37b703 Branch:

[2/9] beam git commit: Rename WindowingStrategies to WindowingStrategyTranslation

2017-05-24 Thread kenn
Rename WindowingStrategies to WindowingStrategyTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c8b2119a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c8b2119a Diff:

[5/9] beam git commit: Rename WindowIntoTranslator to WindowIntoTranslation

2017-05-24 Thread kenn
Rename WindowIntoTranslator to WindowIntoTranslation Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bc4f44f4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bc4f44f4 Diff:

[jira] [Commented] (BEAM-2352) Enable elasticsearch IO ITs

2017-05-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023585#comment-16023585 ] Stephen Sisk commented on BEAM-2352: I was ready to get these turned on, but we noticed an issue with

[jira] [Commented] (BEAM-2141) beam_PerformanceTests_JDBC have not passed in weeks

2017-05-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023572#comment-16023572 ] Stephen Sisk commented on BEAM-2141: I've been watching the behavior of kubernetes, and it changes the

[jira] [Commented] (BEAM-2141) beam_PerformanceTests_JDBC have not passed in weeks

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023569#comment-16023569 ] ASF GitHub Bot commented on BEAM-2141: -- Github user ssisk closed the pull request at:

[GitHub] beam pull request #3213: [BEAM-2141] Fix postgres address in jdbc jenkins jd...

2017-05-24 Thread ssisk
Github user ssisk closed the pull request at: https://github.com/apache/beam/pull/3213 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3204

2017-05-24 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #2162

2017-05-24 Thread Apache Jenkins Server
See

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3905

2017-05-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2225) Add test cases for large keys to GroupByKeyTest

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023541#comment-16023541 ] ASF GitHub Bot commented on BEAM-2225: -- Github user asfgit closed the pull request at:

[1/2] beam git commit: Adds large key tests to GroupByKeyTest

2017-05-24 Thread kenn
Repository: beam Updated Branches: refs/heads/master 6dd5585b3 -> 6418bcfcb Adds large key tests to GroupByKeyTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6a792f32 Tree:

[2/2] beam git commit: This closes #2979: Adds large key tests to GroupByKeyTest

2017-05-24 Thread kenn
This closes #2979: Adds large key tests to GroupByKeyTest Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6418bcfc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6418bcfc Diff:

[jira] [Resolved] (BEAM-163) When a PCollection (via Window.into) has smaller allowedLateness than upstream, might lose data

2017-05-24 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-163. -- Resolution: Fixed Assignee: Borisa Zivkovic Fix Version/s: 2.1.0 > When a

Build failed in Jenkins: beam_PostCommit_Python_Verify #2308

2017-05-24 Thread Apache Jenkins Server
See Changes: [klk] Do not ever shrink allowed lateness -- [...truncated 506.52 KB...] File was already downloaded

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2161

2017-05-24 Thread Apache Jenkins Server
See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2920

2017-05-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #49

2017-05-24 Thread Apache Jenkins Server
See -- [...truncated 1.99 MB...] 2017-05-24T18:37:32.775 [INFO] Excluding it.unimi.dsi:fastutil:jar:6.5.7 from the shaded jar. 2017-05-24T18:37:32.775 [INFO]

[GitHub] beam pull request #3163: [BEAM-163] Warn the user when a PCollection (via Wi...

2017-05-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3163 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3163: [BEAM-163] Warn the user when a PCollection (via Window.into) has smaller allowe...

2017-05-24 Thread kenn
This closes #3163: [BEAM-163] Warn the user when a PCollection (via Window.into) has smaller allowe... Do not ever shrink allowed lateness Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6dd5585b Tree:

[1/2] beam git commit: Do not ever shrink allowed lateness

2017-05-24 Thread kenn
Repository: beam Updated Branches: refs/heads/master 924dd6335 -> 6dd5585b3 Do not ever shrink allowed lateness This does not seem to have any use except to cause data loss. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #2919

2017-05-24 Thread Apache Jenkins Server
See -- [...truncated 319.93 KB...] 2017-05-24T18:19:48.365 [INFO] Downloaded:

[jira] [Created] (BEAM-2359) SparkTimerInternals inputWatermarkTime does not get updated in cluster mode

2017-05-24 Thread Aviem Zur (JIRA)
Aviem Zur created BEAM-2359: --- Summary: SparkTimerInternals inputWatermarkTime does not get updated in cluster mode Key: BEAM-2359 URL: https://issues.apache.org/jira/browse/BEAM-2359 Project: Beam

[jira] [Commented] (BEAM-2347) Elasticsearch IO - test ES 5?

2017-05-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023281#comment-16023281 ] Stephen Sisk commented on BEAM-2347: thanks for clarifying! I converted this to a sub-task of that

[jira] [Updated] (BEAM-2347) Elasticsearch IO - test ES 5?

2017-05-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-2347: --- Issue Type: Sub-task (was: Bug) Parent: BEAM-1637 > Elasticsearch IO - test ES 5? >

[jira] [Updated] (BEAM-2328) Introduce Apache Tika Input component

2017-05-24 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-2328: --- Component/s: sdk-java-extensions > Introduce Apache Tika Input component >

[jira] [Commented] (BEAM-2357) Create HCatalogIO (Hive)

2017-05-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023208#comment-16023208 ] ASF GitHub Bot commented on BEAM-2357: -- GitHub user seshadri-cr opened a pull request:

[GitHub] beam pull request #3220: [BEAM-2357]HiveIO implementation using native API -...

2017-05-24 Thread seshadri-cr
GitHub user seshadri-cr opened a pull request: https://github.com/apache/beam/pull/3220 [BEAM-2357]HiveIO implementation using native API - HCatalogReaderWriter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[jira] [Commented] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-05-24 Thread Nicholas Ursa (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023187#comment-16023187 ] Nicholas Ursa commented on BEAM-2358: - @Rule only works on methods and fields, so this means you

[jira] [Comment Edited] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-05-24 Thread Nicholas Ursa (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023187#comment-16023187 ] Nicholas Ursa edited comment on BEAM-2358 at 5/24/17 4:36 PM: -- @Rule only

[jira] [Updated] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-05-24 Thread Nicholas Ursa (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Ursa updated BEAM-2358: Description: https://beam.apache.org/documentation/pipelines/test-your-pipeline/ has {code} public

[jira] [Commented] (BEAM-2358) "/test-your-pipeline" example code results in an exception

2017-05-24 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023132#comment-16023132 ] Luke Cwik commented on BEAM-2358: - It seems as though docs should be telling people to being using

  1   2   >