[GitHub] beam pull request #2834: [BEAM-59] Move GcsFileSystem to gcp-core

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2834 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-59] Move GcsFileSystem to gcp-core

2017-05-02 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 027dd777d -> 5bfd3e049 [BEAM-59] Move GcsFileSystem to gcp-core It is used by both runner and IO, so should be in core. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993995#comment-15993995 ] ASF GitHub Bot commented on BEAM-59: Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2834

2017-05-02 Thread dhalperi
This closes #2834 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5bfd3e04 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5bfd3e04 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5bfd3e04 Branch:

[GitHub] beam pull request #2850: PR only for Jenkins testing

2017-05-02 Thread markflyhigh
GitHub user markflyhigh opened a pull request: https://github.com/apache/beam/pull/2850 PR only for Jenkins testing Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[GitHub] beam pull request #2849: Trigger for Java SDK post submit tests

2017-05-02 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2849 Trigger for Java SDK post submit tests Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3597

2017-05-02 Thread Apache Jenkins Server
See

[GitHub] beam-site pull request #228: Fix broken HDFS link on built-in IO page

2017-05-02 Thread melap
GitHub user melap opened a pull request: https://github.com/apache/beam-site/pull/228 Fix broken HDFS link on built-in IO page R: @lukecwik @aaltay You can merge this pull request into a Git repository by running: $ git pull https://github.com/melap/beam-site hdfslink

[GitHub] beam-site pull request #227: [BEAM-2142] Add composite transforms Python sni...

2017-05-02 Thread melap
GitHub user melap opened a pull request: https://github.com/apache/beam-site/pull/227 [BEAM-2142] Add composite transforms Python snippets to programming guide Add new snippets from BEAM-1926 R: @aaltay You can merge this pull request into a Git repository by running: $

[jira] [Commented] (BEAM-2142) add missing composite transforms Python snippets to programming guide

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993940#comment-15993940 ] ASF GitHub Bot commented on BEAM-2142: -- GitHub user melap opened a pull request:

[jira] [Commented] (BEAM-1925) Make DoFn invocation logic of Python SDK more extensible

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993935#comment-15993935 ] ASF GitHub Bot commented on BEAM-1925: -- GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #2848: [BEAM-1925] validate DoFn at pipeline creation time

2017-05-02 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2848 [BEAM-1925] validate DoFn at pipeline creation time Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Created] (BEAM-2142) add missing composite transforms Python snippets to programming guide

2017-05-02 Thread Melissa Pashniak (JIRA)
Melissa Pashniak created BEAM-2142: -- Summary: add missing composite transforms Python snippets to programming guide Key: BEAM-2142 URL: https://issues.apache.org/jira/browse/BEAM-2142 Project: Beam

[jira] [Commented] (BEAM-2128) PostCommit Java_MavenInstall broken

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993916#comment-15993916 ] ASF GitHub Bot commented on BEAM-2128: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2795: [BEAM-2128] Restore status quo relationship between...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2795 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/3] beam git commit: Instantiate runner briefly in Pipeline

2017-05-02 Thread kenn
Repository: beam Updated Branches: refs/heads/master a552fb8f6 -> 027dd777d Instantiate runner briefly in Pipeline Today, some runners mutate the PipelineOptions in critical ways when they are built, and BigQueryIO depends, during construction, on options that are sometimes the subject of

[3/3] beam git commit: This closes #2795: Restore status quo relationship between PipelineOptions initialization and PipelineRunners

2017-05-02 Thread kenn
This closes #2795: Restore status quo relationship between PipelineOptions initialization and PipelineRunners Instantiate runner briefly in Pipeline Skip null options when converting back to argv Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #2847: [BEAM-818,BEAM-828] Make tempLocation an inaccessib...

2017-05-02 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2847 [BEAM-818,BEAM-828] Make tempLocation an inaccessible ValueProvider Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[jira] [Commented] (BEAM-818) ValueProvider for tempLocation, runner, etc, that is unavailable to transforms during construction

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993915#comment-15993915 ] ASF GitHub Bot commented on BEAM-818: - GitHub user kennknowles opened a pull request:

[jira] [Commented] (BEAM-2128) PostCommit Java_MavenInstall broken

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993911#comment-15993911 ] ASF GitHub Bot commented on BEAM-2128: -- GitHub user vikkyrk opened a pull request:

[GitHub] beam pull request #2846: [BEAM-2128] Remove job name usages from BigQueryIO ...

2017-05-02 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2846 [BEAM-2128] Remove job name usages from BigQueryIO at pipeline construction time Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ]

[jira] [Commented] (BEAM-885) Move PipelineOptions from Pipeline.create() to Pipeline.run()

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993908#comment-15993908 ] Kenneth Knowles commented on BEAM-885: -- I think now that things are converging, this is duplicate to

[jira] [Resolved] (BEAM-1926) Need 3 Python snippets for composite transforms section in programming guide

2017-05-02 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak resolved BEAM-1926. Resolution: Fixed Thanks! > Need 3 Python snippets for composite transforms section in

[jira] [Closed] (BEAM-1926) Need 3 Python snippets for composite transforms section in programming guide

2017-05-02 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak closed BEAM-1926. -- > Need 3 Python snippets for composite transforms section in programming guide >

[jira] [Resolved] (BEAM-885) Move PipelineOptions from Pipeline.create() to Pipeline.run()

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-885. -- Resolution: Duplicate > Move PipelineOptions from Pipeline.create() to Pipeline.run() >

[jira] [Comment Edited] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-05-02 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993906#comment-15993906 ] Mark Liu edited comment on BEAM-1986 at 5/2/17 10:28 PM: - What is "name of the main

[jira] [Commented] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-05-02 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993906#comment-15993906 ] Mark Liu commented on BEAM-1986: What is "name of the main application" exactly mean? Ideally for testing,

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3596

2017-05-02 Thread Apache Jenkins Server
See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3014

2017-05-02 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3595

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-05-02 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993875#comment-15993875 ] Ahmet Altay commented on BEAM-1986: --- {{beampp}} is a placeholder for {{ApplicationName}}. Is it possible

[jira] [Resolved] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2139. - Resolution: Fixed Fix Version/s: First stable release > Disable SplittableDoFn ValidatesRunner

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3594

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2139) Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993866#comment-15993866 ] ASF GitHub Bot commented on BEAM-2139: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2824: [BEAM-2139] Disable SplittableDoFn ValidatesRunner ...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2824 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread lcwik
Repository: beam Updated Branches: refs/heads/master b5561f718 -> a552fb8f6 [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b2283bf2 Tree:

[2/2] beam git commit: [BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner

2017-05-02 Thread lcwik
[BEAM-2139] Disable SplittableDoFn ValidatesRunner tests for Streaming Flink Runner This closes #2824 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a552fb8f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a552fb8f

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993859#comment-15993859 ] ASF GitHub Bot commented on BEAM-59: Github user asfgit closed the pull request at:

[GitHub] beam pull request #2818: [BEAM-59] Delete old restrictions on output file pa...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2818 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2818

2017-05-02 Thread dhalperi
This closes #2818 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b5561f71 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b5561f71 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b5561f71 Branch:

[1/2] beam git commit: [BEAM-59] Delete old restrictions on output file paths

2017-05-02 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master ccbb00e38 -> b5561f718 [BEAM-59] Delete old restrictions on output file paths These predate Apache Beam and are no longer relevant now that Text and Avro are implemented in the SDK Project:

[jira] [Comment Edited] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-05-02 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993850#comment-15993850 ] Mark Liu edited comment on BEAM-1986 at 5/2/17 9:52 PM: After investigation, I have

[jira] [Comment Edited] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-05-02 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993850#comment-15993850 ] Mark Liu edited comment on BEAM-1986 at 5/2/17 9:51 PM: After investigation, I have

[jira] [Commented] (BEAM-1986) Job ALREADY_EXISTS in post commit

2017-05-02 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993850#comment-15993850 ] Mark Liu commented on BEAM-1986: After investigation, I have some ideas to solve it and want to discuss it

[GitHub] beam pull request #2737: [BEAM-2093] Use the jackson version from the maven ...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2737 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2737

2017-05-02 Thread davor
This closes #2737 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ccbb00e3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ccbb00e3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ccbb00e3 Branch:

[1/2] beam git commit: [BEAM-2093] Use the jackson version from the maven property in maven archetypes

2017-05-02 Thread davor
Repository: beam Updated Branches: refs/heads/master 986d727f6 -> ccbb00e38 [BEAM-2093] Use the jackson version from the maven property in maven archetypes [BEAM-2093] pom.xml organization cleanup, and use filtering for project version as well Project:

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993826#comment-15993826 ] ASF GitHub Bot commented on BEAM-2135: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3593

2017-05-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2844: [BEAM-2135] Fix pointers to sdks/java/io/hadoop-fil...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2844 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system

2017-05-02 Thread lcwik
[BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system This closes #2844 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/986d727f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/986d727f Diff:

[1/2] beam git commit: [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system

2017-05-02 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 2047d8fc4 -> 986d727f6 [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6a1a4009 Tree:

[GitHub] beam pull request #2845: Updating Dataflow API protos and client

2017-05-02 Thread pabloem
GitHub user pabloem opened a pull request: https://github.com/apache/beam/pull/2845 Updating Dataflow API protos and client r:@aaltay Ran job 2017-05-02_14_25_41-229271276661569030 with these changes. You can merge this pull request into a Git repository by running: $ git

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993754#comment-15993754 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2844: [BEAM-2135] Fix pointers to sdks/java/io/hadoop-fil...

2017-05-02 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2844 [BEAM-2135] Fix pointers to sdks/java/io/hadoop-file-system Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2843: Fix pointers to GCP-core

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2843 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2135] Fix pointers to GCP-core

2017-05-02 Thread lcwik
[BEAM-2135] Fix pointers to GCP-core This closes #2843 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2047d8fc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2047d8fc Diff:

[1/2] beam git commit: [BEAM-2135] Fix pointers to GCP-core

2017-05-02 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 4d6f6a10f -> 2047d8fc4 [BEAM-2135] Fix pointers to GCP-core Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6f8f8214 Tree:

[jira] [Commented] (BEAM-1316) DoFn#startBundle should not be able to output

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993732#comment-15993732 ] ASF GitHub Bot commented on BEAM-1316: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2836: [BEAM-1316] Remove the usage of mock from ptransfor...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2836 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2836

2017-05-02 Thread altay
This closes #2836 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4d6f6a10 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4d6f6a10 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4d6f6a10 Branch:

[1/2] beam git commit: [BEAM-1316] Remove the usage of mock from ptransform tests

2017-05-02 Thread altay
Repository: beam Updated Branches: refs/heads/master 87a12af6c -> 4d6f6a10f [BEAM-1316] Remove the usage of mock from ptransform tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ab55ef3b Tree:

[jira] [Commented] (BEAM-539) Error when writing to the root of a GCS location

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993730#comment-15993730 ] ASF GitHub Bot commented on BEAM-539: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #2770: [BEAM-539] Fixes several issues of FileSink

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2770 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2843: Fix pointers to GCP-core

2017-05-02 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2843 Fix pointers to GCP-core R: @lukecwik You can merge this pull request into a Git repository by running: $ git pull https://github.com/dhalperi/beam fix-build Alternatively you can review and

[1/2] beam git commit: [BEAM-539] Fixes several issues of FileSink.

2017-05-02 Thread chamikara
Repository: beam Updated Branches: refs/heads/master 0ce01b63f -> 87a12af6c [BEAM-539] Fixes several issues of FileSink. (1) Updates FileSink to fail for file name prefixes that only contain a single component (for example GCS buckets). For example, currently FileSink fails for 'gs://aaa'

[2/2] beam git commit: This closes #2770

2017-05-02 Thread chamikara
This closes #2770 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/87a12af6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/87a12af6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/87a12af6 Branch:

[GitHub] beam pull request #2831: Convert all unknown Coders into CustomCoder CloudOb...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2831 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects

2017-05-02 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 3bd8a0f9f -> 0ce01b63f [BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects This ensures that all coders will be serializable, even if there is no registered coder translator. Project:

[2/2] beam git commit: [BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects

2017-05-02 Thread lcwik
[BEAM-2020] Convert all unknown Coders into CustomCoder CloudObjects This closes #2831 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0ce01b63 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0ce01b63 Diff:

[jira] [Commented] (BEAM-1327) Replace OutputTimeFn with enum

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993689#comment-15993689 ] Kenneth Knowles commented on BEAM-1327: --- Also, the choice to not call it {{OutputTimeFn}} comes from

[jira] [Resolved] (BEAM-40) Replace rawtype lambda-incompatible uses of SerializableFunction with SimpleFunction (as appropriate)

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-40. - Resolution: Not A Problem > Replace rawtype lambda-incompatible uses of SerializableFunction with >

[jira] [Commented] (BEAM-2051) Reduce scope of the PCollectionView interface

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993682#comment-15993682 ] ASF GitHub Bot commented on BEAM-2051: -- GitHub user tgroh opened a pull request:

[jira] [Updated] (BEAM-40) Replace rawtype lambda-incompatible uses of SerializableFunction with SimpleFunction (as appropriate)

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-40: Fix Version/s: (was: First stable release) Not applicable > Replace rawtype

[jira] [Resolved] (BEAM-1327) Replace OutputTimeFn with enum

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1327. --- Resolution: Fixed > Replace OutputTimeFn with enum > -- > >

[jira] [Commented] (BEAM-40) Replace rawtype lambda-incompatible uses of SerializableFunction with SimpleFunction (as appropriate)

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-40?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993680#comment-15993680 ] Kenneth Knowles commented on BEAM-40: - I've flipped through the SDK a bit and haven't found anything I

[GitHub] beam pull request #2842: [BEAM-2051] Mark all PCollectionView methods intern...

2017-05-02 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2842 [BEAM-2051] Mark all PCollectionView methods internal Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Updated] (BEAM-818) ValueProvider for tempLocation, runner, etc, that is unavailable to transforms during construction

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-818: - Summary: ValueProvider for tempLocation, runner, etc, that is unavailable to transforms during

[jira] [Commented] (BEAM-818) Remove Pipeline.getPipelineOptions

2017-05-02 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993661#comment-15993661 ] Kenneth Knowles commented on BEAM-818: -- Upon exploring this, I think we need to do this another way:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3592

2017-05-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-48) BigQueryIO.Read reimplemented as BoundedSource

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-48?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993646#comment-15993646 ] ASF GitHub Bot commented on BEAM-48: Github user asfgit closed the pull request at:

[GitHub] beam pull request #2832: [BEAM-48] BigQuery: swap from asSingleton to asIter...

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2832 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2832

2017-05-02 Thread dhalperi
This closes #2832 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3bd8a0f9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3bd8a0f9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3bd8a0f9 Branch:

[1/2] beam git commit: BigQuery: swap from asSingleton to asIterable for Cleanup

2017-05-02 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master aaa5e55dc -> 3bd8a0f9f BigQuery: swap from asSingleton to asIterable for Cleanup asIterable can be simpler for runners to implement as it does not require semantically that the PCollection being viewed contains exactly one element.

[jira] [Commented] (BEAM-2141) beam_PerformanceTests_JDBC have not passed in weeks

2017-05-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993629#comment-15993629 ] Jean-Baptiste Onofré commented on BEAM-2141: Sorry, I missed this Jira. Agree to disable the

[GitHub] beam pull request #2835: [BEAM-2141] Disable JDBC tests

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2835 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2835

2017-05-02 Thread dhalperi
This closes #2835 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/aaa5e55d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/aaa5e55d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/aaa5e55d Branch:

[1/2] beam git commit: [BEAM-2141] Disable JDBC tests

2017-05-02 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 9f6377fcc -> aaa5e55dc [BEAM-2141] Disable JDBC tests They do not pass, and they use up valuable executor space Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/abfd0066

[jira] [Commented] (BEAM-1340) Remove or make private public bits of the SDK that shouldn't be public

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993622#comment-15993622 ] ASF GitHub Bot commented on BEAM-1340: -- GitHub user kennknowles opened a pull request:

[jira] [Commented] (BEAM-2141) beam_PerformanceTests_JDBC have not passed in weeks

2017-05-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993621#comment-15993621 ] Davor Bonaci commented on BEAM-2141: LGTM (but please keep this issue opened for the real fix). >

[GitHub] beam pull request #2841: [BEAM-1340,BEAM-1345] Move state, timers, windowing...

2017-05-02 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2841 [BEAM-1340,BEAM-1345] Move state, timers, windowing strategy into public folders Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [

[jira] [Resolved] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2135. - Resolution: Fixed Fix Version/s: First stable release > Rename hdfs module to hadoop-file-system,

[GitHub] beam pull request #2828: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2828 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15993614#comment-15993614 ] ASF GitHub Bot commented on BEAM-2135: -- Github user asfgit closed the pull request at:

[2/5] beam git commit: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lcwik
http://git-wip-us.apache.org/repos/asf/beam/blob/bacd33c8/sdks/java/io/hdfs/src/main/java/org/apache/beam/sdk/io/hdfs/HDFSFileSink.java -- diff --git a/sdks/java/io/hdfs/src/main/java/org/apache/beam/sdk/io/hdfs/HDFSFileSink.java

[4/5] beam git commit: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lcwik
[BEAM-2135] Move hdfs to hadoop-file-system Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bacd33c8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bacd33c8 Diff:

[5/5] beam git commit: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lcwik
[BEAM-2135] Move hdfs to hadoop-file-system This closes #2828 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9f6377fc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9f6377fc Diff:

[3/5] beam git commit: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lcwik
http://git-wip-us.apache.org/repos/asf/beam/blob/bacd33c8/sdks/java/io/hadoop-file-system/src/main/java/org/apache/beam/sdk/io/hdfs/Sink.java -- diff --git

[1/5] beam git commit: [BEAM-2135] Move hdfs to hadoop-file-system

2017-05-02 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 3161904d9 -> 9f6377fcc http://git-wip-us.apache.org/repos/asf/beam/blob/bacd33c8/sdks/java/io/hdfs/src/main/java/org/apache/beam/sdk/io/hdfs/Write.java -- diff --git

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3591

2017-05-02 Thread Apache Jenkins Server
See

<    1   2   3   4   >