[GitHub] beam pull request #1700: [BEAM-1217] Convert options to public to fix privat...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1700


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-1217) Some examples fail to run due to private / public options mismatch.

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15782167#comment-15782167
 ] 

ASF GitHub Bot commented on BEAM-1217:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1700


> Some examples fail to run due to private / public options mismatch.
> ---
>
> Key: BEAM-1217
> URL: https://issues.apache.org/jira/browse/BEAM-1217
> Project: Beam
>  Issue Type: Bug
>Reporter: Jason Kuster
>Assignee: Jason Kuster
>
> Related bug: BEAM-308
> Failure looks like:
> {code}
> Exception in thread "main" java.lang.IllegalArgumentException: non-public 
> interfaces from different packages
>   at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:619)
>   at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
>   at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
>   at java.lang.reflect.WeakCache.get(WeakCache.java:127)
>   at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
>   at java.lang.reflect.Proxy.getProxyClass(Proxy.java:371)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.validateWellFormed(PipelineOptionsFactory.java:605)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1549)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:104)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:289)
>   at 
> org.apache.beam.examples.complete.TrafficRoutes.main(TrafficRoutes.java:340)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[1/2] beam git commit: Convert options to public to fix private/public problem.

2016-12-27 Thread davor 
Repository: beam
Updated Branches:
  refs/heads/master 339ae7df2 -> 6d7bbd3e1


Convert options to public to fix private/public problem.

Signed-off-by: Jason Kuster 


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cf3946e1
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cf3946e1
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/cf3946e1

Branch: refs/heads/master
Commit: cf3946e169833834e44fa271c0577f7cd5020bec
Parents: 339ae7d
Author: Jason Kuster 
Authored: Tue Dec 27 12:21:09 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 22:04:03 2016 -0800

--
 .../main/java/org/apache/beam/examples/complete/AutoComplete.java  | 2 +-
 .../src/main/java/org/apache/beam/examples/complete/TfIdf.java | 2 +-
 .../org/apache/beam/examples/complete/TopWikipediaSessions.java| 2 +-
 .../java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java | 2 +-
 .../main/java/org/apache/beam/examples/complete/TrafficRoutes.java | 2 +-
 .../java/org/apache/beam/examples/cookbook/BigQueryTornadoes.java  | 2 +-
 6 files changed, 6 insertions(+), 6 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/cf3946e1/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java
--
diff --git 
a/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java
 
b/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java
index 31b06c9..c815f27 100644
--- 
a/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java
+++ 
b/examples/java/src/main/java/org/apache/beam/examples/complete/AutoComplete.java
@@ -412,7 +412,7 @@ public class AutoComplete {
*
* Inherits standard Beam example configuration options.
*/
-  private interface Options
+  public interface Options
   extends ExampleOptions, ExampleBigQueryTableOptions, StreamingOptions {
 @Description("Input text file")
 @Validation.Required

http://git-wip-us.apache.org/repos/asf/beam/blob/cf3946e1/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java
--
diff --git 
a/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java 
b/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java
index ea015ae..9de5617 100644
--- a/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java
+++ b/examples/java/src/main/java/org/apache/beam/examples/complete/TfIdf.java
@@ -86,7 +86,7 @@ public class TfIdf {
*
* Inherits standard configuration options.
*/
-  private interface Options extends PipelineOptions {
+  public interface Options extends PipelineOptions {
 @Description("Path to the directory or GCS prefix containing files to read 
from")
 @Default.String("gs://apache-beam-samples/shakespeare/")
 String getInput();

http://git-wip-us.apache.org/repos/asf/beam/blob/cf3946e1/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java
--
diff --git 
a/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java
 
b/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java
index 8e0b815..7eb80b7 100644
--- 
a/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java
+++ 
b/examples/java/src/main/java/org/apache/beam/examples/complete/TopWikipediaSessions.java
@@ -171,7 +171,7 @@ public class TopWikipediaSessions {
*
* Inherits standard Beam configuration options.
*/
-  private interface Options extends PipelineOptions {
+  public interface Options extends PipelineOptions {
 @Description(
   "Input specified as a GCS path containing a BigQuery table exported as 
json")
 @Default.String(EXPORTED_WIKI_TABLE)

http://git-wip-us.apache.org/repos/asf/beam/blob/cf3946e1/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java
--
diff --git 
a/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java
 
b/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java
index c1032b9..412f7fb 100644
--- 
a/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java
+++ 
b/examples/java/src/main/java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java
@@ -301,7 +301,7 @@ public class TrafficMaxLaneFlow {
 *
 * Inherits standard configuration options.
 */
-  private interface TrafficMaxLaneFlowOptions extends ExampleOptions, 
ExampleBigQueryTableOptions {
+  public i

[2/2] beam git commit: This closes #1700

2016-12-27 Thread davor 
This closes #1700


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6d7bbd3e
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6d7bbd3e
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6d7bbd3e

Branch: refs/heads/master
Commit: 6d7bbd3e102b3fbfcbe796d0e5d65899478c8674
Parents: 339ae7d cf3946e
Author: Davor Bonaci 
Authored: Tue Dec 27 22:04:23 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 22:04:23 2016 -0800

--
 .../main/java/org/apache/beam/examples/complete/AutoComplete.java  | 2 +-
 .../src/main/java/org/apache/beam/examples/complete/TfIdf.java | 2 +-
 .../org/apache/beam/examples/complete/TopWikipediaSessions.java| 2 +-
 .../java/org/apache/beam/examples/complete/TrafficMaxLaneFlow.java | 2 +-
 .../main/java/org/apache/beam/examples/complete/TrafficRoutes.java | 2 +-
 .../java/org/apache/beam/examples/cookbook/BigQueryTornadoes.java  | 2 +-
 6 files changed, 6 insertions(+), 6 deletions(-)
--

[GitHub] beam-site pull request #75: [BEAM-946] Added python supports in Programming ...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/75


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-946) Add python Code in Programming Guide.

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781866#comment-15781866
 ] 

ASF GitHub Bot commented on BEAM-946:
-

Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/75


> Add python Code in Programming Guide.
> -
>
> Key: BEAM-946
> URL: https://issues.apache.org/jira/browse/BEAM-946
> Project: Beam
>  Issue Type: Task
>  Components: website
>Reporter: Abdullah Bashir
>Assignee: James Malone
>Priority: Minor
>
> Update Programming Guide to support python version.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[2/3] beam-site git commit: This closes #75

2016-12-27 Thread dhalperi 
This closes #75


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/a60e7dbf
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/a60e7dbf
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/a60e7dbf

Branch: refs/heads/asf-site
Commit: a60e7dbfd667ac606aebc0d89ebd5328e322c611
Parents: afd1f26 4b2338c
Author: Dan Halperin 
Authored: Tue Dec 27 18:47:48 2016 -0800
Committer: Dan Halperin 
Committed: Tue Dec 27 18:47:48 2016 -0800

--
 src/_sass/_toggler-nav.scss|  24 
 src/documentation/programming-guide.md | 177 +++-
 src/js/language-switch.js  |  10 +-
 src/styles/site.scss   |   1 +
 4 files changed, 176 insertions(+), 36 deletions(-)
--

[3/3] beam-site git commit: Regenerate website

2016-12-27 Thread dhalperi 
Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/1e2528f1
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/1e2528f1
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/1e2528f1

Branch: refs/heads/asf-site
Commit: 1e2528f17ac449431ad567ef2f4e0b4e088d05f4
Parents: a60e7db
Author: Dan Halperin 
Authored: Tue Dec 27 18:48:46 2016 -0800
Committer: Dan Halperin 
Committed: Tue Dec 27 18:48:46 2016 -0800

--
 .../documentation/programming-guide/index.html  | 179 +++
 content/js/language-switch.js   |  10 +-
 content/styles/site.css |  14 ++
 3 files changed, 160 insertions(+), 43 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e2528f1/content/documentation/programming-guide/index.html
--
diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index 1781e53..1042062 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -148,6 +148,14 @@
 
 The Beam Programming Guide is intended for Beam users who 
want to use the Beam SDKs to create data processing pipelines. It provides 
guidance for using the Beam SDK classes to build and test your pipeline. It is 
not intended as an exhaustive reference, but as a language-agnostic, high-level 
guide to programmatically building your Beam pipeline. As the programming guide 
is filled out, the text will include code samples in multiple languages to help 
illustrate how to implement Beam concepts in your programs.
 
+
+  Adapt for: 
+  
+Java SDK
+Python SDK
+  
+
+
 Contents
 
 
@@ -219,13 +227,13 @@
 
 Creating 
the Pipeline
 
-The Pipeline abstraction 
encapsulates all the data and steps in your data processing task. Your Beam 
driver program typically starts by constructing a https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/Pipeline.java";>Pipeline
 object, and then using that object as the basis for creating the pipeline’s 
data sets as PCollections and its 
operations as Transforms.
+The Pipeline abstraction 
encapsulates all the data and steps in your data processing task. Your Beam 
driver program typically starts by constructing a Pipelinehttps://github.com/apache/beam/blob/python-sdk/sdks/python/apache_beam/pipeline.py";>Pipeline
 object, and then using that object as the basis for creating the pipeline’s 
data sets as PCollections and its 
operations as Transforms.
 
 To use Beam, your driver program must first create an instance of the Beam 
SDK class Pipeline (typically in the 
main() function). When you create your 
Pipeline, you’ll also need to set some 
configuration options. You can set your pipeline’s 
configuration options programatically, but it’s often easier to set the 
options ahead of time (or read them from the command line) and pass them to the 
Pipeline object when you create the 
object.
 
 The pipeline configuration options determine, among other things, the PipelineRunner that determines where the 
pipeline gets executed: locally, or using a distributed back-end of your 
choice. Depending on where your pipeline gets executed and what your specifed 
Runner requires, the options can also help you specify other aspects of 
execution.
 
-To set your pipeline’s configuration options and create the pipeline, 
create an object of type https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/options/PipelineOptions.java";>PipelineOptions
 and pass it to Pipeline.Create(). The 
most common way to do this is by parsing arguments from the command-line:
+To set your pipeline’s configuration options and create the pipeline, 
create an object of type PipelineOptionshttps://github.com/apache/beam/blob/python-sdk/sdks/python/apache_beam/utils/options.py";>PipelineOptions
 and pass it to Pipeline.Create(). The 
most common way to do this is by parsing arguments from the command-line:
 
 public static void main(String[] args) {
// Will parse the arguments passed into the application 
and construct a PipelineOptions
@@ -238,11 +246,19 @@
 
 
 
+from apache_beam.utils.options import PipelineOptions
+
+# Will parse the arguments passed into the application and 
construct a PipelineOptions
+# Note that --help will print registered options.
+p = beam.Pipeline(options=PipelineOptions())
+
+
+
 The Beam SDKs contain various subclasses of PipelineOptions that correspond to different 
Runners. For example, DirectPipelineOptions contains options for the 
Direct (local) pipeline runner, while DataflowPipelineOptions contains options for 
using the runn

[1/3] beam-site git commit: Added python supports in Programming Guide

2016-12-27 Thread dhalperi 
Repository: beam-site
Updated Branches:
  refs/heads/asf-site afd1f2694 -> 1e2528f17


Added python supports in Programming Guide


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/4b2338cc
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/4b2338cc
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/4b2338cc

Branch: refs/heads/asf-site
Commit: 4b2338cc7e71a1fdd9ab314b98bb48c5d945334d
Parents: afd1f26
Author: Abdullah Bashir 
Authored: Thu Nov 24 12:41:28 2016 +0500
Committer: Dan Halperin 
Committed: Tue Dec 27 18:47:08 2016 -0800

--
 src/_sass/_toggler-nav.scss|  24 
 src/documentation/programming-guide.md | 177 +++-
 src/js/language-switch.js  |  10 +-
 src/styles/site.scss   |   1 +
 4 files changed, 176 insertions(+), 36 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/4b2338cc/src/_sass/_toggler-nav.scss
--
diff --git a/src/_sass/_toggler-nav.scss b/src/_sass/_toggler-nav.scss
new file mode 100644
index 000..c27bf6c
--- /dev/null
+++ b/src/_sass/_toggler-nav.scss
@@ -0,0 +1,24 @@
+nav.language-switcher {
+margin: 25px 0;
+
+ul {
+display: inline;
+padding-left: 5px;
+
+li {
+display: inline;
+cursor: pointer;
+padding: 10px;
+background-color: #f8f8f8;
+
+&.active {
+background-color: #222c37;
+color: #fff;
+}
+}
+}
+}
+
+nav.runner-switcher {
+@extend .language-switcher;
+}
\ No newline at end of file

http://git-wip-us.apache.org/repos/asf/beam-site/blob/4b2338cc/src/documentation/programming-guide.md
--
diff --git a/src/documentation/programming-guide.md 
b/src/documentation/programming-guide.md
index 7eb5f39..15528c5 100644
--- a/src/documentation/programming-guide.md
+++ b/src/documentation/programming-guide.md
@@ -11,6 +11,15 @@ redirect_from:
 
 The **Beam Programming Guide** is intended for Beam users who want to use the 
Beam SDKs to create data processing pipelines. It provides guidance for using 
the Beam SDK classes to build and test your pipeline. It is not intended as an 
exhaustive reference, but as a language-agnostic, high-level guide to 
programmatically building your Beam pipeline. As the programming guide is 
filled out, the text will include code samples in multiple languages to help 
illustrate how to implement Beam concepts in your programs.
 
+
+
+  Adapt for: 
+  
+Java SDK
+Python SDK
+  
+
+
 ## Contents
 
 * [Overview](#overview)
@@ -62,13 +71,13 @@ When you run your Beam driver program, the Pipeline Runner 
that you designate co
 
 ## Creating the Pipeline
 
-The `Pipeline` abstraction encapsulates all the data and steps in your data 
processing task. Your Beam driver program typically starts by constructing a 
[Pipeline](https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/Pipeline.java)
 object, and then using that object as the basis for creating the pipeline's 
data sets as `PCollection`s and its operations as `Transform`s.
+The `Pipeline` abstraction encapsulates all the data and steps in your data 
processing task. Your Beam driver program typically starts by constructing a 
[Pipeline]({{ site.baseurl 
}}/documentation/sdks/javadoc/{{ site.release_latest 
}}/index.html?org/apache/beam/sdk/Pipeline.html)[Pipeline](https://github.com/apache/beam/blob/python-sdk/sdks/python/apache_beam/pipeline.py)
 object, and then using that object as the basis for creating the pipeline's 
data sets as `PCollection`s and its operations as `Transform`s.
 
 To use Beam, your driver program must first create an instance of the Beam SDK 
class `Pipeline` (typically in the `main()` function). When you create your 
`Pipeline`, you'll also need to set some **configuration options**. You can set 
your pipeline's configuration options programatically, but it's often easier to 
set the options ahead of time (or read them from the command line) and pass 
them to the `Pipeline` object when you create the object.
 
 The pipeline configuration options determine, among other things, the 
`PipelineRunner` that determines where the pipeline gets executed: locally, or 
using a distributed back-end of your choice. Depending on where your pipeline 
gets executed and what your specifed Runner requires, the options can also help 
you specify other aspects of execution.
 
-To set your pipeline's configuration options and create the pipeline, create 
an object of type 
[PipelineOptions](https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java

[1/3] beam-site git commit: Updated Wordcount, Mobile gaming, and Using the Docs pages.

2016-12-27 Thread davor 
Repository: beam-site
Updated Branches:
  refs/heads/asf-site e051db4d2 -> afd1f2694


Updated Wordcount, Mobile gaming, and Using the Docs pages.

Update Java SDK page


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/303fb261
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/303fb261
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/303fb261

Branch: refs/heads/asf-site
Commit: 303fb261c6625e3c214fd60ada7a47d10654ebfd
Parents: e051db4
Author: Hadar Hod 
Authored: Fri Dec 9 11:14:53 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:53:43 2016 -0800

--
 src/documentation/index.md   |  12 +++--
 src/documentation/resources.md   |   2 +-
 src/documentation/sdks/java.md   |  34 +++--
 src/documentation/sdks/python.md |   2 -
 src/get-started/mobile-gaming-example.md |  39 +--
 src/get-started/wordcount-example.md |  67 --
 src/images/gaming-example-basic.png  | Bin 0 -> 63121 bytes
 7 files changed, 86 insertions(+), 70 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/303fb261/src/documentation/index.md
--
diff --git a/src/documentation/index.md b/src/documentation/index.md
index 87ba7b8..630b2c4 100644
--- a/src/documentation/index.md
+++ b/src/documentation/index.md
@@ -9,7 +9,7 @@ redirect_from:
 
 # Apache Beam Documentation
 
-Get in-depth conceptual information and reference material for the Beam Model, 
SDKs and Runners:
+This section provides in-depth conceptual information and reference material 
for the Beam Model, SDKs, and Runners:
 
 ## Concepts 
 
@@ -18,6 +18,12 @@ Learn about the Beam Programming Model and the concepts 
common to all Beam SDKs
 * The [Programming Guide]({{ site.baseurl }}/documentation/programming-guide/) 
introduces all the key Beam concepts.
 * Visit [Additional Resources]({{ site.baseurl }}/documentation/resources/) 
for some of our favorite articles and talks about Beam. 
 
+## Pipeline Fundamentals
+
+* [Design Your Pipeline]({{ site.baseurl 
}}/documentation/pipelines/design-your-pipeline/) by planning your pipeline’s 
structure, choosing transforms to apply to your data, and determining your 
input and output methods.
+* [Create Your Pipeline]({{ site.baseurl 
}}/documentation/pipelines/create-your-pipeline/) using the classes in the Beam 
SDKs.
+* [Test Your Pipeline]({{ site.baseurl 
}}/documentation/pipelines/test-your-pipeline/) to minimize debugging a 
pipeline’s remote execution.
+
 ## SDKs
 
 Find status and reference information on all of the available Beam SDKs.
@@ -40,6 +46,6 @@ A Beam Runner runs a Beam pipeline on a specific (often 
distributed) data proces
 
 ### Choosing a Runner
 
-Beam is designed to enable pipelines to be portable across different runners. 
However, given every runner has different capabilities, they also have 
different abilities to implement the core concepts in the Beam model. The 
[Capability Matrix]({{ site.baseurl }}/documentation/runners/capability-matrix) 
provides a detailed comparison of runner functionality.
+Beam is designed to enable pipelines to be portable across different runners. 
However, given every runner has different capabilities, they also have 
different abilities to implement the core concepts in the Beam model. The 
[Capability Matrix]({{ site.baseurl 
}}/documentation/runners/capability-matrix/) provides a detailed comparison of 
runner functionality.
 
-Once you have chosen which runner to use, see that runner's page for more 
information about any initial runner-specific setup as well as any required or 
optional `PipelineOptions` for configuring it's execution. You may also want to 
refer back to the [Quickstart]({{ site.baseurl }}/get-started/quickstart) for 
instructions on executing the sample WordCount pipeline.
+Once you have chosen which runner to use, see that runner's page for more 
information about any initial runner-specific setup as well as any required or 
optional `PipelineOptions` for configuring it's execution. You may also want to 
refer back to the [Quickstart]({{ site.baseurl }}/get-started/quickstart/) for 
instructions on executing the sample WordCount pipeline.

http://git-wip-us.apache.org/repos/asf/beam-site/blob/303fb261/src/documentation/resources.md
--
diff --git a/src/documentation/resources.md b/src/documentation/resources.md
index 89f4b62..060b230 100644
--- a/src/documentation/resources.md
+++ b/src/documentation/resources.md
@@ -28,7 +28,7 @@ Presented by Tyler Akidau, *Apache Beam PPMC member*
 
 Hadoop Summit, San Jose, CA, 2016 
 
-Presented by Davor Bonacci, *Apache Beam PPMC member*

[3/3] beam-site git commit: This closes #105

2016-12-27 Thread davor 
This closes #105


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/afd1f269
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/afd1f269
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/afd1f269

Branch: refs/heads/asf-site
Commit: afd1f2694abefafd4246f702bce88b6b8733ce5d
Parents: e051db4 00c736c
Author: Davor Bonaci 
Authored: Tue Dec 27 17:54:20 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:54:20 2016 -0800

--
 content/documentation/index.html|  14 +++-
 content/documentation/resources/index.html  |   2 +-
 content/documentation/sdks/java/index.html  |  32 +++-
 content/documentation/sdks/python/index.html|   2 -
 .../mobile-gaming-example/index.html|  37 +
 .../get-started/wordcount-example/index.html|  77 ++-
 content/images/gaming-example-basic.png | Bin 0 -> 63121 bytes
 src/documentation/index.md  |  12 ++-
 src/documentation/resources.md  |   2 +-
 src/documentation/sdks/java.md  |  34 +++-
 src/documentation/sdks/python.md|   2 -
 src/get-started/mobile-gaming-example.md|  39 ++
 src/get-started/wordcount-example.md|  67 +---
 src/images/gaming-example-basic.png | Bin 0 -> 63121 bytes
 14 files changed, 174 insertions(+), 146 deletions(-)
--

[GitHub] beam-site pull request #105: Minor improvements to docs

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/105


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/3] beam-site git commit: Regenerate website

2016-12-27 Thread davor 
Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/00c736ce
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/00c736ce
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/00c736ce

Branch: refs/heads/asf-site
Commit: 00c736ce6dd742d2673007d68edb6920e9795f9f
Parents: 303fb26
Author: Davor Bonaci 
Authored: Tue Dec 27 17:54:19 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:54:19 2016 -0800

--
 content/documentation/index.html|  14 +++-
 content/documentation/resources/index.html  |   2 +-
 content/documentation/sdks/java/index.html  |  32 +++-
 content/documentation/sdks/python/index.html|   2 -
 .../mobile-gaming-example/index.html|  37 +
 .../get-started/wordcount-example/index.html|  77 ++-
 content/images/gaming-example-basic.png | Bin 0 -> 63121 bytes
 7 files changed, 88 insertions(+), 76 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/00c736ce/content/documentation/index.html
--
diff --git a/content/documentation/index.html b/content/documentation/index.html
index 1259a66..4767f70 100644
--- a/content/documentation/index.html
+++ b/content/documentation/index.html
@@ -146,7 +146,7 @@
   
 Apache Beam Documentation
 
-Get in-depth conceptual information and reference material for the Beam 
Model, SDKs and Runners:
+This section provides in-depth conceptual information and reference 
material for the Beam Model, SDKs, and Runners:
 
 Concepts
 
@@ -157,6 +157,14 @@
   Visit Additional Resources for 
some of our favorite articles and talks about Beam.
 
 
+Pipeline Fundamentals
+
+
+  Design Your 
Pipeline by planning your pipeline’s structure, choosing transforms to 
apply to your data, and determining your input and output methods.
+  Create Your 
Pipeline using the classes in the Beam SDKs.
+  Test Your 
Pipeline to minimize debugging a pipeline’s remote execution.
+
+
 SDKs
 
 Find status and reference information on all of the available Beam SDKs.
@@ -183,9 +191,9 @@
 
 Choosing a Runner
 
-Beam is designed to enable pipelines to be portable across different 
runners. However, given every runner has different capabilities, they also have 
different abilities to implement the core concepts in the Beam model. The Capability Matrix provides 
a detailed comparison of runner functionality.
+Beam is designed to enable pipelines to be portable across different 
runners. However, given every runner has different capabilities, they also have 
different abilities to implement the core concepts in the Beam model. The Capability Matrix provides 
a detailed comparison of runner functionality.
 
-Once you have chosen which runner to use, see that runner’s page for more 
information about any initial runner-specific setup as well as any required or 
optional PipelineOptions for configuring 
it’s execution. You may also want to refer back to the Quickstart for instructions on executing the 
sample WordCount pipeline.
+Once you have chosen which runner to use, see that runner’s page for more 
information about any initial runner-specific setup as well as any required or 
optional PipelineOptions for configuring 
it’s execution. You may also want to refer back to the Quickstart for instructions on executing 
the sample WordCount pipeline.
 
   
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/00c736ce/content/documentation/resources/index.html
--
diff --git a/content/documentation/resources/index.html 
b/content/documentation/resources/index.html
index 21a707f..9aceea2 100644
--- a/content/documentation/resources/index.html
+++ b/content/documentation/resources/index.html
@@ -187,7 +187,7 @@
 
 Hadoop Summit, San Jose, CA, 2016
 
-Presented by Davor Bonacci, Apache Beam PPMC member
+Presented by Davor Bonaci, Apache Beam PPMC member
 
 https://www.youtube.com/embed/7DZ8ONmeP5A"; frameborder="0" 
allowfullscreen="">
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/00c736ce/content/documentation/sdks/java/index.html
--
diff --git a/content/documentation/sdks/java/index.html 
b/content/documentation/sdks/java/index.html
index 3b3ead4..bd29d00 100644
--- a/content/documentation/sdks/java/index.html
+++ b/content/documentation/sdks/java/index.html
@@ -146,11 +146,37 @@
   
 Apache Beam Java SDK
 
-This page is under construction (https://issues.apache.org/jira/browse/BEAM-504";>BEAM-504).
+The Java SDK for Apache Beam provides a simple, powerful API for building 
both batch and streaming parallel data pr

[2/3] beam-site git commit: Regenerate website

2016-12-27 Thread davor 
Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/d83813c4
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/d83813c4
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/d83813c4

Branch: refs/heads/asf-site
Commit: d83813c417fa04f748ef29cba5e48955b9d5c60b
Parents: 94c2366
Author: Davor Bonaci 
Authored: Tue Dec 27 17:39:31 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:39:31 2016 -0800

--
 content/contribute/release-guide/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/d83813c4/content/contribute/release-guide/index.html
--
diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 74d3b96..97b9ef5 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -524,7 +524,7 @@ TAG="v${VERSION}-RC${RC_NUM}"
 -Ddoctitle="Apache Beam SDK for Java, version ${VERSION}" \
 -Dwindowtitle="Apache Beam SDK for Java, version ${VERSION}" \
 -Dmaven.javadoc.failOnError=false \
-
-DexcludePackageNames="org.apache.beam.examples,org.apache.beam.runners.dataflow.internal,org.apache.beam.runners.flink.examples,org.apache.beam.runners.flink.translation,org.apache.beam.runners.spark.examples,org.apache.beam.runners.spark.translation,org.apache.beam.sdk.microbenchmarks.coders.generated,org.apache.beam.sdk.microbenchmarks.transforms.generated,org.openjdk.jmh.infra.generated"
+
-DexcludePackageNames="org.apache.beam.examples,org.apache.beam.runners.dataflow.internal,org.apache.beam.runners.flink.examples,org.apache.beam.runners.flink.translation,org.apache.beam.runners.spark.examples,org.apache.beam.runners.spark.translation,org.apache.beam.runners.apex.translation,org.apache.beam.sdk.microbenchmarks.coders.generated,org.apache.beam.sdk.microbenchmarks.transforms.generated,org.openjdk.jmh.infra.generated"

[GitHub] beam-site pull request #108: Exclude apex runner translation package from th...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/108


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[1/3] beam-site git commit: Update Release Guide: exclude apex runner translation package from the generated javadoc

2016-12-27 Thread davor 
Repository: beam-site
Updated Branches:
  refs/heads/asf-site 21ae50ee8 -> e051db4d2


Update Release Guide: exclude apex runner translation package from the 
generated javadoc


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/94c23668
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/94c23668
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/94c23668

Branch: refs/heads/asf-site
Commit: 94c23668ab4d2bb4caa8c330bcd284a4224c5bac
Parents: 21ae50e
Author: Jean-Baptiste Onofré 
Authored: Thu Dec 15 10:35:32 2016 +0100
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:39:16 2016 -0800

--
 src/contribute/release-guide.md | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/94c23668/src/contribute/release-guide.md
--
diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md
index 36f3bd1..73e90a6 100644
--- a/src/contribute/release-guide.md
+++ b/src/contribute/release-guide.md
@@ -269,7 +269,7 @@ Use Maven Javadoc plugin to generate the new Java reference 
manual, as follows:
 -Ddoctitle="Apache Beam SDK for Java, version ${VERSION}" \
 -Dwindowtitle="Apache Beam SDK for Java, version ${VERSION}" \
 -Dmaven.javadoc.failOnError=false \
-
-DexcludePackageNames="org.apache.beam.examples,org.apache.beam.runners.dataflow.internal,org.apache.beam.runners.flink.examples,org.apache.beam.runners.flink.translation,org.apache.beam.runners.spark.examples,org.apache.beam.runners.spark.translation,org.apache.beam.sdk.microbenchmarks.coders.generated,org.apache.beam.sdk.microbenchmarks.transforms.generated,org.openjdk.jmh.infra.generated"
+
-DexcludePackageNames="org.apache.beam.examples,org.apache.beam.runners.dataflow.internal,org.apache.beam.runners.flink.examples,org.apache.beam.runners.flink.translation,org.apache.beam.runners.spark.examples,org.apache.beam.runners.spark.translation,org.apache.beam.runners.apex.translation,org.apache.beam.sdk.microbenchmarks.coders.generated,org.apache.beam.sdk.microbenchmarks.transforms.generated,org.openjdk.jmh.infra.generated"
 
 By default, the Javadoc will be generated in `target/site/apidocs/`. Let 
`${JAVADOC_ROOT}` be the absolute path to `apidocs`. ([Pull request 
#1015](https://github.com/apache/beam/pull/1015) will hopefully simplify this 
process.)

[3/3] beam-site git commit: This closes #108

2016-12-27 Thread davor 
This closes #108


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/e051db4d
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/e051db4d
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/e051db4d

Branch: refs/heads/asf-site
Commit: e051db4d24f416ea1101f4e981cfc2d384517133
Parents: 21ae50e d83813c
Author: Davor Bonaci 
Authored: Tue Dec 27 17:39:31 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:39:31 2016 -0800

--
 content/contribute/release-guide/index.html | 2 +-
 src/contribute/release-guide.md | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)
--

[4/4] beam-site git commit: This closes #110

2016-12-27 Thread davor 
This closes #110


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/21ae50ee
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/21ae50ee
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/21ae50ee

Branch: refs/heads/asf-site
Commit: 21ae50ee83654b89a0ba2258c44282a2a983553e
Parents: 15c8077 99e1fb1
Author: Davor Bonaci 
Authored: Tue Dec 27 17:37:39 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:37:39 2016 -0800

--
 content/contribute/release-guide/index.html | 13 -
 src/contribute/release-guide.md | 11 ---
 src/get-started/downloads.md|  4 ++--
 3 files changed, 10 insertions(+), 18 deletions(-)
--

[GitHub] beam-site pull request #110: Update website pull request instructions in the...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/110


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/4] beam-site git commit: Additional clarifications to pull request #110

2016-12-27 Thread davor 
Additional clarifications to pull request #110


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/58cf95d3
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/58cf95d3
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/58cf95d3

Branch: refs/heads/asf-site
Commit: 58cf95d307297a10d6047e01b3b2934ba35db1f7
Parents: 2ec43fd
Author: Davor Bonaci 
Authored: Tue Dec 27 17:36:57 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:36:57 2016 -0800

--
 src/contribute/release-guide.md | 12 
 src/get-started/downloads.md|  4 ++--
 2 files changed, 6 insertions(+), 10 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/58cf95d3/src/contribute/release-guide.md
--
diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md
index 5638fc9..36f3bd1 100644
--- a/src/contribute/release-guide.md
+++ b/src/contribute/release-guide.md
@@ -279,16 +279,12 @@ Please carefully review the generated Javadoc. Check for 
completeness and presen
 
 The final step of building the candidate is to propose a website pull request.
 
-Add the new release to the [Apache Beam Releases]({{ site.baseurl 
}}/use/releases/) page, as follows:
+Start by updating `release_latest` version flag in the top-level 
`_config.yml`, and list the new release in the [Apache Beam Downloads]({{ 
site.baseurl }}/get-started/downloads/), linking to the source code download 
and the Release Notes in JIRA.
 
-* Update `release_latest` version in `_config.yml`.
-* Update the `` tags in the sample `pom.xml` snippet to the new 
release (in `src/get-started/downloads.md`).
-* Add the new version to the `Release Notes` section below, along with links 
to the source code download and the Release Notes in JIRA (in 
`src/get-started/downloads.md` too).
+Add the new Javadoc to [SDK API Reference page]({{ site.baseurl 
}}/documentation/sdks/javadoc/) page, as follows:
 
-Add the new Javadoc to [SDK API Reference page]({{ site.baseurl 
}}/learn/sdks/javadoc/) page, as follows:
-
-* Copy the generated Javadoc into the website repository: `cp -r 
${JAVADOC_ROOT} learn/sdks/javadoc/${VERSION}`.
-* Update the Javadoc link on this page to point to the new version (in 
`src/documentation/sdks/javadoc/currend.md`).
+* Copy the generated Javadoc into the website repository: `cp -r 
${JAVADOC_ROOT} documentation/sdks/javadoc/${VERSION}`.
+* Update the Javadoc link on this page to point to the new version (in 
`src/documentation/sdks/javadoc/current.md`).
 
 Finally, propose a pull request with these changes. (Don’t merge before 
finalizing the release.)
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/58cf95d3/src/get-started/downloads.md
--
diff --git a/src/get-started/downloads.md b/src/get-started/downloads.md
index af8506a..b0011fa 100644
--- a/src/get-started/downloads.md
+++ b/src/get-started/downloads.md
@@ -20,12 +20,12 @@ Java with the `DirectRunner`, add the following 
dependencies to your
 
   org.apache.beam
   beam-sdks-java-core
-  0.3.0-incubating
+  {{ site.release_latest }}
 
 
   org.apache.beam
   beam-runners-direct-java
-  0.3.0-incubating
+  {{ site.release_latest }}
   runtime

[3/4] beam-site git commit: Regenerate website

2016-12-27 Thread davor 
Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/99e1fb13
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/99e1fb13
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/99e1fb13

Branch: refs/heads/asf-site
Commit: 99e1fb131bcb672286e2696fed2f9693964c43bc
Parents: 58cf95d
Author: Davor Bonaci 
Authored: Tue Dec 27 17:37:38 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:37:38 2016 -0800

--
 content/contribute/release-guide/index.html | 13 -
 1 file changed, 4 insertions(+), 9 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/99e1fb13/content/contribute/release-guide/index.html
--
diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 9e7c8e7..74d3b96 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -536,18 +536,13 @@ TAG="v${VERSION}-RC${RC_NUM}"
 
 The final step of building the candidate is to propose a website pull 
request.
 
-Add the new release to the Apache Beam 
Releases page, as follows:
+Start by updating release_latest 
version flag in the top-level _config.yml, and list the new release in the 
Apache Beam Downloads, linking to the 
source code download and the Release Notes in JIRA.
 
-
-  Update the  tags 
in the sample pom.xml snippet to the new 
release.
-  Add the new version to the Release 
Notes section below, along with links to the source code download and 
the Release Notes in JIRA.
-
-
-Add the new Javadoc to SDK API Reference 
page page, as follows:
+Add the new Javadoc to SDK API 
Reference page page, as follows:
 
 
-  Copy the generated Javadoc into the website repository: cp -r ${JAVADOC_ROOT} 
learn/sdks/javadoc/${VERSION}.
-  Update the Javadoc link on this page to point to the new version.
+  Copy the generated Javadoc into the website repository: cp -r ${JAVADOC_ROOT} 
documentation/sdks/javadoc/${VERSION}.
+  Update the Javadoc link on this page to point to the new version (in 
src/documentation/sdks/javadoc/current.md).
 
 
 Finally, propose a pull request with these changes. (Don’t merge before 
finalizing the release.)

[1/4] beam-site git commit: Update website pull request instructions in the Release Guide

2016-12-27 Thread davor 
Repository: beam-site
Updated Branches:
  refs/heads/asf-site 15c8077f7 -> 21ae50ee8


Update website pull request instructions in the Release Guide


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/2ec43fdb
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/2ec43fdb
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/2ec43fdb

Branch: refs/heads/asf-site
Commit: 2ec43fdb22491d7d8881428e3289b7f0efd28660
Parents: 15c8077
Author: Jean-Baptiste Onofré 
Authored: Thu Dec 15 12:58:30 2016 +0100
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:29:32 2016 -0800

--
 src/contribute/release-guide.md | 7 ---
 1 file changed, 4 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/2ec43fdb/src/contribute/release-guide.md
--
diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md
index 8dc96dc..5638fc9 100644
--- a/src/contribute/release-guide.md
+++ b/src/contribute/release-guide.md
@@ -281,13 +281,14 @@ The final step of building the candidate is to propose a 
website pull request.
 
 Add the new release to the [Apache Beam Releases]({{ site.baseurl 
}}/use/releases/) page, as follows:
 
-* Update the `` tags in the sample `pom.xml` snippet to the new 
release.
-* Add the new version to the `Release Notes` section below, along with links 
to the source code download and the Release Notes in JIRA.
+* Update `release_latest` version in `_config.yml`.
+* Update the `` tags in the sample `pom.xml` snippet to the new 
release (in `src/get-started/downloads.md`).
+* Add the new version to the `Release Notes` section below, along with links 
to the source code download and the Release Notes in JIRA (in 
`src/get-started/downloads.md` too).
 
 Add the new Javadoc to [SDK API Reference page]({{ site.baseurl 
}}/learn/sdks/javadoc/) page, as follows:
 
 * Copy the generated Javadoc into the website repository: `cp -r 
${JAVADOC_ROOT} learn/sdks/javadoc/${VERSION}`.
-* Update the Javadoc link on this page to point to the new version.
+* Update the Javadoc link on this page to point to the new version (in 
`src/documentation/sdks/javadoc/currend.md`).
 
 Finally, propose a pull request with these changes. (Don’t merge before 
finalizing the release.)

[jira] [Commented] (BEAM-1163) Add signature keys to the release guide vote template

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781736#comment-15781736
 ] 

ASF GitHub Bot commented on BEAM-1163:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/111


> Add signature keys to the release guide vote template
> -
>
> Key: BEAM-1163
> URL: https://issues.apache.org/jira/browse/BEAM-1163
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Affects Versions: Not applicable
>Reporter: Ismaël Mejía
>Assignee: Ismaël Mejía
>Priority: Trivial
>
> A small improvement, the idea is to add just the fingerprint of the person 
> who signed the release in the template (for validation purposes:
> The release artifacts are signed with the key with fingerprint XXX
> https://dist.apache.org/repos/dist/release/incubator/beam/KEYS



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] beam-site pull request #111: [BEAM-1163] Add signature keys to the vote temp...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/111


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[3/4] beam-site git commit: Regenerate website

2016-12-27 Thread davor 
Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/fdc62f6e
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/fdc62f6e
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/fdc62f6e

Branch: refs/heads/asf-site
Commit: fdc62f6eb78e59a7e4ef042f0743a12d42a78589
Parents: 9f64f4b
Author: Davor Bonaci 
Authored: Tue Dec 27 17:27:02 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:27:02 2016 -0800

--
 content/contribute/release-guide/index.html | 11 ++-
 1 file changed, 6 insertions(+), 5 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/fdc62f6e/content/contribute/release-guide/index.html
--
diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index b7d53d5..9e7c8e7 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -580,10 +580,10 @@ Please review and vote on the release candidate #3 for 
the version 1.2.3, as fol
 
 The complete staging area is available for your review, which includes:
 * JIRA release notes [1],
-* the official Apache source release to be deployed to dist.apache.org [2],
-* all artifacts to be deployed to the Maven Central Repository [3],
-* source code tag "v1.2.3-RC3" [4],
-* website pull request listing the release and publishing the API reference 
manual [5].
+* the official Apache source release to be deployed to dist.apache.org [2], 
which is signed with the key with fingerprint  [3],
+* all artifacts to be deployed to the Maven Central Repository [4],
+* source code tag "v1.2.3-RC3" [5],
+* website pull request listing the release and publishing the API reference 
manual [6].
 
 The vote will be open for at least 72 hours. It is adopted by majority 
approval, with at least 3 PPMC affirmative votes.
 
@@ -592,9 +592,10 @@ Release Manager
 
 [1] link
 [2] link
-[3] link
+[3] https://dist.apache.org/repos/dist/release/incubator/beam/KEYS
 [4] link
 [5] link
+[6] link

[1/4] beam-site git commit: [BEAM-1163] Add signature keys to the vote template (release guide)

2016-12-27 Thread davor 
Repository: beam-site
Updated Branches:
  refs/heads/asf-site 735ecfb45 -> 15c8077f7


[BEAM-1163] Add signature keys to the vote template (release guide)


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/0b035193
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/0b035193
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/0b035193

Branch: refs/heads/asf-site
Commit: 0b0351935d3b625a6f5a0dea4befeae192b5a031
Parents: 735ecfb
Author: Ismaël Mejía 
Authored: Thu Dec 15 21:32:09 2016 +0100
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:23:27 2016 -0800

--
 src/contribute/release-guide.md | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/0b035193/src/contribute/release-guide.md
--
diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md
index 0848e78..1383115 100644
--- a/src/contribute/release-guide.md
+++ b/src/contribute/release-guide.md
@@ -320,7 +320,8 @@ Start the review-and-vote thread on the dev@ mailing list. 
Here’s an email tem
 * the official Apache source release to be deployed to dist.apache.org [2],
 * all artifacts to be deployed to the Maven Central Repository [3],
 * source code tag "v1.2.3-RC3" [4],
-* website pull request listing the release and publishing the API 
reference manual [5].
+* website pull request listing the release and publishing the API 
reference manual [5],
+* the release artifacts are signed with the key with fingerprint  
[6].
 
 The vote will be open for at least 72 hours. It is adopted by majority 
approval, with at least 3 PPMC affirmative votes.
 
@@ -332,6 +333,7 @@ Start the review-and-vote thread on the dev@ mailing list. 
Here’s an email tem
 [3] link
 [4] link
 [5] link
+[6] https://dist.apache.org/repos/dist/release/incubator/beam/KEYS
 
 If there are any issues found in the release candidate, reply on the vote 
thread to cancel the vote. There’s no need to wait 72 hours. Proceed to the 
`Fix Issues` step below and address the problem. However, some issues don’t 
require cancellation. For example, if an issue is found in the website pull 
request, just correct it on the spot and the vote can continue as-is.

[4/4] beam-site git commit: This closes #111

2016-12-27 Thread davor 
This closes #111


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/15c8077f
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/15c8077f
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/15c8077f

Branch: refs/heads/asf-site
Commit: 15c8077f7a04f91250d31417e165084d1695ad88
Parents: 735ecfb fdc62f6
Author: Davor Bonaci 
Authored: Tue Dec 27 17:27:02 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:27:02 2016 -0800

--
 content/contribute/release-guide/index.html | 11 ++-
 src/contribute/release-guide.md | 11 ++-
 2 files changed, 12 insertions(+), 10 deletions(-)
--

[2/4] beam-site git commit: Add clarification to original pull request #111

2016-12-27 Thread davor 
Add clarification to original pull request #111


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/9f64f4b3
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/9f64f4b3
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/9f64f4b3

Branch: refs/heads/asf-site
Commit: 9f64f4b3d0567bc223dd5e38d405999788c39d71
Parents: 0b03519
Author: Davor Bonaci 
Authored: Tue Dec 27 17:26:11 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:26:11 2016 -0800

--
 src/contribute/release-guide.md | 13 ++---
 1 file changed, 6 insertions(+), 7 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/9f64f4b3/src/contribute/release-guide.md
--
diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md
index 1383115..8dc96dc 100644
--- a/src/contribute/release-guide.md
+++ b/src/contribute/release-guide.md
@@ -317,11 +317,10 @@ Start the review-and-vote thread on the dev@ mailing 
list. Here’s an email tem
 
 The complete staging area is available for your review, which includes:
 * JIRA release notes [1],
-* the official Apache source release to be deployed to dist.apache.org [2],
-* all artifacts to be deployed to the Maven Central Repository [3],
-* source code tag "v1.2.3-RC3" [4],
-* website pull request listing the release and publishing the API 
reference manual [5],
-* the release artifacts are signed with the key with fingerprint  
[6].
+* the official Apache source release to be deployed to dist.apache.org 
[2], which is signed with the key with fingerprint  [3],
+* all artifacts to be deployed to the Maven Central Repository [4],
+* source code tag "v1.2.3-RC3" [5],
+* website pull request listing the release and publishing the API 
reference manual [6].
 
 The vote will be open for at least 72 hours. It is adopted by majority 
approval, with at least 3 PPMC affirmative votes.
 
@@ -330,10 +329,10 @@ Start the review-and-vote thread on the dev@ mailing 
list. Here’s an email tem
 
 [1] link
 [2] link
-[3] link
+[3] https://dist.apache.org/repos/dist/release/incubator/beam/KEYS
 [4] link
 [5] link
-[6] https://dist.apache.org/repos/dist/release/incubator/beam/KEYS
+[6] link
 
 If there are any issues found in the release candidate, reply on the vote 
thread to cancel the vote. There’s no need to wait 72 hours. Proceed to the 
`Fix Issues` step below and address the problem. However, some issues don’t 
require cancellation. For example, if an issue is found in the website pull 
request, just correct it on the spot and the vote can continue as-is.

[jira] [Commented] (BEAM-1222) Move GCS specific constants out of fileio

2016-12-27 Thread Konstantinos Katsiapis (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781706#comment-15781706
 ] 

Konstantinos Katsiapis commented on BEAM-1222:
--

I think we should make sure that whatever defaults are used in FileIo are 
actually tailored to the underlying filesystem.

> Move GCS specific constants out of fileio
> -
>
> Key: BEAM-1222
> URL: https://issues.apache.org/jira/browse/BEAM-1222
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py
>Reporter: Chamikara Jayalath
>
> Currently fileio.py has GCS specific constant gcsio.MAX_BATCH_OPERATION_SIZE 
> which should be moved out of it. This will be needed to implement 
> IOChannelFactory proposal [1] for Python SDK.
> [1] 
> https://docs.google.com/document/d/11TdPyZ9_zmjokhNWM3Id-XJsVG3qel2lhdKTknmZ_7M/edit#heading=h.kpqagzh8i11w



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-1220) Graduation items

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781707#comment-15781707
 ] 

ASF GitHub Bot commented on BEAM-1220:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/114


> Graduation items
> 
>
> Key: BEAM-1220
> URL: https://issues.apache.org/jira/browse/BEAM-1220
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Davor Bonaci
>Assignee: Davor Bonaci
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[2/3] beam-site git commit: Regenerate website

2016-12-27 Thread davor 
Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/bee9579e
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/bee9579e
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/bee9579e

Branch: refs/heads/asf-site
Commit: bee9579e89bef81336228b22b6964cae3ca63c83
Parents: 7240745
Author: Davor Bonaci 
Authored: Tue Dec 27 17:10:01 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:10:01 2016 -0800

--
 content/contribute/team/index.html | 178 +---
 1 file changed, 71 insertions(+), 107 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/bee9579e/content/contribute/team/index.html
--
diff --git a/content/contribute/team/index.html 
b/content/contribute/team/index.html
index e4f3aa2..a303c25 100644
--- a/content/contribute/team/index.html
+++ b/content/contribute/team/index.html
@@ -166,129 +166,102 @@
 
   
 
-  Aljoscha Krettek
-  aljoscha
-  aljoscha [at] apache [dot] org
-  data Artisans
-  committer, PPMC
-  +1
-
-  
-
-  Amit Sela
-  amitsela
-  amitsela [at] apache [dot] org
-  PayPal
-  committer, PPMC
-  +2
-
-  
-
-  Ben Chambers
-  bchambers
-  bchambers [at] apache [dot] org
+  Tyler Akidau
+  takidau
+  takidau [at] apache [dot] org
   Google
-  committer, PPMC
+  committer, PMC
   -8
 
   
 
-  Craig Chambers
-  
-  
-  Google
-  committer, PPMC
+  Jesse Anderson
+  jesseanderson
+  jesseanderson [at] apache [dot] org
+  Smoking Hand
+  committer
   -8
 
   
 
-  Dan Halperin
-  dhalperi
-  dhalperi [at] apache [dot] org
+  Davor Bonaci
+  davor
+  davor [at] apache [dot] org
   Google
-  committer, PPMC
+  committer, PMC Chair
   -8
 
   
 
-  Davor Bonaci
-  davor
-  davor [at] apache [dot] org
+  Robert Bradshaw
+  robertwb
+  robertwb [at] apache [dot] org
   Google
-  committer, PPMC
+  committer, PMC
   -8
 
   
 
-  Frances Perry
-  frances
-  frances [at] apache [dot] org
+  Ben Chambers
+  bchambers
+  bchambers [at] apache [dot] org
   Google
-  committer, PPMC
+  committer, PMC
   -8
 
   
 
-  James Malone
-  jamesmalone
-  jamesmalone [at] apache [dot] org
+  Luke Cwik
+  lcwik
+  lcwik [at] apache [dot] org
   Google
-  committer, PPMC
+  committer, PMC
   -8
 
   
 
-  Jean-Baptiste Onofré
-  jbonofre
-  jbonofre [at] apache [dot] org
-  Talend
-  champion, committer, PPMC
+  Stephan Ewen
+  sewen
+  sewen [at] apache [dot] org
+  data Artisans
+  committer, PMC
   +1
 
   
 
-  Jesse Anderson
-  jesseanderson
-  jesseanderson [at] apache [dot] org
-  Smoking Hand
+  Thomas Groh
+  tgroh
+  tgroh [at] apache [dot] org
+  Google
   committer
   -8
 
   
 
-  Josh Wills
-  jwills
-  jwills [at] apache [dot] org
-  
-  committer, PPMC
+  Dan Halperin
+  dhalperi
+  dhalperi [at] apache [dot] org
+  Google
+  committer, PMC
   -8
 
   
 
-  Kostas Tzoumas
-  ktzoumas
-  ktzoumas [at] apache [dot] org
-  data Artisans
-  committer, PPMC
-  +1
-
-  
-
   Kenneth Knowles
   kenn
   kenn [at] apache [dot] org
   Google
-  committer, PPMC
+  committer, PMC
   -8
 
   
 
-  Luke Cwik
-  lcwik
-  lcwik [at] apache [dot] org
-  Google
-  committer, PPMC
-  -8
+  Aljoscha Krettek
+  aljoscha
+  aljoscha [at] apache [dot] org
+  data Artisans
+  committer, PMC
+  +1
 
   
 
@@ -296,61 +269,52 @@
   mxm
   mxm [at] apache [dot] org
   data Artisans
-  committer, PPMC
+  committer,

[jira] [Commented] (BEAM-1220) Graduation items

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781702#comment-15781702
 ] 

ASF GitHub Bot commented on BEAM-1220:
--

GitHub user dhalperi opened a pull request:

https://github.com/apache/beam-site/pull/114

[BEAM-1220] Update team.md with post-graduation committer list



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam-site pmc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam-site/pull/114.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #114


commit 0668f25ae5ad7bfca632093a04fb4abac80398c5
Author: Dan Halperin 
Date:   2016-12-28T01:06:15Z

[BEAM-1220] Update team.md with post-graduation committer list




> Graduation items
> 
>
> Key: BEAM-1220
> URL: https://issues.apache.org/jira/browse/BEAM-1220
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Davor Bonaci
>Assignee: Davor Bonaci
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] beam-site pull request #114: [BEAM-1220] Update team.md with post-graduation...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/114


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[1/3] beam-site git commit: [BEAM-1220] Update team.md with post-graduation committer list

2016-12-27 Thread davor 
Repository: beam-site
Updated Branches:
  refs/heads/asf-site dbf665fd9 -> 735ecfb45


[BEAM-1220] Update team.md with post-graduation committer list


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/72407452
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/72407452
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/72407452

Branch: refs/heads/asf-site
Commit: 7240745248ec934b350a2afc83003114f6bb7d17
Parents: dbf665f
Author: Dan Halperin 
Authored: Tue Dec 27 17:06:15 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:09:42 2016 -0800

--
 src/_beam_team/team.md | 158 +++-
 1 file changed, 67 insertions(+), 91 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/72407452/src/_beam_team/team.md
--
diff --git a/src/_beam_team/team.md b/src/_beam_team/team.md
index 12abad3..70c895d 100644
--- a/src/_beam_team/team.md
+++ b/src/_beam_team/team.md
@@ -2,130 +2,106 @@
 group: "Beam Committers"
 description: "The following is a list of developers with commit privileges 
that have directly contributed to the project in one way or another."
 members:
-  - name: Aljoscha Krettek
-apache_id: aljoscha
-email: aljoscha [at] apache [dot] org
-organization: data Artisans
-roles: committer, PPMC
-time_zone: "+1"
-  - name: Amit Sela
-apache_id: amitsela
-email: amitsela [at] apache [dot] org
-organization: PayPal
-roles: committer, PPMC
-time_zone: "+2"
-  - name: Ben Chambers
-apache_id: bchambers
-email: bchambers [at] apache [dot] org
-organization: Google
-roles: committer, PPMC
-time_zone: "-8"
-  - name: Craig Chambers
-apache_id:
-email:
+  - name: Tyler Akidau
+apache_id: takidau
+email: takidau [at] apache [dot] org
 organization: Google
-roles: committer, PPMC
+roles: committer, PMC
 time_zone: "-8"
-  - name: Dan Halperin
-apache_id: dhalperi
-email: dhalperi [at] apache [dot] org
-organization: Google
-roles: committer, PPMC
+  - name: Jesse Anderson
+apache_id: jesseanderson
+email: jesseanderson [at] apache [dot] org
+organization: Smoking Hand
+roles: committer
 time_zone: "-8"
   - name: Davor Bonaci
 apache_id: davor
 email: davor [at] apache [dot] org
 organization: Google
-roles: committer, PPMC
+roles: committer, PMC Chair
 time_zone: "-8"
-  - name: Frances Perry
-apache_id: frances
-email: frances [at] apache [dot] org
+  - name: Robert Bradshaw
+apache_id: robertwb
+email: robertwb [at] apache [dot] org
 organization: Google
-roles: committer, PPMC
+roles: committer, PMC
 time_zone: "-8"
-  - name: James Malone
-apache_id: jamesmalone
-email: jamesmalone [at] apache [dot] org
+  - name: Ben Chambers
+apache_id: bchambers
+email: bchambers [at] apache [dot] org
 organization: Google
-roles: committer, PPMC
+roles: committer, PMC
 time_zone: "-8"
-  - name: Jean-Baptiste Onofré
-apache_id: jbonofre
-email: jbonofre [at] apache [dot] org
-organization: Talend
-roles: champion, committer, PPMC
+  - name: Luke Cwik
+apache_id: lcwik
+email: lcwik [at] apache [dot] org
+organization: Google
+roles: committer, PMC
+time_zone: "-8"
+  - name: Stephan Ewen
+apache_id: sewen
+email: sewen [at] apache [dot] org
+organization: data Artisans
+roles: committer, PMC
 time_zone: "+1"
-  - name: Jesse Anderson
-apache_id: jesseanderson
-email: jesseanderson [at] apache [dot] org
-organization: Smoking Hand
+  - name: Thomas Groh
+apache_id: tgroh
+email: tgroh [at] apache [dot] org
+organization: Google
 roles: committer
 time_zone: "-8"
-  - name: Josh Wills
-apache_id: jwills
-email: jwills [at] apache [dot] org
-organization:
-roles: committer, PPMC
+  - name: Dan Halperin
+apache_id: dhalperi
+email: dhalperi [at] apache [dot] org
+organization: Google
+roles: committer, PMC
 time_zone: "-8"
-  - name: Kostas Tzoumas
-apache_id: ktzoumas
-email: ktzoumas [at] apache [dot] org
-organization: data Artisans
-roles: committer, PPMC
-time_zone: "+1"
   - name: Kenneth Knowles
 apache_id: kenn
 email: kenn [at] apache [dot] org
 organization: Google
-roles: committer, PPMC
-time_zone: "-8"
-  - name: Luke Cwik
-apache_id: lcwik
-email: lcwik [at] apache [dot] org
-organization: Google
-roles: committer, PPMC
+roles: committer, PMC
 time_zone: "-8"
+  - name: Aljoscha Krettek
+apache_id: aljoscha
+email: aljoscha [at] apache [dot] org
+organiza

[3/3] beam-site git commit: This closes #114

2016-12-27 Thread davor 
This closes #114


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/735ecfb4
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/735ecfb4
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/735ecfb4

Branch: refs/heads/asf-site
Commit: 735ecfb45d819f5b20680ad774b1fe9cc8e01388
Parents: dbf665f bee9579
Author: Davor Bonaci 
Authored: Tue Dec 27 17:10:01 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 17:10:01 2016 -0800

--
 content/contribute/team/index.html | 178 +---
 src/_beam_team/team.md | 158 
 2 files changed, 138 insertions(+), 198 deletions(-)
--

[GitHub] beam-site pull request #114: [BEAM-1220] Update team.md with post-graduation...

2016-12-27 Thread dhalperi 
GitHub user dhalperi opened a pull request:

https://github.com/apache/beam-site/pull/114

[BEAM-1220] Update team.md with post-graduation committer list



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam-site pmc

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam-site/pull/114.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #114


commit 0668f25ae5ad7bfca632093a04fb4abac80398c5
Author: Dan Halperin 
Date:   2016-12-28T01:06:15Z

[BEAM-1220] Update team.md with post-graduation committer list




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-1222) Move GCS specific constants out of fileio

2016-12-27 Thread Chamikara Jayalath (JIRA) 
Chamikara Jayalath created BEAM-1222:


 Summary: Move GCS specific constants out of fileio
 Key: BEAM-1222
 URL: https://issues.apache.org/jira/browse/BEAM-1222
 Project: Beam
  Issue Type: Bug
  Components: sdk-py
Reporter: Chamikara Jayalath


Currently fileio.py has GCS specific constant gcsio.MAX_BATCH_OPERATION_SIZE 
which should be moved out of it. This will be needed to implement 
IOChannelFactory proposal [1] for Python SDK.

[1] 
https://docs.google.com/document/d/11TdPyZ9_zmjokhNWM3Id-XJsVG3qel2lhdKTknmZ_7M/edit#heading=h.kpqagzh8i11w



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Gearpump #157

2016-12-27 Thread Apache Jenkins Server 
See 


--
[...truncated 29643 lines...]
  PAssertTest.testWindowedSerializablePredicate:169 » Runtime Failed to 
construc...
  ApproximateUniqueTest.testApproximateUniqueWithSmallInput:70 » Runtime Failed 
...
  CombineFnsTest.testComposedCombine:126 » Runtime Failed to construct instance 
...
  CombineFnsTest.testComposedCombineNullValues:243 » Runtime Failed to 
construct...
  CombineFnsTest.testComposedCombineWithContext:181 » Runtime Failed to 
construc...
  CombineTest.testAccumulatingCombine:477->runTestAccumulatingCombine:236 » 
Runtime
  CombineTest.testAccumulatingCombineEmpty:483->runTestAccumulatingCombine:236 
» Runtime
  CombineTest.testBasicCombine:221->runTestBasicCombine:200 » Runtime Failed to 
...
  CombineTest.testBasicCombineEmpty:229->runTestBasicCombine:200 » Runtime 
Faile...
  CombineTest.testCombineGloballyAsSingletonView:635 » Runtime Failed to 
constru...
  CombineTest.testCombinePerKeyPrimitiveDisplayData:712 » Runtime Failed to 
cons...
  CombineTest.testCombinePerKeyWithHotKeyFanoutPrimitiveDisplayData:729 » 
Runtime
  CombineTest.testFixedWindowsCombine:256 » Runtime Failed to construct 
instance...
  CombineTest.testFixedWindowsCombineWithContext:282 » Runtime Failed to 
constru...
  CombineTest.testGlobalCombineWithDefaultsAndTriggers:368 » Runtime Failed to 
c...
  CombineTest.testHotKeyCombining:520 » Runtime Failed to construct instance 
fro...
  CombineTest.testHotKeyCombiningWithAccumulationMode:555 » Runtime Failed to 
co...
  CombineTest.testSessionsCombine:395 » Runtime Failed to construct instance 
fro...
  CombineTest.testSessionsCombineWithContext:420 » Runtime Failed to construct 
i...
  CombineTest.testSimpleCombine:171->runTestSimpleCombine:120 » Runtime Failed 
t...
  CombineTest.testSimpleCombineEmpty:193->runTestSimpleCombine:120 » Runtime 
Fai...
  
CombineTest.testSimpleCombineWithContext:178->runTestSimpleCombineWithContext:141
 » Runtime
  
CombineTest.testSimpleCombineWithContextEmpty:186->runTestSimpleCombineWithContext:141
 » Runtime
  CombineTest.testSlidingWindowsCombineWithContext:319 » Runtime Failed to 
const...
  CombineTest.testWindowedCombineEmpty:462 » Runtime Failed to construct 
instanc...
  CountTest.testCountGloballyBasic:88 » Runtime Failed to construct instance 
fro...
  CountTest.testCountGloballyEmpty:103 » Runtime Failed to construct instance 
fr...
  CountTest.testCountPerElementBasic:52 » Runtime Failed to construct instance 
f...
  CountTest.testCountPerElementEmpty:74 » Runtime Failed to construct instance 
f...
  CreateTest.testCreate:83 » Runtime Failed to construct instance from factory 
m...
  CreateTest.testCreateEmpty:96 » Runtime Failed to construct instance from 
fact...
  CreateTest.testCreateTimestamped:238 » Runtime Failed to construct instance 
fr...
  CreateTest.testCreateTimestampedEmpty:257 » Runtime Failed to construct 
instan...
  CreateTest.testCreateWithKVVoidType:307 » Runtime Failed to construct 
instance...
  CreateTest.testCreateWithNullsAndValues:140 » Runtime Failed to construct 
inst...
  CreateTest.testCreateWithUnserializableElements:219 » Runtime Failed to 
constr...
  CreateTest.testCreateWithVoidType:298 » Runtime Failed to construct instance 
f...
  DistinctTest.testDistinct:56 » Runtime Failed to construct instance from 
facto...
  DistinctTest.testDistinctEmpty:75 » Runtime Failed to construct instance from 
...
  DistinctTest.testDistinctWithRepresentativeValue:118 » Runtime Failed to 
const...
  FilterTest.testFilterByPredicate:89 » Runtime Failed to construct instance 
fro...
  FilterTest.testFilterGreaterThan:115 » Runtime Failed to construct instance 
fr...
  FilterTest.testFilterGreaterThanEq:141 » Runtime Failed to construct instance 
...
  FilterTest.testFilterLessThan:102 » Runtime Failed to construct instance from 
...
  FilterTest.testFilterLessThanEq:128 » Runtime Failed to construct instance 
fro...
  FilterTest.testIdentityFilterByPredicate:63 » Runtime Failed to construct 
inst...
  FilterTest.testNoFilterByPredicate:76 » Runtime Failed to construct instance 
f...
  FlattenTest.testEmptyFlattenAsSideInput:157 » Runtime Failed to construct 
inst...
  FlattenTest.testFlattenInputMultipleCopies:123 » Runtime Failed to construct 
i...
  FlattenTest.testFlattenIterables:214 » Runtime Failed to construct instance 
fr...
  FlattenTest.testFlattenIterablesCollections:265 » Runtime Failed to construct 
...
  FlattenTest.testFlattenIterablesEmpty:283 » Runtime Failed to construct 
instan...
  FlattenTest.testFlattenIterablesLists:232 » Runtime Failed to construct 
instan...
  FlattenTest.testFlattenIterablesSets:247 » Runtime Failed to construct 
instanc...
  FlattenTest.testFlattenPCollectionList:77 » Runtime Failed to construct 
instan...
  FlattenTest.testFlattenPCollectionListEmpty:110 » Runtime Failed to construct 
...
  FlattenTest.testFlattenPCollectionListEmpty

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Gearpump #157

2016-12-27 Thread Apache Jenkins Server 
See 


--
[...truncated 29644 lines...]
  ApproximateUniqueTest.testApproximateUniqueWithSmallInput:70 » Runtime Failed 
...
  CombineFnsTest.testComposedCombine:126 » Runtime Failed to construct instance 
...
  CombineFnsTest.testComposedCombineNullValues:243 » Runtime Failed to 
construct...
  CombineFnsTest.testComposedCombineWithContext:181 » Runtime Failed to 
construc...
  CombineTest.testAccumulatingCombine:477->runTestAccumulatingCombine:236 » 
Runtime
  CombineTest.testAccumulatingCombineEmpty:483->runTestAccumulatingCombine:236 
» Runtime
  CombineTest.testBasicCombine:221->runTestBasicCombine:200 » Runtime Failed to 
...
  CombineTest.testBasicCombineEmpty:229->runTestBasicCombine:200 » Runtime 
Faile...
  CombineTest.testCombineGloballyAsSingletonView:635 » Runtime Failed to 
constru...
  CombineTest.testCombinePerKeyPrimitiveDisplayData:712 » Runtime Failed to 
cons...
  CombineTest.testCombinePerKeyWithHotKeyFanoutPrimitiveDisplayData:729 » 
Runtime
  CombineTest.testFixedWindowsCombine:256 » Runtime Failed to construct 
instance...
  CombineTest.testFixedWindowsCombineWithContext:282 » Runtime Failed to 
constru...
  CombineTest.testGlobalCombineWithDefaultsAndTriggers:368 » Runtime Failed to 
c...
  CombineTest.testHotKeyCombining:520 » Runtime Failed to construct instance 
fro...
  CombineTest.testHotKeyCombiningWithAccumulationMode:555 » Runtime Failed to 
co...
  CombineTest.testSessionsCombine:395 » Runtime Failed to construct instance 
fro...
  CombineTest.testSessionsCombineWithContext:420 » Runtime Failed to construct 
i...
  CombineTest.testSimpleCombine:171->runTestSimpleCombine:120 » Runtime Failed 
t...
  CombineTest.testSimpleCombineEmpty:193->runTestSimpleCombine:120 » Runtime 
Fai...
  
CombineTest.testSimpleCombineWithContext:178->runTestSimpleCombineWithContext:141
 » Runtime
  
CombineTest.testSimpleCombineWithContextEmpty:186->runTestSimpleCombineWithContext:141
 » Runtime
  CombineTest.testSlidingWindowsCombineWithContext:319 » Runtime Failed to 
const...
  CombineTest.testWindowedCombineEmpty:462 » Runtime Failed to construct 
instanc...
  CountTest.testCountGloballyBasic:88 » Runtime Failed to construct instance 
fro...
  CountTest.testCountGloballyEmpty:103 » Runtime Failed to construct instance 
fr...
  CountTest.testCountPerElementBasic:52 » Runtime Failed to construct instance 
f...
  CountTest.testCountPerElementEmpty:74 » Runtime Failed to construct instance 
f...
  CreateTest.testCreate:83 » Runtime Failed to construct instance from factory 
m...
  CreateTest.testCreateEmpty:96 » Runtime Failed to construct instance from 
fact...
  CreateTest.testCreateTimestamped:238 » Runtime Failed to construct instance 
fr...
  CreateTest.testCreateTimestampedEmpty:257 » Runtime Failed to construct 
instan...
  CreateTest.testCreateWithKVVoidType:307 » Runtime Failed to construct 
instance...
  CreateTest.testCreateWithNullsAndValues:140 » Runtime Failed to construct 
inst...
  CreateTest.testCreateWithUnserializableElements:219 » Runtime Failed to 
constr...
  CreateTest.testCreateWithVoidType:298 » Runtime Failed to construct instance 
f...
  DistinctTest.testDistinct:56 » Runtime Failed to construct instance from 
facto...
  DistinctTest.testDistinctEmpty:75 » Runtime Failed to construct instance from 
...
  DistinctTest.testDistinctWithRepresentativeValue:118 » Runtime Failed to 
const...
  FilterTest.testFilterByPredicate:89 » Runtime Failed to construct instance 
fro...
  FilterTest.testFilterGreaterThan:115 » Runtime Failed to construct instance 
fr...
  FilterTest.testFilterGreaterThanEq:141 » Runtime Failed to construct instance 
...
  FilterTest.testFilterLessThan:102 » Runtime Failed to construct instance from 
...
  FilterTest.testFilterLessThanEq:128 » Runtime Failed to construct instance 
fro...
  FilterTest.testIdentityFilterByPredicate:63 » Runtime Failed to construct 
inst...
  FilterTest.testNoFilterByPredicate:76 » Runtime Failed to construct instance 
f...
  FlattenTest.testEmptyFlattenAsSideInput:157 » Runtime Failed to construct 
inst...
  FlattenTest.testFlattenInputMultipleCopies:123 » Runtime Failed to construct 
i...
  FlattenTest.testFlattenIterables:214 » Runtime Failed to construct instance 
fr...
  FlattenTest.testFlattenIterablesCollections:265 » Runtime Failed to construct 
...
  FlattenTest.testFlattenIterablesEmpty:283 » Runtime Failed to construct 
instan...
  FlattenTest.testFlattenIterablesLists:232 » Runtime Failed to construct 
instan...
  FlattenTest.testFlattenIterablesSets:247 » Runtime Failed to construct 
instanc...
  FlattenTest.testFlattenPCollectionList:77 » Runtime Failed to construct 
instan...
  FlattenTest.testFlattenPCollectionListEmpty:110 » Runtime Failed to construct 
...
  FlattenTest.testFlattenPCollectionListEmptyThenParDo:183 » Runtime Failed to 
c...
  FlattenTest.testFlattenPCollectionListThenP

[jira] [Commented] (BEAM-1220) Graduation items

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781674#comment-15781674
 ] 

ASF GitHub Bot commented on BEAM-1220:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1701


> Graduation items
> 
>
> Key: BEAM-1220
> URL: https://issues.apache.org/jira/browse/BEAM-1220
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Davor Bonaci
>Assignee: Davor Bonaci
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[5/9] beam git commit: Update top-level pom.xml to remove incubation references

2016-12-27 Thread davor 
Update top-level pom.xml to remove incubation references


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b0d863e5
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b0d863e5
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b0d863e5

Branch: refs/heads/master
Commit: b0d863e52237f54fb5df2ab208735a74c87ceb31
Parents: 6b3c2f6
Author: Davor Bonaci 
Authored: Tue Dec 27 13:14:01 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:45:48 2016 -0800

--
 pom.xml | 37 ++---
 1 file changed, 18 insertions(+), 19 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/b0d863e5/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 6172527..3e4f5e9 100644
--- a/pom.xml
+++ b/pom.xml
@@ -31,7 +31,7 @@
   Apache Beam provides a simple, Java-based interface
   for processing virtually any size data. This artifact includes the parent POM
   for other Beam artifacts.
-  http://beam.incubator.apache.org
+  http://beam.apache.org/
   2016
 
   0.5.0-SNAPSHOT
@@ -45,10 +45,9 @@
   
 
   
-
scm:git:https://git-wip-us.apache.org/repos/asf/incubator-beam.git
-
scm:git:https://git-wip-us.apache.org/repos/asf/incubator-beam.git
-
https://git-wip-us.apache.org/repos/asf?p=incubator-beam.git;a=summary
-release-0.2.0-incubating
+
scm:git:https://git-wip-us.apache.org/repos/asf/beam.git
+
scm:git:https://git-wip-us.apache.org/repos/asf/beam.git
+https://git-wip-us.apache.org/repos/asf?p=beam.git;a=summary
   
 
   
@@ -59,32 +58,32 @@
   
 
   Beam Dev
-  dev-subscr...@beam.incubator.apache.org
-  dev-unsubscr...@beam.incubator.apache.org
-  d...@beam.incubator.apache.org
-  
http://www.mail-archive.com/dev%beam.incubator.apache.org
+  dev-subscr...@beam.apache.org
+  dev-unsubscr...@beam.apache.org
+  d...@beam.apache.org
+  http://www.mail-archive.com/dev%beam.apache.org
 
 
   Beam User
-  user-subscr...@beam.incubator.apache.org
-  user-unsubscr...@beam.incubator.apache.org
-  u...@beam.incubator.apache.org
-  
http://www.mail-archive.com/user%beam.incubator.apache.org
+  user-subscr...@beam.apache.org
+  user-unsubscr...@beam.apache.org
+  u...@beam.apache.org
+  http://www.mail-archive.com/user%beam.apache.org
 
 
   Beam Commits
-  commits-subscr...@beam.incubator.apache.org
-  commits-unsubscr...@beam.incubator.apache.org
-  comm...@beam.incubator.apache.org
-  
http://www.mail-archive.com/commits%beam.incubator.apache.org
+  commits-subscr...@beam.apache.org
+  commits-unsubscr...@beam.apache.org
+  commits@beam.apache.org
+  http://www.mail-archive.com/commits%beam.apache.org
 
   
 
   
 
   The Apache Beam Team
-  d...@beam.incubator.apache.org
-  http://beam.incubator.apache.org
+  d...@beam.apache.org
+  http://beam.apache.org
   Apache Software Foundation
   http://www.apache.org

[2/9] beam git commit: Update top-level NOTICE and remove incubating disclaimer

2016-12-27 Thread davor 
Update top-level NOTICE and remove incubating disclaimer


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/260bc49a
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/260bc49a
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/260bc49a

Branch: refs/heads/master
Commit: 260bc49afb28a62637a150aa3a73d2294017940a
Parents: a3c814d
Author: Davor Bonaci 
Authored: Tue Dec 27 13:00:09 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:21:49 2016 -0800

--
 DISCLAIMER | 10 --
 NOTICE |  2 +-
 2 files changed, 1 insertion(+), 11 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/260bc49a/DISCLAIMER
--
diff --git a/DISCLAIMER b/DISCLAIMER
deleted file mode 100644
index f8568f6..000
--- a/DISCLAIMER
+++ /dev/null
@@ -1,10 +0,0 @@
-Apache Beam is an effort undergoing incubation at the Apache Software
-Foundation (ASF), sponsored by the Apache Incubator PMC.
-
-Incubation is required of all newly accepted projects until a further review
-indicates that the infrastructure, communications, and decision making process
-have stabilized in a manner consistent with other successful ASF projects.
-
-While incubation status is not necessarily a reflection of the completeness
-or stability of the code, it does indicate that the project has yet to be
-fully endorsed by the ASF.

http://git-wip-us.apache.org/repos/asf/beam/blob/260bc49a/NOTICE
--
diff --git a/NOTICE b/NOTICE
index bd3400c..9b35cd4 100644
--- a/NOTICE
+++ b/NOTICE
@@ -1,4 +1,4 @@
-Apache Beam (incubating)
+Apache Beam
 Copyright 2016 The Apache Software Foundation
 
 This product includes software developed at

[7/9] beam git commit: Remove incubation references from core SDK and archetypes

2016-12-27 Thread davor 
Remove incubation references from core SDK and archetypes


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3b304fcf
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3b304fcf
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3b304fcf

Branch: refs/heads/master
Commit: 3b304fcfa7fef110f0a4ff861901fccd9166f309
Parents: 8cfea76
Author: Davor Bonaci 
Authored: Tue Dec 27 13:20:30 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:45:49 2016 -0800

--
 .../main/java/org/apache/beam/sdk/util/state/StateContexts.java  | 4 ++--
 .../starter/src/main/resources/archetype-resources/pom.xml   | 2 +-
 .../starter/src/test/resources/projects/basic/reference/pom.xml  | 2 +-
 3 files changed, 4 insertions(+), 4 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/3b304fcf/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateContexts.java
--
diff --git 
a/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateContexts.java
 
b/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateContexts.java
index 1d6e949..a9ce0b5 100644
--- 
a/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateContexts.java
+++ 
b/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateContexts.java
@@ -54,7 +54,7 @@ public class StateContexts {
   /**
* @deprecated This exists only for temporary compatibility with Dataflow 
worker and should be
* deleted once a worker image is released that uses runners-core build 
after
-   * https://github.com/apache/incubator-beam/pull/1353.
+   * https://github.com/apache/beam/pull/1353.
*/
   @Deprecated
   public static  StateContext windowOnly(final W 
window) {
@@ -80,7 +80,7 @@ public class StateContexts {
   /**
* @deprecated This exists only for temporary compatibility with Dataflow 
worker and should be
* deleted once a worker image is released that uses runners-core build 
after
-   * https://github.com/apache/incubator-beam/pull/1353.
+   * https://github.com/apache/beam/pull/1353.
*/
   @Deprecated
   public static  StateContext createFromComponents(

http://git-wip-us.apache.org/repos/asf/beam/blob/3b304fcf/sdks/java/maven-archetypes/starter/src/main/resources/archetype-resources/pom.xml
--
diff --git 
a/sdks/java/maven-archetypes/starter/src/main/resources/archetype-resources/pom.xml
 
b/sdks/java/maven-archetypes/starter/src/main/resources/archetype-resources/pom.xml
index 4a6e89d..e7f1185 100644
--- 
a/sdks/java/maven-archetypes/starter/src/main/resources/archetype-resources/pom.xml
+++ 
b/sdks/java/maven-archetypes/starter/src/main/resources/archetype-resources/pom.xml
@@ -81,7 +81,7 @@
   to enable development and testing of pipelines. To run on another of the
   Beam runners, add its module to this pom.xml according to the
   runner-specific setup instructions on the Beam website:
-http://beam.incubator.apache.org/documentation/#runners
+http://beam.apache.org/documentation/#runners
 -->
 
   org.apache.beam

http://git-wip-us.apache.org/repos/asf/beam/blob/3b304fcf/sdks/java/maven-archetypes/starter/src/test/resources/projects/basic/reference/pom.xml
--
diff --git 
a/sdks/java/maven-archetypes/starter/src/test/resources/projects/basic/reference/pom.xml
 
b/sdks/java/maven-archetypes/starter/src/test/resources/projects/basic/reference/pom.xml
index 97f9e72..871d194 100644
--- 
a/sdks/java/maven-archetypes/starter/src/test/resources/projects/basic/reference/pom.xml
+++ 
b/sdks/java/maven-archetypes/starter/src/test/resources/projects/basic/reference/pom.xml
@@ -81,7 +81,7 @@
   to enable development and testing of pipelines. To run on another of the
   Beam runners, add its module to this pom.xml according to the
   runner-specific setup instructions on the Beam website:
-http://beam.incubator.apache.org/documentation/#runners
+http://beam.apache.org/documentation/#runners
 -->
 
   org.apache.beam

[4/9] beam git commit: Update README to remove incubation information

2016-12-27 Thread davor 
Update README to remove incubation information


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/88e749e5
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/88e749e5
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/88e749e5

Branch: refs/heads/master
Commit: 88e749e55a04e7f0965bb3bf6fe3f327315dfbc2
Parents: 260bc49
Author: Davor Bonaci 
Authored: Tue Dec 27 13:03:53 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:45:48 2016 -0800

--
 README.md | 46 +-
 1 file changed, 13 insertions(+), 33 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/88e749e5/README.md
--
diff --git a/README.md b/README.md
index d919e5b..f7492e4 100644
--- a/README.md
+++ b/README.md
@@ -17,30 +17,15 @@
 under the License.
 -->
 
-# Apache Beam (incubating)
+# Apache Beam
 
-[Apache Beam](http://beam.incubator.apache.org) is a unified model for 
defining both batch and streaming data-parallel processing pipelines, as well 
as a set of language-specific SDKs for constructing pipelines and Runners for 
executing them on distributed processing backends like [Apache 
Spark](http://spark.apache.org/), [Apache Flink](http://flink.apache.org), and 
[Google Cloud Dataflow](http://cloud.google.com/dataflow).
-
-```
-Apache Beam is an effort undergoing incubation at the Apache Software
-Foundation (ASF), sponsored by the Apache Incubator PMC.
-
-Incubation is required of all newly accepted projects until a further review
-indicates that the infrastructure, communications, and decision making process
-have stabilized in a manner consistent with other successful ASF projects.
-
-While incubation status is not necessarily a reflection of the completeness
-or stability of the code, it does indicate that the project has yet to be
-fully endorsed by the ASF.
-```
+[Apache Beam](http://beam.apache.org/) is a unified model for defining both 
batch and streaming data-parallel processing pipelines, as well as a set of 
language-specific SDKs for constructing pipelines and Runners for executing 
them on distributed processing backends, including [Apache 
Apex](http://apex.apache.org/), [Apache Flink](http://flink.apache.org/), 
[Apache Spark](http://spark.apache.org/), and [Google Cloud 
Dataflow](http://cloud.google.com/dataflow/).
 
 ## Status
 
-_**The Apache Beam project is in the process of bootstrapping. This includes 
the creation of project resources, the refactoring of the initial code 
submissions, and the formulation of project documentation, planning, and design 
documents. Please expect a significant amount of churn and breaking changes in 
the near future.**_
-
-[![Build 
Status](https://api.travis-ci.org/apache/incubator-beam.svg?branch=master)](https://travis-ci.org/apache/incubator-beam?branch=master)
+[![Build 
Status](https://api.travis-ci.org/apache/beam.svg?branch=master)](https://travis-ci.org/apache/beam?branch=master)
 [![Build 
Status](https://builds.apache.org/buildStatus/icon?job=beam_PostCommit_Java_MavenInstall)](https://builds.apache.org/job/beam_PostCommit_MavenVerify/)
-[![Coverage 
Status](https://coveralls.io/repos/github/apache/incubator-beam/badge.svg?branch=master)](https://coveralls.io/github/apache/incubator-beam?branch=master)
+[![Coverage 
Status](https://coveralls.io/repos/github/apache/beam/badge.svg?branch=master)](https://coveralls.io/github/apache/beam?branch=master)
 
 ## Overview
 
@@ -50,7 +35,6 @@ Beam provides a general approach to expressing 
[embarrassingly parallel](https:/
 2. _SDK Writers_: Developing a Beam SDK targeted at a specific user community 
(Java, Python, Scala, Go, R, graphical, etc). These users are language geeks, 
and  would prefer to be shielded from all the details of various runners and 
their implementations.
 3. _Runner Writers_: Have an execution environment for distributed processing 
and would like to support programs written against the Beam Model. Would prefer 
to be shielded from details of multiple SDKs.
 
-
 ### The Beam Model
 
 The model behind Beam evolved from a number of internal Google data processing 
projects, including 
[MapReduce](http://research.google.com/archive/mapreduce.html), 
[FlumeJava](http://research.google.com/pubs/pub35650.html), and 
[Millwheel](http://research.google.com/pubs/pub41378.html). This model was 
originally known as the “[Dataflow 
Model](http://www.vldb.org/pvldb/vol8/p1792-Akidau.pdf)”.
@@ -64,16 +48,14 @@ The key concepts in the Beam programming model are:
 * `Pipeline`: manages a directed acyclic graph of PTransforms and PCollections 
that is ready for execution.
 * `PipelineRunner`: specifies where and how the pipeline should execute.
 
-
 ### SDKs
 
 Beam supports multiple la

[GitHub] beam pull request #1701: [BEAM-1220] Remove incubation references (master br...

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1701


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[8/9] beam git commit: Update Jenkins and Travis to remove incubation references

2016-12-27 Thread davor 
Update Jenkins and Travis to remove incubation references


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5ba42cb2
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5ba42cb2
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5ba42cb2

Branch: refs/heads/master
Commit: 5ba42cb251f3aef323d69a1ea42f0f1417893c5e
Parents: 3b304fc
Author: Davor Bonaci 
Authored: Tue Dec 27 13:47:55 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:47:55 2016 -0800

--
 .jenkins/common_job_properties.groovy| 6 +++---
 .jenkins/job_beam_Release_NightlySnapshot.groovy | 2 +-
 .jenkins/job_seed.groovy | 2 +-
 .travis/README.md| 2 +-
 4 files changed, 6 insertions(+), 6 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/5ba42cb2/.jenkins/common_job_properties.groovy
--
diff --git a/.jenkins/common_job_properties.groovy 
b/.jenkins/common_job_properties.groovy
index e1688ec..2798af0 100644
--- a/.jenkins/common_job_properties.groovy
+++ b/.jenkins/common_job_properties.groovy
@@ -27,7 +27,7 @@ class common_job_properties {
 
 // GitHub project.
 context.properties {
-  githubProjectUrl('https://github.com/apache/incubator-beam/')
+  githubProjectUrl('https://github.com/apache/beam/')
 }
 
 // Set JDK version.
@@ -46,7 +46,7 @@ class common_job_properties {
 context.scm {
   git {
 remote {
-  url('https://github.com/apache/incubator-beam.git')
+  url('https://github.com/apache/beam.git')
   refspec('+refs/heads/*:refs/remotes/origin/* ' +
   '+refs/pull/*:refs/remotes/origin/pr/*')
 }
@@ -156,7 +156,7 @@ class common_job_properties {
   static def setPostCommit(def context,
def build_schedule = '0 */6 * * *',
def scm_schedule = '* * * * *',
-   def notify_address = 
'comm...@beam.incubator.apache.org') {
+   def notify_address = 'commits@beam.apache.org') {
 // Set build triggers
 context.triggers {
   // By default runs every 6 hours.

http://git-wip-us.apache.org/repos/asf/beam/blob/5ba42cb2/.jenkins/job_beam_Release_NightlySnapshot.groovy
--
diff --git a/.jenkins/job_beam_Release_NightlySnapshot.groovy 
b/.jenkins/job_beam_Release_NightlySnapshot.groovy
index 496a0c5..533b444 100644
--- a/.jenkins/job_beam_Release_NightlySnapshot.groovy
+++ b/.jenkins/job_beam_Release_NightlySnapshot.groovy
@@ -39,7 +39,7 @@ mavenJob('beam_Release_NightlySnapshot') {
   delegate,
   '0 7 * * *',
   '0 5 31 2 *',
-  'd...@beam.incubator.apache.org')
+  'd...@beam.apache.org')
 
   // Maven goals for this job.
   goals('-B -e clean deploy -P release,dataflow-runner -DskipITs=false 
-DintegrationTestPipelineOptions=\'[ "--project=apache-beam-testing", 
"--tempRoot=gs://temp-storage-for-end-to-end-tests", 
"--runner=org.apache.beam.runners.dataflow.testing.TestDataflowRunner" ]\'')

http://git-wip-us.apache.org/repos/asf/beam/blob/5ba42cb2/.jenkins/job_seed.groovy
--
diff --git a/.jenkins/job_seed.groovy b/.jenkins/job_seed.groovy
index e46e5a4..96277d1 100644
--- a/.jenkins/job_seed.groovy
+++ b/.jenkins/job_seed.groovy
@@ -33,7 +33,7 @@ job('beam_SeedJob_Main') {
   delegate,
   '0 6 * * *',
   '0 5 31 2 *',
-  'd...@beam.incubator.apache.org')
+  'd...@beam.apache.org')
 
   steps {
 dsl {

http://git-wip-us.apache.org/repos/asf/beam/blob/5ba42cb2/.travis/README.md
--
diff --git a/.travis/README.md b/.travis/README.md
index 536692d..526995a 100644
--- a/.travis/README.md
+++ b/.travis/README.md
@@ -19,5 +19,5 @@
 
 # Travis Scripts
 
-This directory contains scripts used for [Travis 
CI](https://travis-ci.org/apache/incubator-beam/)
+This directory contains scripts used for [Travis 
CI](https://travis-ci.org/apache/beam/)
 testing.

[3/9] beam git commit: Remove incubating references from examples

2016-12-27 Thread davor 
Remove incubating references from examples


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6b3c2f6a
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6b3c2f6a
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6b3c2f6a

Branch: refs/heads/master
Commit: 6b3c2f6a1e85734d85871196409f956c67ecff80
Parents: 88e749e
Author: Davor Bonaci 
Authored: Tue Dec 27 13:11:41 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:45:48 2016 -0800

--
 examples/java/README.md | 16 
 .../java/org/apache/beam/examples/WordCount.java|  4 ++--
 .../org/apache/beam/examples/complete/README.md | 14 +++---
 .../org/apache/beam/examples/cookbook/README.md | 14 +++---
 .../beam/examples/cookbook/TriggerExample.java  |  4 ++--
 5 files changed, 26 insertions(+), 26 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/6b3c2f6a/examples/java/README.md
--
diff --git a/examples/java/README.md b/examples/java/README.md
index 2b5edf5..b58153e 100644
--- a/examples/java/README.md
+++ b/examples/java/README.md
@@ -26,21 +26,21 @@ the development of more complex pipelines.
 ## Word Count
 
 A good starting point for new users is our set of
-[word 
count](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples)
 examples, which computes word frequencies.  This series of four successively 
more detailed pipelines is described in detail in the accompanying 
[walkthrough](https://cloud.google.com/dataflow/examples/wordcount-example).
+[word 
count](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples)
 examples, which computes word frequencies.  This series of four successively 
more detailed pipelines is described in detail in the accompanying 
[walkthrough](https://cloud.google.com/dataflow/examples/wordcount-example).
 
-1. 
[`MinimalWordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java)
 is the simplest word count pipeline and introduces basic concepts like 
[Pipelines](https://cloud.google.com/dataflow/model/pipelines),
+1. 
[`MinimalWordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java)
 is the simplest word count pipeline and introduces basic concepts like 
[Pipelines](https://cloud.google.com/dataflow/model/pipelines),
 [PCollections](https://cloud.google.com/dataflow/model/pcollection),
 [ParDo](https://cloud.google.com/dataflow/model/par-do),
 and [reading and writing 
data](https://cloud.google.com/dataflow/model/reading-and-writing-data) from 
external storage.
 
-1. 
[`WordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WordCount.java)
 introduces Dataflow best practices like 
[PipelineOptions](https://cloud.google.com/dataflow/pipelines/constructing-your-pipeline#Creating)
 and custom 
[PTransforms](https://cloud.google.com/dataflow/model/composite-transforms).
+1. 
[`WordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WordCount.java)
 introduces Dataflow best practices like 
[PipelineOptions](https://cloud.google.com/dataflow/pipelines/constructing-your-pipeline#Creating)
 and custom 
[PTransforms](https://cloud.google.com/dataflow/model/composite-transforms).
 
-1. 
[`DebuggingWordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/DebuggingWordCount.java)
+1. 
[`DebuggingWordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/DebuggingWordCount.java)
 shows how to view live aggregators in the [Dataflow Monitoring 
Interface](https://cloud.google.com/dataflow/pipelines/dataflow-monitoring-intf),
 get the most out of
 [Cloud Logging](https://cloud.google.com/dataflow/pipelines/logging) 
integration, and start writing
 [good 
tests](https://cloud.google.com/dataflow/pipelines/testing-your-pipeline).
 
-1. 
[`WindowedWordCount`](https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WindowedWordCount.java)
 shows how to run the same pipeline over either unbounded PCollections in 
streaming mode or bounded PCollections in batch mode.
+1. 
[`WindowedWordCount`](https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WindowedWordCount.java)
 shows how to run the same pipeline over either unbounded PCollections in 
streaming mode or bounded PCollections in batch mode.
 
 ## Building and Runni

[1/9] beam git commit: Remove "-incubating" from version identification

2016-12-27 Thread davor 
Repository: beam
Updated Branches:
  refs/heads/master ccb8b82c8 -> 339ae7df2


Remove "-incubating" from version identification

This reverts commit 25215889381f7da61766054af68c84ffed4c0c71.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a3c814dd
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a3c814dd
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a3c814dd

Branch: refs/heads/master
Commit: a3c814dd61212efe2daac8a8d810e65dfdd9a3dc
Parents: ccb8b82
Author: Davor Bonaci 
Authored: Tue Dec 27 12:59:15 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:05:51 2016 -0800

--
 examples/java/pom.xml| 2 +-
 examples/java8/pom.xml   | 2 +-
 examples/pom.xml | 2 +-
 pom.xml  | 2 +-
 runners/apex/pom.xml | 2 +-
 runners/core-java/pom.xml| 2 +-
 runners/direct-java/pom.xml  | 2 +-
 runners/flink/examples/pom.xml   | 2 +-
 runners/flink/pom.xml| 2 +-
 runners/flink/runner/pom.xml | 2 +-
 runners/google-cloud-dataflow-java/pom.xml   | 2 +-
 runners/pom.xml  | 2 +-
 runners/spark/pom.xml| 2 +-
 sdks/java/build-tools/pom.xml| 2 +-
 sdks/java/core/pom.xml   | 2 +-
 sdks/java/extensions/join-library/pom.xml| 2 +-
 sdks/java/extensions/pom.xml | 2 +-
 sdks/java/extensions/sorter/pom.xml  | 2 +-
 sdks/java/io/google-cloud-platform/pom.xml   | 2 +-
 sdks/java/io/hdfs/pom.xml| 2 +-
 sdks/java/io/jdbc/pom.xml| 2 +-
 sdks/java/io/jms/pom.xml | 2 +-
 sdks/java/io/kafka/pom.xml   | 2 +-
 sdks/java/io/kinesis/pom.xml | 2 +-
 sdks/java/io/mongodb/pom.xml | 2 +-
 sdks/java/io/mqtt/pom.xml| 4 ++--
 sdks/java/io/pom.xml | 2 +-
 sdks/java/java8tests/pom.xml | 2 +-
 sdks/java/maven-archetypes/examples-java8/pom.xml| 2 +-
 .../src/main/resources/archetype-resources/pom.xml   | 2 +-
 sdks/java/maven-archetypes/examples/pom.xml  | 2 +-
 .../examples/src/main/resources/archetype-resources/pom.xml  | 2 +-
 sdks/java/maven-archetypes/pom.xml   | 2 +-
 sdks/java/maven-archetypes/starter/pom.xml   | 2 +-
 .../starter/src/main/resources/archetype-resources/pom.xml   | 2 +-
 .../starter/src/test/resources/projects/basic/reference/pom.xml  | 2 +-
 sdks/java/pom.xml| 2 +-
 sdks/pom.xml | 2 +-
 38 files changed, 39 insertions(+), 39 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/a3c814dd/examples/java/pom.xml
--
diff --git a/examples/java/pom.xml b/examples/java/pom.xml
index f166a7f..d7910bb 100644
--- a/examples/java/pom.xml
+++ b/examples/java/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-examples-parent
-0.5.0-incubating-SNAPSHOT
+0.5.0-SNAPSHOT
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/a3c814dd/examples/java8/pom.xml
--
diff --git a/examples/java8/pom.xml b/examples/java8/pom.xml
index 1abf6fd..370d79f 100644
--- a/examples/java8/pom.xml
+++ b/examples/java8/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-examples-parent
-0.5.0-incubating-SNAPSHOT
+0.5.0-SNAPSHOT
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/a3c814dd/examples/pom.xml
--
diff --git a/examples/pom.xml b/examples/pom.xml
index 3e0fbdd..adfbaa9 100644
--- a/examples/pom.xml
+++ b/examples/pom.xml
@@ -22,7 +22,7 @@
   
 org.apache.beam
 beam-parent
-0.5.0-incubating-SNAPSHOT
+0.5.0-SNAPSHOT
 ../pom.xml
   
 

http://git-wip-us.apache.org/repos/asf/beam/blob/a3c814dd/pom.xml

[6/9] beam git commit: Update component READMEs to remove graduation information

2016-12-27 Thread davor 
Update component READMEs to remove graduation information


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8cfea766
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8cfea766
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8cfea766

Branch: refs/heads/master
Commit: 8cfea766dfca84fe9ce647e521be485bb92022a9
Parents: b0d863e
Author: Davor Bonaci 
Authored: Tue Dec 27 13:17:22 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 13:45:49 2016 -0800

--
 runners/apex/README.md  |  4 ++--
 runners/flink/README.md |  6 +++---
 runners/spark/README.md |  8 
 sdks/java/extensions/join-library/README.md | 10 --
 4 files changed, 9 insertions(+), 19 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/8cfea766/runners/apex/README.md
--
diff --git a/runners/apex/README.md b/runners/apex/README.md
index 7aa433e..9a82731 100644
--- a/runners/apex/README.md
+++ b/runners/apex/README.md
@@ -37,13 +37,13 @@ The following shows how to run the WordCount example that 
is provided with the s
 To get the latest version of Beam with Apex-Runner, first clone the Beam 
repository:
 
 ```
-git clone https://github.com/apache/incubator‐beam
+git clone https://github.com/apache/beam
 ```
 
 Then switch to the newly created directory and run Maven to build the Apache 
Beam:
 
 ```
-cd incubator‐beam
+cd beam
 mvn clean install ‐DskipTests
 ```
 

http://git-wip-us.apache.org/repos/asf/beam/blob/8cfea766/runners/flink/README.md
--
diff --git a/runners/flink/README.md b/runners/flink/README.md
index c0b3830..ceb44ea 100644
--- a/runners/flink/README.md
+++ b/runners/flink/README.md
@@ -94,11 +94,11 @@ To get started using the Flink Runner, we first need to 
install the latest versi
 
 To retrieve the latest version of Flink-Runner, run the following command
 
-git clone https://github.com/apache/incubator-beam
+git clone https://github.com/apache/beam
 
 Then switch to the newly created directory and run Maven to build the Beam 
runner:
 
-cd incubator-beam
+cd beam
 mvn clean install -DskipTests
 
 Flink-Runner is now installed in your local maven repository.
@@ -169,7 +169,7 @@ The contents of the root `pom.xml` should be slightly 
changed afterwards (explan
 
   org.apache.beam
   beam-runners-flink_2.10
-  0.2.0-incubating-SNAPSHOT
+  0.2.0-SNAPSHOT
 
 
 

http://git-wip-us.apache.org/repos/asf/beam/blob/8cfea766/runners/spark/README.md
--
diff --git a/runners/spark/README.md b/runners/spark/README.md
index aad65b3..15f7081 100644
--- a/runners/spark/README.md
+++ b/runners/spark/README.md
@@ -56,7 +56,7 @@ The Spark runner provides full support for the Beam Model in 
batch processing vi
 
 ### Streaming
 
-Providing full support for the Beam Model in streaming pipelines is under 
development. To follow-up you can subscribe to our [mailing 
list](http://beam.incubator.apache.org/get-started/support/).
+Providing full support for the Beam Model in streaming pipelines is under 
development. To follow-up you can subscribe to our [mailing 
list](http://beam.apache.org/get-started/support/).
 
 ### issue tracking
 
@@ -67,12 +67,12 @@ See [Beam JIRA](https://issues.apache.org/jira/browse/BEAM) 
(runner-spark)
 
 To get the latest version of the Spark Runner, first clone the Beam repository:
 
-git clone https://github.com/apache/incubator-beam
+git clone https://github.com/apache/beam
 
 
 Then switch to the newly created directory and run Maven to build the Apache 
Beam:
 
-cd incubator-beam
+cd beam
 mvn clean install -DskipTests
 
 Now Apache Beam and the Spark Runner are installed in your local maven 
repository.
@@ -116,7 +116,7 @@ Check the output by running:
 __Note: running examples using `mvn exec:exec` only works for Spark local mode 
at the
 moment. See the next section for how to run on a cluster.__
 
-[wc]: 
https://github.com/apache/incubator-beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/examples/WordCount.java
+[wc]: 
https://github.com/apache/beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/examples/WordCount.java
 ## Running on a Cluster
 
 Spark Beam pipelines can be run on a cluster using the `spark-submit` command.

http://git-wip-us.apache.org/repos/asf/beam/blob/8cfea766/sdks/java/extensions/join-library/README.md
--
diff --git a/sdks/java/extensions/join-library/README.md 
b/sdks/java/extensions/join-library/R

[9/9] beam git commit: This closes #1701

2016-12-27 Thread davor 
This closes #1701


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/339ae7df
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/339ae7df
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/339ae7df

Branch: refs/heads/master
Commit: 339ae7df2e202441d33de780da1d681d8a6cabe7
Parents: ccb8b82 5ba42cb
Author: Davor Bonaci 
Authored: Tue Dec 27 16:49:15 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:49:15 2016 -0800

--
 .jenkins/common_job_properties.groovy   |  6 +--
 .../job_beam_Release_NightlySnapshot.groovy |  2 +-
 .jenkins/job_seed.groovy|  2 +-
 .travis/README.md   |  2 +-
 DISCLAIMER  | 10 -
 NOTICE  |  2 +-
 README.md   | 46 ++--
 examples/java/README.md | 16 +++
 examples/java/pom.xml   |  2 +-
 .../org/apache/beam/examples/WordCount.java |  4 +-
 .../org/apache/beam/examples/complete/README.md | 14 +++---
 .../org/apache/beam/examples/cookbook/README.md | 14 +++---
 .../beam/examples/cookbook/TriggerExample.java  |  4 +-
 examples/java8/pom.xml  |  2 +-
 examples/pom.xml|  2 +-
 pom.xml | 39 -
 runners/apex/README.md  |  4 +-
 runners/apex/pom.xml|  2 +-
 runners/core-java/pom.xml   |  2 +-
 runners/direct-java/pom.xml |  2 +-
 runners/flink/README.md |  6 +--
 runners/flink/examples/pom.xml  |  2 +-
 runners/flink/pom.xml   |  2 +-
 runners/flink/runner/pom.xml|  2 +-
 runners/google-cloud-dataflow-java/pom.xml  |  2 +-
 runners/pom.xml |  2 +-
 runners/spark/README.md |  8 ++--
 runners/spark/pom.xml   |  2 +-
 sdks/java/build-tools/pom.xml   |  2 +-
 sdks/java/core/pom.xml  |  2 +-
 .../beam/sdk/util/state/StateContexts.java  |  4 +-
 sdks/java/extensions/join-library/README.md | 10 -
 sdks/java/extensions/join-library/pom.xml   |  2 +-
 sdks/java/extensions/pom.xml|  2 +-
 sdks/java/extensions/sorter/pom.xml |  2 +-
 sdks/java/io/google-cloud-platform/pom.xml  |  2 +-
 sdks/java/io/hdfs/pom.xml   |  2 +-
 sdks/java/io/jdbc/pom.xml   |  2 +-
 sdks/java/io/jms/pom.xml|  2 +-
 sdks/java/io/kafka/pom.xml  |  2 +-
 sdks/java/io/kinesis/pom.xml|  2 +-
 sdks/java/io/mongodb/pom.xml|  2 +-
 sdks/java/io/mqtt/pom.xml   |  4 +-
 sdks/java/io/pom.xml|  2 +-
 sdks/java/java8tests/pom.xml|  2 +-
 .../maven-archetypes/examples-java8/pom.xml |  2 +-
 .../main/resources/archetype-resources/pom.xml  |  2 +-
 sdks/java/maven-archetypes/examples/pom.xml |  2 +-
 .../main/resources/archetype-resources/pom.xml  |  2 +-
 sdks/java/maven-archetypes/pom.xml  |  2 +-
 sdks/java/maven-archetypes/starter/pom.xml  |  2 +-
 .../main/resources/archetype-resources/pom.xml  |  4 +-
 .../resources/projects/basic/reference/pom.xml  |  4 +-
 sdks/java/pom.xml   |  2 +-
 sdks/pom.xml|  2 +-
 55 files changed, 116 insertions(+), 157 deletions(-)
--

[jira] [Commented] (BEAM-1221) Python E2E WordCount Test in Postcommit

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781672#comment-15781672
 ] 

ASF GitHub Bot commented on BEAM-1221:
--

GitHub user markflyhigh opened a pull request:

https://github.com/apache/beam/pull/1705

[BEAM-1221] Run Wordcount IT in Python Postcommit Using Test Framework

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

Use test framework to start e2e wordcount test 
([wordcount_it_test.py](https://github.com/apache/beam/blob/python-sdk/sdks/python/apache_beam/examples/wordcount_it_test.py)),
 in order to:
 - Simplify postcommit run script.
 - Provide an example that shows how to use test framework to run 
integration test on a service.

Test is done by running `run_postcommit.sh` on Dataflow service (didn't run 
ValidatesRunner tests). Result is 
[here](https://pantheon.corp.google.com/dataflow/job/2016-12-27_14_34_56-9345778248827508642?project=google.com:clouddfe)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/markflyhigh/incubator-beam 
wordcount-in-postcommit

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/1705.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1705


commit 8ef14c5598de4676e1b123efdab19d1176237467
Author: Mark Liu 
Date:   2016-12-28T00:33:37Z

[BEAM-1221] Run Wordcount IT in Postcommit Using Test Framework




> Python E2E WordCount Test in Postcommit
> ---
>
> Key: BEAM-1221
> URL: https://issues.apache.org/jira/browse/BEAM-1221
> Project: Beam
>  Issue Type: Task
>  Components: sdk-py, testing
>Reporter: Mark Liu
>Assignee: Mark Liu
>
> Test framework can be used to start e2e wordcount test in post-commit. 
> This will simplify current run_postcommit.sh and provides an example how to 
> run wordcount_it on a service using test framework.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] beam pull request #1705: [BEAM-1221] Run Wordcount IT in Python Postcommit U...

2016-12-27 Thread markflyhigh 
GitHub user markflyhigh opened a pull request:

https://github.com/apache/beam/pull/1705

[BEAM-1221] Run Wordcount IT in Python Postcommit Using Test Framework

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

Use test framework to start e2e wordcount test 
([wordcount_it_test.py](https://github.com/apache/beam/blob/python-sdk/sdks/python/apache_beam/examples/wordcount_it_test.py)),
 in order to:
 - Simplify postcommit run script.
 - Provide an example that shows how to use test framework to run 
integration test on a service.

Test is done by running `run_postcommit.sh` on Dataflow service (didn't run 
ValidatesRunner tests). Result is 
[here](https://pantheon.corp.google.com/dataflow/job/2016-12-27_14_34_56-9345778248827508642?project=google.com:clouddfe)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/markflyhigh/incubator-beam 
wordcount-in-postcommit

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/1705.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1705


commit 8ef14c5598de4676e1b123efdab19d1176237467
Author: Mark Liu 
Date:   2016-12-28T00:33:37Z

[BEAM-1221] Run Wordcount IT in Postcommit Using Test Framework




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] beam-site pull request #112: [BEAM-1220] Remove incubating references

2016-12-27 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/112


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-1220) Graduation items

2016-12-27 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/BEAM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781657#comment-15781657
 ] 

ASF GitHub Bot commented on BEAM-1220:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/112


> Graduation items
> 
>
> Key: BEAM-1220
> URL: https://issues.apache.org/jira/browse/BEAM-1220
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Davor Bonaci
>Assignee: Davor Bonaci
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[6/6] beam-site git commit: This closes #112

2016-12-27 Thread davor 
This closes #112


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/dbf665fd
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/dbf665fd
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/dbf665fd

Branch: refs/heads/asf-site
Commit: dbf665fd9e9c100443dabde83ff8b5c604772d6a
Parents: 40c8199 1e4e170
Author: Davor Bonaci 
Authored: Tue Dec 27 16:41:26 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:41:26 2016 -0800

--
 README.md   |  6 +-
 _config.yml |  4 +-
 .../2016/03/17/capability-matrix.html   |  6 +-
 .../2016/04/03/presentation-materials.html  |  6 +-
 .../sdk/2016/02/25/python-sdk-now-public.html   |  4 +-
 .../beam/release/2016/06/15/first-release.html  |  4 +-
 .../10/11/strata-hadoop-world-and-beam.html |  8 +--
 .../website/2016/02/22/beam-has-a-logo.html |  4 +-
 .../blog/2016/05/18/splitAtFraction-method.html |  6 +-
 .../05/27/where-is-my-pcollection-dot-map.html  |  4 +-
 .../06/13/flink-batch-runner-milestone.html |  4 +-
 content/blog/2016/08/03/six-months.html |  4 +-
 content/blog/2016/10/20/test-stream.html| 10 ++--
 content/blog/index.html |  6 +-
 content/capability-matrix/index.html|  8 +--
 content/coming-soon.html|  6 +-
 .../contribute/contribution-guide/index.html| 38 ++--
 content/contribute/design-principles/index.html |  4 +-
 content/contribute/index.html   |  4 +-
 content/contribute/logos/index.html |  4 +-
 content/contribute/maturity-model/index.html| 18 +++---
 .../presentation-materials/index.html   | 12 ++--
 content/contribute/release-guide/index.html | 14 ++---
 content/contribute/source-repository/index.html | 10 ++--
 content/contribute/team/index.html  |  4 +-
 content/contribute/testing/index.html   | 56 +-
 content/contribute/work-in-progress/index.html  | 14 ++---
 content/contribution-guide/index.html   |  8 +--
 content/docs/contribute.html|  8 +--
 content/docs/learn/index.html   |  8 +--
 content/docs/learn/programming-guide/index.html |  8 +--
 content/docs/use/beam-overview/index.html   |  8 +--
 content/docs/use/index.html |  8 +--
 content/documentation/index.html|  4 +-
 .../pipelines/create-your-pipeline/index.html   |  4 +-
 .../pipelines/design-your-pipeline/index.html   |  4 +-
 .../pipelines/test-your-pipeline/index.html | 12 ++--
 .../documentation/programming-guide/index.html  | 14 ++---
 content/documentation/resources/index.html  |  4 +-
 content/documentation/runners/apex/index.html   |  4 +-
 .../runners/capability-matrix/index.html|  6 +-
 .../documentation/runners/dataflow/index.html   |  6 +-
 content/documentation/runners/direct/index.html |  8 +--
 content/documentation/runners/flink/index.html  |  6 +-
 content/documentation/runners/spark/index.html  |  4 +-
 content/documentation/sdks/java/index.html  |  4 +-
 content/documentation/sdks/python/index.html|  4 +-
 content/feed.xml| 62 ++--
 content/get-started/beam-overview/index.html|  4 +-
 content/get-started/downloads/index.html|  4 +-
 content/get-started/index.html  |  4 +-
 .../mobile-gaming-example/index.html| 16 ++---
 content/get-started/quickstart/index.html   |  4 +-
 content/get-started/releases/index.html |  8 +--
 content/get-started/support/index.html  | 22 +++
 .../get-started/wordcount-example/index.html| 12 ++--
 content/getting-started/index.html  |  8 +--
 content/index.html  | 16 ++---
 content/learn/index.html|  8 +--
 content/learn/presentation-materials/index.html |  8 +--
 content/learn/programming-guide/index.html  |  8 +--
 content/learn/resources/index.html  |  8 +--
 .../learn/runners/capability-matrix/index.html  |  8 +--
 content/learn/runners/dataflow/index.html   |  8 +--
 content/learn/runners/direct/index.html |  8 +--
 content/learn/runners/flink/index.html  |  8 +--
 content/learn/runners/spark/index.html  |  8 +--
 content/learn/sdks/java/index.html  |  8 +--
 content/learn/sdks/javadoc/index.html   |  8 +--
 content/material/index.html |  8 +--
 content/privacy_policy/index.html   |  4 +-
 content/project/logos/index.html|  8 +--
 content/project/team/index.html |  8 +--
 content/releases/index.html |  8 +--
 content/source_repository/index.html|  8 +--
 content/team/index.h

[3/6] beam-site git commit: Regenerate website

2016-12-27 Thread davor 
http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e4e170f/content/get-started/wordcount-example/index.html
--
diff --git a/content/get-started/wordcount-example/index.html 
b/content/get-started/wordcount-example/index.html
index 5132240..ab8723f 100644
--- a/content/get-started/wordcount-example/index.html
+++ b/content/get-started/wordcount-example/index.html
@@ -15,8 +15,8 @@
   https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
   
   
-  http://beam.incubator.apache.org/get-started/wordcount-example/"; 
data-proofer-ignore>
-  http://beam.incubator.apache.org/feed.xml";>
+  http://beam.apache.org/get-started/wordcount-example/"; 
data-proofer-ignore>
+  http://beam.apache.org/feed.xml";>
   
 
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
 (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
@@ -199,7 +199,7 @@
 
 
Minimal WordCount demonstrates a simple pipeline that can read from a text 
file, apply transforms to tokenize and count the words, and write the data to 
an output text file. This example hard-codes the locations for its input and 
output files and doesn’t perform any error checking; it is intended to only 
show you the “bare bones” of creating a Beam pipeline. This lack of 
parameterization makes this particular pipeline less portable across different 
runners than standard Beam pipelines. In later examples, we will parameterize 
the pipeline’s input and output sources and show other best practices.

 
-
To run this example, follow the instructions in the https://github.com/apache/incubator-beam/blob/master/examples/java/README.md#building-and-running";>Beam
 Examples README. To view the full code, see https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java";>MinimalWordCount.

+
To run this example, follow the instructions in the https://github.com/apache/beam/blob/master/examples/java/README.md#building-and-running";>Beam
 Examples README. To view the full code, see https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java";>MinimalWordCount.

 
 
Key Concepts:

 
@@ -327,7 +327,7 @@ Figure 1: The pipeline data flow.

 
 
This section assumes that you have a good understanding of the basic 
concepts in building a pipeline. If you feel that you aren’t at that point 
yet, read the above section, Minimal 
WordCount.

 
-
To run this example, follow the instructions in the https://github.com/apache/incubator-beam/blob/master/examples/java/README.md#building-and-running";>Beam
 Examples README. To view the full code, see https://github.com/apache/incubator-beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WordCount.java";>WordCount.

+
To run this example, follow the instructions in the https://github.com/apache/beam/blob/master/examples/java/README.md#building-and-running";>Beam
 Examples README. To view the full code, see https://github.com/apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/WordCount.java";>WordCount.

 
 
New Concepts:

 
@@ -424,7 +424,7 @@ Figure 1: The pipeline data flow.

 
 
The Debugging WordCount example demonstrates some best practices for 
instrumenting your pipeline code.

 
-
To run this example, follow the instructions in the [2/6] beam-site git commit: Remove incubating references



2016-12-27

Thread
davor



Remove incubating references


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/50e37931
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/50e37931
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/50e37931

Branch: refs/heads/asf-site
Commit: 50e379319c2620be3ff68e006314b8ae13a2ba9c
Parents: 40c8199
Author: Davor Bonaci 
Authored: Tue Dec 27 14:01:36 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:41:11 2016 -0800

--
 README.md   |  6 +--
 _config.yml |  4 +-
 src/_posts/2016-03-17-capability-matrix.md  |  2 +-
 src/_posts/2016-04-03-presentation-materials.md |  2 +-
 src/_posts/2016-05-18-splitAtFraction-method.md |  2 +-
 .../2016-10-12-strata-hadoop-world-and-beam.md  |  4 +-
 src/_posts/2016-10-20-test-stream.md|  6 +--
 src/contribute/contribution-guide.md| 34 ++---
 src/contribute/maturity-model.md| 14 +++---
 src/contribute/presentation-materials.md|  8 +--
 src/contribute/release-guide.md | 10 ++--
 src/contribute/source-repository.md |  6 +--
 src/contribute/testing.md   | 52 ++--
 src/contribute/work-in-progress.md  |  6 +--
 .../pipelines/test-your-pipeline.md |  8 +--
 src/documentation/programming-guide.md  | 10 ++--
 src/documentation/runners/capability-matrix.md  |  2 +-
 src/documentation/runners/dataflow.md   |  2 +-
 src/documentation/runners/direct.md |  4 +-
 src/documentation/runners/flink.md  |  2 +-
 src/get-started/mobile-gaming-example.md| 12 ++---
 src/get-started/support.md  | 18 +++
 src/get-started/wordcount-example.md|  8 +--
 src/index.md| 10 +---
 tools/common_job_properties.groovy  |  4 +-
 tools/job_seed.groovy   |  2 +-
 26 files changed, 115 insertions(+), 123 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/50e37931/README.md
--
diff --git a/README.md b/README.md
index 13bc8f1..ba70ef5 100644
--- a/README.md
+++ b/README.md
@@ -1,6 +1,6 @@
-# Apache Beam (incubating) website
+# Apache Beam website
 
-This is the website for [Apache Beam](http://beam.incubator.apache.org) 
(incubating).
+This is the website for [Apache Beam](http://beam.apache.org/).
 
 ## About this site
 
@@ -10,7 +10,7 @@ for additional formatting capabilities, this website uses
 
 This website is hosted at:
 
-http://beam.incubator.apache.org
+http://beam.apache.org
 
 
 ### Repository Structure

http://git-wip-us.apache.org/repos/asf/beam-site/blob/50e37931/_config.yml
--
diff --git a/_config.yml b/_config.yml
index 3dcc970..3766b1c 100644
--- a/_config.yml
+++ b/_config.yml
@@ -6,7 +6,7 @@
 # 'jekyll serve'. If you change this file, please restart the server process.
 
 # Site settings
-title: Apache Beam (incubating)
+title: Apache Beam
 description: > # this means to ignore newlines until "baseurl:"
   Apache Beam is an open source, unified model and set of language-specific
   SDKs for defining and executing data processing workflows, and also data
@@ -25,7 +25,7 @@ source: src
 destination: content
 
 # the base hostname & protocol for your site
-url: "http://beam.incubator.apache.org";
+url: "http://beam.apache.org";
 
 twitter_username: apachebeam
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/50e37931/src/_posts/2016-03-17-capability-matrix.md
--
diff --git a/src/_posts/2016-03-17-capability-matrix.md 
b/src/_posts/2016-03-17-capability-matrix.md
index 939f704..a125103 100644
--- a/src/_posts/2016-03-17-capability-matrix.md
+++ b/src/_posts/2016-03-17-capability-matrix.md
@@ -573,7 +573,7 @@ capability-matrix-snapshot:
 
 ---
 
-With initial code drops complete ([Dataflow SDK and 
Runner](https://github.com/apache/incubator-beam/pull/1), [Flink 
Runner](https://github.com/apache/incubator-beam/pull/12), [Spark 
Runner](https://github.com/apache/incubator-beam/pull/42)) and expressed 
interest in runner implementations for 
[Storm](https://issues.apache.org/jira/browse/BEAM-9), 
[Hadoop](https://issues.apache.org/jira/browse/BEAM-19), and 
[Gearpump](https://issues.apache.org/jira/browse/BEAM-79) (amongst others), we 
wanted to start addressing a big question in the Apache Beam (incubating) 
community: what capabilities will each runner be able to support?
+With initial code drops complete ([Dataflow SDK and 
Runner](https://github.com/apa






[1/6] beam-site git commit: Remove incubating references




2016-12-27

Thread
davor



Repository: beam-site
Updated Branches:
  refs/heads/asf-site 40c81993f -> dbf665fd9


http://git-wip-us.apache.org/repos/asf/beam-site/blob/50e37931/src/index.md
--
diff --git a/src/index.md b/src/index.md
index e5d47bd..bb51dfd 100644
--- a/src/index.md
+++ b/src/index.md
@@ -2,7 +2,7 @@
 layout: default
 ---
 
-# Apache Beam (incubating)
+# Apache Beam
 
  Apache Beam provides an advanced unified programming model, allowing you 
to implement batch and streaming data processing jobs that can run on any 
execution engine.
 
@@ -35,11 +35,3 @@ Beam is an [Apache Software 
Foundation](http://www.apache.org) project, availabl
 !function(d,s,id){var 
js,fjs=d.getElementsByTagName(s)[0],p=/^http:/.test(d.location)?'http':'https';if(!d.getElementById(id)){js=d.createElement(s);js.id=id;js.src=p+"://platform.twitter.com/widgets.js";fjs.parentNode.insertBefore(js,fjs);}}(document,"script","twitter-wjs");
   
 
-
-
-
-https://incubator.apache.org/images/apache-incubator-logo.png"; alt="Apache 
Incubator Logo">
-
-Apache Beam is an effort undergoing incubation at [The Apache Software 
Foundation (ASF)](http://www.apache.org) sponsored by the Apache Incubator PMC. 
Incubation is required of all newly accepted projects until a further review 
indicates that the infrastructure, communications, and decision making process 
have stabilized in a manner consistent with other successful ASF projects. 
While incubation status is not necessarily a reflection of the completeness or 
stability of the code, it does indicate that the project has yet to be fully 
endorsed by the ASF.
-
-Apache Beam (incubating) is available under [Apache License, version 
2.0](http://www.apache.org/licenses/LICENSE-2.0).

http://git-wip-us.apache.org/repos/asf/beam-site/blob/50e37931/tools/common_job_properties.groovy
--
diff --git a/tools/common_job_properties.groovy 
b/tools/common_job_properties.groovy
index 6e30023..6bc3d14 100644
--- a/tools/common_job_properties.groovy
+++ b/tools/common_job_properties.groovy
@@ -7,7 +7,7 @@ class common_job_properties {
 
 // GitHub project.
 context.properties {
-  githubProjectUrl('https://github.com/apache/incubator-beam-site/')
+  githubProjectUrl('https://github.com/apache/beam-site/')
 }
 
 // Restrict this project to run only on Jenkins executors dedicated to the
@@ -23,7 +23,7 @@ class common_job_properties {
 context.scm {
   git {
 remote {
-  url('https://github.com/apache/incubator-beam-site.git')
+  url('https://github.com/apache/beam-site.git')
   refspec('+refs/heads/*:refs/remotes/origin/* ' +
   '+refs/pull/*:refs/remotes/origin/pr/*')
 }

http://git-wip-us.apache.org/repos/asf/beam-site/blob/50e37931/tools/job_seed.groovy
--
diff --git a/tools/job_seed.groovy b/tools/job_seed.groovy
index a240b6c..7d77941 100644
--- a/tools/job_seed.groovy
+++ b/tools/job_seed.groovy
@@ -27,6 +27,6 @@ job('beam_SeedJob_Website') {
 
   publishers {
 // Notify the mailing list for each failed build.
-mailer('d...@beam.incubator.apache.org', false, false)
+mailer('d...@beam.apache.org', false, false)
   }
 }









[5/6] beam-site git commit: Regenerate website




2016-12-27

Thread
davor



Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/1e4e170f
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/1e4e170f
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/1e4e170f

Branch: refs/heads/asf-site
Commit: 1e4e170fc375d1d06609c3da7b6c033921b5b92e
Parents: 50e3793
Author: Davor Bonaci 
Authored: Tue Dec 27 16:41:26 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:41:26 2016 -0800

--
 .../2016/03/17/capability-matrix.html   |  6 +-
 .../2016/04/03/presentation-materials.html  |  6 +-
 .../sdk/2016/02/25/python-sdk-now-public.html   |  4 +-
 .../beam/release/2016/06/15/first-release.html  |  4 +-
 .../10/11/strata-hadoop-world-and-beam.html |  8 +--
 .../website/2016/02/22/beam-has-a-logo.html |  4 +-
 .../blog/2016/05/18/splitAtFraction-method.html |  6 +-
 .../05/27/where-is-my-pcollection-dot-map.html  |  4 +-
 .../06/13/flink-batch-runner-milestone.html |  4 +-
 content/blog/2016/08/03/six-months.html |  4 +-
 content/blog/2016/10/20/test-stream.html| 10 ++--
 content/blog/index.html |  6 +-
 content/capability-matrix/index.html|  8 +--
 content/coming-soon.html|  6 +-
 .../contribute/contribution-guide/index.html| 38 ++--
 content/contribute/design-principles/index.html |  4 +-
 content/contribute/index.html   |  4 +-
 content/contribute/logos/index.html |  4 +-
 content/contribute/maturity-model/index.html| 18 +++---
 .../presentation-materials/index.html   | 12 ++--
 content/contribute/release-guide/index.html | 14 ++---
 content/contribute/source-repository/index.html | 10 ++--
 content/contribute/team/index.html  |  4 +-
 content/contribute/testing/index.html   | 56 +-
 content/contribute/work-in-progress/index.html  | 14 ++---
 content/contribution-guide/index.html   |  8 +--
 content/docs/contribute.html|  8 +--
 content/docs/learn/index.html   |  8 +--
 content/docs/learn/programming-guide/index.html |  8 +--
 content/docs/use/beam-overview/index.html   |  8 +--
 content/docs/use/index.html |  8 +--
 content/documentation/index.html|  4 +-
 .../pipelines/create-your-pipeline/index.html   |  4 +-
 .../pipelines/design-your-pipeline/index.html   |  4 +-
 .../pipelines/test-your-pipeline/index.html | 12 ++--
 .../documentation/programming-guide/index.html  | 14 ++---
 content/documentation/resources/index.html  |  4 +-
 content/documentation/runners/apex/index.html   |  4 +-
 .../runners/capability-matrix/index.html|  6 +-
 .../documentation/runners/dataflow/index.html   |  6 +-
 content/documentation/runners/direct/index.html |  8 +--
 content/documentation/runners/flink/index.html  |  6 +-
 content/documentation/runners/spark/index.html  |  4 +-
 content/documentation/sdks/java/index.html  |  4 +-
 content/documentation/sdks/python/index.html|  4 +-
 content/feed.xml| 62 ++--
 content/get-started/beam-overview/index.html|  4 +-
 content/get-started/downloads/index.html|  4 +-
 content/get-started/index.html  |  4 +-
 .../mobile-gaming-example/index.html| 16 ++---
 content/get-started/quickstart/index.html   |  4 +-
 content/get-started/releases/index.html |  8 +--
 content/get-started/support/index.html  | 22 +++
 .../get-started/wordcount-example/index.html| 12 ++--
 content/getting-started/index.html  |  8 +--
 content/index.html  | 16 ++---
 content/learn/index.html|  8 +--
 content/learn/presentation-materials/index.html |  8 +--
 content/learn/programming-guide/index.html  |  8 +--
 content/learn/resources/index.html  |  8 +--
 .../learn/runners/capability-matrix/index.html  |  8 +--
 content/learn/runners/dataflow/index.html   |  8 +--
 content/learn/runners/direct/index.html |  8 +--
 content/learn/runners/flink/index.html  |  8 +--
 content/learn/runners/spark/index.html  |  8 +--
 content/learn/sdks/java/index.html  |  8 +--
 content/learn/sdks/javadoc/index.html   |  8 +--
 content/material/index.html |  8 +--
 content/privacy_policy/index.html   |  4 +-
 content/project/logos/index.html|  8 +--
 content/project/team/index.html |  8 +--
 content/releases/index.html |  8 +--
 content/source_repository/index.html|  8 +--
 content/team/index.html |  8 +--
 content/use/beam-overview/index.html|  8 +--
 content/use/index.html  






[4/6] beam-site git commit: Regenerate website




2016-12-27

Thread
davor



http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e4e170f/content/contribution-guide/index.html
--
diff --git a/content/contribution-guide/index.html 
b/content/contribution-guide/index.html
index b48b19c..7fb39a9 100644
--- a/content/contribution-guide/index.html
+++ b/content/contribution-guide/index.html
@@ -2,9 +2,9 @@
 
 
 Redirecting…
-http://beam.incubator.apache.org/contribute/contribution-guide/";>
-http://beam.incubator.apache.org/contribute/contribution-guide/";>
+http://beam.apache.org/contribute/contribution-guide/";>
+http://beam.apache.org/contribute/contribution-guide/";>
 Redirecting…
-http://beam.incubator.apache.org/contribute/contribution-guide/";>Click 
here if you are not redirected.
-location="http://beam.incubator.apache.org/contribute/contribution-guide/";
+http://beam.apache.org/contribute/contribution-guide/";>Click here if 
you are not redirected.
+location="http://beam.apache.org/contribute/contribution-guide/";
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e4e170f/content/docs/contribute.html
--
diff --git a/content/docs/contribute.html b/content/docs/contribute.html
index cfae54e..e6b605f 100644
--- a/content/docs/contribute.html
+++ b/content/docs/contribute.html
@@ -2,9 +2,9 @@
 
 
 Redirecting…
-http://beam.incubator.apache.org/contribute/";>
-http://beam.incubator.apache.org/contribute/";>
+http://beam.apache.org/contribute/";>
+http://beam.apache.org/contribute/";>
 Redirecting…
-http://beam.incubator.apache.org/contribute/";>Click here if you are 
not redirected.
-location="http://beam.incubator.apache.org/contribute/";
+http://beam.apache.org/contribute/";>Click here if you are not 
redirected.
+location="http://beam.apache.org/contribute/";
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e4e170f/content/docs/learn/index.html
--
diff --git a/content/docs/learn/index.html b/content/docs/learn/index.html
index 922447a..2431768 100644
--- a/content/docs/learn/index.html
+++ b/content/docs/learn/index.html
@@ -2,9 +2,9 @@
 
 
 Redirecting…
-http://beam.incubator.apache.org/documentation/";>
-http://beam.incubator.apache.org/documentation/";>
+http://beam.apache.org/documentation/";>
+http://beam.apache.org/documentation/";>
 Redirecting…
-http://beam.incubator.apache.org/documentation/";>Click here if you 
are not redirected.
-location="http://beam.incubator.apache.org/documentation/";
+http://beam.apache.org/documentation/";>Click here if you are not 
redirected.
+location="http://beam.apache.org/documentation/";
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e4e170f/content/docs/learn/programming-guide/index.html
--
diff --git a/content/docs/learn/programming-guide/index.html 
b/content/docs/learn/programming-guide/index.html
index 14bdce8..33aac66 100644
--- a/content/docs/learn/programming-guide/index.html
+++ b/content/docs/learn/programming-guide/index.html
@@ -2,9 +2,9 @@
 
 
 Redirecting…
-http://beam.incubator.apache.org/documentation/programming-guide/";>
-http://beam.incubator.apache.org/documentation/programming-guide/";>
+http://beam.apache.org/documentation/programming-guide/";>
+http://beam.apache.org/documentation/programming-guide/";>
 Redirecting…
-http://beam.incubator.apache.org/documentation/programming-guide/";>Click 
here if you are not redirected.
-location="http://beam.incubator.apache.org/documentation/programming-guide/";
+http://beam.apache.org/documentation/programming-guide/";>Click here 
if you are not redirected.
+location="http://beam.apache.org/documentation/programming-guide/";
 

http://git-wip-us.apache.org/repos/asf/beam-site/blob/1e4e170f/content/docs/use/beam-overview/index.html
--
diff --git a/content/docs/use/beam-overview/index.html 
b/content/docs/use/beam-overview/index.html
index a6cca54..df2a24a 100644
--- a/content/docs/use/beam-overview/index.html
+++ b/content/docs/use/beam-overview/index.html
@@ -2,9 +2,9 @@
 
 
 Redirecting…
-http://beam.incubator.apache.org/get-started/beam-overview/";>
-htt






[GitHub] beam pull request #1704: Add ToString helper transform




2016-12-27

Thread
vikkyrk



GitHub user vikkyrk opened a pull request:

https://github.com/apache/beam/pull/1704

Add ToString helper transform

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/vikkyrk/incubator-beam to_str

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/1704.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1704


commit 6fb3870b569fab051cc4ea989cfb9e7eb15f3da8
Author: Vikas Kedigehalli 
Date:   2016-12-28T00:37:03Z

Add ToString helper transform




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[2/2] beam git commit: Fixing test_default_job_name case




2016-12-27

Thread
dhalperi



Fixing test_default_job_name case


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4a70f009
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4a70f009
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4a70f009

Branch: refs/heads/python-sdk
Commit: 4a70f009b0d60d340b09234b1629ba7bb34154f4
Parents: 5f9851a
Author: Pablo 
Authored: Tue Dec 27 15:03:20 2016 -0800
Committer: Dan Halperin 
Committed: Tue Dec 27 16:32:53 2016 -0800

--
 sdks/python/apache_beam/internal/apiclient_test.py | 5 ++---
 1 file changed, 2 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/4a70f009/sdks/python/apache_beam/internal/apiclient_test.py
--
diff --git a/sdks/python/apache_beam/internal/apiclient_test.py 
b/sdks/python/apache_beam/internal/apiclient_test.py
index cda9445..1a83752 100644
--- a/sdks/python/apache_beam/internal/apiclient_test.py
+++ b/sdks/python/apache_beam/internal/apiclient_test.py
@@ -16,7 +16,6 @@
 #
 """Unit tests for the apiclient module."""
 
-import re
 import unittest
 
 from apache_beam.utils.options import PipelineOptions
@@ -35,8 +34,8 @@ class UtilTest(unittest.TestCase):
 
   def test_default_job_name(self):
 job_name = apiclient.Job.default_job_name(None)
-regexp = 'beamapp-[a-z]*-[0-9]{10}-[0-9]{6}'
-self.assertTrue(re.match(regexp, job_name))
+regexp = 'beamapp-.*-[0-9]{10}-[0-9]{6}'
+self.assertRegexpMatches(job_name, regexp)
 
 
 if __name__ == '__main__':









[1/2] beam git commit: Closes #1702




2016-12-27

Thread
dhalperi



Repository: beam
Updated Branches:
  refs/heads/python-sdk 5f9851a83 -> 2d1655107


Closes #1702


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2d165510
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2d165510
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2d165510

Branch: refs/heads/python-sdk
Commit: 2d165510731d3764a2eee36b8ecd38e160de72ed
Parents: 5f9851a 4a70f00
Author: Dan Halperin 
Authored: Tue Dec 27 16:32:53 2016 -0800
Committer: Dan Halperin 
Committed: Tue Dec 27 16:32:53 2016 -0800

--
 sdks/python/apache_beam/internal/apiclient_test.py | 5 ++---
 1 file changed, 2 insertions(+), 3 deletions(-)
--










[jira] [Created] (BEAM-1221) Python E2E WordCount Test in Postcommit




2016-12-27

Thread
Mark Liu (JIRA)



Mark Liu created BEAM-1221:
--

 Summary: Python E2E WordCount Test in Postcommit
 Key: BEAM-1221
 URL: https://issues.apache.org/jira/browse/BEAM-1221
 Project: Beam
  Issue Type: Task
  Components: sdk-py, testing
Reporter: Mark Liu
Assignee: Mark Liu


Test framework can be used to start e2e wordcount test in post-commit. 

This will simplify current run_postcommit.sh and provides an example how to run 
wordcount_it on a service using test framework.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Commented] (BEAM-1220) Graduation items




2016-12-27

Thread
ASF GitHub Bot (JIRA)




[ 
https://issues.apache.org/jira/browse/BEAM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781633#comment-15781633
 ] 

ASF GitHub Bot commented on BEAM-1220:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/113


> Graduation items
> 
>
> Key: BEAM-1220
> URL: https://issues.apache.org/jira/browse/BEAM-1220
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Davor Bonaci
>Assignee: Davor Bonaci
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[3/3] beam-site git commit: This closes #113




2016-12-27

Thread
davor



This closes #113


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/40c81993
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/40c81993
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/40c81993

Branch: refs/heads/asf-site
Commit: 40c81993f1af91aae64142a59bfc58b966b94b22
Parents: b46a41f 7ce5429
Author: Davor Bonaci 
Authored: Tue Dec 27 16:29:14 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:29:14 2016 -0800

--
 content/downloads/beam-doap.rdf | 39 
 src/downloads/beam-doap.rdf | 39 
 2 files changed, 78 insertions(+)
--










[GitHub] beam-site pull request #113: [BEAM-1220] Add DOAP file




2016-12-27

Thread
asfgit



Github user asfgit closed the pull request at:

https://github.com/apache/beam-site/pull/113


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[1/3] beam-site git commit: Add DOAP file for the project




2016-12-27

Thread
davor



Repository: beam-site
Updated Branches:
  refs/heads/asf-site b46a41fab -> 40c81993f


Add DOAP file for the project


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/0b5e9d26
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/0b5e9d26
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/0b5e9d26

Branch: refs/heads/asf-site
Commit: 0b5e9d2689a8e5c4dad4a7ef9e44cc1cccd6c0e3
Parents: b46a41f
Author: Davor Bonaci 
Authored: Tue Dec 27 16:23:14 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:25:11 2016 -0800

--
 src/downloads/beam-doap.rdf | 39 +++
 1 file changed, 39 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/0b5e9d26/src/downloads/beam-doap.rdf
--
diff --git a/src/downloads/beam-doap.rdf b/src/downloads/beam-doap.rdf
new file mode 100644
index 000..8b1cbd8
--- /dev/null
+++ b/src/downloads/beam-doap.rdf
@@ -0,0 +1,39 @@
+
+
+http://usefulinc.com/ns/doap#"; 
+ xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"; 
+ xmlns:asfext="http://projects.apache.org/ns/asfext#";
+ xmlns:foaf="http://xmlns.com/foaf/0.1/";>
+
+  http://beam.apache.org";>
+2016-12-21
+http://www.apache.org/licenses/LICENSE-2.0"; />
+Apache Beam
+http://beam.apache.org"; />
+http://beam.apache.org"; />
+Apache Beam is a programming model, SDKs, and runners for 
defining and executing data processing pipelines.
+Apache Beam is a unified programming model for both batch and 
streaming data processing, enabling efficient execution across diverse 
distributed execution engines and providing extensibility points for connecting 
to different technologies and user communities.
+https://issues.apache.org/jira/browse/BEAM"; />
+http://beam.apache.org/get-started/support/"; />
+http://beam.apache.org/get-started/downloads/"; />
+Java
+Python
+http://projects.apache.org/category/big-data"; />
+  
+









[2/3] beam-site git commit: Regenerate website




2016-12-27

Thread
davor



Regenerate website


Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/7ce54294
Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/7ce54294
Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/7ce54294

Branch: refs/heads/asf-site
Commit: 7ce542945e1bad899d91ed85bf5878aa7d19b0aa
Parents: 0b5e9d2
Author: Davor Bonaci 
Authored: Tue Dec 27 16:29:14 2016 -0800
Committer: Davor Bonaci 
Committed: Tue Dec 27 16:29:14 2016 -0800

--
 content/downloads/beam-doap.rdf | 39 
 1 file changed, 39 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/beam-site/blob/7ce54294/content/downloads/beam-doap.rdf
--
diff --git a/content/downloads/beam-doap.rdf b/content/downloads/beam-doap.rdf
new file mode 100644
index 000..8b1cbd8
--- /dev/null
+++ b/content/downloads/beam-doap.rdf
@@ -0,0 +1,39 @@
+
+
+http://usefulinc.com/ns/doap#"; 
+ xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#"; 
+ xmlns:asfext="http://projects.apache.org/ns/asfext#";
+ xmlns:foaf="http://xmlns.com/foaf/0.1/";>
+
+  http://beam.apache.org";>
+2016-12-21
+http://www.apache.org/licenses/LICENSE-2.0"; />
+Apache Beam
+http://beam.apache.org"; />
+http://beam.apache.org"; />
+Apache Beam is a programming model, SDKs, and runners for 
defining and executing data processing pipelines.
+Apache Beam is a unified programming model for both batch and 
streaming data processing, enabling efficient execution across diverse 
distributed execution engines and providing extensibility points for connecting 
to different technologies and user communities.
+https://issues.apache.org/jira/browse/BEAM"; />
+http://beam.apache.org/get-started/support/"; />
+http://beam.apache.org/get-started/downloads/"; />
+Java
+Python
+http://projects.apache.org/category/big-data"; />
+  
+









[GitHub] beam-site pull request #113: [BEAM-1220] Add DOAP file




2016-12-27

Thread
davorbonaci



GitHub user davorbonaci opened a pull request:

https://github.com/apache/beam-site/pull/113

[BEAM-1220] Add DOAP file

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam-site doap

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam-site/pull/113.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #113


commit 0b5e9d2689a8e5c4dad4a7ef9e44cc1cccd6c0e3
Author: Davor Bonaci 
Date:   2016-12-28T00:23:14Z

Add DOAP file for the project




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[jira] [Commented] (BEAM-1220) Graduation items




2016-12-27

Thread
ASF GitHub Bot (JIRA)




[ 
https://issues.apache.org/jira/browse/BEAM-1220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781626#comment-15781626
 ] 

ASF GitHub Bot commented on BEAM-1220:
--

GitHub user davorbonaci opened a pull request:

https://github.com/apache/beam-site/pull/113

[BEAM-1220] Add DOAP file

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam-site doap

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam-site/pull/113.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #113


commit 0b5e9d2689a8e5c4dad4a7ef9e44cc1cccd6c0e3
Author: Davor Bonaci 
Date:   2016-12-28T00:23:14Z

Add DOAP file for the project




> Graduation items
> 
>
> Key: BEAM-1220
> URL: https://issues.apache.org/jira/browse/BEAM-1220
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Davor Bonaci
>Assignee: Davor Bonaci
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Created] (BEAM-1220) Graduation items




2016-12-27

Thread
Davor Bonaci (JIRA)



Davor Bonaci created BEAM-1220:
--

 Summary: Graduation items
 Key: BEAM-1220
 URL: https://issues.apache.org/jira/browse/BEAM-1220
 Project: Beam
  Issue Type: Task
  Components: project-management
Reporter: Davor Bonaci
Assignee: Davor Bonaci






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Created] (BEAM-1219) Regexp in test_default_job_name of apiclient_test.py is not general enough




2016-12-27

Thread
Pablo Estrada (JIRA)



Pablo Estrada created BEAM-1219:
---

 Summary: Regexp in test_default_job_name of apiclient_test.py is 
not general enough
 Key: BEAM-1219
 URL: https://issues.apache.org/jira/browse/BEAM-1219
 Project: Beam
  Issue Type: Bug
  Components: sdk-py
Reporter: Pablo Estrada
Assignee: Frances Perry






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Commented] (BEAM-1218) De-Googlify Python SDK




2016-12-27

Thread
Mark Liu (JIRA)




[ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781591#comment-15781591
 ] 

Mark Liu commented on BEAM-1218:


[~altay]

> De-Googlify Python SDK
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Mark Liu
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Updated] (BEAM-1218) De-Googlify Python SDK




2016-12-27

Thread
Mark Liu (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Liu updated BEAM-1218:
---
Assignee: Ahmet Altay  (was: Mark Liu)

> De-Googlify Python SDK
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Ahmet Altay
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Updated] (BEAM-1218) De-Googlify Python SDK




2016-12-27

Thread
Mark Liu (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Liu updated BEAM-1218:
---
Summary: De-Googlify Python SDK  (was: De-Googlify Python SDK in 
PipelineVerifierTest)

> De-Googlify Python SDK
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Mark Liu
>
> Should use PipelineState for general Beam pipeline state verification instead 
> of dataflow.Job.CurrentStateValueValuesEnum.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Updated] (BEAM-1218) De-Googlify Python SDK in PipelineVerifierTest




2016-12-27

Thread
Daniel Halperin (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Halperin updated BEAM-1218:
--
Issue Type: Improvement  (was: Bug)

> De-Googlify Python SDK in PipelineVerifierTest
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Mark Liu
>
> Should use PipelineState for general Beam pipeline state verification instead 
> of dataflow.Job.CurrentStateValueValuesEnum.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Updated] (BEAM-1218) De-Googlify Python SDK




2016-12-27

Thread
Mark Liu (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Liu updated BEAM-1218:
---
Description: (was: Should use PipelineState for general Beam pipeline 
state verification instead of dataflow.Job.CurrentStateValueValuesEnum.)

> De-Googlify Python SDK
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Mark Liu
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Commented] (BEAM-1218) De-Googlify Python SDK




2016-12-27

Thread
ASF GitHub Bot (JIRA)




[ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781588#comment-15781588
 ] 

ASF GitHub Bot commented on BEAM-1218:
--

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/1703


> De-Googlify Python SDK
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Mark Liu
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[GitHub] incubator-beam pull request #1703: [BEAM-1218] Fix Python Incorrect Pipeline...




2016-12-27

Thread
asfgit



Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/1703


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[2/2] incubator-beam git commit: Closes #1703




2016-12-27

Thread
dhalperi



Closes #1703


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5f9851a8
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5f9851a8
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/5f9851a8

Branch: refs/heads/python-sdk
Commit: 5f9851a83f861ea3638feadd3e28fd6229887e7a
Parents: b2728cf 82fc5e4
Author: Dan Halperin 
Authored: Tue Dec 27 15:57:53 2016 -0800
Committer: Dan Halperin 
Committed: Tue Dec 27 15:57:53 2016 -0800

--
 .../tests/pipeline_verifiers_test.py| 28 
 1 file changed, 17 insertions(+), 11 deletions(-)
--










[1/2] incubator-beam git commit: Fix Incorrect State Usage in PipelineVerifier Unit Test




2016-12-27

Thread
dhalperi



Repository: incubator-beam
Updated Branches:
  refs/heads/python-sdk b2728cf13 -> 5f9851a83


Fix Incorrect State Usage in PipelineVerifier Unit Test


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/82fc5e40
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/82fc5e40
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/82fc5e40

Branch: refs/heads/python-sdk
Commit: 82fc5e408f5c24f882036990e7d28bbbd1f08308
Parents: b2728cf
Author: Mark Liu 
Authored: Tue Dec 27 15:19:27 2016 -0800
Committer: Mark Liu 
Committed: Tue Dec 27 15:19:27 2016 -0800

--
 .../tests/pipeline_verifiers_test.py| 28 
 1 file changed, 17 insertions(+), 11 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/82fc5e40/sdks/python/apache_beam/tests/pipeline_verifiers_test.py
--
diff --git a/sdks/python/apache_beam/tests/pipeline_verifiers_test.py 
b/sdks/python/apache_beam/tests/pipeline_verifiers_test.py
index e32f603..9f70b45 100644
--- a/sdks/python/apache_beam/tests/pipeline_verifiers_test.py
+++ b/sdks/python/apache_beam/tests/pipeline_verifiers_test.py
@@ -20,7 +20,6 @@
 import logging
 import unittest
 
-from apache_beam.internal.clients import dataflow
 from apache_beam.runners.runner import PipelineState
 from apache_beam.runners.runner import PipelineResult
 from apache_beam.tests.pipeline_verifiers import PipelineStateMatcher
@@ -29,20 +28,27 @@ from hamcrest import assert_that as hc_assert_that
 
 class PipelineVerifiersTest(unittest.TestCase):
 
-  def test_dataflow_job_state_matcher_success(self):
-"""Test DataflowJobStateMatcher successes when job finished in DONE"""
+  def test_pipeline_state_matcher_success(self):
+"""Test PipelineStateMatcher successes when using default expected state
+and job actually finished in DONE
+"""
 pipeline_result = PipelineResult(PipelineState.DONE)
 hc_assert_that(pipeline_result, PipelineStateMatcher())
 
+  def test_pipeline_state_matcher_given_state(self):
+"""Test PipelineStateMatcher successes when matches given state"""
+pipeline_result = PipelineResult(PipelineState.FAILED)
+hc_assert_that(pipeline_result, PipelineStateMatcher(PipelineState.FAILED))
+
   def test_pipeline_state_matcher_fails(self):
-"""Test DataflowJobStateMatcher fails when job finished in
-FAILED/CANCELLED/STOPPED/UNKNOWN/DRAINED"""
-job_enum = dataflow.Job.CurrentStateValueValuesEnum
-failed_state = [job_enum.JOB_STATE_FAILED,
-job_enum.JOB_STATE_CANCELLED,
-job_enum.JOB_STATE_STOPPED,
-job_enum.JOB_STATE_UNKNOWN,
-job_enum.JOB_STATE_DRAINED]
+"""Test PipelineStateMatcher fails when using default expected state
+and job actually finished in CANCELLED/DRAINED/FAILED/STOPPED/UNKNOWN
+"""
+failed_state = [PipelineState.CANCELLED,
+PipelineState.DRAINED,
+PipelineState.FAILED,
+PipelineState.STOPPED,
+PipelineState.UNKNOWN]
 
 for state in failed_state:
   pipeline_result = PipelineResult(state)









[jira] [Created] (BEAM-1218) De-Googlify Python SDK in PipelineVerifierTest




2016-12-27

Thread
Mark Liu (JIRA)



Mark Liu created BEAM-1218:
--

 Summary: De-Googlify Python SDK in PipelineVerifierTest
 Key: BEAM-1218
 URL: https://issues.apache.org/jira/browse/BEAM-1218
 Project: Beam
  Issue Type: Bug
  Components: sdk-py
Reporter: Mark Liu
Assignee: Mark Liu


Should use PipelineState for general Beam pipeline instead of 
dataflow.Job.CurrentStateValueValuesEnum.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Updated] (BEAM-1218) De-Googlify Python SDK in PipelineVerifierTest




2016-12-27

Thread
Mark Liu (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Liu updated BEAM-1218:
---
Description: Should use PipelineState for general Beam pipeline state 
verification instead of dataflow.Job.CurrentStateValueValuesEnum.  (was: Should 
use PipelineState for general Beam pipeline instead of 
dataflow.Job.CurrentStateValueValuesEnum.)

> De-Googlify Python SDK in PipelineVerifierTest
> --
>
> Key: BEAM-1218
> URL: https://issues.apache.org/jira/browse/BEAM-1218
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py
>Reporter: Mark Liu
>Assignee: Mark Liu
>
> Should use PipelineState for general Beam pipeline state verification instead 
> of dataflow.Job.CurrentStateValueValuesEnum.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[GitHub] incubator-beam pull request #1703: Fix Python Incorrect PipelineState Usage ...




2016-12-27

Thread
markflyhigh



GitHub user markflyhigh opened a pull request:

https://github.com/apache/incubator-beam/pull/1703

Fix Python Incorrect PipelineState Usage in PipelineVerifier Unit Test

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

Use `PipelineState` instead of `dataflow.Job.CurrentStateValueValuesEnum` 
to test `PipelineStateMatcher` since the matcher is used for general Beam 
pipeline state verification.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/markflyhigh/incubator-beam 
fix-pipeline-verifier-test

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1703.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1703


commit 82fc5e408f5c24f882036990e7d28bbbd1f08308
Author: Mark Liu 
Date:   2016-12-27T23:19:27Z

Fix Incorrect State Usage in PipelineVerifier Unit Test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[jira] [Commented] (BEAM-1201) Remove producesSortedKeys from BoundedSource




2016-12-27

Thread
JIRA




[ 
https://issues.apache.org/jira/browse/BEAM-1201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781480#comment-15781480
 ] 

Ismaël Mejía commented on BEAM-1201:


Just a question out of curiosity, what was the initial design goal of this ? 
What was the runner (or dataflow in the old days) suppose to do with this ?

> Remove producesSortedKeys from BoundedSource
> 
>
> Key: BEAM-1201
> URL: https://issues.apache.org/jira/browse/BEAM-1201
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Daniel Halperin
>Assignee: Daniel Halperin
>Priority: Minor
>  Labels: backward-incompatible
> Fix For: 0.5.0-incubating
>
>
> This is a holdover from a precursor of the old Dataflow SDK that we just 
> failed to delete before releasing Dataflow 1.0, but we can delete before the 
> first stable release of Beam.
> This function has never been used by any runner. It does not mean anything 
> obvious to implementors, as many sources produce {{T}}, not {{KV}} -- 
> what does it mean in the former case? (And how do you get the latter case 
> correct?)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[GitHub] incubator-beam pull request #1702: Fixing test_default_job_name case




2016-12-27

Thread
pabloem



GitHub user pabloem opened a pull request:

https://github.com/apache/incubator-beam/pull/1702

Fixing test_default_job_name case

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/pabloem/incubator-beam job_name_regexp

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1702.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1702


commit 30862d05405de304dad0561c94fda18e16ac9c95
Author: Pablo 
Date:   2016-12-27T23:03:20Z

Fixing test_default_job_name case




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[jira] [Closed] (BEAM-1112) Python E2E Integration Test Framework - Batch Only




2016-12-27

Thread
Mark Liu (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mark Liu closed BEAM-1112.
--
   Resolution: Done
Fix Version/s: Not applicable

> Python E2E Integration Test Framework - Batch Only
> --
>
> Key: BEAM-1112
> URL: https://issues.apache.org/jira/browse/BEAM-1112
> Project: Beam
>  Issue Type: Task
>  Components: sdk-py, testing
>Reporter: Mark Liu
>Assignee: Mark Liu
> Fix For: Not applicable
>
>
> Parity with Java. 
> Build e2e integration test framework that can configure and run batch 
> pipeline with specified test runner, wait for pipeline execution and verify 
> results with given verifiers in the end.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[GitHub] incubator-beam-site pull request #112: Remove incubating references




2016-12-27

Thread
davorbonaci



GitHub user davorbonaci opened a pull request:

https://github.com/apache/incubator-beam-site/pull/112

Remove incubating references

R: @francesperry @dhalperi @jbonofre 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam-site grad

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam-site/pull/112.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #112


commit 891f88bd36dfad3659e29379cd09d5a3d4e30ebf
Author: Davor Bonaci 
Date:   2016-12-27T22:01:36Z

store stuff




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[jira] [Commented] (BEAM-1216) Python SDK Assert transform should not use side inputs




2016-12-27

Thread
ASF GitHub Bot (JIRA)




[ 
https://issues.apache.org/jira/browse/BEAM-1216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781308#comment-15781308
 ] 

ASF GitHub Bot commented on BEAM-1216:
--

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/1699


> Python SDK Assert transform should not use side inputs
> --
>
> Key: BEAM-1216
> URL: https://issues.apache.org/jira/browse/BEAM-1216
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py
>Reporter: Vikas Kedigehalli
>Assignee: Vikas Kedigehalli
>
> Assert can be done through GBK without using side inputs. This is useful for 
> runners that do not support side inputs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[GitHub] incubator-beam pull request #1699: [BEAM-1216] Assert transform without side...




2016-12-27

Thread
asfgit



Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/1699


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








[2/2] incubator-beam git commit: [BEAM-1216] Assert transform without side inputs




2016-12-27

Thread
lcwik



[BEAM-1216] Assert transform without side inputs

This closes #1699


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b2728cf1
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b2728cf1
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/b2728cf1

Branch: refs/heads/python-sdk
Commit: b2728cf131e5ee1aa329c12640d5c79f0c40e38c
Parents: 41bf6f8 1c795c1
Author: Luke Cwik 
Authored: Tue Dec 27 13:33:41 2016 -0800
Committer: Luke Cwik 
Committed: Tue Dec 27 13:33:41 2016 -0800

--
 sdks/python/apache_beam/transforms/util.py | 24 +---
 1 file changed, 13 insertions(+), 11 deletions(-)
--










[1/2] incubator-beam git commit: Assert transform without side inputs




2016-12-27

Thread
lcwik



Repository: incubator-beam
Updated Branches:
  refs/heads/python-sdk 41bf6f8b4 -> b2728cf13


Assert transform without side inputs


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1c795c10
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1c795c10
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/1c795c10

Branch: refs/heads/python-sdk
Commit: 1c795c10f0017766462cced1db1295c50bf2e32f
Parents: 41bf6f8
Author: Vikas Kedigehalli 
Authored: Tue Dec 27 11:09:26 2016 -0800
Committer: Vikas Kedigehalli 
Committed: Tue Dec 27 11:09:26 2016 -0800

--
 sdks/python/apache_beam/transforms/util.py | 24 +---
 1 file changed, 13 insertions(+), 11 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/1c795c10/sdks/python/apache_beam/transforms/util.py
--
diff --git a/sdks/python/apache_beam/transforms/util.py 
b/sdks/python/apache_beam/transforms/util.py
index 9815996..ad63a02 100644
--- a/sdks/python/apache_beam/transforms/util.py
+++ b/sdks/python/apache_beam/transforms/util.py
@@ -20,10 +20,12 @@
 
 from __future__ import absolute_import
 
-from apache_beam.pvalue import AsList
-from apache_beam.transforms import core
 from apache_beam.transforms import window
-from apache_beam.transforms.core import CombinePerKey, Create, Flatten, 
GroupByKey, Map
+from apache_beam.transforms.core import CombinePerKey
+from apache_beam.transforms.core import Flatten
+from apache_beam.transforms.core import GroupByKey
+from apache_beam.transforms.core import Map
+from apache_beam.transforms.core import WindowInto
 from apache_beam.transforms.ptransform import PTransform
 from apache_beam.transforms.ptransform import ptransform_fn
 
@@ -217,17 +219,17 @@ def assert_that(actual, matcher, label='assert_that'):
 Ignored.
   """
 
-  def match(_, actual):
-matcher(actual)
-
   class AssertThat(PTransform):
 
-def expand(self, pipeline):
-  return pipeline | 'singleton' >> Create([None]) | Map(
-  match,
-  AsList(actual | core.WindowInto(window.GlobalWindows(
+def expand(self, pcoll):
+  return (pcoll
+  | WindowInto(window.GlobalWindows())
+  | "ToVoidKey" >> Map(lambda v: (None, v))
+  | "Group" >> GroupByKey()
+  | "UnKey" >> Map(lambda (k, v): v)
+  | "Match" >> Map(matcher))
 
 def default_label(self):
   return label
 
-  actual.pipeline | AssertThat()  # pylint: disable=expression-not-assigned
+  actual | AssertThat()  # pylint: disable=expression-not-assigned









[GitHub] incubator-beam pull request #1701: Remove incubation references (master bran...




2016-12-27

Thread
davorbonaci



GitHub user davorbonaci opened a pull request:

https://github.com/apache/incubator-beam/pull/1701

Remove incubation references (master branch only)

R: @jbonofre, @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/davorbonaci/beam grad

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1701.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1701


commit a3c814dd61212efe2daac8a8d810e65dfdd9a3dc
Author: Davor Bonaci 
Date:   2016-12-27T20:59:15Z

Remove "-incubating" from version identification

This reverts commit 25215889381f7da61766054af68c84ffed4c0c71.

commit 260bc49afb28a62637a150aa3a73d2294017940a
Author: Davor Bonaci 
Date:   2016-12-27T21:00:09Z

Update top-level NOTICE and remove incubating disclaimer

commit e4e6831c0809ef8b2a224fe0b72e5ee323901bb9
Author: Davor Bonaci 
Date:   2016-12-27T21:03:53Z

Update README to remove incubation information

commit 75fc3d75c3008c8994223342b4f83b0b20b672bf
Author: Davor Bonaci 
Date:   2016-12-27T21:11:41Z

Remove incubating references from examples

commit 5cb490e11dc8e061acfb13fa04f52873a43c8f65
Author: Davor Bonaci 
Date:   2016-12-27T21:14:01Z

Update top-level pom.xml to remove incubation references

commit f614ac0437181adf0e29609bf6f72e72257f6929
Author: Davor Bonaci 
Date:   2016-12-27T21:17:22Z

Update component READMEs to remove graduation information

commit 2e02b32709c3a668fcdc390e5beb51875d650d0b
Author: Davor Bonaci 
Date:   2016-12-27T21:20:30Z

Remove incubation references from core SDK and archetypes




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---








svn commit: r1776193 - /beam/




2016-12-27

Thread
fbarboza



Author: fbarboza
Date: Tue Dec 27 21:05:22 2016
New Revision: 1776193

URL: http://svn.apache.org/viewvc?rev=1776193&view=rev
Log:
Beam has become a TLP

Added:
beam/
  - copied from r1776192, incubator/beam/









svn commit: r1776193 - /incubator/beam/




2016-12-27

Thread
fbarboza



Author: fbarboza
Date: Tue Dec 27 21:05:22 2016
New Revision: 1776193

URL: http://svn.apache.org/viewvc?rev=1776193&view=rev
Log:
Beam has become a TLP

Removed:
incubator/beam/









[jira] [Commented] (BEAM-1217) Some examples fail to run due to private / public options mismatch.




2016-12-27

Thread
ASF GitHub Bot (JIRA)




[ 
https://issues.apache.org/jira/browse/BEAM-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15781193#comment-15781193
 ] 

ASF GitHub Bot commented on BEAM-1217:
--

GitHub user jasonkuster opened a pull request:

https://github.com/apache/incubator-beam/pull/1700

[BEAM-1217] Convert options to public to fix private/public problem.

Signed-off-by: Jason Kuster 

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [x] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [x] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [x] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jasonkuster/incubator-beam example-fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1700.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1700


commit c66d90cca40b0c8e37af88a2517a75f9e603e59f
Author: Jason Kuster 
Date:   2016-12-27T20:21:09Z

Convert options to public to fix private/public problem.

Signed-off-by: Jason Kuster 




> Some examples fail to run due to private / public options mismatch.
> ---
>
> Key: BEAM-1217
> URL: https://issues.apache.org/jira/browse/BEAM-1217
> Project: Beam
>  Issue Type: Bug
>Reporter: Jason Kuster
>Assignee: Jason Kuster
>
> Related bug: BEAM-308
> Failure looks like:
> {code}
> Exception in thread "main" java.lang.IllegalArgumentException: non-public 
> interfaces from different packages
>   at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:619)
>   at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
>   at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
>   at java.lang.reflect.WeakCache.get(WeakCache.java:127)
>   at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
>   at java.lang.reflect.Proxy.getProxyClass(Proxy.java:371)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.validateWellFormed(PipelineOptionsFactory.java:605)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1549)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:104)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:289)
>   at 
> org.apache.beam.examples.complete.TrafficRoutes.main(TrafficRoutes.java:340)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Assigned] (BEAM-1217) Some examples fail to run due to private / public options mismatch.




2016-12-27

Thread
Jason Kuster (JIRA)




 [ 
https://issues.apache.org/jira/browse/BEAM-1217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jason Kuster reassigned BEAM-1217:
--

Assignee: Jason Kuster

> Some examples fail to run due to private / public options mismatch.
> ---
>
> Key: BEAM-1217
> URL: https://issues.apache.org/jira/browse/BEAM-1217
> Project: Beam
>  Issue Type: Bug
>Reporter: Jason Kuster
>Assignee: Jason Kuster
>
> Related bug: BEAM-308
> Failure looks like:
> {code}
> Exception in thread "main" java.lang.IllegalArgumentException: non-public 
> interfaces from different packages
>   at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:619)
>   at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
>   at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
>   at java.lang.reflect.WeakCache.get(WeakCache.java:127)
>   at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
>   at java.lang.reflect.Proxy.getProxyClass(Proxy.java:371)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.validateWellFormed(PipelineOptionsFactory.java:605)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1549)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:104)
>   at 
> org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:289)
>   at 
> org.apache.beam.examples.complete.TrafficRoutes.main(TrafficRoutes.java:340)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[jira] [Created] (BEAM-1217) Some examples fail to run due to private / public options mismatch.




2016-12-27

Thread
Jason Kuster (JIRA)



Jason Kuster created BEAM-1217:
--

 Summary: Some examples fail to run due to private / public options 
mismatch.
 Key: BEAM-1217
 URL: https://issues.apache.org/jira/browse/BEAM-1217
 Project: Beam
  Issue Type: Bug
Reporter: Jason Kuster


Related bug: BEAM-308
Failure looks like:

{code}
Exception in thread "main" java.lang.IllegalArgumentException: non-public 
interfaces from different packages
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:619)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.getProxyClass(Proxy.java:371)
at 
org.apache.beam.sdk.options.PipelineOptionsFactory.validateWellFormed(PipelineOptionsFactory.java:605)
at 
org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1549)
at 
org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:104)
at 
org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:289)
at 
org.apache.beam.examples.complete.TrafficRoutes.main(TrafficRoutes.java:340)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)








[GitHub] incubator-beam pull request #1700: [BEAM-1217] Convert options to public to ...




2016-12-27

Thread
jasonkuster



GitHub user jasonkuster opened a pull request:

https://github.com/apache/incubator-beam/pull/1700

[BEAM-1217] Convert options to public to fix private/public problem.

Signed-off-by: Jason Kuster 

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [x] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [x] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [x] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jasonkuster/incubator-beam example-fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1700.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1700


commit c66d90cca40b0c8e37af88a2517a75f9e603e59f
Author: Jason Kuster 
Date:   2016-12-27T20:21:09Z

Convert options to public to fix private/public problem.

Signed-off-by: Jason Kuster 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---






    
  1   2    >