[GitHub] incubator-beam pull request #730: Fix SDK name and version sent to the Cloud...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/730


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/3] incubator-beam git commit: Update docstring.

[robertwb]

Update docstring.


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/76f3864b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/76f3864b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/76f3864b

Branch: refs/heads/python-sdk
Commit: 76f3864b61ad9e2ac9a2e81e7a0d5993db5fde6c
Parents: 8a7bc71
Author: Charles Chen 
Authored: Mon Jul 25 18:36:45 2016 -0700
Committer: Charles Chen 
Committed: Mon Jul 25 18:36:45 2016 -0700

--
 sdks/python/apache_beam/utils/dependency.py | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/76f3864b/sdks/python/apache_beam/utils/dependency.py
--
diff --git a/sdks/python/apache_beam/utils/dependency.py 
b/sdks/python/apache_beam/utils/dependency.py
index d8e0036..7d1ae41 100644
--- a/sdks/python/apache_beam/utils/dependency.py
+++ b/sdks/python/apache_beam/utils/dependency.py
@@ -1,3 +1,4 @@
+
 #
 # Licensed to the Apache Software Foundation (ASF) under one or more
 # contributor license agreements.  See the NOTICE file distributed with
@@ -439,7 +440,7 @@ def get_required_container_version():
 
 
 def get_sdk_name_and_version():
-  """Returns the name and version of the SDK reported to Cloud Dataflow."""
+  """Returns name and version of SDK reported to Google Cloud Dataflow."""
   # TODO(ccy): Make this check cleaner.
   container_version = get_required_container_version()
   if container_version == 'beamhead':

[3/3] incubator-beam git commit: Closes #730

[robertwb]

Closes #730


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/26ff6579
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/26ff6579
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/26ff6579

Branch: refs/heads/python-sdk
Commit: 26ff6579531d598e91b220fa21ec9bd7f9220f78
Parents: 153916f 76f3864
Author: Robert Bradshaw 
Authored: Mon Jul 25 21:11:31 2016 -0700
Committer: Robert Bradshaw 
Committed: Mon Jul 25 21:11:31 2016 -0700

--
 sdks/python/apache_beam/internal/apiclient.py |  6 +++---
 sdks/python/apache_beam/utils/dependency.py   | 12 
 2 files changed, 15 insertions(+), 3 deletions(-)
--

[1/3] incubator-beam git commit: Fix SDK name and version sent to the Cloud Dataflow service

[robertwb]

Repository: incubator-beam
Updated Branches:
  refs/heads/python-sdk 153916fe9 -> 26ff65795


Fix SDK name and version sent to the Cloud Dataflow service


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8a7bc71d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8a7bc71d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/8a7bc71d

Branch: refs/heads/python-sdk
Commit: 8a7bc71dee1e3f9f17c29e5e558870a6bc5f4880
Parents: 38d9dea
Author: Charles Chen 
Authored: Mon Jul 25 18:22:08 2016 -0700
Committer: Charles Chen 
Committed: Mon Jul 25 18:22:08 2016 -0700

--
 sdks/python/apache_beam/internal/apiclient.py |  6 +++---
 sdks/python/apache_beam/utils/dependency.py   | 11 +++
 2 files changed, 14 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/8a7bc71d/sdks/python/apache_beam/internal/apiclient.py
--
diff --git a/sdks/python/apache_beam/internal/apiclient.py 
b/sdks/python/apache_beam/internal/apiclient.py
index 363b8e1..137a40b 100644
--- a/sdks/python/apache_beam/internal/apiclient.py
+++ b/sdks/python/apache_beam/internal/apiclient.py
@@ -29,7 +29,6 @@ from apitools.base.py import encoding
 from apitools.base.py import exceptions
 
 from apache_beam import utils
-from apache_beam import version
 from apache_beam.internal import pickler
 from apache_beam.internal.auth import get_service_credentials
 from apache_beam.internal.json_value import to_json_value
@@ -39,6 +38,7 @@ from apache_beam.utils import dependency
 from apache_beam.utils import names
 from apache_beam.utils import retry
 from apache_beam.utils.dependency import get_required_container_version
+from apache_beam.utils.dependency import get_sdk_name_and_version
 from apache_beam.utils.names import PropertyNames
 from apache_beam.utils.options import GoogleCloudOptions
 from apache_beam.utils.options import StandardOptions
@@ -191,12 +191,12 @@ class Environment(object):
 self.proto.userAgent = dataflow.Environment.UserAgentValue()
 self.local = 'localhost' in self.google_cloud_options.dataflow_endpoint
 
-version_string = version.__version__
+sdk_name, version_string = get_sdk_name_and_version()
 
 self.proto.userAgent.additionalProperties.extend([
 dataflow.Environment.UserAgentValue.AdditionalProperty(
 key='name',
-value=to_json_value('Google Cloud Dataflow SDK for Python')),
+value=to_json_value(sdk_name)),
 dataflow.Environment.UserAgentValue.AdditionalProperty(
 key='version', value=to_json_value(version_string))])
 # Version information.

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/8a7bc71d/sdks/python/apache_beam/utils/dependency.py
--
diff --git a/sdks/python/apache_beam/utils/dependency.py 
b/sdks/python/apache_beam/utils/dependency.py
index b809cf2..d8e0036 100644
--- a/sdks/python/apache_beam/utils/dependency.py
+++ b/sdks/python/apache_beam/utils/dependency.py
@@ -59,6 +59,7 @@ import tempfile
 
 
 from apache_beam import utils
+from apache_beam import version as beam_version
 from apache_beam.internal import pickler
 from apache_beam.utils import names
 from apache_beam.utils import processes
@@ -437,6 +438,16 @@ def get_required_container_version():
 return 'beamhead'
 
 
+def get_sdk_name_and_version():
+  """Returns the name and version of the SDK reported to Cloud Dataflow."""
+  # TODO(ccy): Make this check cleaner.
+  container_version = get_required_container_version()
+  if container_version == 'beamhead':
+return ('Apache Beam SDK for Python', beam_version.__version__)
+  else:
+return ('Google Cloud Dataflow SDK for Python', container_version)
+
+
 def _download_pypi_sdk_package(temp_dir):
   """Downloads SDK package from PyPI and returns path to local path."""
   # TODO(silviuc): Handle apache-beam versions when we have official releases.

[GitHub] incubator-beam pull request #720: Remove overrides of isStreaming() and getA...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/720


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/2] incubator-beam git commit: Remove overrides of isStreaming() and getAppName() in SparkPipelineOptions

[lcwik]

Remove overrides of isStreaming() and getAppName() in SparkPipelineOptions

This closes #720


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/267136fb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/267136fb
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/267136fb

Branch: refs/heads/master
Commit: 267136fb609d474b418e5064a52bc1b52753a31e
Parents: 7809f6b f52a656
Author: Luke Cwik 
Authored: Mon Jul 25 19:17:39 2016 -0700
Committer: Luke Cwik 
Committed: Mon Jul 25 19:17:39 2016 -0700

--
 .../org/apache/beam/runners/spark/SparkPipelineOptions.java | 9 -
 .../beam/runners/spark/SparkStreamingPipelineOptions.java   | 9 -
 .../spark/translation/streaming/FlattenStreamingTest.java   | 2 +-
 .../spark/translation/streaming/KafkaStreamingTest.java | 2 +-
 .../translation/streaming/SimpleStreamingWordCountTest.java | 2 +-
 5 files changed, 3 insertions(+), 21 deletions(-)
--

[GitHub] incubator-beam pull request #731: Remove spark test dependency on DirectRunn...

[dhalperi]

GitHub user dhalperi opened a pull request:

https://github.com/apache/incubator-beam/pull/731

Remove spark test dependency on DirectRunner

Rather than assert that SparkRunner matches DirectRunner, assert that 
SparkRunner is correct.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam spark-direct-runner

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/731.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #731


commit 34fa4497e3689deaccff3bd208aec09b391b126d
Author: Dan Halperin 
Date:   2016-07-26T01:37:57Z

Remove spark test dependency on DirectRunner

Rather than assert that SparkRunner matches DirectRunner, assert that 
SparkRunner is correct.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (BEAM-380) Remove Spark runner dependency on beam-examlpes-java

[Daniel Halperin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Halperin resolved BEAM-380.
--
   Resolution: Fixed
Fix Version/s: 0.2.0-incubating

> Remove Spark runner dependency on beam-examlpes-java
> 
>
> Key: BEAM-380
> URL: https://issues.apache.org/jira/browse/BEAM-380
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Amit Sela
>Assignee: Amit Sela
>Priority: Minor
> Fix For: 0.2.0-incubating
>
>
> Remove runner dependency to allow to allow beam-examples to have runtime 
> dependency on runners-spark. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #730: Fix SDK name and version sent to the Cloud...

[charlesccychen]

GitHub user charlesccychen opened a pull request:

https://github.com/apache/incubator-beam/pull/730

Fix SDK name and version sent to the Cloud Dataflow service



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/charlesccychen/incubator-beam fix-sdk-version

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/730.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #730


commit 8a7bc71dee1e3f9f17c29e5e558870a6bc5f4880
Author: Charles Chen 
Date:   2016-07-26T01:22:08Z

Fix SDK name and version sent to the Cloud Dataflow service




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #729: [BEAM-480] Move createTable() from BigQuer...

[peihe]

GitHub user peihe opened a pull request:

https://github.com/apache/incubator-beam/pull/729

[BEAM-480] Move createTable() from BigQueryTableInserter to BigQueryServices




You can merge this pull request into a Git repository by running:

$ git pull https://github.com/peihe/incubator-beam bq-services

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/729.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #729


commit fffb3d98f16132771c9a5e5de7699f7cacdb84f7
Author: Pei He 
Date:   2016-07-25T18:02:10Z

[BEAM-480] Move createTable() to BigQueryServices




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-480) Use BigQueryServices abstraction in BigQueryIO

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392918#comment-15392918
 ] 

ASF GitHub Bot commented on BEAM-480:
-

GitHub user peihe opened a pull request:

https://github.com/apache/incubator-beam/pull/729

[BEAM-480] Move createTable() from BigQueryTableInserter to BigQueryServices




You can merge this pull request into a Git repository by running:

$ git pull https://github.com/peihe/incubator-beam bq-services

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/729.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #729


commit fffb3d98f16132771c9a5e5de7699f7cacdb84f7
Author: Pei He 
Date:   2016-07-25T18:02:10Z

[BEAM-480] Move createTable() to BigQueryServices




> Use BigQueryServices abstraction in BigQueryIO
> --
>
> Key: BEAM-480
> URL: https://issues.apache.org/jira/browse/BEAM-480
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-gcp
>Reporter: Pei He
>Assignee: Pei He
>Priority: Minor
>
> There are legacy code that sent request to BigQuery directly.
> They should be moved to use BigQueryServices.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #728: CoderRegistry: make deprecated method priv...

[dhalperi]

GitHub user dhalperi opened a pull request:

https://github.com/apache/incubator-beam/pull/728

CoderRegistry: make deprecated method private

This was part of the public API signature in Dataflow, but need not be in 
Beam.

Also remove a few unneeded publics in the same file.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam coder-registry

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/728.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #728


commit eeb0586dda3f29dc2ff0de62bc2458812139696b
Author: Dan Halperin 
Date:   2016-07-26T00:12:01Z

CoderRegistry: make deprecated method private

This was part of the public API signature in Dataflow, but need not be in 
Beam.

Also remove a few unneeded publics in the same file.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #727: [BEAM-486] Remove mention of Apache v2.0 L...

[dhalperi]

GitHub user dhalperi opened a pull request:

https://github.com/apache/incubator-beam/pull/727

[BEAM-486] Remove mention of Apache v2.0 LICENSE

R: @jbonofre 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam start-release

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/727.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #727


commit f301b164c0dce8d3db766c3cdc939048c06d5235
Author: Dan Halperin 
Date:   2016-07-25T23:42:23Z

[BEAM-486] Remove mention of Apache v2.0 LICENSE




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-486) Cleanup NOTICE file

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392864#comment-15392864
 ] 

ASF GitHub Bot commented on BEAM-486:
-

GitHub user dhalperi opened a pull request:

https://github.com/apache/incubator-beam/pull/727

[BEAM-486] Remove mention of Apache v2.0 LICENSE

R: @jbonofre 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/dhalperi/incubator-beam start-release

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/727.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #727


commit f301b164c0dce8d3db766c3cdc939048c06d5235
Author: Dan Halperin 
Date:   2016-07-25T23:42:23Z

[BEAM-486] Remove mention of Apache v2.0 LICENSE




> Cleanup NOTICE file
> ---
>
> Key: BEAM-486
> URL: https://issues.apache.org/jira/browse/BEAM-486
> Project: Beam
>  Issue Type: Task
>  Components: project-management
>Reporter: Daniel Halperin
>Assignee: Daniel Halperin
>
> http://mail-archives.apache.org/mod_mbox/incubator-general/201606.mbox/%3ca5f50a0f-f1e1-4391-8188-391187b9e...@classsoftware.com%3E
> - NOTICE file contain unneeded text (i.e mentions  Apache v2.0 licence). 
> There no need to
> generally mention Apache 2.0 licences in NOTICE [2]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Resolved] (BEAM-445) Beam-examples-java build failed through local "mvn install"

[Daniel Halperin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Halperin resolved BEAM-445.
--
Resolution: Fixed

> Beam-examples-java build failed through local "mvn install"
> ---
>
> Key: BEAM-445
> URL: https://issues.apache.org/jira/browse/BEAM-445
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-gcp
> Environment: linux
>Reporter: Mark Liu
>Assignee: Daniel Halperin
>Priority: Critical
> Fix For: Not applicable
>
>
> Build project under beam/examples/java with command "mvn clean install 
> -DskipTests" failed with following error:
> [ERROR] Failed to execute goal on project beam-examples-java: Could not 
> resolve dependencies for project 
> org.apache.beam:beam-examples-java:jar:0.2.0-incubating-SNAPSHOT: Could not 
> transfer artifact 
> io.netty:netty-tcnative-boringssl-static:jar:${os.detected.classifier}:1.1.33.Fork13
>  from/to central (http://repo.maven.apache.org/maven2): Illegal character in 
> path at index 138: 
> http://repo.maven.apache.org/maven2/io/netty/netty-tcnative-boringssl-static/1.1.33.Fork13/netty-tcnative-boringssl-static-1.1.33.Fork13-${os.detected.classifier}.jar
> Reason: can't resolve ${os.detected.classifier} in 
> beam/sdks/java/io/google-cloud-platform/pom file.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (BEAM-458) Support for Flink Metrics

[Daniel Halperin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Halperin updated BEAM-458:
-
Component/s: (was: runner-flink)
 (was: runner-core)
 beam-model

> Support for Flink Metrics 
> --
>
> Key: BEAM-458
> URL: https://issues.apache.org/jira/browse/BEAM-458
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Sumit Chawla
>Assignee: Frances Perry
>Priority: Critical
>
> Flink has added support for CodeHale Metrics 
> (https://ci.apache.org/projects/flink/flink-docs-master/apis/metrics.html#registering-metrics)
> These metrics are more advanced then the current Accumulators. 
> Adding support for these to Beam level should be a good addition.
> https://github.com/apache/flink/pull/1947#issuecomment-233029166



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #22

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-362) Move shared runner functionality out of SDK and into runners/core-java

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392524#comment-15392524
 ] 

ASF GitHub Bot commented on BEAM-362:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/697


> Move shared runner functionality out of SDK and into runners/core-java
> --
>
> Key: BEAM-362
> URL: https://issues.apache.org/jira/browse/BEAM-362
> Project: Beam
>  Issue Type: Improvement
>  Components: runner-core
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[2/4] incubator-beam git commit: Introduce StateInternalsFactory

[kenn]

Introduce StateInternalsFactory

This class vends a StateInternals for a particular key.
Various DoFns that access StateInternals via ProcessContext
will be ported to instead accept a StateInternalsFactory.

The StateInternalsFatory must be provided by the runner
to enable provisioning of the appropriate run-time
StateInternals.


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d2594e0f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d2594e0f
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/d2594e0f

Branch: refs/heads/master
Commit: d2594e0fc588849dba905e168523deacd4f1f4dd
Parents: 20244ba
Author: Kenneth Knowles 
Authored: Mon Jul 18 13:56:22 2016 -0700
Committer: Kenneth Knowles 
Committed: Mon Jul 25 09:30:32 2016 -0700

--
 .../sdk/util/state/StateInternalsFactory.java   | 36 
 1 file changed, 36 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d2594e0f/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateInternalsFactory.java
--
diff --git 
a/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateInternalsFactory.java
 
b/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateInternalsFactory.java
new file mode 100644
index 000..54355c7
--- /dev/null
+++ 
b/sdks/java/core/src/main/java/org/apache/beam/sdk/util/state/StateInternalsFactory.java
@@ -0,0 +1,36 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements.  See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership.  The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License.  You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.beam.sdk.util.state;
+
+import org.apache.beam.sdk.annotations.Experimental;
+import org.apache.beam.sdk.annotations.Experimental.Kind;
+
+import java.io.Serializable;
+
+/**
+ * A factory for providing {@link StateInternals} for a particular key.
+ *
+ * Because it will generally be embedded in a {@link DoFn}, albeit at 
execution time,
+ * it is marked {@link Serializable}.
+ */
+@Experimental(Kind.STATE)
+public interface StateInternalsFactory {
+
+  /** Returns {@link StateInternals} for the provided key. */
+  StateInternals stateInternalsForKey(K key);
+}

[4/4] incubator-beam git commit: This closes #697

[kenn]

This closes #697


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7809f6bd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7809f6bd
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/7809f6bd

Branch: refs/heads/master
Commit: 7809f6bd2cd3605ce389a174aba242ea08860f88
Parents: cf14644 902997d
Author: Kenneth Knowles 
Authored: Mon Jul 25 12:11:27 2016 -0700
Committer: Kenneth Knowles 
Committed: Mon Jul 25 12:11:27 2016 -0700

--
 .../core/GroupAlsoByWindowViaWindowSetDoFn.java | 16 ++--
 .../beam/sdk/util/GroupAlsoByWindowsDoFn.java   | 10 ++-
 .../GroupAlsoByWindowsViaOutputBufferDoFn.java  | 10 +--
 .../sdk/util/GroupByKeyViaGroupByKeyOnly.java   | 79 +---
 .../sdk/util/GroupAlsoByWindowsProperties.java  | 50 +++--
 ...oupAlsoByWindowsViaOutputBufferDoFnTest.java |  8 +-
 .../GroupAlsoByWindowEvaluatorFactory.java  | 30 
 .../beam/runners/direct/ParDoEvaluator.java |  4 +-
 .../direct/ParDoMultiEvaluatorFactory.java  |  6 ++
 .../direct/ParDoSingleEvaluatorFactory.java |  6 ++
 .../direct/WriteWithShardingFactory.java|  7 +-
 .../beam/runners/direct/ParDoEvaluatorTest.java |  1 +
 .../FlinkGroupAlsoByWindowWrapper.java  | 31 +---
 .../spark/translation/TransformTranslator.java  | 70 -
 .../apache/beam/sdk/transforms/DoFnTester.java  | 41 +-
 .../sdk/util/state/StateInternalsFactory.java   | 36 +
 16 files changed, 349 insertions(+), 56 deletions(-)
--

[1/4] incubator-beam git commit: Port runners to use GroupAlsoByWindows via StateInternalsFactory

[kenn]

Repository: incubator-beam
Updated Branches:
  refs/heads/master cf1464465 -> 7809f6bd2


Port runners to use GroupAlsoByWindows via StateInternalsFactory


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/902997d0
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/902997d0
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/902997d0

Branch: refs/heads/master
Commit: 902997d040023c83d23e57362bdfb2d62c53d142
Parents: d2594e0
Author: Kenneth Knowles 
Authored: Mon Jul 18 14:33:58 2016 -0700
Committer: Kenneth Knowles 
Committed: Mon Jul 25 09:30:32 2016 -0700

--
 .../core/GroupAlsoByWindowViaWindowSetDoFn.java | 16 ++--
 .../beam/sdk/util/GroupAlsoByWindowsDoFn.java   | 10 ++-
 .../GroupAlsoByWindowsViaOutputBufferDoFn.java  | 10 +--
 .../sdk/util/GroupByKeyViaGroupByKeyOnly.java   | 79 +---
 .../sdk/util/GroupAlsoByWindowsProperties.java  | 50 +++--
 ...oupAlsoByWindowsViaOutputBufferDoFnTest.java |  8 +-
 .../GroupAlsoByWindowEvaluatorFactory.java  | 30 
 .../beam/runners/direct/ParDoEvaluator.java |  4 +-
 .../direct/ParDoMultiEvaluatorFactory.java  |  6 ++
 .../direct/ParDoSingleEvaluatorFactory.java |  6 ++
 .../beam/runners/direct/ParDoEvaluatorTest.java |  1 +
 .../FlinkGroupAlsoByWindowWrapper.java  | 31 +---
 .../spark/translation/TransformTranslator.java  | 70 -
 .../apache/beam/sdk/transforms/DoFnTester.java  | 41 +-
 14 files changed, 309 insertions(+), 53 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/902997d0/runners/core-java/src/main/java/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.java
--
diff --git 
a/runners/core-java/src/main/java/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.java
 
b/runners/core-java/src/main/java/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.java
index 73244f7..0d320bc 100644
--- 
a/runners/core-java/src/main/java/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.java
+++ 
b/runners/core-java/src/main/java/org/apache/beam/runners/core/GroupAlsoByWindowViaWindowSetDoFn.java
@@ -31,6 +31,7 @@ import org.apache.beam.sdk.util.TimerInternals;
 import org.apache.beam.sdk.util.TimerInternals.TimerData;
 import org.apache.beam.sdk.util.WindowingStrategy;
 import org.apache.beam.sdk.util.state.StateInternals;
+import org.apache.beam.sdk.util.state.StateInternalsFactory;
 import org.apache.beam.sdk.values.KV;
 
 /**
@@ -44,8 +45,10 @@ public class GroupAlsoByWindowViaWindowSetDoFn<
 
   public static 
   DoFn, KV> create(
-  WindowingStrategy strategy, SystemReduceFn reduceFn) {
-return new GroupAlsoByWindowViaWindowSetDoFn<>(strategy, reduceFn);
+  WindowingStrategy strategy,
+  StateInternalsFactory stateInternalsFactory,
+  SystemReduceFn reduceFn) {
+return new GroupAlsoByWindowViaWindowSetDoFn<>(strategy, 
stateInternalsFactory, reduceFn);
   }
 
   protected final Aggregator droppedDueToClosedWindow =
@@ -55,15 +58,18 @@ public class GroupAlsoByWindowViaWindowSetDoFn<
   createAggregator(GroupAlsoByWindowsDoFn.DROPPED_DUE_TO_LATENESS_COUNTER, 
new Sum.SumLongFn());
 
   private final WindowingStrategy windowingStrategy;
+  private final StateInternalsFactory stateInternalsFactory;
   private SystemReduceFn reduceFn;
 
   private GroupAlsoByWindowViaWindowSetDoFn(
   WindowingStrategy windowingStrategy,
+  StateInternalsFactory stateInternalsFactory,
   SystemReduceFn reduceFn) {
 @SuppressWarnings("unchecked")
 WindowingStrategy noWildcard = (WindowingStrategy) 
windowingStrategy;
 this.windowingStrategy = noWildcard;
 this.reduceFn = reduceFn;
+this.stateInternalsFactory = stateInternalsFactory;
   }
 
   @Override
@@ -72,11 +78,7 @@ public class GroupAlsoByWindowViaWindowSetDoFn<
 
 K key = c.element().key();
 TimerInternals timerInternals = c.windowingInternals().timerInternals();
-
-// It is the responsibility of the user of GroupAlsoByWindowsViaWindowSet 
to only
-// provide a WindowingInternals instance with the appropriate key type for 
StateInternals.
-@SuppressWarnings("unchecked")
-StateInternals stateInternals = (StateInternals) 
c.windowingInternals().stateInternals();
+StateInternals stateInternals = 
stateInternalsFactory.stateInternalsForKey(key);
 
 ReduceFnRunner 

[3/4] incubator-beam git commit: Tidy WriteWithShardingFactory

[kenn]

Tidy WriteWithShardingFactory


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/20244bad
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/20244bad
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/20244bad

Branch: refs/heads/master
Commit: 20244badc3d1b8defd9e5b9a718f54475c502365
Parents: cf14644
Author: Kenneth Knowles 
Authored: Tue Jul 19 19:16:13 2016 -0700
Committer: Kenneth Knowles 
Committed: Mon Jul 25 09:30:32 2016 -0700

--
 .../apache/beam/runners/direct/WriteWithShardingFactory.java  | 7 ---
 1 file changed, 4 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/20244bad/runners/direct-java/src/main/java/org/apache/beam/runners/direct/WriteWithShardingFactory.java
--
diff --git 
a/runners/direct-java/src/main/java/org/apache/beam/runners/direct/WriteWithShardingFactory.java
 
b/runners/direct-java/src/main/java/org/apache/beam/runners/direct/WriteWithShardingFactory.java
index 93f2408..d6ee6ea 100644
--- 
a/runners/direct-java/src/main/java/org/apache/beam/runners/direct/WriteWithShardingFactory.java
+++ 
b/runners/direct-java/src/main/java/org/apache/beam/runners/direct/WriteWithShardingFactory.java
@@ -78,7 +78,8 @@ class WriteWithShardingFactory implements 
PTransformOverrideFactory {
   Window.into(new GlobalWindows()).triggering(DefaultTrigger.of())
   .withAllowedLateness(Duration.ZERO)
   .discardingFiredPanes());
-  final PCollectionView numRecords = 
records.apply(Count.globally().asSingletonView());
+  final PCollectionView numRecords = records
+  .apply("CountRecords", Count.globally().asSingletonView());
   PCollection resharded =
   records
   .apply(
@@ -107,7 +108,7 @@ class WriteWithShardingFactory implements 
PTransformOverrideFactory {
 private final PCollectionView numRecords;
 private final int randomExtraShards;
 private int currentShard;
-private int maxShards;
+private int maxShards = 0;
 
 KeyBasedOnCountFn(PCollectionView numRecords, int extraShards) {
   this.numRecords = numRecords;
@@ -116,7 +117,7 @@ class WriteWithShardingFactory implements 
PTransformOverrideFactory {
 
 @Override
 public void processElement(ProcessContext c) throws Exception {
-  if (maxShards == 0L) {
+  if (maxShards == 0) {
 maxShards = calculateShards(c.sideInput(numRecords));
 currentShard = ThreadLocalRandom.current().nextInt(maxShards);
   }

[GitHub] incubator-beam pull request #721: Make DoFnRunner a Receiver.

[robertwb]

Github user robertwb closed the pull request at:

https://github.com/apache/incubator-beam/pull/721


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[4/4] incubator-beam git commit: Closes #721

[robertwb]

Closes #721


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/153916fe
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/153916fe
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/153916fe

Branch: refs/heads/python-sdk
Commit: 153916fe9f641f5fe5e8d473caef67f449ee6bca
Parents: 38d9dea de35f28
Author: Robert Bradshaw 
Authored: Mon Jul 25 12:02:02 2016 -0700
Committer: Robert Bradshaw 
Committed: Mon Jul 25 12:02:02 2016 -0700

--
 sdks/python/apache_beam/runners/common.pxd | 30 ---
 sdks/python/apache_beam/runners/common.py  | 72 ++---
 2 files changed, 86 insertions(+), 16 deletions(-)
--

[3/4] incubator-beam git commit: Allow passing logging context directly.

[robertwb]

Allow passing logging context directly.

This is better than passing a logger module with a specific class.


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/de35f282
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/de35f282
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/de35f282

Branch: refs/heads/python-sdk
Commit: de35f28294dfb4f47b429635eff843b38279e240
Parents: d20cf64
Author: Robert Bradshaw 
Authored: Sat Jul 23 00:54:11 2016 -0700
Committer: Robert Bradshaw 
Committed: Mon Jul 25 11:57:42 2016 -0700

--
 sdks/python/apache_beam/runners/common.py | 10 --
 1 file changed, 8 insertions(+), 2 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/de35f282/sdks/python/apache_beam/runners/common.py
--
diff --git a/sdks/python/apache_beam/runners/common.py 
b/sdks/python/apache_beam/runners/common.py
index 9c9ab22..c017704 100644
--- a/sdks/python/apache_beam/runners/common.py
+++ b/sdks/python/apache_beam/runners/common.py
@@ -62,7 +62,9 @@ class DoFnRunner(Receiver):
context,
tagged_receivers,
logger=None,
-   step_name=None):
+   step_name=None,
+   # Preferred alternative to logger
+   logging_context=None):
 if not args and not kwargs:
   self.dofn = fn
   self.dofn_process = fn.process
@@ -85,9 +87,13 @@ class DoFnRunner(Receiver):
 self.window_fn = windowing.windowfn
 self.context = context
 self.tagged_receivers = tagged_receivers
-self.logging_context = get_logging_context(logger, step_name=step_name)
 self.step_name = step_name
 
+if logging_context:
+  self.logging_context = logging_context
+else:
+  self.logging_context = get_logging_context(logger, step_name=step_name)
+
 # Optimize for the common case.
 self.main_receivers = as_receiver(tagged_receivers[None])
 

[jira] [Commented] (BEAM-354) Modify DatastoreIO to use Datastore v1beta3 API

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392448#comment-15392448
 ] 

ASF GitHub Bot commented on BEAM-354:
-

GitHub user vikkyrk opened a pull request:

https://github.com/apache/incubator-beam/pull/725

[BEAM-354] Move V1Beta3 DatastoreSource into its own file

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

- No logic changes, just move DataSource to new file and rename to 
V1Beta3Source

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/vikkyrk/incubator-beam vikasrk/ds_refactor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/725.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #725


commit 0f7ab24daa18788bef1083242c3a2a7d054c767f
Author: Vikas Kedigehalli 
Date:   2016-07-25T18:10:10Z

Move V1Beta3 DatastoreSource into its own file




> Modify DatastoreIO to use Datastore v1beta3 API
> ---
>
> Key: BEAM-354
> URL: https://issues.apache.org/jira/browse/BEAM-354
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-gcp
>Affects Versions: 0.2.0-incubating
>Reporter: Vikas Kedigehalli
>Assignee: Vikas Kedigehalli
> Fix For: 0.2.0-incubating
>
>
> Datastore v1beta2 API is getting deprecated in favor of v1beta3. Hence the 
> DatastoreIO needs to be migrated to use the new version. Also in the process 
> of doing so, this is a good time to add a level of indirection via a 
> PTranform such that future changes in Datastore API would not result in 
> changing user/pipeline code. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #725: [BEAM-354] Move V1Beta3 DatastoreSource in...

[vikkyrk]

GitHub user vikkyrk opened a pull request:

https://github.com/apache/incubator-beam/pull/725

[BEAM-354] Move V1Beta3 DatastoreSource into its own file

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

- No logic changes, just move DataSource to new file and rename to 
V1Beta3Source

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/vikkyrk/incubator-beam vikasrk/ds_refactor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/725.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #725


commit 0f7ab24daa18788bef1083242c3a2a7d054c767f
Author: Vikas Kedigehalli 
Date:   2016-07-25T18:10:10Z

Move V1Beta3 DatastoreSource into its own file




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #21

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-198) Spark runner batch translator to work with Datasets instead of RDDs

[Amit Sela (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392346#comment-15392346
 ] 

Amit Sela commented on BEAM-198:


See https://github.com/apache/incubator-beam/pull/495
Happy to get reviews/comments/testing/benchmarks. And of course you're most 
welcomed to help with next steps - streaming "a la Beam" with Structured 
Streaming. 

We can chat about this in Beam's Slack channel. 

> Spark runner batch translator to work with Datasets instead of RDDs
> ---
>
> Key: BEAM-198
> URL: https://issues.apache.org/jira/browse/BEAM-198
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-spark
>Reporter: Amit Sela
>Assignee: Amit Sela
>
> Currently, the Spark runner translates batch pipelines into RDD code, meaning 
> it doesn't benefit from the optimizations DataFrames (which isn't type-safe) 
> enjoys.
> With Datasets, batch pipelines will benefit the optimizations, adding to that 
> that Datasets are type-safe and encoder-based they seem like a much better 
> fit for the Beam model.
> Looking ahead, Datasets is a good choice since it's the basis for the future 
> of Spark streaming as well  (Structured Streaming) so this will hopefully lay 
> a solid foundation for a native integration between Spark 2.0 and Beam.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-198) Spark runner batch translator to work with Datasets instead of RDDs

[holdenk (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392332#comment-15392332
 ] 

holdenk commented on BEAM-198:
--

Are people working on this currently? I'd be happy to help out perhaps if not.

> Spark runner batch translator to work with Datasets instead of RDDs
> ---
>
> Key: BEAM-198
> URL: https://issues.apache.org/jira/browse/BEAM-198
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-spark
>Reporter: Amit Sela
>Assignee: Amit Sela
>
> Currently, the Spark runner translates batch pipelines into RDD code, meaning 
> it doesn't benefit from the optimizations DataFrames (which isn't type-safe) 
> enjoys.
> With Datasets, batch pipelines will benefit the optimizations, adding to that 
> that Datasets are type-safe and encoder-based they seem like a much better 
> fit for the Beam model.
> Looking ahead, Datasets is a good choice since it's the basis for the future 
> of Spark streaming as well  (Structured Streaming) so this will hopefully lay 
> a solid foundation for a native integration between Spark 2.0 and Beam.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #712: spark: Direct runner should be test scope

[dhalperi]

Github user dhalperi closed the pull request at:

https://github.com/apache/incubator-beam/pull/712


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam-site pull request #28: Adding Travis CI YAML config

[evilsoapbox]

GitHub user evilsoapbox opened a pull request:

https://github.com/apache/incubator-beam-site/pull/28

Adding Travis CI YAML config

Re-adding YAML config for Travis CI (sorry - had to fix a GitHub mess I 
accidentally created here.) This replaces PR #24.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/evilsoapbox/incubator-beam-site asf-site

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam-site/pull/28.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #28


commit 6add7387614f6b0cefb2e68eb5fa400ff739b7ef
Author: James Malone 
Date:   2016-07-25T16:51:14Z

Adding Travis CI YAML config




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam-site pull request #24: Travis CI YAML config

[evilsoapbox]

Github user evilsoapbox closed the pull request at:

https://github.com/apache/incubator-beam-site/pull/24


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_SparkLocal #20

[Apache Jenkins Server]

See 

[GitHub] incubator-beam pull request #724: [flink] improve example section in README

[mxm]

GitHub user mxm opened a pull request:

https://github.com/apache/incubator-beam/pull/724

[flink] improve example section in README

- updates the README
- repairs broken exec configuration

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mxm/incubator-beam README

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/724.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #724


commit 2f07d4e6d5b801860be804a808ec5c87fe067c5a
Author: Maximilian Michels 
Date:   2016-07-20T14:06:06Z

[flink] improve example section in README

- updates the README
- repairs broken exec configuration




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---