[jira] [Created] (BEAM-632) FlattenWithMultipleInputs broke GoogleCloudDataflow_RunnableOnService tests

[Daniel Halperin (JIRA)]

Daniel Halperin created BEAM-632:


 Summary: FlattenWithMultipleInputs broke 
GoogleCloudDataflow_RunnableOnService tests
 Key: BEAM-632
 URL: https://issues.apache.org/jira/browse/BEAM-632
 Project: Beam
  Issue Type: Bug
  Components: runner-dataflow
Reporter: Daniel Halperin
Assignee: Thomas Groh


https://github.com/apache/incubator-beam/pull/960

Builds #1148+ are failing the new test that [~tgroh] added in that PR.

https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GoogleCloudDataflow/changes



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1150

[Apache Jenkins Server]

See 

[jira] [Closed] (BEAM-631) upgrade surefire plugin to 2.19.1

[Daniel Halperin (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Halperin closed BEAM-631.

   Resolution: Fixed
Fix Version/s: Not applicable

> upgrade surefire plugin to 2.19.1
> -
>
> Key: BEAM-631
> URL: https://issues.apache.org/jira/browse/BEAM-631
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Affects Versions: 0.2.0-incubating
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>Priority: Minor
> Fix For: Not applicable
>
>
> As of surefire 2.19.1, fully qualified class names and packages can be used 
> to exclude tests, which is needed by Gearpump Runner. Spark Runner also 
> requires 2.19.1 for fork control.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (BEAM-631) upgrade surefire plugin to 2.19.1

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492293#comment-15492293
 ] 

ASF GitHub Bot commented on BEAM-631:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/961


> upgrade surefire plugin to 2.19.1
> -
>
> Key: BEAM-631
> URL: https://issues.apache.org/jira/browse/BEAM-631
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Affects Versions: 0.2.0-incubating
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>Priority: Minor
>
> As of surefire 2.19.1, fully qualified class names and packages can be used 
> to exclude tests, which is needed by Gearpump Runner. Spark Runner also 
> requires 2.19.1 for fork control.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #961: [BEAM-631] upgrade surefire plugin to 2.19...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/961


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/2] incubator-beam git commit: Closes #961

[dhalperi]

Closes #961


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d71d828b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d71d828b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/d71d828b

Branch: refs/heads/master
Commit: d71d828b762b38074c67db0210c9c5b952e18905
Parents: ae6333a e7f8fae
Author: Dan Halperin 
Authored: Wed Sep 14 21:03:03 2016 -0700
Committer: Dan Halperin 
Committed: Wed Sep 14 21:03:03 2016 -0700

--
 pom.xml  | 4 ++--
 runners/spark/pom.xml| 2 --
 .../examples/src/main/resources/archetype-resources/pom.xml  | 4 ++--
 3 files changed, 4 insertions(+), 6 deletions(-)
--

[1/2] incubator-beam git commit: [BEAM-631] upgrade surefire plugin to 2.19.1

[dhalperi]

Repository: incubator-beam
Updated Branches:
  refs/heads/master ae6333a41 -> d71d828b7


[BEAM-631] upgrade surefire plugin to 2.19.1


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e7f8fae2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e7f8fae2
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/e7f8fae2

Branch: refs/heads/master
Commit: e7f8fae296318e8f7805484e50becfbe5f336bb2
Parents: ae6333a
Author: manuzhang 
Authored: Thu Sep 15 08:39:53 2016 +0800
Committer: manuzhang 
Committed: Thu Sep 15 08:39:53 2016 +0800

--
 pom.xml  | 4 ++--
 runners/spark/pom.xml| 2 --
 .../examples/src/main/resources/archetype-resources/pom.xml  | 4 ++--
 3 files changed, 4 insertions(+), 6 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e7f8fae2/pom.xml
--
diff --git a/pom.xml b/pom.xml
index 242a9ce..01b5a88 100644
--- a/pom.xml
+++ b/pom.xml
@@ -875,7 +875,7 @@
 
   org.apache.maven.plugins
   maven-surefire-plugin
-  2.18.1
+  2.19.1
   
 false
 false
@@ -886,7 +886,7 @@
 
   org.apache.maven.surefire
   surefire-junit47
-  2.18.1
+  2.19.1
 
   
 

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e7f8fae2/runners/spark/pom.xml
--
diff --git a/runners/spark/pom.xml b/runners/spark/pom.xml
index 14bbd73..228a90b 100644
--- a/runners/spark/pom.xml
+++ b/runners/spark/pom.xml
@@ -284,8 +284,6 @@
 
   org.apache.maven.plugins
   maven-surefire-plugin
-  
-  2.19.1
   
 1
 false

http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e7f8fae2/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml
--
diff --git 
a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml
 
b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml
index 54b16b0..d3418ef 100644
--- 
a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml
+++ 
b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml
@@ -73,7 +73,7 @@
   
 org.apache.maven.plugins
 maven-surefire-plugin
-2.18.1
+2.19.1
 
   all
   4
@@ -83,7 +83,7 @@
   
 org.apache.maven.surefire
 surefire-junit47
-2.18.1
+2.19.1
   
 
   

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1149

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-79) Gearpump runner

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491929#comment-15491929
 ] 

ASF GitHub Bot commented on BEAM-79:


Github user manuzhang closed the pull request at:

https://github.com/apache/incubator-beam/pull/959


> Gearpump runner
> ---
>
> Key: BEAM-79
> URL: https://issues.apache.org/jira/browse/BEAM-79
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-gearpump
>Reporter: Tyler Akidau
>Assignee: Manu Zhang
>
> Intel is submitting Gearpump (http://www.gearpump.io) to ASF 
> (https://wiki.apache.org/incubator/GearpumpProposal). Appears to be a mix of 
> low-level primitives a la MillWheel, with some higher level primitives like 
> non-merging windowing mixed in. Seems like it would make a nice Beam runner.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #959: [BEAM-79] upgrade surefire version to excl...

[manuzhang]

Github user manuzhang closed the pull request at:

https://github.com/apache/incubator-beam/pull/959


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-631) upgrade surefire plugin to 2.19.1

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491927#comment-15491927
 ] 

ASF GitHub Bot commented on BEAM-631:
-

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-beam/pull/961

[BEAM-631] upgrade surefire plugin to 2.19.1

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-beam upgrade_surefire

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/961.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #961


commit e7f8fae296318e8f7805484e50becfbe5f336bb2
Author: manuzhang 
Date:   2016-09-15T00:39:53Z

[BEAM-631] upgrade surefire plugin to 2.19.1




> upgrade surefire plugin to 2.19.1
> -
>
> Key: BEAM-631
> URL: https://issues.apache.org/jira/browse/BEAM-631
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Affects Versions: 0.2.0-incubating
>Reporter: Manu Zhang
>Assignee: Manu Zhang
>Priority: Minor
>
> As of surefire 2.19.1, fully qualified class names and packages can be used 
> to exclude tests, which is needed by Gearpump Runner. Spark Runner also 
> requires 2.19.1 for fork control.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #961: [BEAM-631] upgrade surefire plugin to 2.19...

[manuzhang]

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-beam/pull/961

[BEAM-631] upgrade surefire plugin to 2.19.1

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-beam upgrade_surefire

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/961.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #961


commit e7f8fae296318e8f7805484e50becfbe5f336bb2
Author: manuzhang 
Date:   2016-09-15T00:39:53Z

[BEAM-631] upgrade surefire plugin to 2.19.1




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (BEAM-631) upgrade surefire plugin to 2.19.1

[Manu Zhang (JIRA)]

Manu Zhang created BEAM-631:
---

 Summary: upgrade surefire plugin to 2.19.1
 Key: BEAM-631
 URL: https://issues.apache.org/jira/browse/BEAM-631
 Project: Beam
  Issue Type: Improvement
  Components: testing
Affects Versions: 0.2.0-incubating
Reporter: Manu Zhang
Assignee: Manu Zhang
Priority: Minor


As of surefire 2.19.1, fully qualified class names and packages can be used to 
exclude tests, which is needed by Gearpump Runner. Spark Runner also requires 
2.19.1 for fork control.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1148

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-618) Python SDKs writes non RFC compliant JSON files for BQ Export

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491846#comment-15491846
 ] 

ASF GitHub Bot commented on BEAM-618:
-

GitHub user ajamato reopened a pull request:

https://github.com/apache/incubator-beam/pull/947

[BEAM-618] Disallow NAN, INF and -INF invalid JSON values in bigquery 
exporter

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [x] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [x] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [x] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

Now exporting JSON will fail with invalid NAN, INF or -INF values.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ajamato/incubator-beam py_json

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/947.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #947


commit 442bed71e68524368408573ce0bcb22901d7f861
Author: Alex Amato 
Date:   2016-09-09T00:57:28Z

Set allow_nan=False on bigquery JSON encoding

commit bd7f920faf41a3a203d854de626c9dcd90a90e29
Author: Alex Amato 
Date:   2016-09-12T20:09:34Z

Remove unused line

commit 441b59bdf2de88cae119f0399bd38f64ecbbf96f
Author: Alex Amato 
Date:   2016-09-14T17:05:25Z

Fix Lint Error




> Python SDKs writes non RFC compliant JSON files for BQ Export
> -
>
> Key: BEAM-618
> URL: https://issues.apache.org/jira/browse/BEAM-618
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py
>Reporter: Alex Amato
>Assignee: Frances Perry
>
> Python SDK uses the built in json.dumps to write JSON files to GCS for the BQ 
> Exporter. BigQuery can fail to parse these files when it tries to load these 
> files into a BQ table because json.dumps can export JSON which does not 
> conform to the IEEE RFC.
> There are a few cases which are not RFC compilant listed in that module.
> https://docs.python.org/2/library/json.html#standard-compliance-and-interoperability
> The main issue we run into is the NAN, INF and -INF values.
> These fails with a confusing error (and we delete the GCS files making it 
> hard to debug):
> JSON table encountered too many errors, giving up. Rows JSON parsing error in 
> row starting at position
> We can set the allow_nan argument to json.dumps to false to address these 
> issues. So that when a user tries to write a file with INF, -INF or NAN
> Setting this argument will produce this type of error when json.dumps is 
> called with NAN/INF values. We may want to catch this error to mention the 
> fact that INF and NAN are not allowed.
> Traceback (most recent call last):
>   File "", line 1, in 
>   File "/usr/lib/python2.7/json/__init__.py", line 250, in dumps
> sort_keys=sort_keys, **kw).encode(obj)
>   File "/usr/lib/python2.7/json/encoder.py", line 207, in encode
> chunks = self.iterencode(o, _one_shot=True)
>   File "/usr/lib/python2.7/json/encoder.py", line 270, in iterencode
> return _iterencode(o, 0)
> ValueError: Out of range float values are not JSON compliant



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #947: [BEAM-618] Disallow NAN, INF and -INF inva...

[ajamato]

Github user ajamato closed the pull request at:

https://github.com/apache/incubator-beam/pull/947


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #947: [BEAM-618] Disallow NAN, INF and -INF inva...

[ajamato]

GitHub user ajamato reopened a pull request:

https://github.com/apache/incubator-beam/pull/947

[BEAM-618] Disallow NAN, INF and -INF invalid JSON values in bigquery 
exporter

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [x] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [x] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [x] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

Now exporting JSON will fail with invalid NAN, INF or -INF values.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ajamato/incubator-beam py_json

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/947.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #947


commit 442bed71e68524368408573ce0bcb22901d7f861
Author: Alex Amato 
Date:   2016-09-09T00:57:28Z

Set allow_nan=False on bigquery JSON encoding

commit bd7f920faf41a3a203d854de626c9dcd90a90e29
Author: Alex Amato 
Date:   2016-09-12T20:09:34Z

Remove unused line

commit 441b59bdf2de88cae119f0399bd38f64ecbbf96f
Author: Alex Amato 
Date:   2016-09-14T17:05:25Z

Fix Lint Error




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] incubator-beam pull request #958: Insert a shuffle before write finalization

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/958


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/2] incubator-beam git commit: Closes #958

[robertwb]

Closes #958


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a60b58a9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a60b58a9
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/a60b58a9

Branch: refs/heads/python-sdk
Commit: a60b58a947fda65cb2f6d8c0bcbbf0756c8407bf
Parents: 4b584ca 4602c95
Author: Robert Bradshaw 
Authored: Wed Sep 14 16:41:14 2016 -0700
Committer: Robert Bradshaw 
Committed: Wed Sep 14 16:41:14 2016 -0700

--
 sdks/python/apache_beam/io/iobase.py | 9 ++---
 1 file changed, 6 insertions(+), 3 deletions(-)
--

[1/2] incubator-beam git commit: Insert a shuffle before write finalization

[robertwb]

Repository: incubator-beam
Updated Branches:
  refs/heads/python-sdk 4b584ca26 -> a60b58a94


Insert a shuffle before write finalization


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4602c954
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4602c954
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/4602c954

Branch: refs/heads/python-sdk
Commit: 4602c954caeda24cc7ce762c2fd9995aa4c04c1a
Parents: 4b584ca
Author: Charles Chen 
Authored: Wed Sep 14 12:14:34 2016 -0700
Committer: Charles Chen 
Committed: Wed Sep 14 14:52:08 2016 -0700

--
 sdks/python/apache_beam/io/iobase.py | 9 ++---
 1 file changed, 6 insertions(+), 3 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/4602c954/sdks/python/apache_beam/io/iobase.py
--
diff --git a/sdks/python/apache_beam/io/iobase.py 
b/sdks/python/apache_beam/io/iobase.py
index b269ae5..ecb8a70 100644
--- a/sdks/python/apache_beam/io/iobase.py
+++ b/sdks/python/apache_beam/io/iobase.py
@@ -1028,9 +1028,12 @@ class WriteImpl(ptransform.PTransform):
   AsSingleton(init_result_coll)))
 else:
   min_shards = 1
-  write_result_coll = pcoll | core.ParDo('write_bundles',
- _WriteBundleDoFn(), self.sink,
- AsSingleton(init_result_coll))
+  write_result_coll = (pcoll | core.ParDo('write_bundles',
+  _WriteBundleDoFn(), self.sink,
+  AsSingleton(init_result_coll))
+   | core.Map(lambda x: (None, x))
+   | core.GroupByKey()
+   | core.FlatMap(lambda x: x[1]))
 return do_once | core.FlatMap(
 'finalize_write',
 _finalize_write,

[GitHub] incubator-beam pull request #960: Add Flatten with Duplicate Inputs Test

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/960


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[3/3] incubator-beam git commit: Add Flatten with Duplicate Inputs Test

[lcwik]

Add Flatten with Duplicate Inputs Test

This closes #960


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ae6333a4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ae6333a4
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/ae6333a4

Branch: refs/heads/master
Commit: ae6333a412a04b0cff0a762b92243db9a9eb38aa
Parents: 3f882b7 561377b
Author: Luke Cwik 
Authored: Wed Sep 14 16:08:10 2016 -0700
Committer: Luke Cwik 
Committed: Wed Sep 14 16:08:10 2016 -0700

--
 .../apache/beam/sdk/transforms/FlattenTest.java | 20 
 1 file changed, 20 insertions(+)
--

[1/3] incubator-beam git commit: Add Flatten with Duplicate Inputs Test

[lcwik]

Repository: incubator-beam
Updated Branches:
  refs/heads/master 3f882b773 -> ae6333a41


Add Flatten with Duplicate Inputs Test

This test demonstrates that if a Flatten.PCollections transform has the
same PCollectionList in its input multiple times, it will duplicate the
input PCollection for each time it occurs within the list.


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/321ffc2e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/321ffc2e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/321ffc2e

Branch: refs/heads/master
Commit: 321ffc2ed8c48a6f4bc487d44eecf1355ca3798c
Parents: 3f882b7
Author: Thomas Groh 
Authored: Wed Sep 14 15:58:58 2016 -0700
Committer: Luke Cwik 
Committed: Wed Sep 14 16:06:27 2016 -0700

--
 .../apache/beam/sdk/transforms/FlattenTest.java | 20 
 1 file changed, 20 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/321ffc2e/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java
--
diff --git 
a/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java 
b/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java
index d755e28..c188546 100644
--- 
a/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java
+++ 
b/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/FlattenTest.java
@@ -24,6 +24,7 @@ import static org.apache.beam.sdk.TestUtils.NO_LINES;
 import static org.apache.beam.sdk.TestUtils.NO_LINES_ARRAY;
 
 import com.google.common.collect.ImmutableSet;
+import com.google.common.collect.Iterables;
 import java.io.Serializable;
 import java.util.ArrayList;
 import java.util.Arrays;
@@ -114,6 +115,25 @@ public class FlattenTest implements Serializable {
 PAssert.that(output).empty();
 p.run();
   }
+  @Test
+  @Category(RunnableOnService.class)
+  public void testFlattenInputMultipleCopies() {
+Pipeline p = TestPipeline.create();
+
+PCollection lines = p.apply("mkLines", Create.of(LINES));
+PCollection lines2 = p.apply("mkOtherLines", Create.of(LINES2));
+
+PCollection flattened = PCollectionList.of(lines)
+.and(lines2)
+.and(lines)
+.and(lines)
+.apply(Flatten.pCollections());
+
+PAssert.that(flattened).containsInAnyOrder(Iterables.concat(LINES, LINES, 
LINES, LINES2));
+
+p.run();
+  }
+
 
   @Test
   @Category(RunnableOnService.class)

[GitHub] incubator-beam pull request #960: Add Flatten with Duplicate Inputs Test

[tgroh]

GitHub user tgroh opened a pull request:

https://github.com/apache/incubator-beam/pull/960

Add Flatten with Duplicate Inputs Test

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

This test demonstrates that if a Flatten.PCollections transform has the
same PCollectionList in its input multiple times, it will duplicate the
input PCollection for each time it occurs within the list.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/tgroh/incubator-beam flatten_duplicates

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/960.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #960


commit df468dbe1fa1acceba2ea60b769052ff18e720d8
Author: Thomas Groh 
Date:   2016-09-14T22:58:58Z

Add Flatten with Duplicate Inputs Test

This test demonstrates that if a Flatten.PCollections transform has the
same PCollectionList in its input multiple times, it will duplicate the
input PCollection for each time it occurs within the list.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Commented] (BEAM-79) Gearpump runner

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491675#comment-15491675
 ] 

ASF GitHub Bot commented on BEAM-79:


GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-beam/pull/959

[BEAM-79] upgrade surefire version to exclude tests

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-beam gearpump-runner-sync

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/959.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #959


commit c879a7fa02259458029d8dca82ecaf80d36019b7
Author: manuzhang 
Date:   2016-09-14T22:52:09Z

[BEAM-79] upgrade surefire version to exclude tests




> Gearpump runner
> ---
>
> Key: BEAM-79
> URL: https://issues.apache.org/jira/browse/BEAM-79
> Project: Beam
>  Issue Type: New Feature
>  Components: runner-gearpump
>Reporter: Tyler Akidau
>Assignee: Manu Zhang
>
> Intel is submitting Gearpump (http://www.gearpump.io) to ASF 
> (https://wiki.apache.org/incubator/GearpumpProposal). Appears to be a mix of 
> low-level primitives a la MillWheel, with some higher level primitives like 
> non-merging windowing mixed in. Seems like it would make a nice Beam runner.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #959: [BEAM-79] upgrade surefire version to excl...

[manuzhang]

GitHub user manuzhang opened a pull request:

https://github.com/apache/incubator-beam/pull/959

[BEAM-79] upgrade surefire version to exclude tests

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/manuzhang/incubator-beam gearpump-runner-sync

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/959.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #959


commit c879a7fa02259458029d8dca82ecaf80d36019b7
Author: manuzhang 
Date:   2016-09-14T22:52:09Z

[BEAM-79] upgrade surefire version to exclude tests




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Updated] (BEAM-458) Support for Flink Metrics

[Sumit Chawla (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Chawla updated BEAM-458:
--
Description: 
Flink has added support for CodeHale Metrics 
(https://ci.apache.org/projects/flink/flink-docs-master/monitoring/metrics.html)

These metrics are more advanced then the current Accumulators. 

Adding support for these to Beam level should be a good addition.

https://github.com/apache/flink/pull/1947#issuecomment-233029166

  was:
Flink has added support for CodeHale Metrics 
(https://ci.apache.org/projects/flink/flink-docs-master/apis/metrics.html#registering-metrics)

These metrics are more advanced then the current Accumulators. 

Adding support for these to Beam level should be a good addition.

https://github.com/apache/flink/pull/1947#issuecomment-233029166


> Support for Flink Metrics 
> --
>
> Key: BEAM-458
> URL: https://issues.apache.org/jira/browse/BEAM-458
> Project: Beam
>  Issue Type: New Feature
>  Components: beam-model
>Reporter: Sumit Chawla
>
> Flink has added support for CodeHale Metrics 
> (https://ci.apache.org/projects/flink/flink-docs-master/monitoring/metrics.html)
> These metrics are more advanced then the current Accumulators. 
> Adding support for these to Beam level should be a good addition.
> https://github.com/apache/flink/pull/1947#issuecomment-233029166



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1147

[Apache Jenkins Server]

See 

[jira] [Commented] (BEAM-630) DataflowRunnableOnService test suite is broken

[ASF GitHub Bot (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491053#comment-15491053
 ] 

ASF GitHub Bot commented on BEAM-630:
-

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/954


> DataflowRunnableOnService test suite is broken
> --
>
> Key: BEAM-630
> URL: https://issues.apache.org/jira/browse/BEAM-630
> Project: Beam
>  Issue Type: Bug
>  Components: runner-dataflow
>Affects Versions: Not applicable
>Reporter: Daniel Halperin
>Assignee: Eugene Kirpichov
> Fix For: 0.3.0-incubating
>
>
> Looks like it's related to problems with the new DoFnSignatures/Invoker: 
> https://builds.apache.org/job/beam_PostCommit_RunnableOnService_GoogleCloudDataflow/1134/#showFailuresLink



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] incubator-beam pull request #954: Enables BytecodeVerificationLocal on travi...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/954


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[2/2] incubator-beam git commit: Closes #954

[dhalperi]

Closes #954


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3f882b77
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3f882b77
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/3f882b77

Branch: refs/heads/master
Commit: 3f882b77381b6a4a5628fcdfa3cf325d596cf79e
Parents: 665457c d6424db
Author: Dan Halperin 
Authored: Wed Sep 14 10:52:36 2016 -0700
Committer: Dan Halperin 
Committed: Wed Sep 14 10:52:36 2016 -0700

--
 .travis.yml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--

[1/2] incubator-beam git commit: Enables BytecodeVerificationLocal on travis

[dhalperi]

Repository: incubator-beam
Updated Branches:
  refs/heads/master 665457c9c -> 3f882b773


Enables BytecodeVerificationLocal on travis

This is to achieve stricter verification of bytecode,
mainly bytecode generated by DoFnInvokers dynamically.

See https://issues.apache.org/jira/browse/BEAM-630 for
an example situation that could have been caught earlier
with this change.


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d6424dbc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d6424dbc
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/d6424dbc

Branch: refs/heads/master
Commit: d6424dbce69b12704eb3d82a2ee168a8f7134723
Parents: 665457c
Author: Eugene Kirpichov 
Authored: Tue Sep 13 14:29:56 2016 -0700
Committer: Dan Halperin 
Committed: Wed Sep 14 10:52:35 2016 -0700

--
 .travis.yml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d6424dbc/.travis.yml
--
diff --git a/.travis.yml b/.travis.yml
index 2331282..786b370 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -42,7 +42,7 @@ matrix:
   env: CUSTOM_JDK="openjdk7" 
MAVEN_OVERRIDE="-DbeamSurefireArgline='-Xmx512m'"
 
 before_install:
-  - echo "MAVEN_OPTS='-Xmx1024m -XX:MaxPermSize=512m'" > ~/.mavenrc
+  - echo "MAVEN_OPTS='-Xmx1024m -XX:MaxPermSize=512m 
-XX:+BytecodeVerificationLocal'" > ~/.mavenrc
   - if [ "$TRAVIS_OS_NAME" == "osx" ]; then export 
JAVA_HOME=$(/usr/libexec/java_home); fi
   - if [ "$TRAVIS_OS_NAME" == "linux" ]; then jdk_switcher use "$CUSTOM_JDK"; 
fi
   - export BEAM_SUREFIRE_ARGLINE="-Xmx512m"

[GitHub] incubator-beam pull request #957: Remove PubsubFileInjector and IntraBundleP...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/incubator-beam/pull/957


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Resolved] (BEAM-414) IntraBundleParallelization needs to be removed

[Luke Cwik (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luke Cwik resolved BEAM-414.

   Resolution: Fixed
Fix Version/s: 0.3.0-incubating

> IntraBundleParallelization needs to be removed
> --
>
> Key: BEAM-414
> URL: https://issues.apache.org/jira/browse/BEAM-414
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Reporter: Luke Cwik
>Assignee: Pei He
>Priority: Minor
>  Labels: newbie, starter
> Fix For: 0.3.0-incubating
>
>
> IntraBundleParallelization needs to be removed because it does not work since 
> it breaks bundle processing semantics by expecting that context information 
> is not mutated by the runner between element processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[2/2] incubator-beam git commit: [BEAM-414] Remove PubsubFileInjector and IntraBundleParallelization

[lcwik]

[BEAM-414] Remove PubsubFileInjector and IntraBundleParallelization

This closes #957


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/665457c9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/665457c9
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/665457c9

Branch: refs/heads/master
Commit: 665457c9ce641936011d1dd85c2b8050521cccef
Parents: e9a08e4 fc96474
Author: Luke Cwik 
Authored: Wed Sep 14 09:01:20 2016 -0700
Committer: Luke Cwik 
Committed: Wed Sep 14 09:01:20 2016 -0700

--
 .../examples/common/PubsubFileInjector.java | 153 
 .../transforms/IntraBundleParallelization.java  | 361 ---
 .../IntraBundleParallelizationTest.java | 280 --
 3 files changed, 794 deletions(-)
--

[1/2] incubator-beam git commit: Remove PubsubFileInjector and IntraBundleParallelization

[lcwik]

Repository: incubator-beam
Updated Branches:
  refs/heads/master e9a08e454 -> 665457c9c


Remove PubsubFileInjector and IntraBundleParallelization


Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fc964748
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fc964748
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/fc964748

Branch: refs/heads/master
Commit: fc96474804cdcd950663e7eaea5c140652a07c8e
Parents: e9a08e4
Author: peihe 
Authored: Tue Sep 13 21:29:13 2016 -0700
Committer: peihe 
Committed: Tue Sep 13 21:30:05 2016 -0700

--
 .../examples/common/PubsubFileInjector.java | 153 
 .../transforms/IntraBundleParallelization.java  | 361 ---
 .../IntraBundleParallelizationTest.java | 280 --
 3 files changed, 794 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/fc964748/examples/java/src/main/java/org/apache/beam/examples/common/PubsubFileInjector.java
--
diff --git 
a/examples/java/src/main/java/org/apache/beam/examples/common/PubsubFileInjector.java
 
b/examples/java/src/main/java/org/apache/beam/examples/common/PubsubFileInjector.java
deleted file mode 100644
index 4634159..000
--- 
a/examples/java/src/main/java/org/apache/beam/examples/common/PubsubFileInjector.java
+++ /dev/null
@@ -1,153 +0,0 @@
-/*
- * Licensed to the Apache Software Foundation (ASF) under one
- * or more contributor license agreements.  See the NOTICE file
- * distributed with this work for additional information
- * regarding copyright ownership.  The ASF licenses this file
- * to you under the Apache License, Version 2.0 (the
- * "License"); you may not use this file except in compliance
- * with the License.  You may obtain a copy of the License at
- *
- * http://www.apache.org/licenses/LICENSE-2.0
- *
- * Unless required by applicable law or agreed to in writing, software
- * distributed under the License is distributed on an "AS IS" BASIS,
- * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
- * See the License for the specific language governing permissions and
- * limitations under the License.
- */
-package org.apache.beam.examples.common;
-
-import com.google.api.services.pubsub.Pubsub;
-import com.google.api.services.pubsub.model.PublishRequest;
-import com.google.api.services.pubsub.model.PubsubMessage;
-import com.google.common.collect.ImmutableMap;
-import java.io.IOException;
-import java.util.Arrays;
-import org.apache.beam.sdk.Pipeline;
-import org.apache.beam.sdk.io.TextIO;
-import org.apache.beam.sdk.options.Description;
-import org.apache.beam.sdk.options.PipelineOptions;
-import org.apache.beam.sdk.options.PipelineOptionsFactory;
-import org.apache.beam.sdk.options.PubsubOptions;
-import org.apache.beam.sdk.options.Validation;
-import org.apache.beam.sdk.transforms.IntraBundleParallelization;
-import org.apache.beam.sdk.transforms.OldDoFn;
-import org.apache.beam.sdk.util.Transport;
-
-/**
- * A batch Dataflow pipeline for injecting a set of GCS files into
- * a PubSub topic line by line. Empty lines are skipped.
- *
- * This is useful for testing streaming
- * pipelines. Note that since batch pipelines might retry chunks, this
- * does _not_ guarantee exactly-once injection of file data. Some lines may
- * be published multiple times.
- * 
- */
-public class PubsubFileInjector {
-
-  /**
-   * An incomplete {@code PubsubFileInjector} transform with unbound output 
topic.
-   */
-  public static class Unbound {
-private final String timestampLabelKey;
-
-Unbound() {
-  this.timestampLabelKey = null;
-}
-
-Unbound(String timestampLabelKey) {
-  this.timestampLabelKey = timestampLabelKey;
-}
-
-Unbound withTimestampLabelKey(String timestampLabelKey) {
-  return new Unbound(timestampLabelKey);
-}
-
-public Bound publish(String outputTopic) {
-  return new Bound(outputTopic, timestampLabelKey);
-}
-  }
-
-  /** A {@link OldDoFn} that publishes non-empty lines to Google Cloud PubSub. 
*/
-  public static class Bound extends OldDoFn {
-private final String outputTopic;
-private final String timestampLabelKey;
-public transient Pubsub pubsub;
-
-public Bound(String outputTopic, String timestampLabelKey) {
-  this.outputTopic = outputTopic;
-  this.timestampLabelKey = timestampLabelKey;
-}
-
-@Override
-public void startBundle(Context context) {
-  this.pubsub =
-  
Transport.newPubsubClient(context.getPipelineOptions().as(PubsubOptions.class))
-  .build();
-}
-
-@Override
-public void processElement(ProcessContext c) 

[jira] [Commented] (BEAM-414) IntraBundleParallelization needs to be removed

[Luke Cwik (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490774#comment-15490774
 ] 

Luke Cwik commented on BEAM-414:


https://github.com/apache/incubator-beam/pull/957

> IntraBundleParallelization needs to be removed
> --
>
> Key: BEAM-414
> URL: https://issues.apache.org/jira/browse/BEAM-414
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Reporter: Luke Cwik
>Assignee: Pei He
>Priority: Minor
>  Labels: newbie, starter
>
> IntraBundleParallelization needs to be removed because it does not work since 
> it breaks bundle processing semantics by expecting that context information 
> is not mutated by the runner between element processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Assigned] (BEAM-414) IntraBundleParallelization needs to be removed

[Luke Cwik (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Luke Cwik reassigned BEAM-414:
--

Assignee: Pei He  (was: Luke Cwik)

> IntraBundleParallelization needs to be removed
> --
>
> Key: BEAM-414
> URL: https://issues.apache.org/jira/browse/BEAM-414
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Reporter: Luke Cwik
>Assignee: Pei He
>Priority: Minor
>  Labels: newbie, starter
>
> IntraBundleParallelization needs to be removed because it does not work since 
> it breaks bundle processing semantics by expecting that context information 
> is not mutated by the runner between element processing.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)