[jira] [Commented] (BEAM-110) Use SDK implementation for HadoopIO in contrib/hadoop

2016-11-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15695093#comment-15695093 ] Davor Bonaci commented on BEAM-110: --- Yes, I think this is obsolete. Spark runner's support for Source API

[jira] [Commented] (BEAM-980) Document how to configure the DAG created by Apex Runner

2016-11-24 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15694643#comment-15694643 ] Thomas Weise commented on BEAM-980: --- [~sandeepdeshmukh] can you take this up? > Document how to configure

[jira] [Commented] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2016-11-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693403#comment-15693403 ] ASF GitHub Bot commented on BEAM-956: - Github user asfgit closed the pull request at:

[1/2] incubator-beam git commit: Replace WindowAssignment OldDoFn by FlatMap in Flink Runner

2016-11-24 Thread aljoscha
Repository: incubator-beam Updated Branches: refs/heads/master 3e4b2fd0d -> 8d1214a3b Replace WindowAssignment OldDoFn by FlatMap in Flink Runner The streaming runner had an OldDoFn that was used for assigning windows using a WindowFn. This is now done with a FlatMap. Project:

[GitHub] incubator-beam pull request #1435: Replace WindowAssignment OldDoFn by FlatM...

2016-11-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1435 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #1435

2016-11-24 Thread aljoscha
This closes #1435 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8d1214a3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8d1214a3 Diff:

[jira] [Commented] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2016-11-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15693377#comment-15693377 ] Amit Sela commented on BEAM-1048: - To clarify - calling `rdd.count()` on the read input RDD creates a batch

[jira] [Updated] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2016-11-24 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-1048: Assignee: Kobi Salant (was: Amit Sela) > Spark Runner streaming batch duration does not include duration of

[jira] [Created] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2016-11-24 Thread Kobi Salant (JIRA)
Kobi Salant created BEAM-1048: - Summary: Spark Runner streaming batch duration does not include duration of reading from source Key: BEAM-1048 URL: https://issues.apache.org/jira/browse/BEAM-1048

Jenkins build is back to stable : beam_PostCommit_MavenVerify #1896

2016-11-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-956) Execute ReduceFnRunner Directly in Flink Runner

2016-11-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692922#comment-15692922 ] ASF GitHub Bot commented on BEAM-956: - GitHub user aljoscha opened a pull request:

[GitHub] incubator-beam pull request #1435: Replace WindowAssignment OldDoFn by FlatM...

2016-11-24 Thread aljoscha
GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam/pull/1435 Replace WindowAssignment OldDoFn by FlatMap in FLink Runner The streaming runner had an OldDoFn that was used for assigning windows using a WindowFn. This is now done with a FlatMap.

Jenkins build became unstable: beam_PostCommit_MavenVerify #1895

2016-11-24 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-959) IO validation messages need improvement

2016-11-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692765#comment-15692765 ] ASF GitHub Bot commented on BEAM-959: - Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: [BEAM-959] This closes #1374

2016-11-24 Thread jbonofre
[BEAM-959] This closes #1374 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3e4b2fd0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3e4b2fd0 Diff:

[GitHub] incubator-beam pull request #1374: [BEAM-959] Improve validation messages in...

2016-11-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1374 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: [BEAM-959] Improve validation messages in JdbcIO

2016-11-24 Thread jbonofre
Repository: incubator-beam Updated Branches: refs/heads/master 6d0c205a3 -> 3e4b2fd0d [BEAM-959] Improve validation messages in JdbcIO Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7b314aad Tree: