[jira] [Commented] (BEAM-2377) Cross compile flink runner to scala 2.11
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16313077#comment-16313077 ] ASF GitHub Bot commented on BEAM-2377: -- aljoscha closed pull request #3881: [BEAM-2377] Allow cross compilation (2.10,2.11) for flink runner URL: https://github.com/apache/beam/pull/3881 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request (from a fork), the diff is supplied below (as it won't show otherwise due to GitHub magic): diff --git a/examples/java/pom.xml b/examples/java/pom.xml index ade4cac7a49..817af333690 100644 --- a/examples/java/pom.xml +++ b/examples/java/pom.xml @@ -95,7 +95,7 @@ org.apache.beam - beam-runners-flink_2.10 + beam-runners-flink_${flink.scala.version} runtime diff --git a/examples/java8/pom.xml b/examples/java8/pom.xml index 585d7b8ce2d..f27f6dfbe2a 100644 --- a/examples/java8/pom.xml +++ b/examples/java8/pom.xml @@ -95,7 +95,7 @@ org.apache.beam - beam-runners-flink_2.10 + beam-runners-flink_${flink.scala.version} runtime diff --git a/pom.xml b/pom.xml index 236645cb989..f112c6409a8 100644 --- a/pom.xml +++ b/pom.xml @@ -154,6 +154,7 @@ 1.1.4 0.10.1.0 1.4 +2.11 1.5.0.Final 2.0 @@ -363,6 +364,19 @@ + + + flink-scala-2.10 + + + flink-scala-2.10 + + + +2.10 + + + @@ -606,7 +620,7 @@ org.apache.beam -beam-runners-flink_2.10 +beam-runners-flink_${flink.scala.version} ${project.version} diff --git a/runners/flink/pom.xml b/runners/flink/pom.xml index 0ef19312b84..5c680c86861 100644 --- a/runners/flink/pom.xml +++ b/runners/flink/pom.xml @@ -26,7 +26,7 @@ ../pom.xml - beam-runners-flink_2.10 + beam-runners-flink_${flink.scala.version} Apache Beam :: Runners :: Flink jar @@ -165,7 +165,7 @@ org.apache.flink - flink-clients_2.10 + flink-clients_${flink.scala.version} ${flink.version} @@ -189,13 +189,13 @@ org.apache.flink - flink-runtime_2.10 + flink-runtime_${flink.scala.version} ${flink.version} org.apache.flink - flink-streaming-java_2.10 + flink-streaming-java_${flink.scala.version} ${flink.version} @@ -210,7 +210,7 @@ org.apache.flink - flink-runtime_2.10 + flink-runtime_${flink.scala.version} ${flink.version} test-jar test @@ -336,7 +336,7 @@ org.apache.flink - flink-streaming-java_2.10 + flink-streaming-java_${flink.scala.version} ${flink.version} test test-jar @@ -344,7 +344,7 @@ org.apache.flink - flink-test-utils_2.10 + flink-test-utils_${flink.scala.version} ${flink.version} test diff --git a/sdks/java/javadoc/pom.xml b/sdks/java/javadoc/pom.xml index 35f0b864e51..1d90046838c 100644 --- a/sdks/java/javadoc/pom.xml +++ b/sdks/java/javadoc/pom.xml @@ -64,7 +64,7 @@ org.apache.beam - beam-runners-flink_2.10 + beam-runners-flink_${flink.scala.version} diff --git a/sdks/java/maven-archetypes/examples-java8/src/main/resources/archetype-resources/pom.xml b/sdks/java/maven-archetypes/examples-java8/src/main/resources/archetype-resources/pom.xml index ffdb0660466..9257989ddf7 100644 --- a/sdks/java/maven-archetypes/examples-java8/src/main/resources/archetype-resources/pom.xml +++ b/sdks/java/maven-archetypes/examples-java8/src/main/resources/archetype-resources/pom.xml @@ -215,7 +215,7 @@ org.apache.beam - beam-runners-flink_2.10 + beam-runners-flink_@flink.scala.version@ ${beam.version} runtime diff --git a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml index b8b9c9f0fa4..59bd5c211a4 100644 --- a/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml +++ b/sdks/java/maven-archetypes/examples/src/main/resources/archetype-resources/pom.xml @@ -214,7 +214,7 @@ org.apache.beam - beam-runners-flink_2.10 + beam-runners-flink_@flink.scala.version@ ${beam.version} runtime diff --git a/sdks/java/nexmark/pom.xml b/sdks/java/nexmark/pom.xml index 67628a12831..d7e41759ef3 100644 --- a/sdks/java/nexmark/pom.xml +++ b/sdks/java/nexmark/pom.xml @@ -67,7 +67,7 @@
[jira] [Commented] (BEAM-2377) Cross compile flink runner to scala 2.11
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16174641#comment-16174641 ] ASF GitHub Bot commented on BEAM-2377: -- GitHub user aljoscha opened a pull request: https://github.com/apache/beam/pull/3881 [BEAM-2377] Allow cross compilation (2.10,2.11) for flink runner This is a fixed version of #3255 which was reverted in #3875. The problem was that `flink.scala.version` was not set in the nexmark pom. You can merge this pull request into a Git repository by running: $ git pull https://github.com/aljoscha/beam fix-pr-3255-scala-version Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3881.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3881 commit f61605b4199c6904a6dcbd111ffb906491fa9e0e Author: Ole LangbehnDate: 2017-05-31T07:54:04Z [BEAM-2377] Allow cross compilation (2.10,2.11) for flink runner Flink allows being built against scala 2.11. But the Flink Runner did not. This commit alleviates that, as well as allowing for ensuring that builds work against scala 2.11 dependencies. It introduces a flink.scala.version mvn property that is set to 2.11 as a default, as well as a mvn profile that overrides the scala version to 2.10. > Cross compile flink runner to scala 2.11 > > > Key: BEAM-2377 > URL: https://issues.apache.org/jira/browse/BEAM-2377 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Reporter: Ole Langbehn >Assignee: Aljoscha Krettek > Fix For: 2.2.0 > > > The flink runner is compiled for flink built against scala 2.10. flink cross > compiles its scala artifacts against 2.10 and 2.11. > In order to make it possible to use beam with the flink runner in scala 2.11 > projects, it would be nice if you could publish the flink runner for 2.11 > next to 2.10. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2377) Cross compile flink runner to scala 2.11
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172873#comment-16172873 ] ASF GitHub Bot commented on BEAM-2377: -- Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3255 > Cross compile flink runner to scala 2.11 > > > Key: BEAM-2377 > URL: https://issues.apache.org/jira/browse/BEAM-2377 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Reporter: Ole Langbehn >Assignee: Aljoscha Krettek > Fix For: 2.2.0 > > > The flink runner is compiled for flink built against scala 2.10. flink cross > compiles its scala artifacts against 2.10 and 2.11. > In order to make it possible to use beam with the flink runner in scala 2.11 > projects, it would be nice if you could publish the flink runner for 2.11 > next to 2.10. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BEAM-2377) Cross compile flink runner to scala 2.11
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16031082#comment-16031082 ] Aljoscha Krettek commented on BEAM-2377: [~davor] I'm not to familiar with our CI infra but I imagine it would be enough to add a new Jenkins job that also does nightly snapshot releases for Scala 2.11. In addition we would add this to the release process. What do you think? > Cross compile flink runner to scala 2.11 > > > Key: BEAM-2377 > URL: https://issues.apache.org/jira/browse/BEAM-2377 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Reporter: Ole Langbehn >Assignee: Aljoscha Krettek > > The flink runner is compiled for flink built against scala 2.10. flink cross > compiles its scala artifacts against 2.10 and 2.11. > In order to make it possible to use beam with the flink runner in scala 2.11 > projects, it would be nice if you could publish the flink runner for 2.11 > next to 2.10. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BEAM-2377) Cross compile flink runner to scala 2.11
[ https://issues.apache.org/jira/browse/BEAM-2377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16028407#comment-16028407 ] ASF GitHub Bot commented on BEAM-2377: -- GitHub user neurolabs opened a pull request: https://github.com/apache/beam/pull/3255 [BEAM-2377] Allow usage of scala 2.11 dependencies as well as cross compilation for flink runner Flink allows being built against scala 2.11. But the Flink Runner did not. This commit alleviates that, as well as allowing for ensuring that builds work against scala 2.11 dependencies. It introduces a scala.version mvn property that is set to 2.10 as a default, as well as a mvn profile that overrides the scala version to 2.11. I'm not sure about the granularity (should I only enable this for the flink runner, or should the whole build be verified against 2.11). So please comment on this PR. It would be nice if you could cross publish the flink runner for scala-2.11 based on this pull request. You can merge this pull request into a Git repository by running: $ git pull https://github.com/neurolabs/beam master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3255.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3255 commit 3e2564d65fb371abd0caf663785faee4f1f73120 Author: Ole LangbehnDate: 2017-05-29T14:14:18Z Allow usage of scala 2.11 dependencies as well as cross compilation for flink runner Flink allows being built against scala 2.11. But the Flink Runner did not. This commit alleviates that, as well as allowing for ensuring that builds work against scala 2.11 dependencies. It introduces a scala.version mvn property that is set to 2.10 as a default, as well as a mvn profile that overrides the scala version to 2.11. > Cross compile flink runner to scala 2.11 > > > Key: BEAM-2377 > URL: https://issues.apache.org/jira/browse/BEAM-2377 > Project: Beam > Issue Type: Improvement > Components: runner-flink >Reporter: Ole Langbehn >Assignee: Aljoscha Krettek > > The flink runner is compiled for flink built against scala 2.10. flink cross > compiles its scala artifacts against 2.10 and 2.11. > In order to make it possible to use beam with the flink runner in scala 2.11 > projects, it would be nice if you could publish the flink runner for 2.11 > next to 2.10. -- This message was sent by Atlassian JIRA (v6.3.15#6346)