Re: idea构建flink源码失败

2023-02-07 文章 Ran Tao
jdk8 & scala2.12的组合是支持的,你这个问题一般就是jdk和idea设置问题。可以通过以下方法尝试下:

1.注意查看 maven profile,查看勾选的profile(可以使用scala-2.12)。
2.ProjectStrccture -> modules  设置各个module 匹配 jdk8
3.IDEA-Settings-Builder-Compiler 设置 jdk8,以及使用jdk11的话注意开启交叉编译
4.scala-compiler的server也要设置jdk8



tiger <2372554...@qq.com.invalid> 于2023年2月4日周六 18:06写道:

> hi,
>
>
> 各位大佬好,在idea构建flink源码失败,吧几乎所有scala版本,sbt版本都下载下来,一一测试都失败了。
>
> 环境如下:
>
> 操作系统:Ubuntu22.04
>
> idea:2022.3.2
>
> jdk:
>
>   java version "1.8.0_191"
>  Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
>  Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)
>
> scala:
>
> 2.12.0,2.12.14(都下载下来了.
> 2.12.1,2.12.2,2.12.3,2.12.4,2.13.3)
>
>
> sbt:
>
>  sbt-1.3.6 (  都下载下:sbt-1.1.4  sbt-1.2.0 , sbt-1.4.0 sbt-1.5.5
> sbt-1.6.1  sbt-1.7.2  sbt-1.8.1)
>
>
> mvn:
>
> 3.8.7,3.2.5
>
>
> 目前的异常是:
>
> scalac: Error: assertion failed:
>(class DataStream,iterate$default$2)
>   while compiling:
>
> /java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
>  during phase: typer
>   library version: version 2.12.14
>  compiler version: version 2.12.14
>reconstructed args: -nobootcp -classpath
>
> /jdk/development/jre/lib/charsets.jar:/jdk/development/jre/lib/deploy.jar:/jdk/development/jre/lib/ext/cldrdata.jar:/jdk/development/jre/lib/ext/dnsns.jar:/jdk/development/jre/lib/ext/jaccess.jar:/jdk/development/jre/lib/ext/jfxrt.jar:/jdk/development/jre/lib/ext/localedata.jar:/jdk/development/jre/lib/ext/nashorn.jar:/jdk/development/jre/lib/ext/sunec.jar:/jdk/development/jre/lib/ext/sunjce_provider.jar:/jdk/development/jre/lib/ext/sunpkcs11.jar:/jdk/development/jre/lib/ext/zipfs.jar:/jdk/development/jre/lib/javaws.jar:/jdk/development/jre/lib/jce.jar:/jdk/development/jre/lib/jfr.jar:/jdk/development/jre/lib/jfxswt.jar:/jdk/development/jre/lib/jsse.jar:/jdk/development/jre/lib/management-agent.jar:/jdk/development/jre/lib/plugin.jar:/jdk/development/jre/lib/resources.jar:/jdk/development/jre/lib/rt.jar:/java-source/flink/flink-streaming-scala/target/classes:/java-source/flink/flink-streaming-java/target/classes:/java-source/flink/flink-core/target/classes:/java-source/flink/flink-connectors/flink-file-sink-common/target/classes:/java-source/flink/flink-runtime/target/classes:/java-source/flink/flink-java/target/classes:/rely/maven/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/rely/maven/repository/org/apache/flink/flink-shaded-guava/30.1.1-jre-15.0/flink-shaded-guava-30.1.1-jre-15.0.jar:/rely/maven/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/java-source/flink/flink-scala/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-asm-9/9.2-15.0/flink-shaded-asm-9-9.2-15.0.jar:/rely/maven/repository/com/twitter/chill_2.12/0.7.6/chill_2.12-0.7.6.jar:/rely/maven/repository/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar:/rely/maven/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar:/java-source/flink/flink-annotations/target/classes:/java-source/flink/flink-metrics/flink-metrics-core/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-jackson/2.12.4-15.0/flink-shaded-jackson-2.12.4-15.0.jar:/rely/maven/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/rely/maven/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/rely/maven/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/rely/maven/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/rely/maven/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/java-source/flink/flink-rpc/flink-rpc-core/target/classes:/java-source/flink/flink-rpc/flink-rpc-akka-loader/target/classes:/java-source/flink/flink-queryable-state/flink-queryable-state-client-java/target/classes:/java-source/flink/flink-filesystems/flink-hadoop-fs/target/classes:/rely/maven/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-netty/
> 4.1.70.
> Final-15.0/flink-shaded-netty-4.1.70.Final-15.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-zookeeper-3/3.5.9-15.0/flink-shaded-zookeeper-3-3.5.9-15.0.jar:/rely/maven/repository/commons-cli/commons-cli/1.5.0/commons-cli-1.5.0.jar:/rely/maven/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/rely/maven/repository/org/xerial/snappy/snappy-java/
> 1.1.8.3/snappy-java-1.1.8.3.jar:/rely/maven/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/rely/maven/repository/io/airlift/air

Re: idea构建flink源码失败

2023-02-06 文章 Weihua Hu
Hi,

Flink 1.15 版本之后已经不支持 JDK 8 了,可以尝试使用 jdk 11 编译,另外在 idea
编译具体是怎么操作的呢?可以尝试在命令行编译,如果有问题可以发一下更多的错误日志。

源码编译可以参考文档:
https://nightlies.apache.org/flink/flink-docs-master/docs/flinkdev/building/

Best,
Weihua


On Sat, Feb 4, 2023 at 6:06 PM tiger <2372554...@qq.com.invalid> wrote:

> hi,
>
>
> 各位大佬好,在idea构建flink源码失败,吧几乎所有scala版本,sbt版本都下载下来,一一测试都失败了。
>
> 环境如下:
>
> 操作系统:Ubuntu22.04
>
> idea:2022.3.2
>
> jdk:
>
>   java version "1.8.0_191"
>  Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
>  Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)
>
> scala:
>
> 2.12.0,2.12.14(都下载下来了.
> 2.12.1,2.12.2,2.12.3,2.12.4,2.13.3)
>
>
> sbt:
>
>  sbt-1.3.6 (  都下载下:sbt-1.1.4  sbt-1.2.0 , sbt-1.4.0 sbt-1.5.5
> sbt-1.6.1  sbt-1.7.2  sbt-1.8.1)
>
>
> mvn:
>
> 3.8.7,3.2.5
>
>
> 目前的异常是:
>
> scalac: Error: assertion failed:
>(class DataStream,iterate$default$2)
>   while compiling:
>
> /java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
>  during phase: typer
>   library version: version 2.12.14
>  compiler version: version 2.12.14
>reconstructed args: -nobootcp -classpath
>
> /jdk/development/jre/lib/charsets.jar:/jdk/development/jre/lib/deploy.jar:/jdk/development/jre/lib/ext/cldrdata.jar:/jdk/development/jre/lib/ext/dnsns.jar:/jdk/development/jre/lib/ext/jaccess.jar:/jdk/development/jre/lib/ext/jfxrt.jar:/jdk/development/jre/lib/ext/localedata.jar:/jdk/development/jre/lib/ext/nashorn.jar:/jdk/development/jre/lib/ext/sunec.jar:/jdk/development/jre/lib/ext/sunjce_provider.jar:/jdk/development/jre/lib/ext/sunpkcs11.jar:/jdk/development/jre/lib/ext/zipfs.jar:/jdk/development/jre/lib/javaws.jar:/jdk/development/jre/lib/jce.jar:/jdk/development/jre/lib/jfr.jar:/jdk/development/jre/lib/jfxswt.jar:/jdk/development/jre/lib/jsse.jar:/jdk/development/jre/lib/management-agent.jar:/jdk/development/jre/lib/plugin.jar:/jdk/development/jre/lib/resources.jar:/jdk/development/jre/lib/rt.jar:/java-source/flink/flink-streaming-scala/target/classes:/java-source/flink/flink-streaming-java/target/classes:/java-source/flink/flink-core/target/classes:/java-source/flink/flink-connectors/flink-file-sink-common/target/classes:/java-source/flink/flink-runtime/target/classes:/java-source/flink/flink-java/target/classes:/rely/maven/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/rely/maven/repository/org/apache/flink/flink-shaded-guava/30.1.1-jre-15.0/flink-shaded-guava-30.1.1-jre-15.0.jar:/rely/maven/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/java-source/flink/flink-scala/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-asm-9/9.2-15.0/flink-shaded-asm-9-9.2-15.0.jar:/rely/maven/repository/com/twitter/chill_2.12/0.7.6/chill_2.12-0.7.6.jar:/rely/maven/repository/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar:/rely/maven/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar:/java-source/flink/flink-annotations/target/classes:/java-source/flink/flink-metrics/flink-metrics-core/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-jackson/2.12.4-15.0/flink-shaded-jackson-2.12.4-15.0.jar:/rely/maven/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/rely/maven/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/rely/maven/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/rely/maven/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/rely/maven/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/java-source/flink/flink-rpc/flink-rpc-core/target/classes:/java-source/flink/flink-rpc/flink-rpc-akka-loader/target/classes:/java-source/flink/flink-queryable-state/flink-queryable-state-client-java/target/classes:/java-source/flink/flink-filesystems/flink-hadoop-fs/target/classes:/rely/maven/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-netty/
> 4.1.70.
> Final-15.0/flink-shaded-netty-4.1.70.Final-15.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-zookeeper-3/3.5.9-15.0/flink-shaded-zookeeper-3-3.5.9-15.0.jar:/rely/maven/repository/commons-cli/commons-cli/1.5.0/commons-cli-1.5.0.jar:/rely/maven/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/rely/maven/repository/org/xerial/snappy/snappy-java/
> 1.1.8.3/snappy-java-1.1.8.3.jar:/rely/maven/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/rely/maven/repository/io/airlift/aircompressor/0.21/aircompressor-0.21.jar:/

idea构建flink源码失败

2023-02-04 文章 tiger

hi,

    
各位大佬好,在idea构建flink源码失败,吧几乎所有scala版本,sbt版本都下载下来,一一测试都失败了。


环境如下:

操作系统:Ubuntu22.04

idea:2022.3.2

jdk:

     java version "1.8.0_191"
    Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
    Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)

scala:

   2.12.0,2.12.14(都下载下来了. 
2.12.1,2.12.2,2.12.3,2.12.4,2.13.3)



sbt:

    sbt-1.3.6 (  都下载下:sbt-1.1.4  sbt-1.2.0 , sbt-1.4.0 sbt-1.5.5  
sbt-1.6.1  sbt-1.7.2  sbt-1.8.1)



mvn:

   3.8.7,3.2.5


目前的异常是:

scalac: Error: assertion failed:
  (class DataStream,iterate$default$2)
 while compiling: 
/java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala

    during phase: typer
 library version: version 2.12.14
    compiler version: version 2.12.14
  reconstructed args: -nobootcp -classpath 
/jdk/development/jre/lib/charsets.jar:/jdk/development/jre/lib/deploy.jar:/jdk/development/jre/lib/ext/cldrdata.jar:/jdk/development/jre/lib/ext/dnsns.jar:/jdk/development/jre/lib/ext/jaccess.jar:/jdk/development/jre/lib/ext/jfxrt.jar:/jdk/development/jre/lib/ext/localedata.jar:/jdk/development/jre/lib/ext/nashorn.jar:/jdk/development/jre/lib/ext/sunec.jar:/jdk/development/jre/lib/ext/sunjce_provider.jar:/jdk/development/jre/lib/ext/sunpkcs11.jar:/jdk/development/jre/lib/ext/zipfs.jar:/jdk/development/jre/lib/javaws.jar:/jdk/development/jre/lib/jce.jar:/jdk/development/jre/lib/jfr.jar:/jdk/development/jre/lib/jfxswt.jar:/jdk/development/jre/lib/jsse.jar:/jdk/development/jre/lib/management-agent.jar:/jdk/development/jre/lib/plugin.jar:/jdk/development/jre/lib/resources.jar:/jdk/development/jre/lib/rt.jar:/java-source/flink/flink-streaming-scala/target/classes:/java-source/flink/flink-streaming-java/target/classes:/java-source/flink/flink-core/target/classes:/java-source/flink/flink-connectors/flink-file-sink-common/target/classes:/java-source/flink/flink-runtime/target/classes:/java-source/flink/flink-java/target/classes:/rely/maven/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/rely/maven/repository/org/apache/flink/flink-shaded-guava/30.1.1-jre-15.0/flink-shaded-guava-30.1.1-jre-15.0.jar:/rely/maven/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/java-source/flink/flink-scala/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-asm-9/9.2-15.0/flink-shaded-asm-9-9.2-15.0.jar:/rely/maven/repository/com/twitter/chill_2.12/0.7.6/chill_2.12-0.7.6.jar:/rely/maven/repository/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar:/rely/maven/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar:/java-source/flink/flink-annotations/target/classes:/java-source/flink/flink-metrics/flink-metrics-core/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-jackson/2.12.4-15.0/flink-shaded-jackson-2.12.4-15.0.jar:/rely/maven/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/rely/maven/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/rely/maven/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/rely/maven/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/rely/maven/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/java-source/flink/flink-rpc/flink-rpc-core/target/classes:/java-source/flink/flink-rpc/flink-rpc-akka-loader/target/classes:/java-source/flink/flink-queryable-state/flink-queryable-state-client-java/target/classes:/java-source/flink/flink-filesystems/flink-hadoop-fs/target/classes:/rely/maven/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-netty/4.1.70.Final-15.0/flink-shaded-netty-4.1.70.Final-15.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-zookeeper-3/3.5.9-15.0/flink-shaded-zookeeper-3-3.5.9-15.0.jar:/rely/maven/repository/commons-cli/commons-cli/1.5.0/commons-cli-1.5.0.jar:/rely/maven/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/rely/maven/repository/org/xerial/snappy/snappy-java/1.1.8.3/snappy-java-1.1.8.3.jar:/rely/maven/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/rely/maven/repository/io/airlift/aircompressor/0.21/aircompressor-0.21.jar:/rely/maven/repository/org/apache/flink/flink-shaded-force-shading/15.0/flink-shaded-force-shading-15.0.jar:/rely/maven/repository/org/slf4j/slf4j-api/1.7.32/slf4j-api-1.7.32.jar:/rely/maven/repository/com/google/code/findbugs/jsr305/1.3.9/jsr305-1.3.9.jar:/rely/maven/repository/org/objenesis/objenesis/2.1/objenesis-2.1.jar:/home/disk/scala/scala-2.12.14/lib/scala-parser-combinators_2.12-1.0.7.jar:/home/disk/scala/scala-2.12.14/lib/scala-reflect.jar:/home/disk/scala/scala-2.12.14/lib/scala-swing_2.12-2.0.3.jar:/home/