Re: idea构建flink源码失败

2023-02-06 文章 Weihua Hu
Hi,

Flink 1.15 版本之后已经不支持 JDK 8 了,可以尝试使用 jdk 11 编译,另外在 idea
编译具体是怎么操作的呢?可以尝试在命令行编译,如果有问题可以发一下更多的错误日志。

源码编译可以参考文档:
https://nightlies.apache.org/flink/flink-docs-master/docs/flinkdev/building/

Best,
Weihua


On Sat, Feb 4, 2023 at 6:06 PM tiger <2372554...@qq.com.invalid> wrote:

> hi,
>
>
> 各位大佬好,在idea构建flink源码失败,吧几乎所有scala版本,sbt版本都下载下来,一一测试都失败了。
>
> 环境如下:
>
> 操作系统:Ubuntu22.04
>
> idea:2022.3.2
>
> jdk:
>
>   java version "1.8.0_191"
>  Java(TM) SE Runtime Environment (build 1.8.0_191-b12)
>  Java HotSpot(TM) 64-Bit Server VM (build 25.191-b12, mixed mode)
>
> scala:
>
> 2.12.0,2.12.14(都下载下来了.
> 2.12.1,2.12.2,2.12.3,2.12.4,2.13.3)
>
>
> sbt:
>
>  sbt-1.3.6 (  都下载下:sbt-1.1.4  sbt-1.2.0 , sbt-1.4.0 sbt-1.5.5
> sbt-1.6.1  sbt-1.7.2  sbt-1.8.1)
>
>
> mvn:
>
> 3.8.7,3.2.5
>
>
> 目前的异常是:
>
> scalac: Error: assertion failed:
>(class DataStream,iterate$default$2)
>   while compiling:
>
> /java-source/flink/flink-streaming-scala/src/main/scala/org/apache/flink/streaming/api/scala/DataStream.scala
>  during phase: typer
>   library version: version 2.12.14
>  compiler version: version 2.12.14
>reconstructed args: -nobootcp -classpath
>
> /jdk/development/jre/lib/charsets.jar:/jdk/development/jre/lib/deploy.jar:/jdk/development/jre/lib/ext/cldrdata.jar:/jdk/development/jre/lib/ext/dnsns.jar:/jdk/development/jre/lib/ext/jaccess.jar:/jdk/development/jre/lib/ext/jfxrt.jar:/jdk/development/jre/lib/ext/localedata.jar:/jdk/development/jre/lib/ext/nashorn.jar:/jdk/development/jre/lib/ext/sunec.jar:/jdk/development/jre/lib/ext/sunjce_provider.jar:/jdk/development/jre/lib/ext/sunpkcs11.jar:/jdk/development/jre/lib/ext/zipfs.jar:/jdk/development/jre/lib/javaws.jar:/jdk/development/jre/lib/jce.jar:/jdk/development/jre/lib/jfr.jar:/jdk/development/jre/lib/jfxswt.jar:/jdk/development/jre/lib/jsse.jar:/jdk/development/jre/lib/management-agent.jar:/jdk/development/jre/lib/plugin.jar:/jdk/development/jre/lib/resources.jar:/jdk/development/jre/lib/rt.jar:/java-source/flink/flink-streaming-scala/target/classes:/java-source/flink/flink-streaming-java/target/classes:/java-source/flink/flink-core/target/classes:/java-source/flink/flink-connectors/flink-file-sink-common/target/classes:/java-source/flink/flink-runtime/target/classes:/java-source/flink/flink-java/target/classes:/rely/maven/repository/com/twitter/chill-java/0.7.6/chill-java-0.7.6.jar:/rely/maven/repository/org/apache/flink/flink-shaded-guava/30.1.1-jre-15.0/flink-shaded-guava-30.1.1-jre-15.0.jar:/rely/maven/repository/org/apache/commons/commons-math3/3.6.1/commons-math3-3.6.1.jar:/java-source/flink/flink-scala/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-asm-9/9.2-15.0/flink-shaded-asm-9-9.2-15.0.jar:/rely/maven/repository/com/twitter/chill_2.12/0.7.6/chill_2.12-0.7.6.jar:/rely/maven/repository/org/scala-lang/scala-reflect/2.12.7/scala-reflect-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-library/2.12.7/scala-library-2.12.7.jar:/rely/maven/repository/org/scala-lang/scala-compiler/2.12.7/scala-compiler-2.12.7.jar:/rely/maven/repository/org/scala-lang/modules/scala-xml_2.12/1.0.6/scala-xml_2.12-1.0.6.jar:/java-source/flink/flink-annotations/target/classes:/java-source/flink/flink-metrics/flink-metrics-core/target/classes:/rely/maven/repository/org/apache/flink/flink-shaded-jackson/2.12.4-15.0/flink-shaded-jackson-2.12.4-15.0.jar:/rely/maven/repository/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar:/rely/maven/repository/com/esotericsoftware/kryo/kryo/2.24.0/kryo-2.24.0.jar:/rely/maven/repository/com/esotericsoftware/minlog/minlog/1.2/minlog-1.2.jar:/rely/maven/repository/commons-collections/commons-collections/3.2.2/commons-collections-3.2.2.jar:/rely/maven/repository/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar:/java-source/flink/flink-rpc/flink-rpc-core/target/classes:/java-source/flink/flink-rpc/flink-rpc-akka-loader/target/classes:/java-source/flink/flink-queryable-state/flink-queryable-state-client-java/target/classes:/java-source/flink/flink-filesystems/flink-hadoop-fs/target/classes:/rely/maven/repository/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-netty/
> 4.1.70.
> Final-15.0/flink-shaded-netty-4.1.70.Final-15.0.jar:/rely/maven/repository/org/apache/flink/flink-shaded-zookeeper-3/3.5.9-15.0/flink-shaded-zookeeper-3-3.5.9-15.0.jar:/rely/maven/repository/commons-cli/commons-cli/1.5.0/commons-cli-1.5.0.jar:/rely/maven/repository/org/javassist/javassist/3.24.0-GA/javassist-3.24.0-GA.jar:/rely/maven/repository/org/xerial/snappy/snappy-java/
> 1.1.8.3/snappy-java-1.1.8.3.jar:/rely/maven/repository/org/lz4/lz4-java/1.8.0/lz4-java-1.8.0.jar:/rely/maven/repository/io/airlift/aircompressor/0.21/aircompressor-0.21.jar:/rely/maven/repository/org/apache/flink/flink-shaded-force-shading/15.0/flink-shaded-force-shading-15.0.jar:/rely/maven/repository/org/slf4j/slf4j-api/1.7.32/slf4j-api-1.7.3

退订

2023-02-06 文章 郑林怡
退订

Re: Flink SQL使用hive dialect异常

2023-02-06 文章 yuxia
你好,可以贴一下详细的异常栈吗?
可以在 FLINK_HOME/log/ 下面看到

Best regards,
Yuxia

- 原始邮件 -
发件人: "aiden" <18765295...@163.com>
收件人: "user-zh" 
发送时间: 星期一, 2023年 2 月 06日 下午 4:44:02
主题: Flink SQL使用hive dialect异常

HI

   我在使用Flink SQL Client开发hive时遇到一个问题,在设置set table.sql-dialect=hive时,会报如下错误
Flink SQL> CREATE CATALOG myhive WITH (
>   'type' = 'hive',
>   'hive-conf-dir' = '/opt/bd/flink/hive-conf'
> );

[INFO] Execute statement succeed.

Flink SQL> 
> use catalog myhive;
[INFO] Execute statement succeed.

Flink SQL> show tables;
++
| table name |
++
| hive_table_name|
++
20 rows in set

Flink SQL> SET table.sql-dialect=hive;
[INFO] Session property has been set.

Flink SQL> show tables;
[ERROR] Could not execute SQL statement. Reason:
org.apache.flink.table.client.gateway.SqlExecutionException: Failed to parse 
statement: show tables;

Flink SQL> show tables;
[ERROR] Could not execute SQL statement. Reason:
java.lang.NoClassDefFoundError: Could not initialize class 
org.apache.hadoop.hive.ql.exec.FunctionRegistry

Flink版本为1.15.2,hadoop版本为3.0.0,hive版本为2.1.1,lib下jar为:
flink-cep-1.15.2.jar
flink-connector-files-1.15.2.jar
flink-csv-1.15.2.jar
flink-dist-1.15.2.jar
flink-json-1.15.2.jar
flink-scala_2.12-1.15.2.jar
flink-shaded-zookeeper-3.5.9.jar
flink-sql-connector-hive-2.2.0_2.12-1.15.2.jar
flink-table-api-java-uber-1.15.2.jar
flink-table-planner_2.12-1.15.2.jar
flink-table-runtime-1.15.2.jar
log4j-1.2-api-2.17.1.jar
log4j-api-2.17.1.jar
log4j-core-2.17.1.jar
log4j-slf4j-impl-2.17.1.jar
按照官网说明,将flink-sql-connector-hive-2.2.0_2.12-1.15.2.jar包删除并添加antlr-runtime-3.5.2.jar、flink-connector-hive_2.12-1.15.2.ja及hive-exec-2.1.1.jar包后依然报同样错误,请问这个该如何解决。