Re: Re: Flink connect hive with hadoop HA

2020-02-14 Thread Robert Metzger
There's a configuration value "env.hadoop.conf.dir" to set the hadoop configuration directory: https://ci.apache.org/projects/flink/flink-docs-master/ops/config.html#env-hadoop-conf-dir If the files in that directory correctly configure Hadoop HA, the client side should pick up the config. On

Re:Re: Flink connect hive with hadoop HA

2020-02-10 Thread sunfulin
Hi ,guys Thanks for kind reply. Actually I want to know how to change client side haddop conf while using table API within my program. Hope some useful sug. At 2020-02-11 02:42:31, "Bowen Li" wrote: Hi sunfulin, Sounds like you didn't config the hadoop HA correctly on the client

Re:Re: Flink connect hive with hadoop HA

2020-02-10 Thread sunfulin
Hi ,guys Thanks for kind reply. Actually I want to know how to change client side haddop conf while using table API within my program. Hope some useful sug. At 2020-02-11 02:42:31, "Bowen Li" wrote: Hi sunfulin, Sounds like you didn't config the hadoop HA correctly on the client

Re: Flink connect hive with hadoop HA

2020-02-10 Thread Bowen Li
Hi sunfulin, Sounds like you didn't config the hadoop HA correctly on the client side according to [1]. Let us know if it helps resolve the issue. [1] https://stackoverflow.com/questions/25062788/namenode-ha-unknownhostexception-nameservice1 On Mon, Feb 10, 2020 at 7:11 AM Khachatryan Roman

Re: Flink connect hive with hadoop HA

2020-02-10 Thread Bowen Li
Hi sunfulin, Sounds like you didn't config the hadoop HA correctly on the client side according to [1]. Let us know if it helps resolve the issue. [1] https://stackoverflow.com/questions/25062788/namenode-ha-unknownhostexception-nameservice1 On Mon, Feb 10, 2020 at 7:11 AM Khachatryan Roman

Re: Flink connect hive with hadoop HA

2020-02-10 Thread Khachatryan Roman
Hi, Could you please provide a full stacktrace? Regards, Roman On Mon, Feb 10, 2020 at 2:12 PM sunfulin wrote: > Hi, guys > I am using Flink 1.10 and test functional cases with hive intergration. > Hive with 1.1.0-cdh5.3.0 and with hadoop HA enabled.Running flink job I can > see successful

Flink connect hive with hadoop HA

2020-02-10 Thread sunfulin
Hi, guys I am using Flink 1.10 and test functional cases with hive intergration. Hive with 1.1.0-cdh5.3.0 and with hadoop HA enabled.Running flink job I can see successful connection with hive metastore, but cannot read table data with exception: java.lang.IllegalArgumentException:

Flink connect hive with hadoop HA

2020-02-10 Thread sunfulin
Hi, guys I am using Flink 1.10 and test functional cases with hive intergration. Hive with 1.1.0-cdh5.3.0 and with hadoop HA enabled.Running flink job I can see successful connection with hive metastore, but cannot read table data with exception: java.lang.IllegalArgumentException: