zhangjun0x01 commented on pull request #1558:
URL: https://github.com/apache/iceberg/pull/1558#issuecomment-705916509
> @zhangjun0x01, @JingsongLi, how does Flink normally handle hive-site.xml
files? This seems strange to me, so I'd like to understand if this is something
that Flink would normally do.
hi,@rdblue:
As far as I know, flink provides a hiveConfDir to get hive-site.xml, it
is indeed no problem before flink 1.11, but flink 1.11 provides an application
mode to submit flink job, in this case, the user jar is parsed in the
jobmanager node of flink, but this jobmanager node is very likely to have no
hive-site.xml file. If we provide a local path to get hive-site.xml, the
program will not find it in application mode , so I thought of a way to be
compatible with flink's various submission modes . We provide a local or hdfs
path to get hive-site.xml.I described possible problems in the
https://github.com/apache/iceberg/issues/1437
I think this should also be a issue with flink. What do you
think?@JingsongLi
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
