Todd Lipcon has posted comments on this change. ( 
http://gerrit.cloudera.org:8080/13224 )

Change subject: Hive 3: switch to Tez-on-YARN execution
......................................................................


Patch Set 2:

(2 comments)

http://gerrit.cloudera.org:8080/#/c/13224/2/fe/pom.xml
File fe/pom.xml:

http://gerrit.cloudera.org:8080/#/c/13224/2/fe/pom.xml@56
PS2, Line 56:     <dependency>
> Why does impala dependency opposite of hive's?
Sorry, I don't understand your question. Can you clarify?

I found I needed both 'hadoop-hdfs' and 'hadoop-hdfs-client' when I upgraded to 
Hadoop 3.1 or else I was missing various classes at compile time 
(DFSConfigKeys.java is in hadoop-hdfs, and some hdfs.protocol.* classes are in 
hdfs-client)


http://gerrit.cloudera.org:8080/#/c/13224/2/testdata/cluster/node_templates/common/etc/hadoop/conf/yarn-site.xml.py
File testdata/cluster/node_templates/common/etc/hadoop/conf/yarn-site.xml.py:

http://gerrit.cloudera.org:8080/#/c/13224/2/testdata/cluster/node_templates/common/etc/hadoop/conf/yarn-site.xml.py@48
PS2, Line 48: $HADOOP_COMMON_HOME/share/hadoop/common/*,
            :       $HADOOP_COMMON_HOME/share/hadoop/common/lib/*,
            :       $HADOOP_HDFS_HOME/share/hadoop/hdfs/*,
            :       $HADOOP_HDFS_HOME/share/hadoop/hdfs/lib/*,
            :       $HADOOP_YARN_HOME/share/hadoop/yarn/*,
            :       $HADOOP_YARN_HOME/share/hadoop/yarn/lib/*
> Where do HADOOP_COMMON_HOME, HADOOP_HDFS_HOME, HADOOP_YARN_HOME get defined
those are all defined by the hadoop wrapper scripts which start the 
nodemanager. Everything here is actually the default value, and we're just 
appending LZO_JAR_PATH, TEZ_HOME, etc.



--
To view, visit http://gerrit.cloudera.org:8080/13224
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: If96064f271582b2790a3cfb3d135f3834d46c41d
Gerrit-Change-Number: 13224
Gerrit-PatchSet: 2
Gerrit-Owner: Todd Lipcon <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Joe McDonnell <[email protected]>
Gerrit-Reviewer: Sudhanshu Arora <[email protected]>
Gerrit-Reviewer: Todd Lipcon <[email protected]>
Gerrit-Reviewer: Vihang Karajgaonkar <[email protected]>
Gerrit-Reviewer: Yongzhi Chen <[email protected]>
Gerrit-Comment-Date: Fri, 03 May 2019 22:56:56 +0000
Gerrit-HasComments: Yes

Reply via email to