[
https://issues.apache.org/jira/browse/HAWQ-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948361#comment-15948361
]
Radar Lei commented on HAWQ-1421:
---------------------------------
Thanks [~shivram], most changes looks great!
But for pxf dependencies, I failed to get pxf rpm installed with HDP
installed. Please verify PXF can work with these hadoop distributions.
rpm -ivh pxf-hdfs-3.2.1.0-1.el6.noarch.rpm
error: Failed dependencies:
pxf-service >= 3.2.1.0 is needed by pxf-hdfs-0:3.2.1.0-1.el6.noarch
hadoop >= 2.7.1 is needed by pxf-hdfs-0:3.2.1.0-1.el6.noarch
hadoop-mapreduce >= 2.7.1 is needed by pxf-hdfs-0:3.2.1.0-1.el6.noarch
rpm -qa |grep hdfs
hadoop_2_5_0_0_1245-hdfs-2.7.3.2.5.0.0-1245.el6.x86_64
hadoop_2_5_0_0_1245-hdfs-secondarynamenode-2.7.3.2.5.0.0-1245.el6.x86_64
ranger-hdfs-plugin-0.6.0.2.5.0.0-1245.el6.noarch
hadoop_2_5_0_0_1245-hdfs-namenode-2.7.3.2.5.0.0-1245.el6.x86_64
ranger_2_5_0_0_1245-hdfs-plugin-0.6.0.2.5.0.0-1245.el6.x86_64
hadoop_2_5_0_0_1245-hdfs-datanode-2.7.3.2.5.0.0-1245.el6.x86_64
Another thought is user might using binary hadoop without rpm installs, will
PXF works with this situation?
> Improve PXF rpm package name format and dependencies
> ----------------------------------------------------
>
> Key: HAWQ-1421
> URL: https://issues.apache.org/jira/browse/HAWQ-1421
> Project: Apache HAWQ
> Issue Type: Improvement
> Components: Build, PXF
> Reporter: Radar Lei
> Assignee: Shivram Mani
> Fix For: 2.2.0.0-incubating
>
>
> If we build pxf rpm package by 'make rpm', we will get below pxf packages:
> {quote}
> apache-tomcat-7.0.62-el6.noarch.rpm
> pxf-3.2.1.0-root.el6.noarch.rpm
> pxf-hbase_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> pxf-hdfs_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> pxf-hive_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> pxf-jdbc_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> pxf-json_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> pxf-service_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> {quote}
> These rpm packages have dependencies on Apache Hadoop components only, some
> other Hadoop distributes can't satisfy it. E.g. :
> {quote}
> rpm -ivh pxf-hdfs_3_2_1_0-3.2.1.0-root.el6.noarch.rpm
> error: Failed dependencies:
> pxf-service_3_2_1_0 >= 3.2.1.0 is needed by
> pxf-hdfs_3_2_1_0-0:3.2.1.0-root.el6.noarch
> hadoop >= 2.7.1 is needed by pxf-hdfs_3_2_1_0-0:3.2.1.0-root.el6.noarch
> hadoop-mapreduce >= 2.7.1 is needed by
> pxf-hdfs_3_2_1_0-0:3.2.1.0-root.el6.noarch
> {quote}
> We'd better make the rpm package name format and dependencies better.
> 1. Remove the version string like '3_2_1_0'.
> 2. Remove the user name from the build environment.
> 3. Consider do we need to include the apache-tomcat rpm package into HAWQ
> rpm release tarball.
> 4. Improve the hard code 'el6' string. (This might be optinal)
> 5. Improve the dependencies, including the dependencies between these pxf
> rpm packages.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
