[
https://issues.apache.org/jira/browse/BIGTOP-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated BIGTOP-1004:
-----------------------------------
Attachment: BIGTOP-1004.patch
There is actually this in install_hadoop.sh meant to create version independent
symlinks:
{noformat}
# Remove all source and create version-less symlinks to offer integration point
with other projects
for DIR in ${HADOOP_DIR} ${HDFS_DIR} ${YARN_DIR} ${MAPREDUCE_DIR} ${HTTPFS_DIR}
; do
(cd $DIR &&
rm -fv *-sources.jar
rm -fv lib/hadoop-*.jar
for j in hadoop-*.jar; do
if [[ $j =~ hadoop-(.*)-${HADOOP_VERSION}.jar ]]; then
name=${BASH_REMATCH[1]}
ln -s $j hadoop-$name.jar
fi
done)
done
{noformat}
However, the symlinks are not present as expected after installation.
The problem is HADOOP_VERSION is hardcoded in install_hadoop.sh to "0.21.3".
{noformat}
+ for j in 'hadoop-*.jar'
+ [[ hadoop-annotations-2.0.5-alpha.jar =~ hadoop-(.*)-0.23.1.jar ]]
...
{noformat}
Attached a patch that sets up HADOOP_VERSION in the environment. Confirmed the
presence of expected symlinks after package install.
> Hadoop install should have version independent symlinks
> -------------------------------------------------------
>
> Key: BIGTOP-1004
> URL: https://issues.apache.org/jira/browse/BIGTOP-1004
> Project: Bigtop
> Issue Type: Improvement
> Reporter: Andrew Purtell
> Attachments: BIGTOP-1004.patch
>
>
> The Hadoop packages should install version independent symlinks.
> When working on BIGTOP-993 I couldn't replace Hadoop dependencies in the
> component lib/ with symlinks, unlike the case for Zookeeper and HBase,
> because version independent symlinks aren't available for Hadoop jars.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira