This is an automated email from the ASF dual-hosted git repository. oflebbe pushed a commit to branch bigtop-alpha in repository https://gitbox.apache.org/repos/asf/bigtop.git
commit b8a1c799a229e9b8e21c005f954e3d9d56c38358 Author: Olaf Flebbe <[email protected]> AuthorDate: Tue Jul 2 22:31:42 2019 +0200 adapt to hadoop3 --- bigtop-packages/src/deb/hadoop/control | 24 ++++++++++++------------ bigtop-packages/src/deb/hadoop/hadoop.install | 7 +++++++ bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec | 3 ++- 3 files changed, 21 insertions(+), 13 deletions(-) diff --git a/bigtop-packages/src/deb/hadoop/control b/bigtop-packages/src/deb/hadoop/control index fc3f3c9..e80073b 100644 --- a/bigtop-packages/src/deb/hadoop/control +++ b/bigtop-packages/src/deb/hadoop/control @@ -47,7 +47,7 @@ Description: Hadoop is a software platform for processing vast amounts of data Package: hadoop-hdfs Architecture: any -Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), bigtop-groovy, hadoop (= ${binary:Version}), bigtop-jsvc +Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), bigtop-groovy, hadoop (= ${binary:Version}) Description: The Hadoop Distributed File System Hadoop Distributed File System (HDFS) is the primary storage system used by Hadoop applications. HDFS creates multiple replicas of data blocks and distributes @@ -56,7 +56,7 @@ Description: The Hadoop Distributed File System Package: hadoop-yarn Architecture: any -Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), hadoop (= ${binary:Version}) +Depends: ${shlibs:Depends}, ${misc:Depends}, adduser, bigtop-utils (>= 0.7), hadoop (= ${binary:Version}), lsb-base Description: The Hadoop NextGen MapReduce (YARN) YARN (Hadoop NextGen MapReduce) is a general purpose data-computation framework. The fundamental idea of YARN is to split up the two major functionalities of the @@ -106,13 +106,13 @@ Description: Pseudo-distributed Hadoop configuration Package: hadoop-mapreduce-historyserver Architecture: any -Depends: hadoop-mapreduce (= ${binary:Version}), hadoop-hdfs (= ${binary:Version}) +Depends: hadoop-mapreduce (= ${binary:Version}), hadoop-hdfs (= ${binary:Version}), lsb-base Description: MapReduce History Server The History server keeps records of the different activities being performed on a Apache Hadoop cluster Package: hadoop-yarn-nodemanager Architecture: any -Depends: hadoop-yarn (= ${binary:Version}) +Depends: hadoop-yarn (= ${binary:Version}), lsb-base Description: YARN Node Manager The NodeManager is the per-machine framework agent who is responsible for containers, monitoring their resource usage (cpu, memory, disk, network) and @@ -120,19 +120,19 @@ Description: YARN Node Manager Package: hadoop-yarn-resourcemanager Architecture: any -Depends: hadoop-yarn (= ${binary:Version}) +Depends: hadoop-yarn (= ${binary:Version}), lsb-base Description: YARN Resource Manager The resource manager manages the global assignment of compute resources to applications Package: hadoop-yarn-proxyserver Architecture: any -Depends: hadoop-yarn (= ${binary:Version}) +Depends: hadoop-yarn (= ${binary:Version}), lsb-base Description: YARN Web Proxy The web proxy server sits in front of the YARN application master web UI. Package: hadoop-yarn-timelineserver Architecture: any -Depends: hadoop-yarn (= ${binary:Version}) +Depends: hadoop-yarn (= ${binary:Version}), lsb-base Description: YARN Timeline Server Storage and retrieval of applications' current as well as historic information in a generic fashion is solved in YARN through the @@ -140,14 +140,14 @@ Description: YARN Timeline Server Package: hadoop-hdfs-namenode Architecture: any -Depends: hadoop-hdfs (= ${binary:Version}) +Depends: hadoop-hdfs (= ${binary:Version}), lsb-base Description: The Hadoop namenode manages the block locations of HDFS files The Hadoop Distributed Filesystem (HDFS) requires one unique server, the namenode, which manages the block locations of files on the filesystem. Package: hadoop-hdfs-secondarynamenode Architecture: any -Depends: hadoop-hdfs (= ${binary:Version}) +Depends: hadoop-hdfs (= ${binary:Version}), lsb-base Description: Hadoop Secondary namenode The Secondary Name Node periodically compacts the Name Node EditLog into a checkpoint. This compaction ensures that Name Node restarts @@ -155,7 +155,7 @@ Description: Hadoop Secondary namenode Package: hadoop-hdfs-zkfc Architecture: any -Depends: hadoop-hdfs (= ${binary:Version}) +Depends: hadoop-hdfs (= ${binary:Version}), lsb-base Description: Hadoop HDFS failover controller The Hadoop HDFS failover controller is a ZooKeeper client which also monitors and manages the state of the NameNode. Each of the machines @@ -166,7 +166,7 @@ Description: Hadoop HDFS failover controller Package: hadoop-hdfs-journalnode Provides: hadoop-hdfs-journalnode Architecture: any -Depends: hadoop-hdfs (= ${binary:Version}) +Depends: hadoop-hdfs (= ${binary:Version}), lsb-base Description: Hadoop HDFS JournalNode The HDFS JournalNode is responsible for persisting NameNode edit logs. In a typical deployment the JournalNode daemon runs on at least three @@ -174,7 +174,7 @@ Description: Hadoop HDFS JournalNode Package: hadoop-hdfs-datanode Architecture: any -Depends: hadoop-hdfs (= ${binary:Version}) +Depends: hadoop-hdfs (= ${binary:Version}), lsb-base Description: Hadoop Data Node The Data Nodes in the Hadoop Cluster are responsible for serving up blocks of data over the network to Hadoop Distributed Filesystem diff --git a/bigtop-packages/src/deb/hadoop/hadoop.install b/bigtop-packages/src/deb/hadoop/hadoop.install index 7fd0f34..eb70b29 100644 --- a/bigtop-packages/src/deb/hadoop/hadoop.install +++ b/bigtop-packages/src/deb/hadoop/hadoop.install @@ -11,6 +11,13 @@ /usr/lib/hadoop/etc /usr/lib/hadoop/libexec/hadoop-config.sh /usr/lib/hadoop/libexec/hadoop-layout.sh +/usr/lib/hadoop/libexec/hadoop-functions.sh +/usr/lib/hadoop/libexec/hadoop-layout.sh +/usr/lib/hadoop/libexec/hadoop-layout.sh.example +/usr/lib/hadoop/libexec/shellprofile.d/ +/usr/lib/hadoop/libexec/shellprofile.d/* +/usr/lib/hadoop/libexec/tools/ +/usr/lib/hadoop/libexec/tools/* /usr/lib/hadoop/*.jar /usr/lib/hadoop/lib /usr/lib/hadoop/sbin diff --git a/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec b/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec index 262b2a6..2c72349 100644 --- a/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec +++ b/bigtop-packages/src/rpm/hadoop/SPECS/hadoop.spec @@ -223,7 +223,7 @@ located. %package hdfs Summary: The Hadoop Distributed File System Group: System/Daemons -Requires: %{name} = %{version}-%{release}, bigtop-groovy, bigtop-jsvc +Requires: %{name} = %{version}-%{release}, bigtop-groovy %description hdfs Hadoop Distributed File System (HDFS) is the primary storage system used by @@ -666,6 +666,7 @@ fi %{lib_hadoop}/etc %{lib_hadoop}/libexec/hadoop-config.sh %{lib_hadoop}/libexec/hadoop-layout.sh +%{lib_hadoop}/libexec/hadoop-functions.sh %{lib_hadoop}/libexec/kms-config.sh %{bin_hadoop}/hadoop %{man_hadoop}/man1/hadoop.1.*
