masatana opened a new pull request, #1323:
URL: https://github.com/apache/bigtop/pull/1323
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines:
https://cwiki.apache.org/confluence/display/BIGTOP/How+to+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g.,
'BIGTOP-3638: Your PR title ...'.
-->
### Description of PR
https://issues.apache.org/jira/browse/BIGTOP-4327
### How was this patch tested?
<details>
<summary>Build RPM & DEB packages, and test with them on Rocky Linux 8,
Ubuntu 24.04</summary>
## RPM
### YARN
* Build RPM packages (on Ubuntu 24.04 w/ docker)
```
$ ./gradlew allclean hadoop-pkg-ind repo-ind -POS=rockylinux-8
```
* Smoke tests (yarn, mapreduce)
```
$ ./docker-hadoop.sh --enable-local-repo --disable-gpg-check
--docker-compose-plugin -C config_rockylinux-8.yaml -F
docker-compose-cgroupv2.yml --stack hdfs,yarn,mapreduce --smoke-tests
yarn,mapreduce -c 3
(snip)
> Task :bigtop-tests:smoke-tests:mapreduce:test
Finished generating test XML results (0.038 secs) into:
/bigtop-home/bigtop-tests/smoke-tests/mapreduce/build/test-results/test
Generating HTML test report...
Finished generating test html results (0.1 secs) into:
/bigtop-home/bigtop-tests/smoke-tests/mapreduce/build/reports/tests/test
Now testing...
:bigtop-tests:smoke-tests:mapreduce:test (Thread[Execution worker for ':'
Thread 4,5,main]) completed. Took 5 mins 6.249 secs.
BUILD SUCCESSFUL in 5m 32s
30 actionable tasks: 10 executed, 20 up-to-date
Stopped 1 worker daemon(s).
+ rm -rf buildSrc/build/test-results/binary
+ rm -rf /bigtop-home/.gradle
```
* Install additional packages(hadoop-yarn-timelineserver
hadoop-yarn-router), run `systemctl start`
```
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 /bin/bash
[root@4b8e269f3689 /]# dnf install hadoop-yarn-timelineserver
hadoop-yarn-router
Last metadata expiration check: 0:16:34 ago on Tue Jan 14 14:22:52 2025.
Dependencies resolved.
======================================================================================================
Package Architecture Version
Repository Size
======================================================================================================
Installing:
hadoop-yarn-router x86_64 3.3.6-1.el8
bigtop-home_output 8.4 k
hadoop-yarn-timelineserver x86_64 3.3.6-1.el8
bigtop-home_output 8.6 k
Transaction Summary
======================================================================================================
Install 2 Packages
Total size: 17 k
Installed size: 4.2 k
Is this ok [y/N]: y
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing :
1/1
Installing : hadoop-yarn-timelineserver-3.3.6-1.el8.x86_64
1/2
Running scriptlet: hadoop-yarn-timelineserver-3.3.6-1.el8.x86_64
1/2
Installing : hadoop-yarn-router-3.3.6-1.el8.x86_64
2/2
Running scriptlet: hadoop-yarn-router-3.3.6-1.el8.x86_64
2/2
Verifying : hadoop-yarn-router-3.3.6-1.el8.x86_64
1/2
Verifying : hadoop-yarn-timelineserver-3.3.6-1.el8.x86_64
2/2
Installed:
hadoop-yarn-router-3.3.6-1.el8.x86_64
hadoop-yarn-timelineserver-3.3.6-1.el8.x86_64
Complete!
[root@4b8e269f3689 /]# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl start
hadoop-yarn-$service_name; done
[root@4b8e269f3689 /]# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl status --no-pager
hadoop-yarn-$service_name; done
● hadoop-yarn-resourcemanager.service - Hadoop ResourceManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-resourcemanager.service; static; vendor
preset: disabled)
Active: active (running) since Tue 2025-01-14 14:25:02 UTC; 15min ago
Docs: https://hadoop.apache.org/
Main PID: 6422 (java)
Tasks: 252 (limit: 98358)
Memory: 469.1M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-resourcemanager.service
└─6422
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_resource…
Jan 14 14:25:35 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Unknown serializa…ef-gid
Jan 14 14:25:35 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Changed dead -> running
Jan 14 14:25:42 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Unknown serializa…ef-gid
Jan 14 14:25:42 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Changed dead -> running
Jan 14 14:39:29 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Unknown serializa…ef-gid
Jan 14 14:39:29 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Changed dead -> running
Jan 14 14:39:38 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Trying to enqueue…eplace
Jan 14 14:39:38 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Installed new job…as 394
Jan 14 14:39:38 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Enqueued job hado…as 394
Jan 14 14:39:38 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Job hadoop-yarn-r…t=done
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-nodemanager.service - Hadoop NodeManager
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-nodemanager.service;
static; vendor preset: disabled)
Active: active (running) since Tue 2025-01-14 14:25:44 UTC; 14min ago
Docs: https://hadoop.apache.org/
Main PID: 8094 (java)
Tasks: 132 (limit: 98358)
Memory: 406.1M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-nodemanager.service
└─8094
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_nodemana…
Jan 14 14:25:44 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Changed start -> running
Jan 14 14:25:44 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Job hadoop-yarn-nodem…t=done
Jan 14 14:25:44 4b8e269f3689 systemd[1]: Started Hadoop NodeManager.
Jan 14 14:25:44 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Failed to send unit c…y peer
Jan 14 14:39:29 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Unknown serialization…ef-gid
Jan 14 14:39:29 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Changed dead -> running
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Trying to enqueue job…eplace
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Installed new job had…as 425
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Enqueued job hadoop-y…as 425
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Job hadoop-yarn-nodem…t=done
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-proxyserver.service - Hadoop ProxyServer
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-proxyserver.service;
static; vendor preset: disabled)
Active: active (running) since Tue 2025-01-14 14:25:15 UTC; 14min ago
Docs: https://hadoop.apache.org/
Main PID: 6916 (java)
Tasks: 34 (limit: 98358)
Memory: 134.6M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-proxyserver.service
└─6916
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_proxyser…
Jan 14 14:25:35 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Unknown serialization…ef-gid
Jan 14 14:25:35 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Changed dead -> running
Jan 14 14:25:42 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Unknown serialization…ef-gid
Jan 14 14:25:42 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Changed dead -> running
Jan 14 14:39:29 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Unknown serialization…ef-gid
Jan 14 14:39:29 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Changed dead -> running
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Trying to enqueue job…eplace
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Installed new job had…as 456
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Enqueued job hadoop-y…as 456
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Job hadoop-yarn-proxy…t=done
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-timelineserver.service - Hadoop NodeManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-timelineserver.service; static; vendor
preset: disabled)
Active: active (running) since Tue 2025-01-14 14:39:40 UTC; 27s ago
Docs: https://hadoop.apache.org/
Process: 12996 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start timelineserver (code=exited, status=0/SUCCESS)
Main PID: 13047 (java)
Tasks: 54 (limit: 98358)
Memory: 291.3M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-timelineserver.service
└─13047
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_timelin…
Jan 14 14:39:38 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
User lookup succee…id=992
Jan 14 14:39:38 4b8e269f3689 systemd[12996]:
hadoop-yarn-timelineserver.service: Executing: /us…server
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Child 12996 belong…rvice.
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Control process ex…atus=0
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Got final SIGCHLD …start.
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Main PID guessed: 13047
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Changed start -> running
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Job hadoop-yarn-ti…t=done
Jan 14 14:39:40 4b8e269f3689 systemd[1]: Started Hadoop NodeManager.
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Failed to send uni…y peer
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-router.service - Hadoop Router
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-router.service;
static; vendor preset: disabled)
Active: active (running) since Tue 2025-01-14 14:39:43 UTC; 25s ago
Docs: https://hadoop.apache.org/
Process: 13111 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start router (code=exited, status=0/SUCCESS)
Main PID: 13162 (java)
Tasks: 98 (limit: 98358)
Memory: 359.8M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-router.service
└─13162
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_router …
Jan 14 14:39:40 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: User
lookup succeeded: uid…id=992
Jan 14 14:39:40 4b8e269f3689 systemd[13111]: hadoop-yarn-router.service:
Executing: /usr/bin/ya…router
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Child
13111 belongs to had…rvice.
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Control
process exited, co…atus=0
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Got
final SIGCHLD for stat…start.
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Main
PID guessed: 13162
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Changed
start -> running
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Job
hadoop-yarn-router.ser…t=done
Jan 14 14:39:43 4b8e269f3689 systemd[1]: Started Hadoop Router.
Jan 14 14:39:43 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Failed
to send unit change…y peer
Hint: Some lines were ellipsized, use -l to show in full.
```
* Check if the systemd unit files
```
[root@4b8e269f3689 /]# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl cat hadoop-yarn-$service_name;
done
# /usr/lib/systemd/system/hadoop-yarn-resourcemanager.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop ResourceManager
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start
resourcemanager
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop
resourcemanager
# /usr/lib/systemd/system/hadoop-yarn-nodemanager.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop NodeManager
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start nodemanager
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop nodemanager
# /usr/lib/systemd/system/hadoop-yarn-proxyserver.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop ProxyServer
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start proxyserver
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop proxyserver
# /usr/lib/systemd/system/hadoop-yarn-timelineserver.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop NodeManager
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start
timelineserver
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop timelineserver
# /usr/lib/systemd/system/hadoop-yarn-router.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop Router
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start router
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop router
```
* Check if `systemctl start` works after container restart
```
~/bigtop/provisioner/docker$ docker ps
CONTAINER ID IMAGE COMMAND CREATED
STATUS PORTS NAMES
ed32e60e22b8 bigtop/puppet:trunk-rockylinux-8 "/sbin/init" 19 minutes
ago Up 19 minutes 20250114_232210_r24549-bigtop-2
584b08516eae bigtop/puppet:trunk-rockylinux-8 "/sbin/init" 19 minutes
ago Up 19 minutes 20250114_232210_r24549-bigtop-3
4b8e269f3689 bigtop/puppet:trunk-rockylinux-8 "/sbin/init" 19 minutes
ago Up 19 minutes 20250114_232210_r24549-bigtop-1
~/bigtop/provisioner/docker$ docker restart 4b8e269f3689
4b8e269f3689
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 /bin/bash
[root@4b8e269f3689 /]# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl start
hadoop-yarn-$service_name; done
[root@4b8e269f3689 /]# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl status --no-pager
hadoop-yarn-$service_name; done
● hadoop-yarn-resourcemanager.service - Hadoop ResourceManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-resourcemanager.service; static; vendor
preset: disabled)
Active: active (running) since Tue 2025-01-14 14:43:02 UTC; 20s ago
Docs: https://hadoop.apache.org/
Process: 49 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start resourcemanager (code=exited, status=0/SUCCESS)
Main PID: 103 (java)
Tasks: 231 (limit: 98358)
Memory: 505.7M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-resourcemanager.service
└─103
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_resourcem…
Jan 14 14:43:00 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: User lookup succe…id=992
Jan 14 14:43:00 4b8e269f3689 systemd[49]:
hadoop-yarn-resourcemanager.service: Executing: /usr/…anager
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Child 49 belongs …rvice.
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Control process e…atus=0
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Got final SIGCHLD…start.
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Main PID guessed: 103
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Changed start -> running
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Job hadoop-yarn-r…t=done
Jan 14 14:43:02 4b8e269f3689 systemd[1]: Started Hadoop ResourceManager.
Jan 14 14:43:02 4b8e269f3689 systemd[1]:
hadoop-yarn-resourcemanager.service: Failed to send un…y peer
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-nodemanager.service - Hadoop NodeManager
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-nodemanager.service;
static; vendor preset: disabled)
Active: active (running) since Tue 2025-01-14 14:43:04 UTC; 18s ago
Docs: https://hadoop.apache.org/
Process: 139 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start nodemanager (code=exited, status=0/SUCCESS)
Main PID: 195 (java)
Tasks: 112 (limit: 98358)
Memory: 354.8M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-nodemanager.service
└─195
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_nodemanag…
Jan 14 14:43:02 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
User lookup succeeded…id=992
Jan 14 14:43:02 4b8e269f3689 systemd[139]: hadoop-yarn-nodemanager.service:
Executing: /usr/bin…anager
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Child 139 belongs to …rvice.
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Control process exite…atus=0
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Got final SIGCHLD for…start.
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Main PID guessed: 195
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Changed start -> running
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Job hadoop-yarn-nodem…t=done
Jan 14 14:43:04 4b8e269f3689 systemd[1]: Started Hadoop NodeManager.
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-nodemanager.service:
Failed to send unit c…y peer
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-proxyserver.service - Hadoop ProxyServer
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-proxyserver.service;
static; vendor preset: disabled)
Active: active (running) since Tue 2025-01-14 14:43:06 UTC; 16s ago
Docs: https://hadoop.apache.org/
Process: 366 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start proxyserver (code=exited, status=0/SUCCESS)
Main PID: 420 (java)
Tasks: 35 (limit: 98358)
Memory: 157.9M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-proxyserver.service
└─420
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_proxyserv…
Jan 14 14:43:04 4b8e269f3689 systemd[1]: Starting Hadoop ProxyServer...
Jan 14 14:43:04 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
User lookup succeeded…id=992
Jan 14 14:43:04 4b8e269f3689 systemd[366]: hadoop-yarn-proxyserver.service:
Executing: /usr/bin…server
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Child 366 belongs to …rvice.
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Control process exite…atus=0
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Got final SIGCHLD for…start.
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Main PID guessed: 420
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Changed start -> running
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-proxyserver.service:
Job hadoop-yarn-proxy…t=done
Jan 14 14:43:06 4b8e269f3689 systemd[1]: Started Hadoop ProxyServer.
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-timelineserver.service - Hadoop NodeManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-timelineserver.service; static; vendor
preset: disabled)
Active: active (running) since Tue 2025-01-14 14:43:08 UTC; 14s ago
Docs: https://hadoop.apache.org/
Process: 662 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start timelineserver (code=exited, status=0/SUCCESS)
Main PID: 716 (java)
Tasks: 54 (limit: 98358)
Memory: 284.9M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-timelineserver.service
└─716
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_timelines…
Jan 14 14:43:06 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
User lookup succee…id=992
Jan 14 14:43:06 4b8e269f3689 systemd[662]:
hadoop-yarn-timelineserver.service: Executing: /usr/…server
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Child 662 belongs …rvice.
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Control process ex…atus=0
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Got final SIGCHLD …start.
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Main PID guessed: 716
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Changed start -> running
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Job hadoop-yarn-ti…t=done
Jan 14 14:43:08 4b8e269f3689 systemd[1]: Started Hadoop NodeManager.
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-timelineserver.service:
Failed to send uni…y peer
Hint: Some lines were ellipsized, use -l to show in full.
● hadoop-yarn-router.service - Hadoop Router
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-router.service;
static; vendor preset: disabled)
Active: active (running) since Tue 2025-01-14 14:43:09 UTC; 13s ago
Docs: https://hadoop.apache.org/
Process: 779 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start router (code=exited, status=0/SUCCESS)
Main PID: 834 (java)
Tasks: 98 (limit: 98358)
Memory: 284.1M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-yarn-router.service
└─834
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_router -D…
Jan 14 14:43:08 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: User
lookup succeeded: uid…id=992
Jan 14 14:43:08 4b8e269f3689 systemd[779]: hadoop-yarn-router.service:
Executing: /usr/bin/yarn…router
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Child
779 belongs to hadoo…rvice.
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Control
process exited, co…atus=0
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Got
final SIGCHLD for stat…start.
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Main
PID guessed: 834
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Changed
start -> running
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Job
hadoop-yarn-router.ser…t=done
Jan 14 14:43:09 4b8e269f3689 systemd[1]: Started Hadoop Router.
Jan 14 14:43:09 4b8e269f3689 systemd[1]: hadoop-yarn-router.service: Failed
to send unit change…y peer
Hint: Some lines were ellipsized, use -l to show in full.
```
### MapReduce
* Check `systemctl status`
```
[root@4b8e269f3689 /]# systemctl status hadoop-mapreduce-historyserver
● hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static; vendor
pre>
Active: inactive (dead)
Docs: https://hadoop.apache.org/
Jan 14 14:45:14 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Collecting.
```
* Check systemd unit file
```
[root@4b8e269f3689 /]# systemctl cat hadoop-mapreduce-historyserver
# /usr/lib/systemd/system/hadoop-mapreduce-historyserver.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop MapReduce HistoryServer
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=mapred
Group=mapred
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
RuntimeDirectory=hadoop-mapreduce
SuccessExitStatus=5 6
ExecStart=/usr/bin/mapred --config /etc/hadoop/conf --daemon start
historyserver
ExecStop=/usr/bin/mapred --config /etc/hadoop/conf --daemon stop
historyserver
```
* Check if `systemctl restart` works
```
[root@4b8e269f3689 /]# systemctl restart hadoop-mapreduce-historyserver
[root@4b8e269f3689 /]# systemctl status hadoop-mapreduce-historyserver
● hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static; vendor
preset: disabled)
Active: active (running) since Tue 2025-01-14 14:47:39 UTC; 1s ago
Docs: https://hadoop.apache.org/
Process: 1048 ExecStop=/usr/bin/mapred --config /etc/hadoop/conf --daemon
stop historyserver (code=exited, status=0/SUCCESS)
Process: 1110 ExecStart=/usr/bin/mapred --config /etc/hadoop/conf --daemon
start historyserver (code=exited, status=0/SUCCESS)
Main PID: 1163 (java)
Tasks: 26 (limit: 98358)
Memory: 165.5M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-mapreduce-historyserver.service
└─1163
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_historyserver -Djava.net.preferIPv4Stack=true
-Dmapred.jobsummary.logger=INFO,RFA -Dyarn.log.dir=/var/log/hadoop-ma>
Jan 14 14:47:37 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: User lookup succeeded: uid=994 gid=991
Jan 14 14:47:37 4b8e269f3689 systemd[1110]:
hadoop-mapreduce-historyserver.service: Executing: /usr/bin/mapred --config
/etc/hadoop/conf --daemon start historyserver
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Child 1110 belongs to
hadoop-mapreduce-historyserver.service.
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Control process exited, code=exited
status=0
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Got final SIGCHLD for state start.
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Main PID guessed: 1163
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Changed start -> running
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Job
hadoop-mapreduce-historyserver.service/start finished, result=done
Jan 14 14:47:39 4b8e269f3689 systemd[1]: Started Hadoop MapReduce
HistoryServer.
Jan 14 14:47:39 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Failed to send unit change signal for
hadoop-mapreduce-historyserver.service: Connection reset by peer
```
* Check if `systemctl start` works after container restart
```
~/bigtop/provisioner/docker$ docker restart 4b8e269f3689
4b8e269f3689
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 systemctl
status hadoop-mapreduce-historyserver
● hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static; vendor
preset: disabled)
Active: inactive (dead)
Docs: https://hadoop.apache.org/
Jan 14 14:50:47 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Collecting.
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 systemctl
start hadoop-mapreduce-historyserver
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 systemctl
status hadoop-mapreduce-historyserver
● hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static; vendor
preset: disabled)
Active: active (running) since Tue 2025-01-14 14:50:52 UTC; 3s ago
Docs: https://hadoop.apache.org/
Process: 45 ExecStart=/usr/bin/mapred --config /etc/hadoop/conf --daemon
start historyserver (code=exited, status=0/SUCCESS)
Main PID: 100 (java)
Tasks: 26 (limit: 98358)
Memory: 208.0M
CGroup:
/docker/4b8e269f36896e2d562470e6259cbd544b64530172dc070787adde174972c9f7/system.slice/hadoop-mapreduce-historyserver.service
└─100
/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.432.b06-2.el8.x86_64/bin/java
-Dproc_historyserver -Djava.net.preferIPv4Stack=true
-Dmapred.jobsummary.logger=INFO,RFA -Dyarn.log.dir=/var/log/hadoop-map>
Jan 14 14:50:50 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: User lookup succeeded: uid=994 gid=991
Jan 14 14:50:50 4b8e269f3689 systemd[45]:
hadoop-mapreduce-historyserver.service: Executing: /usr/bin/mapred --config
/etc/hadoop/conf --daemon start historyserver
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Child 45 belongs to
hadoop-mapreduce-historyserver.service.
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Control process exited, code=exited
status=0
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Got final SIGCHLD for state start.
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Main PID guessed: 100
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Changed start -> running
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Job
hadoop-mapreduce-historyserver.service/start finished, result=done
Jan 14 14:50:52 4b8e269f3689 systemd[1]: Started Hadoop MapReduce
HistoryServer.
Jan 14 14:50:52 4b8e269f3689 systemd[1]:
hadoop-mapreduce-historyserver.service: Failed to send unit change signal for
hadoop-mapreduce-historyserver.service: Connection reset by peer
```
---
## DEB
### YARN
* Build DEB packages (on Ubuntu 24.04)
```
$ ./gradlew hadoop-clean bigtop-utils-pkg bigtop-jsvc-pkg bigtop-groovy-pkg
hadoop-pkg repo
```
* Smoke tests (yarn, mapreduce)
```
$ ./docker-hadoop.sh --enable-local-repo --disable-gpg-check
--docker-compose-plugin -C config_ubuntu-24.04.yaml -F
docker-compose-cgroupv2.yml --stack hdfs,yarn,mapreduce --smoke-tests
yarn,mapreduce -c 3
(snip)
BUILD SUCCESSFUL in 4m 42s
30 actionable tasks: 11 executed, 19 up-to-date
Stopped 1 worker daemon(s).
+ rm -rf buildSrc/build/test-results/binary
+ rm -rf /bigtop-home/.gradle
```
* Install additional packages(hadoop-yarn-timelineserver
hadoop-yarn-router), run `systemctl start`
```
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 /bin/bash
root@1a4c2274e21a:/# apt install hadoop-yarn-timelineserver
hadoop-yarn-router
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following NEW packages will be installed:
hadoop-yarn-router hadoop-yarn-timelineserver
0 upgraded, 2 newly installed, 0 to remove and 5 not upgraded.
Need to get 0 B/8618 B of archives.
After this operation, 57.3 kB of additional disk space will be used.
WARNING: The following packages cannot be authenticated!
hadoop-yarn-router hadoop-yarn-timelineserver
Authentication warning overridden.
Get:1 file:/bigtop-home/output/apt bigtop/contrib amd64 hadoop-yarn-router
amd64 3.3.6-1 [4276 B]
Get:2 file:/bigtop-home/output/apt bigtop/contrib amd64
hadoop-yarn-timelineserver amd64 3.3.6-1 [4342 B]
debconf: delaying package configuration, since apt-utils is not installed
Selecting previously unselected package hadoop-yarn-router.
(Reading database ... 52687 files and directories currently installed.)
Preparing to unpack .../hadoop-yarn-router_3.3.6-1_amd64.deb ...
Unpacking hadoop-yarn-router (3.3.6-1) ...
Selecting previously unselected package hadoop-yarn-timelineserver.
Preparing to unpack .../hadoop-yarn-timelineserver_3.3.6-1_amd64.deb ...
Unpacking hadoop-yarn-timelineserver (3.3.6-1) ...
Setting up hadoop-yarn-timelineserver (3.3.6-1) ...
invoke-rc.d: policy-rc.d denied execution of start.
Setting up hadoop-yarn-router (3.3.6-1) ...
invoke-rc.d: policy-rc.d denied execution of start.
root@1a4c2274e21a:/# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl start
hadoop-yarn-$service_name; done
root@1a4c2274e21a:/# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl status --no-pager
hadoop-yarn-$service_name; done
● hadoop-yarn-resourcemanager.service - Hadoop ResourceManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-resourcemanager.service; static)
Active: active (running) since Wed 2025-01-15 01:13:13 UTC; 26min ago
Docs: https://hadoop.apache.org/
Main PID: 5627 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-resourcemanager.service
└─5627 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_resourcemanager -Djava.net.preferIPv4Stack=true
-Dservice.libdir=/usr/lib/hadoop-yarn/./,/usr/lib/hadoop-yarn/lib,/usr/lib/hadoop-hdfs…
Jan 15 01:13:10 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-resourcemanager.service - Hadoop ResourceManager...
Jan 15 01:13:13 1a4c2274e21a systemd[1]: Started
hadoop-yarn-resourcemanager.service - Hadoop ResourceManager.
● hadoop-yarn-nodemanager.service - Hadoop NodeManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-nodemanager.service; static)
Active: active (running) since Wed 2025-01-15 01:13:47 UTC; 25min ago
Docs: https://hadoop.apache.org/
Main PID: 6816 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-nodemanager.service
└─6816 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_nodemanager -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-nodemanager-1a4c2274e21a.l…
Jan 15 01:13:45 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-nodemanager.service - Hadoop NodeManager...
Jan 15 01:13:47 1a4c2274e21a systemd[1]: Started
hadoop-yarn-nodemanager.service - Hadoop NodeManager.
● hadoop-yarn-proxyserver.service - Hadoop ProxyServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-proxyserver.service; static)
Active: active (running) since Wed 2025-01-15 01:13:30 UTC; 25min ago
Docs: https://hadoop.apache.org/
Main PID: 6266 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-proxyserver.service
└─6266 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_proxyserver -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-proxyserver-1a4c2274e21a.l…
Jan 15 01:13:27 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-proxyserver.service - Hadoop ProxyServer...
Jan 15 01:13:30 1a4c2274e21a systemd[1]: Started
hadoop-yarn-proxyserver.service - Hadoop ProxyServer.
● hadoop-yarn-timelineserver.service - Hadoop NodeManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-timelineserver.service; static)
Active: active (running) since Wed 2025-01-15 01:39:03 UTC; 10s ago
Docs: https://hadoop.apache.org/
Process: 11129 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf
--daemon start timelineserver (code=exited, status=0/SUCCESS)
Main PID: 11168 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-timelineserver.service
└─11168 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_timelineserver -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-timelineserver-1a4c227…
Jan 15 01:39:01 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-timelineserver.service - Hadoop NodeManager...
Jan 15 01:39:03 1a4c2274e21a systemd[1]: Started
hadoop-yarn-timelineserver.service - Hadoop NodeManager.
● hadoop-yarn-router.service - Hadoop Router
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-router.service;
static)
Active: active (running) since Wed 2025-01-15 01:39:05 UTC; 8s ago
Docs: https://hadoop.apache.org/
Process: 11205 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf
--daemon start router (code=exited, status=0/SUCCESS)
Main PID: 11247 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-router.service
└─11247 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_router -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-router-1a4c2274e21a.log -Dyarn…
Jan 15 01:39:03 1a4c2274e21a systemd[1]: Starting hadoop-yarn-router.service
- Hadoop Router...
Jan 15 01:39:05 1a4c2274e21a systemd[1]: Started hadoop-yarn-router.service
- Hadoop Router.
```
* Check if the systemd unit files
```
root@1a4c2274e21a:/# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl cat hadoop-yarn-$service_name;
done
# /usr/lib/systemd/system/hadoop-yarn-resourcemanager.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop ResourceManager
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start
resourcemanager
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop
resourcemanager
# /usr/lib/systemd/system/hadoop-yarn-nodemanager.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop NodeManager
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start nodemanager
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop nodemanager
# /usr/lib/systemd/system/hadoop-yarn-proxyserver.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop ProxyServer
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start proxyserver
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop proxyserver
# /usr/lib/systemd/system/hadoop-yarn-timelineserver.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop NodeManager
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start
timelineserver
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop timelineserver
# /usr/lib/systemd/system/hadoop-yarn-router.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop Router
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=yarn
Group=yarn
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
SuccessExitStatus=5 6
ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon start router
ExecStop=/usr/bin/yarn --config /etc/hadoop/conf --daemon stop router
```
* Check if `systemctl start` works after container restart
```
~/bigtop/provisioner/docker$ docker restart 1a4c2274e21a
1a4c2274e21a
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 /bin/bash
root@1a4c2274e21a:/# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl start
hadoop-yarn-$service_name; done
root@1a4c2274e21a:/# for service_name in resourcemanager nodemanager
proxyserver timelineserver router; do systemctl status --no-pager
hadoop-yarn-$service_name; done
● hadoop-yarn-resourcemanager.service - Hadoop ResourceManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-resourcemanager.service; static)
Active: active (running) since Wed 2025-01-15 01:41:48 UTC; 12s ago
Docs: https://hadoop.apache.org/
Process: 148 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start resourcemanager (code=exited, status=0/SUCCESS)
Main PID: 190 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-resourcemanager.service
└─190 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_resourcemanager -Djava.net.preferIPv4Stack=true
-Dservice.libdir=/usr/lib/hadoop-yarn/./,/usr/lib/hadoop-yarn/lib,/usr/lib/hadoop-hdfs/…
Jan 15 01:41:46 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-resourcemanager.service - Hadoop ResourceManager...
Jan 15 01:41:48 1a4c2274e21a systemd[1]: Started
hadoop-yarn-resourcemanager.service - Hadoop ResourceManager.
● hadoop-yarn-nodemanager.service - Hadoop NodeManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-nodemanager.service; static)
Active: active (running) since Wed 2025-01-15 01:41:50 UTC; 11s ago
Docs: https://hadoop.apache.org/
Process: 227 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start nodemanager (code=exited, status=0/SUCCESS)
Main PID: 269 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-nodemanager.service
└─269 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_nodemanager -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-nodemanager-1a4c2274e21a.lo…
Jan 15 01:41:48 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-nodemanager.service - Hadoop NodeManager...
Jan 15 01:41:50 1a4c2274e21a systemd[1]: Started
hadoop-yarn-nodemanager.service - Hadoop NodeManager.
● hadoop-yarn-proxyserver.service - Hadoop ProxyServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-proxyserver.service; static)
Active: active (running) since Wed 2025-01-15 01:41:50 UTC; 11s ago
Docs: https://hadoop.apache.org/
Process: 401 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start proxyserver (code=exited, status=0/SUCCESS)
Main PID: 443 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-proxyserver.service
└─443 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_proxyserver -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-proxyserver-1a4c2274e21a.lo…
Jan 15 01:41:50 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-proxyserver.service - Hadoop ProxyServer...
Jan 15 01:41:50 1a4c2274e21a systemd[1]: Started
hadoop-yarn-proxyserver.service - Hadoop ProxyServer.
● hadoop-yarn-timelineserver.service - Hadoop NodeManager
Loaded: loaded
(/usr/lib/systemd/system/hadoop-yarn-timelineserver.service; static)
Active: active (running) since Wed 2025-01-15 01:41:52 UTC; 9s ago
Docs: https://hadoop.apache.org/
Process: 715 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start timelineserver (code=exited, status=0/SUCCESS)
Main PID: 755 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-timelineserver.service
└─755 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_timelineserver -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-timelineserver-1a4c2274e…
Jan 15 01:41:50 1a4c2274e21a systemd[1]: Starting
hadoop-yarn-timelineserver.service - Hadoop NodeManager...
Jan 15 01:41:52 1a4c2274e21a systemd[1]: Started
hadoop-yarn-timelineserver.service - Hadoop NodeManager.
● hadoop-yarn-router.service - Hadoop Router
Loaded: loaded (/usr/lib/systemd/system/hadoop-yarn-router.service;
static)
Active: active (running) since Wed 2025-01-15 01:41:54 UTC; 7s ago
Docs: https://hadoop.apache.org/
Process: 807 ExecStart=/usr/bin/yarn --config /etc/hadoop/conf --daemon
start router (code=exited, status=0/SUCCESS)
Main PID: 847 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-yarn-router.service
└─847 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_router -Djava.net.preferIPv4Stack=true
-Dyarn.log.dir=/var/log/hadoop-yarn
-Dyarn.log.file=hadoop-yarn-router-1a4c2274e21a.log -Dyarn.h…
Jan 15 01:41:52 1a4c2274e21a systemd[1]: Starting hadoop-yarn-router.service
- Hadoop Router...
Jan 15 01:41:54 1a4c2274e21a systemd[1]: Started
hadoop-yarn-router.service - Hadoop Router.
```
### MapReduce
* Check `systemctl status`
```
root@1a4c2274e21a:/# systemctl status hadoop-mapreduce-historyserver
○ hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static)
Active: inactive (dead)
Docs: https://hadoop.apache.org/
Jan 15 01:13:22 1a4c2274e21a systemd[1]: Starting
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer...
Jan 15 01:13:24 1a4c2274e21a systemd[1]: Started
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer.
```
* Check systemd unit file
```
root@1a4c2274e21a:/# systemctl cat hadoop-mapreduce-historyserver
# /usr/lib/systemd/system/hadoop-mapreduce-historyserver.service
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
[Unit]
Documentation=https://hadoop.apache.org/
Description=Hadoop MapReduce HistoryServer
Before=multi-user.target
Before=graphical.target
After=remote-fs.target
[Service]
User=mapred
Group=mapred
Type=forking
Restart=no
TimeoutSec=5min
IgnoreSIGPIPE=no
KillMode=process
RemainAfterExit=no
RuntimeDirectory=hadoop-mapreduce
SuccessExitStatus=5 6
ExecStart=/usr/bin/mapred --config /etc/hadoop/conf --daemon start
historyserver
ExecStop=/usr/bin/mapred --config /etc/hadoop/conf --daemon stop
historyserver
```
* Check if `systemctl restart` works
```
root@1a4c2274e21a:/# systemctl restart hadoop-mapreduce-historyserver
root@1a4c2274e21a:/# systemctl status hadoop-mapreduce-historyserver
● hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static)
Active: active (running) since Wed 2025-01-15 01:44:45 UTC; 6s ago
Docs: https://hadoop.apache.org/
Process: 998 ExecStart=/usr/bin/mapred --config /etc/hadoop/conf
--daemon start historyserver (code=exited, status=0/SUCCESS)
Main PID: 1038 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-mapreduce-historyserver.service
└─1038 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_historyserver -Djava.net.preferIPv4Stack=true
-Dmapred.jobsummary.logger=INFO,RFA -Dyarn.log.dir=/var/log/hadoop-mapreduce
-Dyarn.log.file=hadoop-mapred-historyserver-1a4c2274e21a.log
-Dyarn.home.dir=/usr/lib/hadoop-yarn -Dyarn.root.logger=INFO,console
-Djava.library.path=//usr/lib/hadoop/lib/native
-Dhadoop.log.dir=/var/log/hadoop-mapreduce
-Dhadoop.log.file=hadoop-mapred-historyserver-1a4c2274e21a.log
-Dhadoop.home.dir=//usr/lib/hadoop -Dhadoop.id.str=mapred
-Dhadoop.root.logger=INFO,RFA -Dhadoop.policy.file=hadoop-policy.xml
-Dhadoop.security.logger=INFO,NullAppender
org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer
Jan 15 01:44:43 1a4c2274e21a systemd[1]: Starting
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer...
Jan 15 01:44:45 1a4c2274e21a systemd[1]: Started
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer.
```
* Check if `systemctl start` works after container restart
```
~/bigtop/provisioner/docker$ docker restart 1a4c2274e21a
1a4c2274e21a
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 systemctl
status hadoop-mapreduce-historyserver
○ hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static)
Active: inactive (dead)
Docs: https://hadoop.apache.org/
Jan 15 01:13:22 1a4c2274e21a systemd[1]: Starting
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer...
Jan 15 01:13:24 1a4c2274e21a systemd[1]: Started
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer.
Jan 15 01:44:43 1a4c2274e21a systemd[1]: Starting
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer...
Jan 15 01:44:45 1a4c2274e21a systemd[1]: Started
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer.
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 systemctl
start hadoop-mapreduce-historyserver
~/bigtop/provisioner/docker$ ./docker-hadoop.sh -dcp --exec 1 systemctl
status hadoop-mapreduce-historyserver
● hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer
Loaded: loaded
(/usr/lib/systemd/system/hadoop-mapreduce-historyserver.service; static)
Active: active (running) since Wed 2025-01-15 01:46:02 UTC; 9s ago
Docs: https://hadoop.apache.org/
Process: 153 ExecStart=/usr/bin/mapred --config /etc/hadoop/conf
--daemon start historyserver (code=exited, status=0/SUCCESS)
Main PID: 194 (java)
CGroup:
/docker/1a4c2274e21a0927e5c72b32c21914362e5fbb5ebee5d9ceff6fce16b63077e1/system.slice/hadoop-mapreduce-historyserver.service
└─194 /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java
-Dproc_historyserver -Djava.net.preferIPv4Stack=true
-Dmapred.jobsummary.logger=INFO,RFA -Dyarn.log.dir=/var/log/hadoop-mapreduce
-Dyarn.log.file=hadoop-mapred-historyserver-1a4c2274e21a.log
-Dyarn.home.dir=/usr/lib/hadoop-yarn -Dyarn.root.logger=INFO,console
-Djava.library.path=//usr/lib/hadoop/lib/native
-Dhadoop.log.dir=/var/log/hadoop-mapreduce
-Dhadoop.log.file=hadoop-mapred-historyserver-1a4c2274e21a.log
-Dhadoop.home.dir=//usr/lib/hadoop -Dhadoop.id.str=mapred
-Dhadoop.root.logger=INFO,RFA -Dhadoop.policy.file=hadoop-policy.xml
-Dhadoop.security.logger=INFO,NullAppender
org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer
Jan 15 01:46:00 1a4c2274e21a systemd[1]: Starting
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer...
Jan 15 01:46:02 1a4c2274e21a systemd[1]: Started
hadoop-mapreduce-historyserver.service - Hadoop MapReduce HistoryServer.
```
</details>
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'BIGTOP-3638. Your PR title ...')?
- [x] Make sure that newly added files do not have any licensing issues.
When in doubt refer to https://www.apache.org/licenses/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
