Thanks guys, I figured out what my issue was.I did not setup the ssh key
correctly, it was for my user but I started the service as root.
Now it is working except none of the namenodes are transitioning to active on
startup, and the datanodes are not starting automatically (I think because no
n
Why you have set this again in hdfs-site.xml at the end.
dfs.namenode.rpc-address
nn1:8020
Remove this and start name node again.
Regards
Susheel Kumar
On Tue, 3 Oct 2023, 10:09 pm Harry Jamison,
wrote:
> OK here is where I am at now.
>
> When I start the namenodes, they work, but
OK here is where I am at now.
When I start the namenodes, they work, but they are all in standby mode.When I
start my first datanode it seems to kill one of the namenodes (the active one I
assume)
I am getting 2 different warnings in the namenode
[2023-10-03 09:03:52,162] WARN Unable to initiali
Harry,
Great question.
I would say the same configurations in core-site.xml and hdfs-site.xml will
be overwriting each other in some way.
Glad you found the root cause.
Keep going.
On Tue, Oct 3, 2023 at 10:27 AM Harry Jamison
wrote:
> Liming
>
> After looking at my config, I think that maybe
The core-site.xml configuration settings will be overridden by
hdfs-site.xml, mapred-site.xml, yarn-site.xml. This was like that but don't
know if it is changed now.
Look at your shared.edits.dir configuration. You have not set it correct
across name nodes.
Regards
On Tue, 3 Oct 2023, 1:59 pm H
> Or do I just have it there mistakenly?
Yes, It should be in core-site.xml
It is there in the HA doc
```
fs.defaultFS - the default path prefix used by the Hadoop FS client
when none is given
Optionally, you may now configure the default path for Hadoop clients
to use the new HA-enabled logica
Liming
After looking at my config, I think that maybe my problem is because my
fs.defaultFS is inconsistent between hdfs-site.xml and core-site.xmlWhat does
hdfs-site.xml vs core-site.xml do why is the same setting in 2 different
places?Or do I just have it there mistakenly?
this is what I hav
Can you show us the configuration files?
Maybe I can help you with some suggestions.
On Tue, Oct 3, 2023 at 9:05 AM Harry Jamison
wrote:
> I am trying to setup a HA HDFS cluster, and I am running into a problem
>
> I am not sure what I am doing wrong, I thought I followed the HA namenode
> guid
I am trying to setup a HA HDFS cluster, and I am running into a problem
I am not sure what I am doing wrong, I thought I followed the HA namenode
guide, but it is not working.
Apache Hadoop 3.3.6 – HDFS High Availability
I have 2 namenodes and 3 journal nodes, and 3 zookeeper nodes.
After some
