I dug into this a little bit more. Apparently the default is 50GB.
On my datanodes, I ran df –hl. This is the output
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/centos-root 50G 12G 39G 23% /
devtmpfs 16G 0 16G 0% /dev
tmpfs 16G 0 16G 0% /dev/shm
tmpfs 16G 1.4G 15G 9% /run
tmpfs 16G 0 16G 0% /sys/fs/cgroup
/dev/sda2 494M 123M 372M 25% /boot
/dev/mapper/centos-home 2.7T 33M 2.7T 1% /home
If I’m reading this right it HAS to be mounted correctly because no other mount
points have enough space correct?
Adaryl "Bob" Wakefield, MBA
Principal
Mass Street Analytics, LLC
913.938.6685
www.linkedin.com/in/bobwakefieldmba
Twitter: @BobLovesData
From: Adaryl "Bob" Wakefield, MBA
Sent: Tuesday, November 03, 2015 10:32 AM
To: [email protected]
Subject: Re: HDFS disk usage
How would I go about doing that?
Adaryl "Bob" Wakefield, MBA
Principal
Mass Street Analytics, LLC
913.938.6685
www.linkedin.com/in/bobwakefieldmba
Twitter: @BobLovesData
From: Olivier Renault
Sent: Tuesday, November 03, 2015 3:49 AM
To: [email protected] ; [email protected]
Subject: Re: HDFS disk usage
Could you double check that your datanodes are using the correct mount point?
Thanks,
Olivier
------
Olivier Renault
Solution Engineer
Mobile: +44 7500 933 036
On Tue, Nov 3, 2015 at 1:45 AM -0800, "Adaryl "Bob" Wakefield, MBA"
<[email protected]> wrote:
Why is there such a large discrepancy between what is reported and my actual
disk size?
B.
From: Olivier Renault
Sent: Tuesday, November 03, 2015 3:01 AM
To: [email protected] ; [email protected]
Subject: Re: HDFS disk usage
It reports the space available for HDFS.
Thanks,
Olivier
On Mon, Nov 2, 2015 at 11:57 PM -0800, "Adaryl "Bob" Wakefield, MBA"
<[email protected]> wrote:
On the dashboard, what exactly is HDFS disk usage reporting? The numbers I’m
seeing are WAY less than the total disk space on my cluster.
B.
