Hi,
Seems there are individual threads going on for this mismatch directory.
Writing to Pedro to do the following in separate email previously:
Please try doing a ls against the following directory which links to the GPFS directory:
ls -ltr /hadoop/yarn/local/bdahdpworkerprd01.gpfs/usercache
Do you see a usercache directory under /hadoop/yarn/local?
Looks like the ls of /hadoop/yarn/local/usercache is against the usercache directory on your local /hadoop directory and not the gpfs directory.
To which Pedro replied that the link directories was setup by IBM.
And he does see the usercache directory under the /hadoop/yarn/local directory.
So this means that when doing a ls of /hadoop/yarn/local/usercache it will pick up the local usercache directory.
To see the GPFS usercache, the ls needs to point to the ln directory /hadoop/yarn/local/bdahdpworkerprd01.gpfs.
Regards,
Linda
-------------------------------------------------------------------------
Linda Cham
Spectrum Scale Big Data Analytics
[email protected]
(845) 433-7467 (T/L) 8-293-7467
----- Original message -----
From: [email protected]
Sent by: [email protected]
To: [email protected]
Cc:
Subject: [EXTERNAL] gpfsug-discuss Digest, Vol 101, Issue 39
Date: Tue, Jun 30, 2020 9:06 AM
Send gpfsug-discuss mailing list submissions to
[email protected]
To subscribe or unsubscribe via the World Wide Web, visit
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
or, via email, send a message with subject or body 'help' to
[email protected]
You can reach the person managing the list at
[email protected]
When replying, please edit your Subject line so it is more specific
than "Re: Contents of gpfsug-discuss digest..."
Today's Topics:
1. Re: Mismatch between local and Scale directories
(Grunenberg, Renar)
----------------------------------------------------------------------
Message: 1
Date: Tue, 30 Jun 2020 12:59:08 +0000
From: "Grunenberg, Renar" <[email protected]>
To: gpfsug main discussion list <[email protected]>
Subject: Re: [gpfsug-discuss] Mismatch between local and Scale
directories
Message-ID: <[email protected]>
Content-Type: text/plain; charset="utf-8"
Hallo Pedro,
what do you mean you had linked the local hadoop-Directory with the gpfs fs. Can you clarify? Do you use transparency on the gpfs-nodes?
You should use on the local-hadoop site hdfs dfs ?ls <path> cmd?s here. No os cmds like ls only!
Renar Grunenberg
Abteilung Informatik - Betrieb
HUK-COBURG
Bahnhofsplatz
96444 Coburg
Telefon: 09561 96-44110
Telefax: 09561 96-44104
E-Mail: [email protected]
Internet: www.huk.de
________________________________
HUK-COBURG Haftpflicht-Unterst?tzungs-Kasse kraftfahrender Beamter Deutschlands a. G. in Coburg
Reg.-Gericht Coburg HRB 100; St.-Nr. 9212/101/00021
Sitz der Gesellschaft: Bahnhofsplatz, 96444 Coburg
Vorsitzender des Aufsichtsrats: Prof. Dr. Heinrich R. Schradin.
Vorstand: Klaus-J?rgen Heitmann (Sprecher), Stefan Gronbach, Dr. Hans Olav Her?y, Dr. J?rg Rheinl?nder, Sarah R?ssler, Daniel Thomas.
________________________________
Diese Nachricht enth?lt vertrauliche und/oder rechtlich gesch?tzte Informationen.
Wenn Sie nicht der richtige Adressat sind oder diese Nachricht irrt?mlich erhalten haben,
informieren Sie bitte sofort den Absender und vernichten Sie diese Nachricht.
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Nachricht ist nicht gestattet.
This information may contain confidential and/or privileged information.
If you are not the intended recipient (or have received this information in error) please notify the
sender immediately and destroy this information.
Any unauthorized copying, disclosure or distribution of the material in this information is strictly forbidden.
________________________________
Von: [email protected] <[email protected]> Im Auftrag von Baptista, Pedro Real
Gesendet: Dienstag, 30. Juni 2020 14:29
An: gpfsug main discussion list <[email protected]>
Betreff: Re: [gpfsug-discuss] Mismatch between local and Scale directories
Hi Yaron,
Thank you for your reply.
No, /var is not full and all other disks have free space also.
Best regards
Pedro Real Baptista
Consulting | Analytics & Cognitive
Deloitte Consultores, S.A.
Av. Eng. Duarte Pacheco, 7, 1070-100 Lisboa, Portugal
M: +351 962369236
[email protected]<mailto:%[email protected]> | www.deloitte.pt<http://www.deloitte.pt/ >
[cid:[email protected]]<http://www.deloitte.pt/ >
From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> On Behalf Of Yaron Daniel
Sent: 30 de junho de 2020 13:06
To: gpfsug main discussion list <[email protected]<mailto:[email protected]>>
Subject: [EXT] Re: [gpfsug-discuss] Mismatch between local and Scale directories
HI
what is the output of :
#df -h
Look like /, /var is full ?
Regards
________________________________
Yaron Daniel
94 Em Ha'Moshavot Rd
[cid:[email protected]]
Storage Architect ? IL Lab Services (Storage)
Petach Tiqva, 49527
IBM Global Markets, Systems HW Sales
Israel
Phone:
+972-3-916-5672
Fax:
+972-3-916-5672
Mobile:
+972-52-8395593
e-mail:
[email protected]<mailto:[email protected]>
Webex: https://ibm.webex.com/meet/yard<Webex:%20%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard%0dIBM%20Israel>
IBM Israel<Webex:%20%20%20%20%20%20%20%20%20%20%20%20%20https://ibm.webex.com/meet/yard%0dIBM%20Israel>
[IBM Storage for Cyber Resiliency & Modern Data Protection V1] [cid:[email protected]] [cid:[email protected]] [cid:[email protected]] [cid:[email protected]]
[cid:[email protected]][cid:[email protected]][cid:[email protected]] [IBM Storage and Cloud Essentials] [cid:[email protected]]
From: "Baptista, Pedro Real" <[email protected]<mailto:[email protected]>>
To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>
Date: 30/06/2020 14:54
Subject: [EXTERNAL] [gpfsug-discuss] Mismatch between local and Scale directories
Sent by: [email protected]<mailto:[email protected]>
________________________________
Hi all,
I?m finding diferences between my local directories (Hadoop cluster) and GPFS filesystem. I?ve linked both yarn and mapreduce directories to Scale.
For example, in one specific worker node:
[cid:[email protected]]
If I list the usercache folder, I see differences.
Local:
[cid:[email protected]]
GPFS
[cid:[email protected]]
I see that GPFS is working ok in the node
[cid:[email protected]]
However, if I check the node health:
[cid:[email protected]]
I?m new to Spectrum Scale and I don?t know what?s csm_resync_needed and local_fs_filled.
Can anyone give a hand with this?
Best regards,
Pedro Real Baptista
Consulting | Analytics & Cognitive
Deloitte Consultores, S.A.
Av. Eng. Duarte Pacheco, 7, 1070-100 Lisboa, Portugal
M: +351 962369236
[email protected]<mailto:%[email protected]>| www.deloitte.pt<http://secure-web.cisco.com/1rJhl7ESWYrTmt1WoVdb6kWjihCNE8HMLybWnRnzY5Y1r-z_Inptagcam9z0AVh1nWVm8zad5VeQwzrz1QszH5nUOlyTGb2v4yzGu92aCricPjOoikjmy31svec85RmOYKkoKUgAj6wC-hoOhF7HX9rYgaKGfZS1mDeO_uq7izfjGCZu8ANk_v33Jrsg8WtVjARiBQVrCgTl0ghg-eH170fllK4e_8AsSRQ-agoa15wA76wzW1k83MCwTt9zJcIFR93_tOcl0i4VbjFJylSRZL5c0Ia7sO1wazIRbVG61y7Q_54jY_RhtWcMgYQP97GAB/http%3A%2F%2Fwww.deloitte.pt%2F >
[cid:[email protected]]<http://secure-web.cisco.com/1rJhl7ESWYrTmt1WoVdb6kWjihCNE8HMLybWnRnzY5Y1r-z_Inptagcam9z0AVh1nWVm8zad5VeQwzrz1QszH5nUOlyTGb2v4yzGu92aCricPjOoikjmy31svec85RmOYKkoKUgAj6wC-hoOhF7HX9rYgaKGfZS1mDeO_uq7izfjGCZu8ANk_v33Jrsg8WtVjARiBQVrCgTl0ghg-eH170fllK4e_8AsSRQ-agoa15wA76wzW1k83MCwTt9zJcIFR93_tOcl0i4VbjFJylSRZL5c0Ia7sO1wazIRbVG61y7Q_54jY_RhtWcMgYQP97GAB/http%3A%2F%2Fwww.deloitte.pt%2F >
*Disclaimer:*
Deloitte refers to a Deloitte member firm, one of its related entities, or Deloitte Touche Tohmatsu Limited (?DTTL?).
Each Deloitte member firm is a separate legal entity and a member of DTTL. DTTL does not provide services to clients.
Please see www.deloitte.com/about<http://www.deloitte.com/about >to learn more.
Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of my firm shall be understood as neither given nor endorsed by it._______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss <http://secure-web.cisco.com/1HMlNwUFuvF1Cxz4WEr5vNOzTCiigxD1EkNgqCxytj5F_2uhft0nUnqEsuaNiccKA5pGjtyNHgYytzvHetLNWkwCSOwN9vEGg3SiCRNiqnEFTU3sQWCUdRHvOTmxFaR8R4OH_UNsSiJyi_DXPVf-VeKsXEqw8UPLQeAatNNdzfwPtA10hBmG5-ZMvJELI5N6c8S_z8J4zy7sxgdEkLO-CzygqSZm_FRz13HXbplzA29PByMkU-iiBFjCtpQHfv5eIlcyfi7pMmWv38kzIpYmGKtN83ZtJD1nq0_llxQc8r5hBqx7ob2P4LslqIAFetkxx/http%3A%2F%2Fgpfsug.org%2Fmailman%2Flistinfo%2Fgpfsug-discuss >
*Disclaimer:*
Deloitte refers to a Deloitte member firm, one of its related entities, or Deloitte Touche Tohmatsu Limited (?DTTL?).
Each Deloitte member firm is a separate legal entity and a member of DTTL. DTTL does not provide services to clients.
Please see www.deloitte.com/about<http://www.deloitte.com/about > to learn more.
Privileged/Confidential Information may be contained in this message. If you are not the addressee indicated in this message (or responsible for delivery of the message to such person), you may not copy or deliver this message to anyone. In such case, you should destroy this message and kindly notify the sender by reply email. Please advise immediately if you or your employer do not consent to Internet email for messages of this kind. Opinions, conclusions and other information in this message that do not relate to the official business of my firm shall be understood as neither given nor endorsed by it.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment.html >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 2030 bytes
Desc: image001.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment.png >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.gif
Type: image/gif
Size: 1114 bytes
Desc: image002.gif
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment.gif >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.gif
Type: image/gif
Size: 4105 bytes
Desc: image003.gif
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0001.gif >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.jpg
Type: image/jpeg
Size: 3847 bytes
Desc: image004.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.jpg
Type: image/jpeg
Size: 4266 bytes
Desc: image005.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0001.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.jpg
Type: image/jpeg
Size: 3747 bytes
Desc: image006.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0002.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image007.jpg
Type: image/jpeg
Size: 3793 bytes
Desc: image007.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0003.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image008.jpg
Type: image/jpeg
Size: 4301 bytes
Desc: image008.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0004.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image009.jpg
Type: image/jpeg
Size: 3739 bytes
Desc: image009.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0005.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image010.jpg
Type: image/jpeg
Size: 3855 bytes
Desc: image010.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0006.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image011.gif
Type: image/gif
Size: 4084 bytes
Desc: image011.gif
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0002.gif >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image012.jpg
Type: image/jpeg
Size: 3776 bytes
Desc: image012.jpg
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0007.jpg >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image013.png
Type: image/png
Size: 15587 bytes
Desc: image013.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0001.png >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image014.png
Type: image/png
Size: 11114 bytes
Desc: image014.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0002.png >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image015.png
Type: image/png
Size: 17038 bytes
Desc: image015.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0003.png >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image016.png
Type: image/png
Size: 5902 bytes
Desc: image016.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0004.png >
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image017.png
Type: image/png
Size: 23157 bytes
Desc: image017.png
URL: <http://gpfsug.org/pipermail/gpfsug-discuss/attachments/20200630/ec1d1b5c/attachment-0005.png >
------------------------------
_______________________________________________
gpfsug-discuss mailing list
gpfsug-discuss at spectrumscale.org
http://gpfsug.org/mailman/listinfo/gpfsug-discuss
End of gpfsug-discuss Digest, Vol 101, Issue 39
***********************************************
_______________________________________________ gpfsug-discuss mailing list gpfsug-discuss at spectrumscale.org http://gpfsug.org/mailman/listinfo/gpfsug-discuss
