Your message dated Mon, 19 Nov 2018 09:26:57 +0100
with message-id <[email protected]>
and subject line Re: Bug#913677: glusterfs-client: Hard link limit?
has caused the Debian Bug report #913677,
regarding glusterfs-client: Hard link limit?
to be marked as done.
This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.
(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact [email protected]
immediately.)
--
913677: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913677
Debian Bug Tracking System
Contact [email protected] with problems
--- Begin Message ---
Package: glusterfs-client
Version: 4.1.5-1~bpo9+1
Severity: normal
Dear Maintainer,
I've not been able to determine if this is a fuse limit, a gluster
limit, or something else entirely.
Anyway, I have been rsync'ing from a $commercial NFS over to a new shiny
gluster volume.
However it seems there is hard link limit I have hit.
>From rsync:
rsync: link
"/opt/nximages/pi/ae/266c042d7ec532c9fb8bf9f81d1012512e86b5-26253/.full.jpg.23309"
=> 02/f6b1b71161fbd3900b5b04cc0eca8ba5ec5efd-26253/full.jpg failed: Too
many links (31)
rsync: link
"/opt/nximages/pi/ae/266c042d7ec532c9fb8bf9f81d1012512e86b5-26253/.merch.jpg.23309"
=> 02/f6b1b71161fbd3900b5b04cc0eca8ba5ec5efd-26253/merch.jpg failed: Too
many links (31)
>From /var/log/glusterfs/opt-nximages.log
[2018-11-14 00:08:14.246446] W [MSGID: 114031]
[client-rpc-fops_v2.c:2383:client4_0_link_cbk] 0-nximages1-client-2:
remote operation failed:
(/pi/c7/57da83670efc30e2c40fc61a84c64582ca5e79-1909762/thumb.png ->
/pi/c7/8a9c2182416f9c8a3b676d842310ad75a2fde4-1909762/.thumb.png.23309)
[Too many links]
[2018-11-14 00:08:14.246532] W [MSGID: 114031]
[client-rpc-fops_v2.c:2383:client4_0_link_cbk] 0-nximages1-client-1:
remote operation failed:
(/pi/c7/57da83670efc30e2c40fc61a84c64582ca5e79-1909762/thumb.png ->
/pi/c7/8a9c2182416f9c8a3b676d842310ad75a2fde4-1909762/.thumb.png.23309)
[Too many links]
[2018-11-14 00:08:14.247201] W [fuse-bridge.c:565:fuse_entry_cbk]
0-glusterfs-fuse: 49760979: LINK()
/pi/c7/8a9c2182416f9c8a3b676d842310ad75a2fde4-1909762/.thumb.png.23309
=> -1 (Too many links)
I can't seem to locate a mention of such a limit. I place this here
hoping for assistance from those with more gluster experience than
myself
Thanks
-- System Information:
Debian Release: 9.5
APT prefers stable-updates
APT policy: (500, 'stable-updates'), (500, 'stable'), (98, 'unstable')
Architecture: amd64 (x86_64)
Kernel: Linux 4.18.0-0.bpo.1-cloud-amd64 (SMP w/2 CPU cores)
Locale: LANG=en_AU.UTF-8, LC_CTYPE=en_AU.UTF-8 (charmap=UTF-8),
LANGUAGE=en_AU.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Versions of packages glusterfs-client depends on:
ii fuse 2.9.7-1+deb9u1
ii glusterfs-common 4.1.5-1~bpo9+1
ii libc6 2.24-11+deb9u3
ii libssl1.1 1.1.0f-3+deb9u2
ii python 2.7.13-2
glusterfs-client recommends no packages.
glusterfs-client suggests no packages.
-- no debconf information
Psst! It's possible that this email contains information that is on the super
secret side of confidential. So if you received it accidentally, let the sender
know straight away and delete it (and the email you sent them). Also, we should
let you know that any emails that come and go through Winc™ might be
scanned, stored or read by Winc™ at its discretion. If you've got a
question, please give us a buzz on +61 2 9335 0555 (Australia) or +64 9 271
7600 (NZ). Oh, and Winc™ does its best to avoid errors on emails it
sends, but we can't promise that it will be error free. So, please don't hold
it against us.
--- End Message ---
--- Begin Message ---
Am 19.11.2018 um 03:27 schrieb Dean Hamstead:
> storage.max-hardlinks: 0
>
> seems to have fixed this problem. 100 seems like a strangely low limit.
>
> we dont have one file with 100 hardlinks, just lots of files with a
> single hardlink
>
> anyway, thanks muchly
>
>
> On 2018-11-15 19:38, Patrick Matthäi wrote:
>> From glusterfs list. Can you please check this and give me a feedback?
>>
>> "Are they hitting the setting introduced in 4.0 that limits the # of
>>
>> hardlinks per file? [1]
>>
>> To check if that is true, the brick logs should contain the log message
>> [2] when they hit this option induced limit. Also, inspection of "Links"
>> output for the file in question would help determine how many links it
>> already has.
>>
>> If it is local-FS specific, they may hit this message instead [3].
>>
>> Although, it could be an incarnation of the extended attribute size that
>> we store hard link names for GFID backpointers as in this bug [4]. This
>> should not occur on XFS (which is what the user is reporting as being
>> used), but useful to keep in check.
>>
>> Hth,
>> Shyam
>>
>> [1] option introduced to control max hardlinks:
>> https://github.com/gluster/glusterfs/blob/release-4.0/doc/release-notes/4.0.0.md#5-add-option-in-posix-to-limit-hardlinks-per-inode
>>
>>
>> [2] Error message when posix xlator detects the max-hardlink is being
>> exceeded on the brick logs:
>> https://github.com/gluster/glusterfs/blob/release-4.1/xlators/storage/posix/src/posix-entry-ops.c#L1921
>>
>>
>> [3] Error message if creating the hardlink is failing on the local-FS on
>> the brick logs:
>> https://github.com/gluster/glusterfs/blob/release-4.1/xlators/storage/posix/src/posix-entry-ops.c#L1948
>>
>>
>> [4] Running out of xattr space:
>> https://bugzilla.redhat.com/show_bug.cgi?id=1602262#c5";
>>
>>
>> Am 14.11.2018 um 12:09 schrieb Dean Hamstead:
>>> xfs in this case
>>>
>>> On 14/11/18 7:18 pm, Patrick Matthäi wrote:
>>>> Am 14.11.2018 um 01:09 schrieb Dean Hamstead:
>>>>> Package: glusterfs-client
>>>>> Version: 4.1.5-1~bpo9+1
>>>>> Severity: normal
>>>>>
>>>>> Dear Maintainer,
>>>>>
>>>>> I've not been able to determine if this is a fuse limit, a gluster
>>>>> limit, or something else entirely.
>>>>>
>>>>> Anyway, I have been rsync'ing from a $commercial NFS over to a new
>>>>> shiny
>>>>> gluster volume.
>>>>>
>>>>> However it seems there is hard link limit I have hit.
>>>>>
>>>>> From rsync:
>>>>>
>>>>> rsync: link
>>>>> "/opt/nximages/pi/ae/266c042d7ec532c9fb8bf9f81d1012512e86b5-26253/.full.jpg.23309"
>>>>>
>>>>>
>>>>> => 02/f6b1b71161fbd3900b5b04cc0eca8ba5ec5efd-26253/full.jpg
>>>>> failed: Too
>>>>> many links (31)
>>>>> rsync: link
>>>>> "/opt/nximages/pi/ae/266c042d7ec532c9fb8bf9f81d1012512e86b5-26253/.merch.jpg.23309"
>>>>>
>>>>>
>>>>> => 02/f6b1b71161fbd3900b5b04cc0eca8ba5ec5efd-26253/merch.jpg failed:
>>>>> Too
>>>>> many links (31)
>>>> Hi,
>>>>
>>>> do you use xfs or ext4 as filesystem?
>>>>
--
/*
Mit freundlichem Gruß / With kind regards,
Patrick Matthäi
GNU/Linux Debian Developer
Blog: http://www.linux-dev.org/
E-Mail: [email protected]
[email protected]
*/
--- End Message ---
