Re: [lustre-discuss] patchless server vs. patched server
IIRC "patchless server" can only serve ZFS based backends.So, it you really need ldiskfs - you're stuck with patched kernel for now. 27.05.2020, 18:41, "Pascal Suter" :Hi alli am currently upgrading a lustre 2.10.3 to 2.12.4 on CentOS 7.7 and Iam unsure if I should use the patchless or patched server version. whatis the advantage of still using the patched server version over usingthe patchless variant? From an linux sysadmin point of view I prefer touse an unpatched kernel and it would seem unnecessary to still maintaina patched variant if they both worked the same in the end.regardsPascal___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ________Sincerely,George Melikov ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] File size anomaly on Lustre Filesystem
ST21 Traversing all blocks to verify nothing leaked ... loading space map for vdev 0 of 1, metaslab 180 of 181 ... 62.0T completed (12801MB/s) estimated time remaining: 0hr 00min 07sec leaked space: vdev 0, offset 0x1d80003de000, size 1081344 […] See attachment. Please would someone be able to advise. Thanks Nick ___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.o…________Sincerely,George Melikov ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] slow write performance from client to server
Please post your benchmark method. Sincerely, George Melikov, Tel. 7-915-278-39-36 Skype: georgemelikov 16.10.2018, 12:03, "Riccardo Veraldi" : > On 10/15/18 4:59 PM, Alexander I Kulyavtsev wrote: >> You can do a quick check with 2.10.5 client by mounting lustre on MDS if >> you do not have free node to install 2.10.5 client. >> >> Do you have lnet configured with IB or 10GE? LNet defaults to tcp if not >> set. Can it be you are connected through slow management network? >> >> Alex. > > hi, my lnet is configured with both IB and 10GE. it is using IB I > verified it and anyway performance is very slow even if it where just > using tcp on 10GE > > since I only get 2MB/s > > thanks > >> On 10/15/18, 6:41 PM, "lustre-discuss on behalf of Riccardo Veraldi" >> > riccardo.vera...@cnaf.infn.it> wrote: >> >> Hello, >> >> I have a new Lustre FS version 2.10.5. 18 OSTs 18TB each on 3 OSSes. >> >> I noticed very slow performances couple of MB/sec when RHEL6 Lustre >> clients 2.8.0 are writing to the fielsystem. >> >> Could it be a Lustre version problem server vs client ? >> >> I have no errors either on server or client side that can debug it >> further... >> >> thanks >> >> Rick >> >> ___ >> lustre-discuss mailing list >> lustre-discuss@lists.lustre.org >> >> https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.lustre.org_listinfo.cgi_lustre-2Ddiscuss-2Dlustre.org=DwIGaQ=gRgGjJ3BkIsb5y6s49QqsA=23V5nhLj03jeTboyg6QveA=ABK5Lf73Df1JeZ-ryuh87ds4a5qoTk1gcookZ1auOuU=3gW-gvhmg4r0oQv3isx4u1P2TBHOzyDeFC-MZoxR68Y= > > ___ > lustre-discuss mailing list > lustre-discuss@lists.lustre.org > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] lfs mirror create directory
Thanks Patrick, so manual mirroring is the case. 01.10.2018, 15:51, "Patrick Farrell" :George,Your mirror is stale - look at the output. Mirroring in Lustre is currently a manual process, you have to manually resync a file after writing to it. lfs mirror resync is the lfs command.If your mirror is in sync, you should get the behavior you’re looking for.- Patrick From: lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of George Melikov <m...@gmelikov.ru>Sent: Monday, October 1, 2018 6:17:44 AMTo: Jian Yu; lustre-discussSubject: Re: [lustre-discuss] lfs mirror create directory Thank you, Jian, it works this way.I want to read/write to Lustre even if one of OSTs with file is unavailable.But now if i unmount one of OSTs with file, I can't read/write from/to this file.Lustre v2.11.52Is this use case works in Lustre?# lfs getstripe ./1./1 lcm_layout_gen: 3 lcm_mirror_count: 2 lcm_entry_count: 2 lcme_id: 65537 lcme_mirror_id: 1 lcme_flags: init lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 2 lmm_objects: - 0: { l_ost_idx: 2, l_fid: [0x10002:0x5:0x0] } lcme_id: 131074 lcme_mirror_id: 2 lcme_flags: init,stale lcme_extent.e_start: 0 lcme_extent.e_end: EOF lmm_stripe_count: 1 lmm_stripe_size: 1048576 lmm_pattern: raid0 lmm_layout_gen: 0 lmm_stripe_offset: 0 lmm_objects: - 0: { l_ost_idx: 0, l_fid: [0x1:0x44:0x0] }# umount /mnt/lustre/ost2# cat ./1...infinite wait...So I've unmounted OST with index 2 and can't even `cat` the file.28.09.2018, 20:17, "Jian Yu" <yuj...@whamcloud.com>:> Hi George,>> Please run "mkdir ./mirrored/" first, then run "lfs mirror create":>> # mkdir ./mirrored/>> # lfs mirror create -N2 ./mirrored/>> # lfs getstripe ./mirrored/> ./mirrored/> lcm_layout_gen: 0> lcm_mirror_count: 2> lcm_entry_count: 2> lcme_id: N/A> lcme_mirror_id: N/A> lcme_flags: 0> lcme_extent.e_start: 0> lcme_extent.e_end: EOF> stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1>> lcme_id: N/A> lcme_mirror_id: N/A> lcme_flags: 0> lcme_extent.e_start: 0> lcme_extent.e_end: EOF> stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1>> --> Best regards,> Jian Yu>> -Original Message-> From: lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of George Melikov <m...@gmelikov.ru>> Date: Friday, September 28, 2018 at 8:05 AM> To: lustre-discuss <lustre-discuss@lists.lustre.org>> Subject: [lustre-discuss] lfs mirror create directory>> Does `lfs mirror create` work for directories in 2.11?> Tried it, nope :(>> # lfs mirror create -N2 ./mirrored/> lfs mirror create: cannot create composite file './mirrored/': Is a directory>> But documentation says it's good to go...> > lfs mirror create <--mirror-count|-N[mirror_count]> > [setstripe_options|[--flags<=flags>]]> ... >> > Sincerely,> George Melikov,>___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
Re: [lustre-discuss] lfs mirror create directory
Thank you, Jian, it works this way.
I want to read/write to Lustre even if one of OSTs with file is unavailable.
But now if i unmount one of OSTs with file, I can't read/write from/to this
file.
Lustre v2.11.52
Is this use case works in Lustre?
# lfs getstripe ./1
./1
lcm_layout_gen:3
lcm_mirror_count: 2
lcm_entry_count: 2
lcme_id: 65537
lcme_mirror_id: 1
lcme_flags: init
lcme_extent.e_start: 0
lcme_extent.e_end: EOF
lmm_stripe_count: 1
lmm_stripe_size: 1048576
lmm_pattern: raid0
lmm_layout_gen:0
lmm_stripe_offset: 2
lmm_objects:
- 0: { l_ost_idx: 2, l_fid: [0x10002:0x5:0x0] }
lcme_id: 131074
lcme_mirror_id: 2
lcme_flags: init,stale
lcme_extent.e_start: 0
lcme_extent.e_end: EOF
lmm_stripe_count: 1
lmm_stripe_size: 1048576
lmm_pattern: raid0
lmm_layout_gen:0
lmm_stripe_offset: 0
lmm_objects:
- 0: { l_ost_idx: 0, l_fid: [0x1:0x44:0x0] }
# umount /mnt/lustre/ost2
# cat ./1
...infinite wait...
So I've unmounted OST with index 2 and can't even `cat` the file.
28.09.2018, 20:17, "Jian Yu" :
> Hi George,
>
> Please run "mkdir ./mirrored/" first, then run "lfs mirror create":
>
> # mkdir ./mirrored/
>
> # lfs mirror create -N2 ./mirrored/
>
> # lfs getstripe ./mirrored/
> ./mirrored/
> lcm_layout_gen: 0
> lcm_mirror_count: 2
> lcm_entry_count: 2
> lcme_id: N/A
> lcme_mirror_id: N/A
> lcme_flags: 0
> lcme_extent.e_start: 0
> lcme_extent.e_end: EOF
> stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1
>
> lcme_id: N/A
> lcme_mirror_id: N/A
> lcme_flags: 0
> lcme_extent.e_start: 0
> lcme_extent.e_end: EOF
> stripe_count: 1 stripe_size: 1048576 pattern: raid0 stripe_offset: -1
>
> --
> Best regards,
> Jian Yu
>
> -Original Message-
> From: lustre-discuss on behalf of
> George Melikov
> Date: Friday, September 28, 2018 at 8:05 AM
> To: lustre-discuss
> Subject: [lustre-discuss] lfs mirror create directory
>
> Does `lfs mirror create` work for directories in 2.11?
> Tried it, nope :(
>
> # lfs mirror create -N2 ./mirrored/
> lfs mirror create: cannot create composite file './mirrored/': Is a
> directory
>
> But documentation says it's good to go...
> > lfs mirror create <--mirror-count|-N[mirror_count]
> > [setstripe_options|[--flags<=flags>]]> ...
>
>
> Sincerely,
> George Melikov,
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] lfs mirror create directory
Does `lfs mirror create` work for directories in 2.11?Tried it, nope :( # lfs mirror create -N2 ./mirrored/lfs mirror create: cannot create composite file './mirrored/': Is a directory But documentation says it's good to go...> lfs mirror create <--mirror-count|-N[mirror_count]> [setstripe_options|[--flags<=flags>]]> ... ____Sincerely,George Melikov, 28.09.2018, 11:21, "Andreas Dilger" :It is best to leave the MDT recordsize at the default. For most files it will not matter (too small), but for Data on MDT you also don't want a large recordsize. Cheers, AndreasOn Sep 28, 2018, at 09:17, Robert Redl <robert.r...@lmu.de> wrote: Dear All,I have a related question. The documentation says nothing about the recommended recordsize for MDTs with ZFS backend. Are there any recommendation? Or is data on MDTs stored in a way that the recordsize does not matter?Thanks,Robert On 09/28/2018 12:54 AM, Andreas Dilger wrote:Firstly, we don't test anything larger than 1MB. Secondly, the best recordsize is up to the apication IO pattern. If it is streaming writes, it might be OK. If it is random write then probably not. Cheers, AndreasOn Sep 27, 2018, at 19:04, Riccardo Veraldi <riccardo.vera...@cnaf.infn.it> wrote: Hello,I have always been using ZFS record size to 1MB with Lustre on top of ZFS. Anyway it is possible to set it to more than 1MB. May this have any benefit in performance and is it recommended to set for example:echo 4194304 > /sys/module/zfs/parameters/zfs_max_recordsizezfs set recordsize=4m zpool Thank you.Rick ___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org,___lustre-discuss mailing listlustre-discuss@lists.lustre.orghttp://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] Automated tests
Hello, Is there any public automated test platforms for latest Lustre code? I've found buildbots http://build.lustre.org/console , but they don't run any tests. Thanks! Sincerely, George Melikov, Tel. 7-915-278-39-36 Skype: georgemelikov С наилучшими пожеланиями, Георгий Меликов, m...@gmelikov.ru Моб: +7 9152783936 Skype: georgemelikov ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
[lustre-discuss] lnet configuration messed up when clients mount lustre
Hello,
I've found that `lfs check` command documentation and arguments are misleading,
it is used to check targets, not servers, as documentation states (or am I
wrong?).
I didn't found the better place for patches or discussions, so I propose a
patch here.
I'll be glad if someone can give me the right direction for such cases.
From 2aaf4fa4a12ce38d283725410f4f7d0f3b1488ab Mon Sep 17 00:00:00 2001
From: George Melikov <m...@gmelikov.ru>
Date: Fri, 20 Apr 2018 15:27:00 +0300
Subject: [PATCH] Fix `lfs check` documentation and arguments
---
lustre/doc/lfs.1 | 8 +---
lustre/utils/lfs.c | 4 ++--
2 files changed, 7 insertions(+), 5 deletions(-)
diff --git a/lustre/doc/lfs.1 b/lustre/doc/lfs.1
index 29cd139519..714785fa63 100644
--- a/lustre/doc/lfs.1
+++ b/lustre/doc/lfs.1
@@ -7,7 +7,7 @@ lfs \- client utility for Lustre-specific file layout and other
attributes
.br
.B lfs changelog_clear
.br
-.B lfs check <mds|osts|servers>
+.B lfs check <mds|mdts|osts|all|servers>
.br
.B lfs data_version [-n] \fB\fR
.br
@@ -151,8 +151,10 @@ interest to a particular consumer , potentially
allowing the MDT to
free up disk space. An of 0 indicates the current last record.
Changelog consumers must be registered on the MDT node using \fBlctl\fR.
.TP
-.B check
-Display the status of MDS or OSTs (as specified in the command) or all the
servers (MDS and OSTs)
+.B check <mds|mdts|osts|all|servers>
+Check and display the status of MDTs or OSTs (as specified in the command)
+or all (MDTs and OSTs). \fBmds\fR and \fBservers\fR arguments are equal to
+\fBmdts\fR and \fBall\fR, respectively, and remain for backward compatibility
only.
.TP
.B data_version [-n]
Display current version of file data. If -n is specified, data version is read
diff --git a/lustre/utils/lfs.c b/lustre/utils/lfs.c
index 4dcb8f31a1..a7a9de9e73 100644
--- a/lustre/utils/lfs.c
+++ b/lustre/utils/lfs.c
@@ -5152,9 +5152,9 @@ static int lfs_check(int argc, char **argv)
if (strcmp(argv[1], "osts") == 0) {
strcpy(obd_types[0], "osc");
-} else if (strcmp(argv[1], "mds") == 0) {
+} else if (strcmp(argv[1], "mds") == 0 || strcmp(argv[1], "mdts") ==
0) {
strcpy(obd_types[0], "mdc");
-} else if (strcmp(argv[1], "servers") == 0) {
+} else if (strcmp(argv[1], "servers") == 0 || strcmp(argv[1], "all")
== 0) {
num_types = 2;
strcpy(obd_types[0], "osc");
strcpy(obd_types[1], "mdc");
--
2.14.2
Sincerely,
George Melikov,
Tel. 7-915-278-39-36
Skype: georgemelikov
С наилучшими пожеланиями,
Георгий Меликов,
m...@gmelikov.ru
Моб: +7 9152783936
Skype: georgemelikov
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
