Re: [lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and Tuning Root Squash

2017-06-06 Thread Dilger, Andreas 
One thing that is important to note here is that the syntax of "conf_param" is 
not the same as "set_param" and "get_param".  The conf_param syntax is what 
sets the parameters permanently in the configuration log, while {get,set}_param 
run on the local node only.

There is a newer "lctl set_param -P" interface that was added, to allow 
permanently setting parameters using the (IMHO more familiar) "set_param" 
syntax, but it has some problems that currently prevent it from being used more 
widely.  There is a Jira ticket open for this that has been getting some 
attention recently, and hopefully the "set_param -P" functionality will be able 
to replace conf_param completely in the future.

Cheers, Andreas

On Jun 6, 2017, at 05:41, Gibbins, Faye  wrote:
> 
> Hi,
>  
> I think I’ve found a bug in the manual: 
> https://build.hpdd.intel.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#dbdoclet.50438221_48757
>  I’ve included it below in case this is the correct place to report it. If 
> not please let me know and I’ll submit it elsewhere.
>  
> In section 25.2.2. Enabling and Tuning Root Squash, the bit that says:
>  
> Snip---
> Root squash parameters can also be changed with the lctl conf_param command. 
> For example:
>  
> mgs# lctl conf_param testfs.mdt.root_squash="1000:101"
> mgs# lctl conf_param testfs.mdt.nosquash_nids="*@tcp"
> Snip---
>  
> Should be IMHO:
>  
> Snip---
> Root squash parameters can also be changed with the lctl conf_param command. 
> For example:
>  
> mgs# lctl conf_param mdt.testfs-MDT.root_squash="1000:101"
> mgs# lctl conf_param mdt.testfs-MDT.nosquash_nids="*@tcp"
> Snip---
>  
> Here is an example of me using my version compared to the documentation 
> version using Lustre 2.8 on RHEL 7:
>  
> Snip---
> 0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
> mdt.audiodb-MDT.root_squash=0:0
> 0 edi-vf-1-5:audiodb-MDT# lctl set_param 
> mdt.audiodb-MDT.root_squash="0:1"
> mdt.audiodb-MDT.root_squash=0:1
> 0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
> mdt.audiodb-MDT.root_squash=0:1
> 0 edi-vf-1-5:audiodb-MDT# lctl set_param 
> mdt.audiodb-MDT.root_squash="0:0"
> mdt.audiodb-MDT.root_squash=0:0
> # Using the documented version.
> 0 edi-vf-1-5:audiodb-MDT# lctl set_param audiodb.mdt.root_squash="0:1"
> error: set_param: param_path 'audiodb/mdt/root_squash': No such file or 
> directory
> 0 edi-vf-1-5:audiodb-MDT#
> Snip---
>  
> Yours
> Faye Gibbins
> Snr SysAdmin, Unix Lead Architect
> Software Systems and Cloud Services
> Cirrus Logic | cirrus.com  | +44 (0) 131 272 7398
>  
> 
>  
> This message and any attachments may contain privileged and confidential 
> information that is intended solely for the person(s) to whom it is 
> addressed. If you are not an intended recipient you must not: read; copy; 
> distribute; discuss; take any action in or make any reliance upon the 
> contents of this message; nor open or read any attachment. If you have 
> received this message in error, please notify us as soon as possible on the 
> following telephone number and destroy this message including any 
> attachments. Thank you. Cirrus Logic International (UK) Ltd and Cirrus Logic 
> International Semiconductor Ltd are companies registered in Scotland, with 
> registered numbers SC089839 and SC495735 respectively. Our registered office 
> is at 7B Nightingale Way, Quartermile, Edinburgh, EH3 9EG, UK. Tel: +44 
> (0)131 272 7000. cirrus.com ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Intel Corporation







___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and Tuning Root Squash

2017-06-06 Thread Chris Horn 
The LUDOC project in Intel’s Jira is the correct place to report these issues: 
https://wiki.hpdd.intel.com/display/PUB/How+to+file+a+LUDOC+bug

These are the instructions for submitting fixes to the Lustre Manual if you’re 
so inclined: 
https://wiki.hpdd.intel.com/display/PUB/Making+changes+to+the+Lustre+Manual+source

Chris Horn

From: lustre-discuss  on behalf of 
"Gibbins, Faye" 
Date: Tuesday, June 6, 2017 at 6:41 AM
To: "lustre-discuss@lists.lustre.org" 
Subject: [lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and Tuning 
Root Squash

Hi,

I think I’ve found a bug in the manual: 
https://build.hpdd.intel.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#dbdoclet.50438221_48757
 I’ve included it below in case this is the correct place to report it. If not 
please let me know and I’ll submit it elsewhere.

In section 25.2.2. Enabling and Tuning Root Squash, the bit that says:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param testfs.mdt.root_squash="1000:101"
mgs# lctl conf_param testfs.mdt.nosquash_nids="*@tcp"
Snip---

Should be IMHO:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param mdt.testfs-MDT.root_squash="1000:101"
mgs# lctl conf_param mdt.testfs-MDT.nosquash_nids="*@tcp"
Snip---

Here is an example of me using my version compared to the documentation version 
using Lustre 2.8 on RHEL 7:

Snip---
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:0
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:1"
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:0"
mdt.audiodb-MDT.root_squash=0:0
# Using the documented version.
0 edi-vf-1-5:audiodb-MDT# lctl set_param audiodb.mdt.root_squash="0:1"
error: set_param: param_path 'audiodb/mdt/root_squash': No such file or 
directory
0 edi-vf-1-5:audiodb-MDT#
Snip---

Yours
Faye Gibbins
Snr SysAdmin, Unix Lead Architect
Software Systems and Cloud Services
Cirrus Logic | cirrus.com  | +44 (0) 131 272 7398

[id:image002.png@01D2CF24.9A35B8F0]

This message and any attachments may contain privileged and confidential 
information that is intended solely for the person(s) to whom it is addressed. 
If you are not an intended recipient you must not: read; copy; distribute; 
discuss; take any action in or make any reliance upon the contents of this 
message; nor open or read any attachment. If you have received this message in 
error, please notify us as soon as possible on the following telephone number 
and destroy this message including any attachments. Thank you. Cirrus Logic 
International (UK) Ltd and Cirrus Logic International Semiconductor Ltd are 
companies registered in Scotland, with registered numbers SC089839 and SC495735 
respectively. Our registered office is at 7B Nightingale Way, Quartermile, 
Edinburgh, EH3 9EG, UK. Tel: +44 (0)131 272 7000. cirrus.com
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] seclabel

2017-06-06 Thread Robin Humble 
On Tue, May 23, 2017 at 08:08:54PM +, Dilger, Andreas wrote:
>On May 19, 2017, at 08:47, Robin Humble  wrote:
>> On Wed, May 17, 2017 at 02:37:31PM +, Sebastien Buisson wrote:
>>> Le 17 mai 2017 à 16:16, Robin Humble  a écrit :
 I took a gander at the source and noticed that llite/xattr.c
 deliberately filters out 'security.capability' and returns 0/-ENODATA
 for setcap/getcap, which is indeed what strace sees. so setcap/getcap
 is never even sent to the MDS.
 
 if I remove that filter (see patch on lustre-devel) then setcap/getcap
 works ->
>> ...
 'b15587' is listed as the reason for the filtering.
 I don't know what that refers to.
 is it still relevant?
>>> b15587 refers to the old Lustre Bugzilla tracking tool:
>>> https://projectlava.xyratex.com/show_bug.cgi?id=15587
>>> 
>>> Reading the discussion in the ticket, supporting xattr at the time of 
>>> Lustre 1.8 and 2.0 was causing issues on MDS side in some situations. So it 
>>> was decided to discard security.capability xattr on Lustre client side. I 
>>> think Andreas might have some insight, as he apparently participated in 
>>> b15587.
>> 
>> my word that's a long time ago...
>> I don't see much in the way of jira tickets about getxattr issues on
>> MDS in recent times, and they're much more heavily used these days, so
>> I hope that particular problem has long since been fixed.
>> 
>> should I open a jira ticket to track re-enabling of security.capabilities?

LU-9562
thanks for everyone's help!

>I don't recall the details of b=15587 off the top of my head, but the 
>high-level issue is
>that the security labels added a significant performance overhead, since they 
>were retrieved
>on every file access, but not cached on the client, even if most systems never 
>used them.
>
>Seagate implemented the client-side xattr cache for Lustre 2.5, so this should 
>work a lot
>better these days.  I'm not 100% positive if we also cache negative xattr 
>lookups or not,
>so this would need some testing/tracing to see if it generates a large number 
>of RPCs.

fair enough.

cheers,
robin
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and Tuning Root Squash

2017-06-06 Thread Gibbins, Faye 
Thanks Peter, LUDOC-377 created ☺

From: Jones, Peter A [mailto:peter.a.jo...@intel.com]
Sent: 06 June 2017 13:44
To: Gibbins, Faye ; lustre-discuss@lists.lustre.org
Subject: Re: [lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and 
Tuning Root Squash

Thanks Faye. The correct place to report suspected documentation bugs is to 
open a ticket in the documentation project in JIRA - 
https://jira.hpdd.intel.com/projects/LUDOC


On 6/6/17, 4:41 AM, "lustre-discuss on behalf of Gibbins, Faye" 
mailto:lustre-discuss-boun...@lists.lustre.org>
 on behalf of faye.gibb...@cirrus.com> wrote:

Hi,

I think I’ve found a bug in the manual: 
https://build.hpdd.intel.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#dbdoclet.50438221_48757
 I’ve included it below in case this is the correct place to report it. If not 
please let me know and I’ll submit it elsewhere.

In section 25.2.2. Enabling and Tuning Root Squash, the bit that says:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param testfs.mdt.root_squash="1000:101"
mgs# lctl conf_param testfs.mdt.nosquash_nids="*@tcp"
Snip---

Should be IMHO:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param mdt.testfs-MDT.root_squash="1000:101"
mgs# lctl conf_param mdt.testfs-MDT.nosquash_nids="*@tcp"
Snip---

Here is an example of me using my version compared to the documentation version 
using Lustre 2.8 on RHEL 7:

Snip---
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:0
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:1"
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:0"
mdt.audiodb-MDT.root_squash=0:0
# Using the documented version.
0 edi-vf-1-5:audiodb-MDT# lctl set_param audiodb.mdt.root_squash="0:1"
error: set_param: param_path 'audiodb/mdt/root_squash': No such file or 
directory
0 edi-vf-1-5:audiodb-MDT#
Snip---

Yours
Faye Gibbins
Snr SysAdmin, Unix Lead Architect
Software Systems and Cloud Services
Cirrus Logic | cirrus.com  | +44 (0) 131 272 7398

[cid:image002.png@01D2CF24.9A35B8F0]

This message and any attachments may contain privileged and confidential 
information that is intended solely for the person(s) to whom it is addressed. 
If you are not an intended recipient you must not: read; copy; distribute; 
discuss; take any action in or make any reliance upon the contents of this 
message; nor open or read any attachment. If you have received this message in 
error, please notify us as soon as possible on the following telephone number 
and destroy this message including any attachments. Thank you. Cirrus Logic 
International (UK) Ltd and Cirrus Logic International Semiconductor Ltd are 
companies registered in Scotland, with registered numbers SC089839 and SC495735 
respectively. Our registered office is at 7B Nightingale Way, Quartermile, 
Edinburgh, EH3 9EG, UK. Tel: +44 (0)131 272 7000. cirrus.com
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and Tuning Root Squash

2017-06-06 Thread Jones, Peter A 
Thanks Faye. The correct place to report suspected documentation bugs is to 
open a ticket in the documentation project in JIRA - 
https://jira.hpdd.intel.com/projects/LUDOC


On 6/6/17, 4:41 AM, "lustre-discuss on behalf of Gibbins, Faye" 
mailto:lustre-discuss-boun...@lists.lustre.org>
 on behalf of faye.gibb...@cirrus.com> wrote:

Hi,

I think I’ve found a bug in the manual: 
https://build.hpdd.intel.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#dbdoclet.50438221_48757
 I’ve included it below in case this is the correct place to report it. If not 
please let me know and I’ll submit it elsewhere.

In section 25.2.2. Enabling and Tuning Root Squash, the bit that says:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param testfs.mdt.root_squash="1000:101"
mgs# lctl conf_param testfs.mdt.nosquash_nids="*@tcp"
Snip---

Should be IMHO:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param mdt.testfs-MDT.root_squash="1000:101"
mgs# lctl conf_param mdt.testfs-MDT.nosquash_nids="*@tcp"
Snip---

Here is an example of me using my version compared to the documentation version 
using Lustre 2.8 on RHEL 7:

Snip---
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:0
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:1"
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:0"
mdt.audiodb-MDT.root_squash=0:0
# Using the documented version.
0 edi-vf-1-5:audiodb-MDT# lctl set_param audiodb.mdt.root_squash="0:1"
error: set_param: param_path 'audiodb/mdt/root_squash': No such file or 
directory
0 edi-vf-1-5:audiodb-MDT#
Snip---

Yours
Faye Gibbins
Snr SysAdmin, Unix Lead Architect
Software Systems and Cloud Services
Cirrus Logic | cirrus.com  | +44 (0) 131 272 7398

[cid:image002.png@01D2CF24.9A35B8F0]

This message and any attachments may contain privileged and confidential 
information that is intended solely for the person(s) to whom it is addressed. 
If you are not an intended recipient you must not: read; copy; distribute; 
discuss; take any action in or make any reliance upon the contents of this 
message; nor open or read any attachment. If you have received this message in 
error, please notify us as soon as possible on the following telephone number 
and destroy this message including any attachments. Thank you. Cirrus Logic 
International (UK) Ltd and Cirrus Logic International Semiconductor Ltd are 
companies registered in Scotland, with registered numbers SC089839 and SC495735 
respectively. Our registered office is at 7B Nightingale Way, Quartermile, 
Edinburgh, EH3 9EG, UK. Tel: +44 (0)131 272 7000. cirrus.com
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] Lustre Manual Bug Report: 25.2.2. Enabling and Tuning Root Squash

2017-06-06 Thread Gibbins, Faye 
Hi,

I think I've found a bug in the manual: 
https://build.hpdd.intel.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#dbdoclet.50438221_48757
 I've included it below in case this is the correct place to report it. If not 
please let me know and I'll submit it elsewhere.

In section 25.2.2. Enabling and Tuning Root Squash, the bit that says:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param testfs.mdt.root_squash="1000:101"
mgs# lctl conf_param testfs.mdt.nosquash_nids="*@tcp"
Snip---

Should be IMHO:

Snip---
Root squash parameters can also be changed with the lctl conf_param command. 
For example:

mgs# lctl conf_param mdt.testfs-MDT.root_squash="1000:101"
mgs# lctl conf_param mdt.testfs-MDT.nosquash_nids="*@tcp"
Snip---

Here is an example of me using my version compared to the documentation version 
using Lustre 2.8 on RHEL 7:

Snip---
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:0
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:1"
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl get_param mdt.audiodb-MDT.root_squash
mdt.audiodb-MDT.root_squash=0:1
0 edi-vf-1-5:audiodb-MDT# lctl set_param 
mdt.audiodb-MDT.root_squash="0:0"
mdt.audiodb-MDT.root_squash=0:0
# Using the documented version.
0 edi-vf-1-5:audiodb-MDT# lctl set_param audiodb.mdt.root_squash="0:1"
error: set_param: param_path 'audiodb/mdt/root_squash': No such file or 
directory
0 edi-vf-1-5:audiodb-MDT#
Snip---

Yours
Faye Gibbins
Snr SysAdmin, Unix Lead Architect
Software Systems and Cloud Services
Cirrus Logic | cirrus.com  | +44 (0) 131 272 7398

[cid:image002.png@01D2CF24.9A35B8F0]

This message and any attachments may contain privileged and confidential 
information that is intended solely for the person(s) to whom it is addressed. 
If you are not an intended recipient you must not: read; copy; distribute; 
discuss; take any action in or make any reliance upon the contents of this 
message; nor open or read any attachment. If you have received this message in 
error, please notify us as soon as possible on the following telephone number 
and destroy this message including any attachments. Thank you. Cirrus Logic 
International (UK) Ltd and Cirrus Logic International Semiconductor Ltd are 
companies registered in Scotland, with registered numbers SC089839 and SC495735 
respectively. Our registered office is at 7B Nightingale Way, Quartermile, 
Edinburgh, EH3 9EG, UK. Tel: +44 (0)131 272 7000. cirrus.com
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] Experience with PCIe INTEL SSD

2017-06-06 Thread Arman Khalatyan 
Hello everybody,
Can some one share his experience of using NVME Intel P3600 as a MDS with
ldiskfs?
We have two of them, is it better to use them with lvm mirror or mdraid?
We tested with zfs mirror but somehow it is not performing as fast as we
expected.

Thanks,
Arman.
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org