Re: [lustre-discuss] Using lctl lfsck syntax issues

2018-08-09 Thread Andreas Dilger
The lctl commands need to be run on the MDS. 

Cheers, Andreas

> On Aug 9, 2018, at 11:49, Ms. Megan Larko  wrote:
> 
> Howdy List!
> 
> I am checking Lustre-2.10.4 (kernel 3.10.0-693 on CentOS 7.3.1611).
> I am having trouble using lctl lfsck.  I believe I am not using the proper 
> syntax.  The manual page, "man 8 lctl-lfsck-start" (or query in place of 
> start) is not providing me the info I seek (or rather I just am not 'getting' 
> it).
> 
> All of my queries (shown below) have the same response.
> > lctl lfsck_query -t namespace --device meg1-MDT
> Fail to query LFSCK: Invalid argument
> > lctl lfsck_query --device meg1-MDT
> Fail to query LFSCK: Invalid argument
> > lctl lfsck_query -M meg1-MDT
> Fail
> > lctl lfsck_query -M 4# lctl dl shows MDT as device num. 4
> Fail 
> 
> I am running this on the Lustre client.  The lctl command is from:
> > rpm -qf /usr/sbin/lctl
> lustre-2.10.4-1.el7.centos.x86_64
> 
> I would like to test the lsfck_query|start|stop function.
> 
> P.S.  Can an actual--non-dryrun--lfsck be run on a mounted active Lustre File 
> System?
> 
> Cheers,
> megan
> 
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] lustre vs. lustre-client

2018-08-09 Thread Brian Andrus
IIRC, that is so, when you install the lustre server package, it also 
covers the dependency on lustre-client that other packages may have.  If 
you look further down in the spec file, you see that:


%if %{with servers}
Requires: lustre-osd
Requires: lustre-osd-mount
Provides: lustre-client = %{version}-%{fullrelease}
%endif


Brian Andrus

On 8/9/2018 5:51 PM, Faaland, Olaf P. wrote:

Hi,

What is the reason for naming the package "lustre" if it includes both client and server 
binaries, but "lustre-client" if it includes only the client?

= (from
# Set the package name prefix
%if %{undefined lustre_name}
 %if %{with servers}
 %global lustre_name lustre
 %else
 %global lustre_name lustre-client
 %endif
%endif
=

Are there sites that build both with and without servers, and need to keep 
track which is installed on a given machine?  The size of the RPMs isn't that 
different, so it's not obvious to me why one would do that.

thanks,

Olaf P. Faaland
Livermore Computing
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[lustre-discuss] lustre vs. lustre-client

2018-08-09 Thread Faaland, Olaf P.
Hi,

What is the reason for naming the package "lustre" if it includes both client 
and server binaries, but "lustre-client" if it includes only the client?

= (from 
# Set the package name prefix
%if %{undefined lustre_name}
%if %{with servers}
%global lustre_name lustre
%else
%global lustre_name lustre-client
%endif
%endif
=

Are there sites that build both with and without servers, and need to keep 
track which is installed on a given machine?  The size of the RPMs isn't that 
different, so it's not obvious to me why one would do that.

thanks,

Olaf P. Faaland
Livermore Computing
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[lustre-discuss] Using lctl lfsck syntax issues

2018-08-09 Thread Ms. Megan Larko
Howdy List!

I am checking Lustre-2.10.4 (kernel 3.10.0-693 on CentOS 7.3.1611).
I am having trouble using lctl lfsck.  I believe I am not using the proper
syntax.  The manual page, "man 8 lctl-lfsck-start" (or query in place of
start) is not providing me the info I seek (or rather I just am not
'getting' it).

All of my queries (shown below) have the same response.
> lctl lfsck_query -t namespace --device meg1-MDT
Fail to query LFSCK: Invalid argument
> lctl lfsck_query --device meg1-MDT
Fail to query LFSCK: Invalid argument
> lctl lfsck_query -M meg1-MDT
Fail
> lctl lfsck_query -M 4# lctl dl shows MDT as device num. 4
Fail 

I am running this on the Lustre client.  The lctl command is from:
> rpm -qf /usr/sbin/lctl
lustre-2.10.4-1.el7.centos.x86_64

I would like to test the lsfck_query|start|stop function.

P.S.  Can an actual--non-dryrun--lfsck be run on a mounted active Lustre
File System?

Cheers,
megan
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[lustre-discuss] ksym errors on kmod-lustre RPM after 2.10.4 build against MOFED 4.3

2018-08-09 Thread Ms. Megan Larko
Hi!

I concur with Gin Tan.

I built my successful Lustre-2.10.4 on an older linux-3.10.0-693.[ 2.2..x
or 17.1 ].
After booting into the 693 kernel, I then built MLNX_OFED_LINUX-4.3-1.0.1.0
via command:
"./mlnxofedinstall --skip-distro-check --add-kernel-support"

Then I start that version of mlnx (/etc/init.d/openibd start).

Then I build spl and zfs if the box is a Lustre server.
I go right to building Lustre if the goal is to install a client.

Lustre Client:
./configure --disable-server --disable-ldiskfs
--with-o2ib=/usr/src/ofa_kernel/default
--with-linux=/usr/src/kernels/3.10.0-693.17.1.el7.x86_64

Then the usual and customary "make" and "make rpms".
I do have a kmod-lustre-* rpm.   I have no symbol errors and my test bed of
Lustre-2.10.4 is behaving nicely.

I have found that order matters.  I seem to need to do the kernel first,
then Mellanox on that kernel and build the Lustre part on the kernel with
the new MLNX active.

Cheers,
megan
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] LUG 2018

2018-08-09 Thread Rawlings, Kenrick D
The video links for all of the days are now available at 
http://opensfs.org/lug-2018-agenda -- please let us know if there are any 
issues. The Lustre Wiki LUG 2018 page will also be updated with them by the end 
of the week.


Thanks,
Ken
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] LUG 2018

2018-08-09 Thread Peter Jones
They’re gradually being uploaded - 
https://www.youtube.com/playlist?list=PLA5dHg1_l3V8h8CqY_Q8yhn8bi2Fe2jnj


From: lustre-discuss  on behalf of 
"E.S. Rosenberg" 
Date: Thursday, August 9, 2018 at 5:25 AM
To: Shawn Hall 
Cc: Alexander I Kulyavtsev , Lustre discussion 

Subject: Re: [lustre-discuss] LUG 2018

Any news with this?

On Wed, Jun 20, 2018 at 8:53 PM, Shawn Hall 
mailto:shawn.h...@nag.com>> wrote:
There were recordings taken – they have not been put online yet it appears.  
I’ll check with Kevin from Argonne this afternoon to see where we’re at on 
getting those posted.

Shawn

From: lustre-discuss 
mailto:lustre-discuss-boun...@lists.lustre.org>>
 on behalf of "E.S. Rosenberg" 
mailto:esr%2blus...@mail.hebrew.edu>>
Date: Wednesday, June 20, 2018 at 1:51 PM
To: Andreas Dilger mailto:adil...@whamcloud.com>>
Cc: Alexander I Kulyavtsev mailto:a...@fnal.gov>>, Lustre 
discussion 
mailto:lustre-discuss@lists.lustre.org>>
Subject: Re: [lustre-discuss] LUG 2018

Thanks those are great overviews, does the fact that there are only links to 
slides mean that no recordings were put online (on youtube) this year?

On Wed, Jun 20, 2018 at 8:46 PM, Andreas Dilger 
mailto:adil...@whamcloud.com>> wrote:
There is also a semi-complete archive of past LUG events at:

http://wiki.lustre.org/Category:Events

like http://wiki.lustre.org/Lustre_User_Group_2018 and similar.  While
the page layout isn't as fancy, this archive goes back a lot further
than the official OpenSFS pages, and holds presentations, video links,
etc. for LUG sites that no longer exist (e.g. when LUG was organized
with a 3rd-party provider).

It doesn't include presentations from e.g. China LUG or Japan LUG or
other events that I don't have the slides for, but if someone has a
copy of those slides it would be useful to make a page to host them.

Cheers, Andreas

On Jun 20, 2018, at 11:25, Alexander I Kulyavtsev 
mailto:a...@fnal.gov>> wrote:
>
> Slides at:
> http://opensfs.org/lug-2018-agenda/
> -A.
>
> From: lustre-discuss 
> mailto:lustre-discuss-boun...@lists.lustre.org>>
>  on behalf of "E.S. Rosenberg" 
> mailto:esr%2blus...@mail.hebrew.edu>>
> Date: Wednesday, June 20, 2018 at 12:20 PM
> To: Lustre discussion 
> mailto:lustre-discuss@lists.lustre.org>>
> Subject: [lustre-discuss] LUG 2018
>
> Hi all,
> Are the talks online yet?
> Thanks,
> Eli
>
>
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

---
Andreas Dilger
Principal Lustre Architect
Whamcloud







Disclaimer

Please see our Privacy Notice for 
information on how we process personal data.

This e-mail has been scanned for all viruses and malware, and may have been 
automatically archived by Mimecast Ltd, an innovator in Software as a Service 
(SaaS) for business.

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] LUG 2018

2018-08-09 Thread Stephen Simms

Hi Eli,

It looks like video links for the first day are up here:

http://opensfs.org/lug-2018-agenda/

I know that Kevin Harms has been working hard with Ken Rawlings to get these 
video recordings edited and online.  I would expect to see more video links 
there soon.

Sincerely,
Stephen Simms 

> On Aug 9, 2018, at 08:25, E.S. Rosenberg  wrote:
> 
> Any news with this?
> 
>> On Wed, Jun 20, 2018 at 8:53 PM, Shawn Hall  wrote:
>> There were recordings taken – they have not been put online yet it appears.  
>> I’ll check with Kevin from Argonne this afternoon to see where we’re at on 
>> getting those posted.
>> 
>>  
>> 
>> Shawn
>> 
>>  
>> 
>> From: lustre-discuss  on behalf of 
>> "E.S. Rosenberg" 
>> Date: Wednesday, June 20, 2018 at 1:51 PM
>> To: Andreas Dilger 
>> Cc: Alexander I Kulyavtsev , Lustre discussion 
>> 
>> Subject: Re: [lustre-discuss] LUG 2018
>> 
>>  
>> 
>> Thanks those are great overviews, does the fact that there are only links to 
>> slides mean that no recordings were put online (on youtube) this year?
>> 
>>  
>> 
>> On Wed, Jun 20, 2018 at 8:46 PM, Andreas Dilger  
>> wrote:
>> 
>> There is also a semi-complete archive of past LUG events at:
>> 
>> http://wiki.lustre.org/Category:Events
>> 
>> like http://wiki.lustre.org/Lustre_User_Group_2018 and similar.  While
>> the page layout isn't as fancy, this archive goes back a lot further
>> than the official OpenSFS pages, and holds presentations, video links,
>> etc. for LUG sites that no longer exist (e.g. when LUG was organized
>> with a 3rd-party provider).
>> 
>> It doesn't include presentations from e.g. China LUG or Japan LUG or
>> other events that I don't have the slides for, but if someone has a
>> copy of those slides it would be useful to make a page to host them.
>> 
>> Cheers, Andreas
>> 
>> 
>> On Jun 20, 2018, at 11:25, Alexander I Kulyavtsev  wrote:
>> > 
>> > Slides at:
>> > http://opensfs.org/lug-2018-agenda/
>> > -A.
>> > 
>> > From: lustre-discuss  on behalf 
>> > of "E.S. Rosenberg" 
>> > Date: Wednesday, June 20, 2018 at 12:20 PM
>> > To: Lustre discussion 
>> > Subject: [lustre-discuss] LUG 2018
>> > 
>> > Hi all,
>> > Are the talks online yet?
>> > Thanks,
>> > Eli
>> > 
>> >
>> 
>> > ___
>> > lustre-discuss mailing list
>> > lustre-discuss@lists.lustre.org
>> > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>> 
>> ---
>> Andreas Dilger
>> Principal Lustre Architect
>> Whamcloud
>> 
>> 
>> 
>> 
>> 
>> 
>>  
>> 
>> 
>> 
>> Disclaimer
>> 
>> Please see our Privacy Notice for information on how we process personal 
>> data.
>> 
>> This e-mail has been scanned for all viruses and malware, and may have been 
>> automatically archived by Mimecast Ltd, an innovator in Software as a 
>> Service (SaaS) for business.
>> 
> 
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] LUG 2018

2018-08-09 Thread E.S. Rosenberg
Any news with this?

On Wed, Jun 20, 2018 at 8:53 PM, Shawn Hall  wrote:

> There were recordings taken – they have not been put online yet it
> appears.  I’ll check with Kevin from Argonne this afternoon to see where
> we’re at on getting those posted.
>
>
>
> Shawn
>
>
>
> *From: *lustre-discuss  on
> behalf of "E.S. Rosenberg" 
> *Date: *Wednesday, June 20, 2018 at 1:51 PM
> *To: *Andreas Dilger 
> *Cc: *Alexander I Kulyavtsev , Lustre discussion <
> lustre-discuss@lists.lustre.org>
> *Subject: *Re: [lustre-discuss] LUG 2018
>
>
>
> Thanks those are great overviews, does the fact that there are only links
> to slides mean that no recordings were put online (on youtube) this year?
>
>
>
> On Wed, Jun 20, 2018 at 8:46 PM, Andreas Dilger 
> wrote:
>
> There is also a semi-complete archive of past LUG events at:
>
> http://wiki.lustre.org/Category:Events
>
> like http://wiki.lustre.org/Lustre_User_Group_2018 and similar.  While
> the page layout isn't as fancy, this archive goes back a lot further
> than the official OpenSFS pages, and holds presentations, video links,
> etc. for LUG sites that no longer exist (e.g. when LUG was organized
> with a 3rd-party provider).
>
> It doesn't include presentations from e.g. China LUG or Japan LUG or
> other events that I don't have the slides for, but if someone has a
> copy of those slides it would be useful to make a page to host them.
>
> Cheers, Andreas
>
>
> On Jun 20, 2018, at 11:25, Alexander I Kulyavtsev  wrote:
> >
> > Slides at:
> > http://opensfs.org/lug-2018-agenda/
> > -A.
> >
> > From: lustre-discuss  on
> behalf of "E.S. Rosenberg" 
> > Date: Wednesday, June 20, 2018 at 12:20 PM
> > To: Lustre discussion 
> > Subject: [lustre-discuss] LUG 2018
> >
> > Hi all,
> > Are the talks online yet?
> > Thanks,
> > Eli
> >
> >
>
> > ___
> > lustre-discuss mailing list
> > lustre-discuss@lists.lustre.org
> > http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
> ---
> Andreas Dilger
> Principal Lustre Architect
> Whamcloud
>
>
>
>
>
>
>
>
> *Disclaimer*
>
> Please see our Privacy Notice
>  for information on how we
> process personal data.
>
> This e-mail has been scanned for all viruses and malware, and may have
> been automatically archived by Mimecast Ltd, an innovator in Software as a
> Service (SaaS) for business.
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] lustre-discuss Digest, Vol 149, Issue 5

2018-08-09 Thread Gin Tan
Had the same issue, it was because I still had the kernel modules loaded
while building the RPMs.

Uninstalled kmod-lustre and re-compiled fixed the ksym issues.

Also, there's a page allocation issue with MoFED 4.3, use MoFED 4.4.


-- 

*Gin Tan*
MASSIVE support and consulting services

*Monash eResearch Centre*
Monash University

Room G63B, 15 Innovation Walk
Clayton Campus
Wellington Road
Clayton VIC 3800
Australia

T: +61 3 9902 0245
E: gin@monash.edu
Z: https://monash.zoom.us/my/gintan
www.monash.edu.au/eresearch


On Thu, 9 Aug 2018 at 06:21, 
wrote:

> Send lustre-discuss mailing list submissions to
> lustre-discuss@lists.lustre.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> or, via email, send a message with subject or body 'help' to
> lustre-discuss-requ...@lists.lustre.org
>
> You can reach the person managing the list at
> lustre-discuss-ow...@lists.lustre.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of lustre-discuss digest..."
>
>
> Today's Topics:
>
>1. ksym errors on kmod-lustre RPM after 2.10.4 build against
>   MOFED 4.3 (Matt R?s?-Barnett)
>
>
> --
>
> Message: 1
> Date: Tue, 7 Aug 2018 23:42:23 +0100
> From: Matt R?s?-Barnett 
> To: "lustre-discuss@lists.lustre.org"
> 
> Subject: [lustre-discuss] ksym errors on kmod-lustre RPM after 2.10.4
> build against MOFED 4.3
> Message-ID: <20180807224223.rhags26mq2vlp6tt@yoshimo.localdomain>
> Content-Type: text/plain; charset=iso-8859-1; format=flowed
>
> Hello,
>
> I've been trying to build a fresh set of RPMs to reproduce the publicly
> available build of Lustre v2_10_4 against RHEL7.5
> kernel-3.10.0-862.2.3.el7 with MOFED 4.3-3.0.2.1:
>
> https://downloads.whamcloud.com/public/lustre/lustre-2.10.4-ib/MOFED-4.3-3.0.2.1/
>
> To do this I've been closely following the instructions at
> http://wiki.lustre.org/Compiling_Lustre
>
> The build process itself is successful, however I am running into an
> error when I try to install the lustre RPMs, and specifically get the
> following:
>
> [root@build ~]# yum --enablerepo=lustre-server install lustre
> kmod-lustre kmod-lustre-osd-ldiskfs lustre-osd-ldiskfs-mount
> Loaded plugins: product-id, search-disabled-repos, subscription-manager
> ...
> Resolving Dependencies
> --> Running transaction check
> ---> Package kmod-lustre.x86_64 0:2.10.4-1.el7 will be installed
> --> Processing Dependency: ksym(ib_get_dma_mr) = 0x9add141e for package:
> kmod-lustre-2.10.4-1.el7.x86_64
> --> Processing Dependency: ksym(backport_dependency_symbol) = 0xb43a926b
> for package: kmod-lustre-2.10.4-1.el7.x86_64
> --> Processing Dependency: ksym(__rdma_create_id) = 0x4f20f8d2 for
> package: kmod-lustre-2.10.4-1.el7.x86_64
> --> Processing Dependency: ksym(__rdma_accept) = 0x2962f069 for package:
> kmod-lustre-2.10.4-1.el7.x86_64
> ---> Package kmod-lustre-osd-ldiskfs.x86_64 0:2.10.4-1.el7 will be
> installed
> ---> Package lustre.x86_64 0:2.10.4-1.el7 will be installed
> ---> Package lustre-osd-ldiskfs-mount.x86_64 0:2.10.4-1.el7 will be
> installed
> --> Running transaction check
> ---> Package kmod-lustre.x86_64 0:2.10.4-1.el7 will be installed
> --> Processing Dependency: ksym(ib_get_dma_mr) = 0x9add141e for package:
> kmod-lustre-2.10.4-1.el7.x86_64
> --> Processing Dependency: ksym(__rdma_create_id) = 0x4f20f8d2 for
> package: kmod-lustre-2.10.4-1.el7.x86_64
> --> Processing Dependency: ksym(__rdma_accept) = 0x2962f069 for package:
> kmod-lustre-2.10.4-1.el7.x86_64
> ---> Package kmod-mlnx-ofa_kernel.x86_64
> 0:4.3-OFED.4.3.3.0.2.1.gcf60532.rhel7u5 will be installed
> --> Finished Dependency Resolution
> Error: Package: kmod-lustre-2.10.4-1.el7.x86_64 (lustre-server)
>Requires: ksym(__rdma_create_id) = 0x4f20f8d2
>Installing:
> kmod-mlnx-ofa_kernel-4.3-OFED.4.3.3.0.2.1.gcf60532.rhel7u5.x86_64
> (mlnx-ofed)
>ksym(__rdma_create_id) = 0x9b63e879
> Error: Package: kmod-lustre-2.10.4-1.el7.x86_64 (lustre-server)
>Requires: ksym(ib_get_dma_mr) = 0x9add141e
>Installing:
> kmod-mlnx-ofa_kernel-4.3-OFED.4.3.3.0.2.1.gcf60532.rhel7u5.x86_64
> (mlnx-ofed)
>ksym(ib_get_dma_mr) = 0x87f4f63d
> Error: Package: kmod-lustre-2.10.4-1.el7.x86_64 (lustre-server)
>Requires: ksym(__rdma_accept) = 0x2962f069
>Installing:
> kmod-mlnx-ofa_kernel-4.3-OFED.4.3.3.0.2.1.gcf60532.rhel7u5.x86_64
> (mlnx-ofed)
>ksym(__rdma_accept) = 0x530ea333
> Error: Package: kmod-lustre-2.10.4-1.el7.x86_64 (lustre-server)
>Requires: ksym(ib_get_dma_mr) = 0x9add141e
>Available:
> kmod-mlnx-ofa_kernel-4.3-OFED.4.3.3.0.2.1.gcf60532.rhel7u5.x86_64
> (mlnx-ofed)
>ksym(ib_get_dma_mr) = 0x87f4f63d
>