Re: [lustre-discuss] [EXTERNAL] Mounting lustre on block device

2023-03-16 Thread Jeff Johnson
If you *really* want a block device on a client that resides in Lustre you
*could* create a file in Lustre and then make that file a loopback device
with losetup. Of course, your mileage will vary *a lot* based on use case,
access, underlying LFS configuration.

dd if=/dev/zero
of=/my_lustre_mountpoint/some_subdir/big_raw_file bs=1048576 count=10
losetup -f /my_lustre_mountpoint/some_subdir/big_raw_file
*assuming loop0 is created*
some_fun_command /dev/loop0

Disclaimer: Just because you *can* do this, doesn't necessarily mean it is
a good idea



On Thu, Mar 16, 2023 at 3:29 PM Mohr, Rick via lustre-discuss <
lustre-discuss@lists.lustre.org> wrote:

> Are you asking if you can mount Lustre on a client so that it shows up as
> a block device?  If so, the answer to that is you can't.  Lustre does not
> appear as a block device to the clients.
>
> -Rick
>
>
>
> On 3/16/23, 3:44 PM, "lustre-discuss on behalf of Shambhu Raje via
> lustre-discuss"  lustre-discuss-boun...@lists.lustre.org> on behalf of
> lustre-discuss@lists.lustre.org >
> wrote:
>
>
> When we mount a lustre file system on client, the lustre file system does
> not use block device on client side. Instead it uses virtual file system
> namespace. Mounting point will not be shown when we do 'lsblk'. As it only
> show on 'df-hT'.
>
>
> How can we mount lustre file system on block such that when we write
> something with lusterfs then it can be shown in block device??
> Can share command??
>
>
>
>
>
>
>
>
>
>
>
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>


-- 
--
Jeff Johnson
Co-Founder
Aeon Computing

jeff.john...@aeoncomputing.com
www.aeoncomputing.com
t: 858-412-3810 x1001   f: 858-412-3845
m: 619-204-9061

4170 Morena Boulevard, Suite C - San Diego, CA 92117

High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] Lustre project quotas and project IDs

2023-03-16 Thread Andreas Dilger via lustre-discuss
On Mar 16, 2023, at 04:50, Passerini Marco 
mailto:marco.passer...@cscs.ch>> wrote:

By trial and error, I found that, when using project quotas, the maximum ID 
available is 4294967294. Is this correct?

Yes, the "-1" ID is reserved for error conditions.

If I assign quota to a lot of project IDs, is the performance expected to go 
down more than having just a few or is it fixed?

Probably if you have millions or billions of different IDs there would be some 
performance loss, at a minimum just because the quota files will consume a lot 
of disk space and memory to manage.  I don't think we've done specific scaling 
testing for the number of project IDs, but it has worked well for the 
"expected" number of different IDs at production sites (in the 10,000s).

I've recommended to a few sites that want to have a "unified" quota to use e.g. 
PROJID=UID for user directories, PROJID=1M + UID for scratch, and PROJID=2M+N 
for independent projects, just to make the PROJIDs easily identified (at least 
until someone implements LU-13335 to do projid<->name mapping).

How many IDs were you thinking of using?

Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Whamcloud







___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] [EXTERNAL] Mounting lustre on block device

2023-03-16 Thread Mohr, Rick via lustre-discuss
Are you asking if you can mount Lustre on a client so that it shows up as a 
block device?  If so, the answer to that is you can't.  Lustre does not appear 
as a block device to the clients.

-Rick



On 3/16/23, 3:44 PM, "lustre-discuss on behalf of Shambhu Raje via 
lustre-discuss" mailto:lustre-discuss-boun...@lists.lustre.org> on behalf of 
lustre-discuss@lists.lustre.org > wrote:


When we mount a lustre file system on client, the lustre file system does not 
use block device on client side. Instead it uses virtual file system namespace. 
Mounting point will not be shown when we do 'lsblk'. As it only show on 'df-hT'.


How can we mount lustre file system on block such that when we write something 
with lusterfs then it can be shown in block device??
Can share command??











___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] Mounting lustre on block device

2023-03-16 Thread Patrick Farrell via lustre-discuss
Lustre doesn't show up in lsblk on the client because it isn't a block device 
on the client.  NFS and other network file systems also don't show up lsblk, 
for the same reason.

-Patrick

From: lustre-discuss  on behalf of 
Shambhu Raje via lustre-discuss 
Sent: Thursday, March 16, 2023 2:36 PM
To: lustre-discuss@lists.lustre.org 
Subject: [lustre-discuss] Mounting lustre on block device

When we mount a lustre file system on client, the lustre file system does not 
use block device on client side. Instead it uses virtual file system namespace. 
Mounting point will not be shown when we do 'lsblk'. As it only show on 'df-hT'.

How can we mount lustre file system on block such that when we write something 
with lusterfs then it can be shown in block device??
Can share command??

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[lustre-discuss] Mounting lustre on block device

2023-03-16 Thread Shambhu Raje via lustre-discuss
When we mount a lustre file system on client, the lustre file system does
not use block device on client side. Instead it uses virtual file system
namespace. Mounting point will not be shown when we do 'lsblk'. As it only
show on 'df-hT'.

How can we mount lustre file system on block such that when we write
something with lusterfs then it can be shown in block device??
Can share command??
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] Configuring LustreFS Over DRBD

2023-03-16 Thread Shambhu Raje via lustre-discuss
Thank you for the clarification.

On Thu, Mar 16, 2023, 01:36 Laura Hild  wrote:

> Hi Shambhu-
>
> I believe neither the ldiskfs nor ZFS OSDs support an active-active
> configuration (except in the sense that one can have multiple targets, some
> of which are active on one host and others on another).  It seems
> reasonable to me, only having used DRBD and Lustre independently of each
> other, that it would be possible to use DRBD in active-passive mode in
> place of shared storage for fail-over, but with inferior performance.
> Clients would connect to whichever server is currently active for a
> particular target.
>
> If instead what you're talking about is mounting a filesystem for
> simultaneous use on the DRBD hosts themselves, you're looking for a
> "shared-disk" clustered filesystem, not Lustre, which is a "distributed"
> clustered filesystem.
>
> -Laura
>
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[lustre-discuss] Lustre project quotas and project IDs

2023-03-16 Thread Passerini Marco
By trial and error, I found that, when using project quotas, the maximum ID 
available is 4294967294. Is this correct?


If I assign quota to a lot of project IDs, is the performance expected to go 
down more than having just a few or is it fixed?


Regards,

Marco Passerini

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org