[Lustre-discuss] Lustre mailing list not being archived anymore

2013-05-30 Thread E.S. Rosenberg
Hi all, I just wanted to point out that https://groups.google.com/forum/?fromgroups#!forum/lustre-discuss-list is not keeping an archive of the list anymore. (for more then a year already) Is there another (mailman?) archive somewhere? Regards, Eli ___

[Lustre-discuss] up to date documentation

2013-06-12 Thread E.S. Rosenberg
Is there any up-to-date documentation on lustre available, I am trying to read myself in before I try to set up a lustre cluster but the documentation on the website seems to be 2-3 years or older. As far as I understood a while ago on IRC stable lustre is 1.8.x while 2.x is not considered stable

Re: [Lustre-discuss] up to date documentation

2013-06-12 Thread E.S. Rosenberg
on lustre.org is still *very* relevant. Ah, ok because it talks about Q2 2010 as the future, and download links there are broken. Is lustre.org not being maintained anymore? About releases, http://lustre.opensfs.org/download-lustre/ HTH parinay Thanks, Eli On 12 June 2013 15:58, E.S

Re: [Lustre-discuss] how the lustre distribute data among disks within one OST

2013-06-13 Thread E.S. Rosenberg
On Thu, Jun 13, 2013 at 3:09 AM, Christopher J. Morrone morro...@llnl.gov wrote: Lustre does not manage the individual disks. I sits on top of a filesystem, either ldiskfs(basically ext4) or zfs (as of Lustre 2.4). Is ZFS the recommended fs, or just an option? Doesn't ZFS suffer major

Re: [Lustre-discuss] up to date documentation

2013-06-13 Thread E.S. Rosenberg
with the EOFS and openSFS boards to update lustre.org Sent from my iPhone On Jun 12, 2013, at 11:16 AM, Christopher J. Morrone morro...@llnl.gov wrote: On 06/12/2013 04:59 AM, E.S. Rosenberg wrote: Is lustre.org not being maintained anymore? Not as far as I can tell

Re: [Lustre-discuss] Metadata to Data ratio

2013-06-18 Thread E.S. Rosenberg
Thanks On Tue, Jun 18, 2013 at 12:07 PM, Parinay Kondekar parinay_konde...@xyratex.com wrote: http://build.whamcloud.com/job/lustre-manual/lastSuccessfulBuild/artifact/lustre_manual.xhtml#dbdoclet.50438256_31079 HTH On 18 June 2013 14:20, E.S. Rosenberg esr+lus...@mail.hebrew.edu wrote

[Lustre-discuss] explanation about inodes in MDT/OST

2013-06-19 Thread E.S. Rosenberg
In a Lustre ldiskfs file system, all the inodes are allocated on the MDT and OSTs when the file system is first formatted. The total number of inodes on a formatted MDT or OST cannot be easily changed, although it is possible to add OSTs with additional space and corresponding inodes. Thus, the

Re: [Lustre-discuss] explanation about inodes in MDT/OST

2013-06-23 Thread E.S. Rosenberg
, if there are no enough inodes on MDT adding OSTs wont help much. I don't think you can change no. of inodes w/o formatting. You might want to take a look at lfs_migrate, on how to increase the no_of_inodes on OST's. HTH p On 19 June 2013 19:19, E.S. Rosenberg esr+lus...@mail.hebrew.edumailto:esr

Re: [Lustre-discuss] Using NFS to mount lustre

2013-06-23 Thread E.S. Rosenberg
On Fri, Jun 21, 2013 at 7:51 PM, White, Cliff cliff.wh...@intel.com wrote: From: Teik Hooi Beh th...@thbeh.commailto:th...@thbeh.com Date: Friday, June 21, 2013 1:29 AM To: Parinay Kondekar parinay_konde...@xyratex.commailto:parinay_konde...@xyratex.com Cc:

[Lustre-discuss] lustre in mainline kernel

2013-07-18 Thread E.S. Rosenberg
Hi all, I noticed that lustre was taken into the mainline kernel 3.11 and was wondering what that means for lustre, will we be able to install lustre without patching the kernel? Does this mean that packages for other distros will become a lot easier? Thanks, Eli

Re: [Lustre-discuss] Upgrading OSS and MDS from 1.6 to 2.5

2013-08-11 Thread E.S. Rosenberg
On Thu, Aug 8, 2013 at 4:44 PM, Phill Harvey-Smith p.harvey-sm...@warwick.ac.uk wrote: On 07/08/2013 14:39, Phill Harvey-Smith wrote: Hi all, Are there any gotyas that I need to be aware of in upgrading our OSS and MDS servers to the latest 2.5 Lustre version, will all the clients need to be

[Lustre-discuss] projected date for lustre 2.5

2013-10-13 Thread E.S. Rosenberg
As I understand in the end 2.4 will not be the stable/long term release of lustre, so I was just wondering if anything more accurate then Q4 was known yet... Thanks, Eli ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org

[Lustre-discuss] lustre on debian

2013-11-25 Thread E.S. Rosenberg
Since in Linux we are mostly a debian shop we'd like to stick with debian for our calculation nodes if possible. So I wanted to ask the lustre 2.2 instructions for Debian are they more or less relevant to lustre 2.4/2.5 or am I going headlong into a tall brick wall. Also are newer clients

Re: [Lustre-discuss] lustre on debian

2013-11-25 Thread E.S. Rosenberg
You mean the 3.11 kernel right? On Mon, Nov 25, 2013 at 6:43 PM, Thomas Stibor t.sti...@gsi.de wrote: Forgot to mention that: I have built Debian Wheezy packages which are available at: http://web-docs.gsi.de/~tstibor/lustre/lustre-builds/ On Mon, Nov 25, 2013 at 05:48:06PM +0200, E.S

Re: [Lustre-discuss] lustre on debian

2013-11-25 Thread E.S. Rosenberg
25, 2013 at 6:42 PM, E.S. Rosenberg esr+lus...@mail.hebrew.edu wrote: You mean the 3.11 kernel right? On Mon, Nov 25, 2013 at 6:43 PM, Thomas Stibor t.sti...@gsi.de wrote: Forgot to mention that: I have built Debian Wheezy packages which are available at: http://web-docs.gsi.de/~tstibor/lustre

[Lustre-discuss] hpdd-discuss

2013-12-29 Thread E.S. Rosenberg
Is hpdd-discuss forwarded here and vice versa? Or should I be subscribing to that list too? Thanks, Eli ___ Lustre-discuss mailing list Lustre-discuss@lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss

[Lustre-discuss] getting 2.4.2 source through git

2013-12-29 Thread E.S. Rosenberg
Hi all, I am not a big git expert, can anyone tell me where I can clone the 2.4.2 source? I cloned the master but that was 2.5.52 and results in a kernel panic when I mount using kernel 3.12.4 on Debian Thanks, Eli ___ Lustre-discuss mailing list

Re: [Lustre-discuss] How do I downgrade from 2.5.0 to 2.1.6?

2014-01-08 Thread E.S. Rosenberg
Wouldn't it make more sense to downgrade/install 2.4.2 in that case? On Wed, Jan 8, 2014 at 4:58 PM, Oliver Mangold oliver.mang...@emea.nec.comwrote: Hello, we installed Lustre 2.5.0 servers at a customer site and ran into massive stability problems. Because of this we would like to

Re: [Lustre-discuss] How do I downgrade from 2.5.0 to 2.1.6?

2014-01-08 Thread E.S. Rosenberg
We weren't able to use lustre (2.4.2/2.5.x) with kernel 3.12.4 (staging kernel driver - kernel panics on mount) After compiling 3.13-rc we have a working system (though it has not yet being put through its' paces except for some simultaneous dd) On Wed, Jan 8, 2014 at 5:02 PM, E.S. Rosenberg esr

Re: [Lustre-discuss] Lustre Installation

2014-04-23 Thread E.S. Rosenberg
You should probably be trying 2.4.x or 2.5.x available here: https://wiki.hpdd.intel.com/display/PUB/Lustre+Releases On Tue, Mar 4, 2014 at 2:40 AM, omar o...@nearinc.com wrote: Dear community, Has anyone installed Lustre on openSUSE 12.3 64-bit with kernel 3.7.10-1.28-dektop? If so, could

Re: [Lustre-discuss] lustre 2.5.58 MDT 100% full

2014-06-10 Thread E.S. Rosenberg
Did anyone answer this? From my way too basic understanding should it be possible to expand an MDT? after all the underlying fs is ext4? On Mon, Jun 2, 2014 at 5:12 PM, Anjana Kar k...@psc.edu wrote: The MGS/MDT pool and filesystem were created using these commands: zpool create -f -o

Re: [Lustre-discuss] Virtual machines on Lustre

2014-06-11 Thread E.S. Rosenberg
On Wed, Jun 11, 2014 at 2:03 AM, Colin Faber cfa...@gmail.com wrote: Yes. Many of the various VM products will work just fine with lustre. However they will not perform as well as native hw. I think he means that the virtual disk images sit on lustre instead of netapp or other storage

Re: [Lustre-discuss] Virtual machines on Lustre

2014-06-11 Thread E.S. Rosenberg
On Wed, Jun 11, 2014 at 3:57 PM, Andrew Holway andrew.hol...@gmail.com wrote: On 11 Jun 2014 14:22, E.S. Rosenberg esr+lus...@mail.hebrew.edu wrote: On Wed, Jun 11, 2014 at 2:03 AM, Colin Faber cfa...@gmail.com wrote: Yes. Many of the various VM products will work just fine

Re: [Lustre-discuss] Client build fails on Ubuntu 13.10 (3.11 kernel)

2014-08-19 Thread E.S. Rosenberg
On our debian we built 2.4.x like so: sh autogen.sh ./configure --disable-modules --disable-server --enable-client --prefix=/path/to/prefix/you/want The kernel module already ships with 3.11 iirc, though I don't know what the lustre version compatibility is of 3.11, we use a self built 3.14

Re: [Lustre-discuss] Lustre stats

2014-12-11 Thread E.S. Rosenberg
Since we tend to forget this from time to time I just want to do it in public: Thanks! And thank you to all the people involved with the lustre project (and other FOSS). On Wed, Nov 12, 2014 at 1:04 AM, Scott Nolin scott.no...@ssec.wisc.edu wrote: Here is my attempt to detail some of the Lustre

Re: [Lustre-discuss] Debian Client on Linux 3.12

2014-12-22 Thread E.S. Rosenberg
Re:all We use lustre client on kernel 3.17 (on Debian), we use the kernel parts that ship on kernel.org and compile the client only Our configure instruction is: ./configure --disable-modules --disable-server --enable-client HTH, Eli On Fri, Dec 19, 2014 at 10:21 PM, Dilger, Andreas

Re: [Lustre-discuss] Debian Client on Linux 3.12

2014-12-22 Thread E.S. Rosenberg
Hmm, that may not have been 100% clear, we compile kernel.org kernels ourself and compile lustre ourself... On Mon, Dec 22, 2014 at 3:09 PM, E.S. Rosenberg esr+lus...@mail.hebrew.edu wrote: Re:all We use lustre client on kernel 3.17 (on Debian), we use the kernel parts that ship on kernel.org

Re: [Lustre-discuss] Build lustre 2.6 Client on Debian Wheezy

2015-01-11 Thread E.S. Rosenberg
On Fri, Jan 9, 2015 at 12:45 PM, Thierry Lamoureux thierry.lamour...@noveltis.fr wrote: Hi guys, Did one of you had a little moment to have a look to my previous message? As far as I can tell your previous message is not a complete paste, it doesn't end at an error and it seems to end in the

Re: [Lustre-discuss] Build lustre 2.6 Client on Debian Wheezy

2015-01-11 Thread E.S. Rosenberg
On Wed, Jan 7, 2015 at 1:42 PM, Dilger, Andreas andreas.dil...@intel.com wrote: On 2015/01/07, 4:33 AM, Kilian Cavalotti kilian.cavalotti.w...@gmail.com wrote: Bonjour Thierry, /bin/sh: 1: [: -lt: unexpected operator I'm pretty sure that's because in Debian, /bin/sh is linked to dash and the

Re: [lustre-discuss] New community release model and 2.5.3 (and 2.x.0) patch lists?

2015-04-16 Thread E.S. Rosenberg
On Wed, Apr 15, 2015 at 9:53 PM, Colin Faber cfa...@gmail.com wrote: I think in general this is a good idea. As discussed at the OpenSFS board meeting yesterday, it would be really nice for organizations which are building custom releases themselves to provide this patch list as a wiki page

[lustre-discuss] Kernel 4.2

2015-07-05 Thread E.S. Rosenberg
There are several articles on the size of the kernel 4.2 update and it bringing lots of new/improved features. I didn't see any mention of lustre features I assume because they interest the article writers less so I'd like to ask here: what if anything does kernel 4.2 bring us? Thanks, Eli

Re: [lustre-discuss] Lustre on mac os 10.10 and windows 7

2015-08-16 Thread E.S. Rosenberg
I am puzzled, why would you format an external harddisk as lustre? You realize lustre is not really aimed at being a single disk filesystem? Lustre is supposed to be spread over a set of disks (and servers) where you have disks/servers specifically in charge of storing objects and disks/servers

Re: [lustre-discuss] Lustre on mac os 10.10 and windows 7

2015-08-24 Thread E.S. Rosenberg
:46, E.S. Rosenberg wrote: I am puzzled, why would you format an external harddisk as lustre? You realize lustre is not really aimed at being a single disk filesystem? Lustre is supposed to be spread over a set of disks (and servers) where you have disks/servers specifically in charge of storing

[lustre-discuss] BLK_DEF_MAX_SECTORS in newer kernels

2015-09-08 Thread E.S. Rosenberg
Hi all, I'm trying to build lustre 2.7 with kernel 4.1.6 from source, I applied the patches that appear in: lustre/kernel_patches/series/3.x-fc18.series The following patch: blkdev_tunables-3.7.patch Seems to be adding the use of a define that left the kernel a while ago: BLK_DEF_MAX_SECTORS As

Re: [lustre-discuss] refresh file layout error

2015-09-02 Thread E.S. Rosenberg
> -Marc > > > D. Marc Stearman > Lustre Operations Lead > stearm...@llnl.gov > 925.423.9670 > > > > > On Sep 2, 2015, at 4:57 AM, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > Hi all, > > > > I am seeing an interesting

Re: [lustre-discuss] refresh file layout error

2015-09-02 Thread E.S. Rosenberg
the server 'sees'/'knows' is a symlink to the lustre filesystem which lives on nfs... Thanks, Eli > > Ed Wahl > OSC > > > -- > *From:* lustre-discuss [lustre-discuss-boun...@lists.lustre.org] on > behalf of E.S. Rosenberg [esr+lus...@mail.hebrew.edu]

[lustre-discuss] refresh file layout error

2015-09-02 Thread E.S. Rosenberg
Hi all, I am seeing an interesting/annoying problem with lustre and am not really sure what/where to look. When a webserver (galaxy using wsgi/apache2) tries to server (large) files stored on lustre it fails to send the full file and I see the following errors in syslog: Sep 2 11:50:17 hm-02

[lustre-discuss] Are there plans to have a lustre kernel branch git?

2015-09-08 Thread E.S. Rosenberg
Which would be easily merged with the mainline kernel git instead of the current setup of manually patching Thanks, Eli ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Apache via NFS via Lustre

2015-12-15 Thread E.S. Rosenberg
Hi Eric, Since we also have some issues with servers accessing files this issue interests me... Did you find anything on this? Thanks, Eli On Mon, Nov 30, 2015 at 7:53 PM, Eric Kolb wrote: > Hello, > > Perhaps someone has seen a similar issue? If so any insight would be >

Re: [lustre-discuss] Odd behavior with Matlab.

2016-06-02 Thread E.S. Rosenberg
d >> weeks and afterwards it appeared again quite frequently. This happened >> while there was no change in the installed Lustre versions. >> >> Regards, >>Roland >> >> >> Am 02.06.2016 um 17:39 schrieb Phill Harvey-Smith: >> >>> On 0

Re: [lustre-discuss] stripe count recommendation, and proposal for auto-stripe tool

2016-05-29 Thread E.S. Rosenberg
After (finally) reading this interesting discussion I was left with one question: Some of the rules suggested above would imply quite a large amount of stripes as files get truly big, isn't the (logical) upper limit on striping the amount of OSTs you have in the system? Striping more then the OST

Re: [lustre-discuss] Lustre Client Package for Rocks 6.2

2016-06-23 Thread E.S. Rosenberg
Have you tried doing the lustre install from source? On Thu, Jun 23, 2016 at 10:45 AM, wrote: > *Dear Rocks User,* > > > > Please help in getting correct Lustre Client Package for Rocks 6.2 with > Kernel 2.6.32-504.16.2.el6.x86_64 > > Currently I’m trying to install

Re: [lustre-discuss] Trying to compile lustre 2.8 against kernel 4.5

2016-06-23 Thread E.S. Rosenberg
! > > On May 22, 2016, at 2:38 PM, E.S. Rosenberg wrote: > > > Internal functions have changed and as a result it is currently not > compiling, what is the accepted style for fixing these things? > > > > Right now I am looking at this error: > >

[lustre-discuss] Access Audit

2016-01-17 Thread E.S. Rosenberg
Hi all, We have a researcher interested in using our cluster who needs to comply with HIPAA (US legislation on Patient Record confidentiality) so I was wondering is there anyone here who has experience with being HIPAA compliant? And is there an auditing mechanism for lustre that shows who

[lustre-discuss] "Text file busy" error

2016-04-18 Thread E.S. Rosenberg
Hi all, Several of our users ran into the "Text file busy" error described in LU-6232 (and possibly related to LU-4398 and LU-4429). Has there been any progress on this issue? I feel pretty dumb when I have to explain this issue to them and how to work around it Thanks, Eli Background for

Re: [lustre-discuss] "Text file busy" error

2016-04-18 Thread E.S. Rosenberg
I thought we fixed that problem? > > Cheers, Andreas > > > On Apr 18, 2016, at 12:28, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > > Hi all, > > Several of our users ran into the "Text file busy" error described in > LU-6232 (and

Re: [lustre-discuss] "Text file busy" error

2016-04-20 Thread E.S. Rosenberg
So what version of lustre is built in to kernel 4.5? We are switching distro soon at the very least to kernel 4.16 + userspace 2.7 and now would definitely be the best time to still decide to use a newer kernel. On Mon, Apr 18, 2016 at 10:28 PM, E.S. Rosenberg <esr+lus...@mail.hebrew.

Re: [lustre-discuss] "Text file busy" error

2016-04-21 Thread E.S. Rosenberg
up sufficiently to be moved into the main tree. > > The master and 2.8 clients work up to at least kernel 4.2 and possibly > later, and are of course up-to-date feature wise. > > Cheers, Andreas > > On Apr 20, 2016, at 04:29, E.S. Rosenberg <esr+lus...@mail.hebrew.edu > &

[lustre-discuss] reasonable runtime for e2fsck

2016-08-11 Thread E.S. Rosenberg
Sorry about spamming the list but I realize it may be better that subjects be split into threads I started e2fsck --mdsdb 6 hours ago on an MDT that is 1T in size, am I being unreasonable if I think it should have been done by now? What type of runtimes have you seen? I shudder to think how

Re: [lustre-discuss] proper procedure after MDT kernel panic

2016-08-11 Thread E.S. Rosenberg
What is the normal amount of time I should expect e2fsck --mdsdb to be running (1T MDT)? (So far it's running quite a few hours) Thanks, Eli On Thu, Aug 11, 2016 at 12:42 PM, E.S. Rosenberg <esr+lus...@mail.hebrew.edu > wrote: > Hi all, > Our MDT suffered a kernel panic (which

Re: [lustre-discuss] reasonable runtime for e2fsck

2016-08-12 Thread E.S. Rosenberg
> > Lustre Principal Architect > > Intel High Performance Data Division > > > > On 2016/08/11, 20:19, "lustre-discuss on behalf of E.S. Rosenberg" < > lustre-discuss-boun...@lists.lustre.org on behalf of > esr+lus...@mail.hebrew.edu> wrote: > > &g

[lustre-discuss] proper procedure after MDT kernel panic

2016-08-11 Thread E.S. Rosenberg
Hi all, Our MDT suffered a kernel panic (which I will post separately), the OSSs stayed alive but the MDT was out for some time while nodes still tried to interact with lustre. So I have several questions: a. what happens to processes/reading writing during such an event (if they already have

[lustre-discuss] Does an updated version exist?

2016-08-16 Thread E.S. Rosenberg
I just found this paper: http://wiki.lustre.org/images/d/da/Understanding_Lustre_Filesystem_Internals.pdf It looks interesting but it deals with lustre 1.6 so I am not sure how relevant it still is. Thanks, Eli ___ lustre-discuss mailing list

Re: [lustre-discuss] Traffic compression?

2017-02-07 Thread E.S. Rosenberg
e-discuss <lustre-discuss-boun...@lists.lustre.org> on behalf of "E.S. Rosenberg" <esr+lus...@mail.hebrew.edu> Date: Monday, February 6, 2017 at 3:25 PM To: "lustre-discuss@lists.lustre.org" <lustre-discuss@lists.lustre.org> Subject: [lustre-discuss] Traffic co

[lustre-discuss] What do you use to monitor Lustre

2017-02-07 Thread E.S. Rosenberg
As a continuation to my recent question on traffic compression/caching I was wondering what others use to monitor their Lustre performance Currently I have collectl running on all clients, the data gets shipped by filebeat to an ELK+Grafana stack. Hoping to soon also deploy collectl on the

[lustre-discuss] Traffic compression?

2017-02-06 Thread E.S. Rosenberg
We started closer monitoring of resources on our cluster and I noticed that there is sometimes a big discrepancy between the read traffic reported by Lustre and the incoming traffic reported by infiniband (which is the interace carrying the Lustre traffic). Currently I have a 4.4GB peak on Lustre

[lustre-discuss] Do 2.9 Client and 2.8 Server play nice

2017-01-24 Thread E.S. Rosenberg
Hi everyone, In the past 2.8 Client + 2.7 (or maybe it was 2.5.3) server gave us issues (servers crashing). We would like to be able to move beyond kernel 4.2 on our clients but doing a server upgrade is not really what I want to do right now. Does anyone know/is anyone running 2.9.0 clients

Re: [lustre-discuss] Do 2.9 Client and 2.8 Server play nice

2017-01-24 Thread E.S. Rosenberg
M, "lustre-discuss on behalf of E.S. Rosenberg" < > lustre-discuss-boun...@lists.lustre.org on behalf of > esr+lus...@mail.hebrew.edu> wrote: > > Hi everyone, > > In the past 2.8 Client + 2.7 (or maybe it was 2.5.3) server gave us issues > (servers crashing). > &

Re: [lustre-discuss] Using Lustre

2017-02-16 Thread E.S. Rosenberg
These are very general questions that *should* be addressed in generally available documentation but I may be wrong but I think they are. Either way to the best of my knowledge Lustre is currently only supported on Linux, the officially supported distributions are RHEL and its' derivatives. We

Re: [lustre-discuss] refresh file layout error

2016-09-26 Thread E.S. Rosenberg
re-discuss [lustre-discuss-boun...@lists.lustre.org] on behalf > of Patrick Farrell [p...@cray.com] > Sent: Friday, September 04, 2015 4:07 PM > To: lustre-discuss@lists.lustre.org; E.S. Rosenberg; Wahl, Edward > Subject: Re: [lustre-discuss] refresh file layout error > > Martin mi

Re: [lustre-discuss] Advice Lustre & ZFS.

2016-09-29 Thread E.S. Rosenberg
Isn't hw raid bounds and leagues faster then any software raid that you're ever going to be putting in? We have lustre OSTs running on RAID6 arrays and MDT/MGT on RAID1 with ldiskfs as filesystem On Thu, Sep 29, 2016 at 5:09 PM, Phill Harvey-Smith < p.harvey-sm...@warwick.ac.uk> wrote: > Hi

Re: [lustre-discuss] Lustre server/client compatibility

2016-09-29 Thread E.S. Rosenberg
I can only tell you about "the other way around", we updated our clients to 2.8.0 while the server was 2.5.3 and started having kernel panics on the MDS/MGS which was resolved after we also updated the servers to 2.8.0. The way I understand what it says on the website about compatibility 2.8.0

[lustre-discuss] Using lustre as a filesystem to boot from

2016-10-06 Thread E.S. Rosenberg
Hi all, Is anyone using lustre for network boot? (For the filesystems that are loaded after the kernel is brought in by DHCP/tftp) We are currently using NFS for this but I am wondering if lustre would allow us some more robust features (like programs not crashing on clients when they are

Re: [lustre-discuss] Does an updated version exist?

2016-09-28 Thread E.S. Rosenberg
On Sat, Aug 27, 2016 at 12:51 AM, Christopher J. Morrone wrote: > On 08/26/2016 12:48 PM, Oleg Drokin wrote: > > > (it's best to be written by third parties anyway since once you work too > much > > on some code, you take too many things for granted/think they are > obvious, >

Re: [lustre-discuss] Distributing locally....

2016-11-02 Thread E.S. Rosenberg
Re:all from the right mail address. You should be able to build debs from the source of lustre it works well for the userland binaries, as far as kernel goes we don't use debs so can't tell you. (debuild and all of that) HTH, Eli On Wed, Nov 2, 2016 at 3:40 PM, Patrick Farrell

Re: [lustre-discuss] Quick ZFS pool question?

2016-10-13 Thread E.S. Rosenberg
On Fri, Oct 7, 2016 at 9:16 AM, Xiong, Jinshan wrote: > > > On Oct 6, 2016, at 2:04 AM, Phill Harvey-Smith < > p.harvey-sm...@warwick.ac.uk> wrote: > > > > Hi all, > > > > Having tested a simple setup for lustre / zfs, I'd like to trey and > replicate on the test system

[lustre-discuss] Is anyone using a mixed local/hosted lustre solution

2016-11-29 Thread E.S. Rosenberg
Hi everyone, We are discussing extending our cluster to hosted solutions ("the cloud" for the people who like buzz words), is anyone using a lustre solution that is partially hosted? What are the experiences? Is data moving between the hosted OSTs and local OTSs according to demand? Does it

[lustre-discuss] What happens when a file grows

2017-03-30 Thread E.S. Rosenberg
Hi all, I was wondering about the following scenario: What happens when a file is created without striping and it gets larger then the available space on the OST that it is on? Does it now fail to write because adding stripes is impossible after a file exists or will the rest of the file get

Re: [lustre-discuss] lfs_migrate

2017-03-20 Thread E.S. Rosenberg
command as shown below, but please confirm via the appropriate Lustre > manual: > > lctl set_param osc.--*.active=0 > > Brett > -- > Protect Yourself Against Cybercrime > PDS Software Solutions LLC > https://www.TrustPDS.com <https://www.trustpds.com/> > > On Mo

[lustre-discuss] lfs_migrate

2017-03-20 Thread E.S. Rosenberg
In the man page it says the following: Because lfs_migrate is not yet closely integrated with the MDS, it cannot determine whether a file is currently open and/or in-use by other applications or nodes. That makes it UNSAFE for use on files that might be modified by other applications, since

[lustre-discuss] how homogenous should a lustre cluster be?

2017-03-20 Thread E.S. Rosenberg
Dear all, How homogenous/not homogenous are your clusters? At the moment all our OSS are identical and running lustrefs (lustre 2.8.0), now that I am taking one OSS offline for hardware maintenance I started wondering if I can bring it back as a ZFS OSS or would that make my lustre blow up?

Re: [lustre-discuss] What happens when a file grows

2017-04-02 Thread E.S. Rosenberg
s the size grows, which will largely > avoid this problem. > > Cheers, Andreas > > > On Mar 30, 2017, at 14:59, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > > Hi all, > > I was wondering about the following scenario: > > > &g

Re: [lustre-discuss] upgrading from 2.5.2 to 2.9

2017-04-02 Thread E.S. Rosenberg
We went 2.5.x > 2.7.0 > 2.8.0 Now I'm eyeing 2.9.0 but as far as I understood it involves going to CentOS 7.x which in and of itself I don't mind but does mean I want to test it on a test setup which I lack currently HTH, Eli On Wed, Mar 29, 2017 at 4:23 PM, Anjana Kar wrote:

Re: [lustre-discuss] client fails to mount

2017-04-24 Thread E.S. Rosenberg
On Mon, Apr 24, 2017 at 8:13 PM, Strikwerda, Ger wrote: > Hi Raj (and others), > > In which file should i state the credits/peer_credits stuff? > > Perhaps relevant config-files: > > [root@pg-gpu01 ~]# cd /etc/modprobe.d/ > > [root@pg-gpu01 modprobe.d]# ls >

Re: [lustre-discuss] Lustre and OFED

2017-07-30 Thread E.S. Rosenberg
ow you've made me unsure of what whether or not my Lustre install is using RDMA, how should I be able to tell (we are definitely using IPoIB/o2ib)? Thanks, Eli > > > > >Harald > > > > > >> > >> -Ben Evans > >> > >> From: lustre-discuss &

Re: [lustre-discuss] LUG 2017 Videos

2017-07-09 Thread E.S. Rosenberg
Great, thanks for all your hard work! On Sun, Jul 9, 2017 at 12:30 AM, Rawlings, Kenrick D wrote: > Videos from LUG 2017 are now online. Robert Ping has made them available > on YouTube and created a playlist with all of the presentation videos: > >

Re: [lustre-discuss] set OSTs read only ?

2017-07-16 Thread E.S. Rosenberg
On Thu, Jul 13, 2017 at 5:49 AM, Bob Ball wrote: > On the mgs/mgt do something like: > lctl --device -OST0019-osc-MDT deactivate > > No further files will be assigned to that OST. Reverse with "activate". > Or reboot the mgs/mdt as this is not persistent. "lctl dl" will

Re: [lustre-discuss] Lustre and OFED

2017-07-27 Thread E.S. Rosenberg
again, Eli > > --Jeff > > On Thu, Jul 27, 2017 at 4:55 PM, E.S. Rosenberg < > esr+lus...@mail.hebrew.edu> wrote: > >> Hi all, >> >> How 'needed' is OFED for Lustre? In the LUG talks it is mentioned every >> once in a while and that got me thinking a bit.

[lustre-discuss] Lustre and OFED

2017-07-27 Thread E.S. Rosenberg
Hi all, How 'needed' is OFED for Lustre? In the LUG talks it is mentioned every once in a while and that got me thinking a bit. What things are gained by installing OFED? Performance? Accurate traffic reports? Currently I am using a lustre system without OFED but our IB hardware is from the FDR

[lustre-discuss] kerberised lustre performance

2017-04-27 Thread E.S. Rosenberg
Hi everyone, I just saw Sebatians' talk at LUG 2016 (Yes I know I'm a bit behind times) and I was wondering if and how much a performance impact there is from the need to get kerberos tickets before file actions (or is it only mounting?)... https://www.youtube.com/watch?v=zo6b03zxrIs Thanks, Eli

[lustre-discuss] undelete

2017-04-27 Thread E.S. Rosenberg
A user just rm'd a big archive of theirs on lustre, any way to recover it before it gets destroyed by other writes? ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] client fails to mount

2017-04-25 Thread E.S. Rosenberg
ping from a working node. Is there a way to > verbose the Lustre logging to see more detail on the LNET level? > >> > >> It is very strange that a rebooted node is able to lctl ping compute > nodes, but fails to lctl ping metadata and storage nodes. > >> > >>

Re: [lustre-discuss] Lustre 2.10 on RHEL6.x?

2017-08-07 Thread E.S. Rosenberg
ng some kind of > support for RHEL 6.x in the 2.10 LTS releases so I think it likely that at > least support for clients will be reintroduced in a future 2.10.x > maintenance release. > > On 8/7/17, 6:34 AM, "lustre-discuss on behalf of E.S. Rosenberg" < > lustre-discuss-boun

Re: [lustre-discuss] nodes crash during ior test

2017-08-07 Thread E.S. Rosenberg
OT: Can we create a wiki page or some other form of knowledge pooling on benchmarking lustre? Right now I'm using slides from 2009 as my source which may not be ideal... http://wiki.lustre.org/images/4/40/Wednesday_shpc-2009-benchmarking.pdf OT2: Did I miss the release announcement or was 2.10

Re: [lustre-discuss] Lustre 2.10 on RHEL6.x?

2017-08-07 Thread E.S. Rosenberg
If I'm not mistaken they haven't provided RPMs for RHEL6.x since 2.9... HTH, Eli On Mon, Aug 7, 2017 at 4:33 PM, Steve Barnet wrote: > Hey all, > > I am looking to upgrade from lustre 2.8 to 2.10. I see that > there are no pre-built RPMs for 2.10 on RHEL6.x families.

Re: [lustre-discuss] seclabel

2017-05-15 Thread E.S. Rosenberg
Hi Robin, Did you ever solve this? We are considering trying root-on-lustre but that would be a deal-breaker. Thanks, Eli On Sat, Mar 4, 2017 at 9:38 AM, Dilger, Andreas wrote: > On Mar 2, 2017, at 05:55, Robin Humble > wrote: > > > >

Re: [lustre-discuss] seclabel

2017-05-16 Thread E.S. Rosenberg
> attributes. In this way Lustre supports seclabel. > In Lustre 2.9, an additional enhancement for SELinux support was landed. > > Which version are you using? > > Cheers, > Sebastien. > > > Le 15 mai 2017 à 14:39, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> a &g

[lustre-discuss] LUG 2017

2017-06-12 Thread E.S. Rosenberg
Hi all, Are the talks going to be posted to Youtube like in the past? I haven't been able to find them so far... Thanks, Eli ___ lustre-discuss mailing list lustre-discuss@lists.lustre.org http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] LUG 2017

2017-06-22 Thread E.S. Rosenberg
to save manual effort. I'll report back on this within the > next day or two. > > Thanks, > Ken > > ___ > From: Dilger, Andreas <andreas.dil...@intel.com> > Sent: Thursday, June 15, 2017 6:49 AM > To: Rawlings, Kenrick D > Cc: E.S. Rosenbe

Re: [lustre-discuss] errors 107 in syslog on client 2.8.0

2017-06-26 Thread E.S. Rosenberg
Hi Ekaterina, On Mon, Jun 26, 2017 at 11:04 AM, Ekaterina Popova wrote: > Greetings, > > We've installed lustre client 2.8.0 on Debian 8. Lustre is mounted, it > works, but there are many errors in system logs such as: > > Jun 26 06:42:46 fs0003 kernel:

Re: [lustre-discuss] lnetctl & /etc/sysconfig/lnet.conf Usage

2017-05-18 Thread E.S. Rosenberg
On Tue, May 9, 2017 at 9:07 PM, Di Natale, Giuseppe wrote: > Greetings everyone, > > > I am working on a patch to move /etc/sysconfig/lnet.conf to > /etc/lnet.conf. For those interested in the patch, it can be found at > https://review.whamcloud.com/#/c/26971/. > I am no

[lustre-discuss] State of the upstream client

2017-05-23 Thread E.S. Rosenberg
Hi all, So I may be asking for something that will anyhow be dealt with at LUG 2017 but I actually would like to know. At LUG 2016 there was a talk that sounded very hopeful that the upstream version of lustre was taking leaps and bounds to being in sync with the main Lustre project. Where are

Re: [lustre-discuss] State of the upstream client

2017-05-24 Thread E.S. Rosenberg
On Wed, May 24, 2017 at 2:23 AM, Dilger, Andreas <andreas.dil...@intel.com> wrote: > On May 23, 2017, at 11:15, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> > wrote: > > > > Hi all, > > So I may be asking for something that will anyhow be dealt with at LUG >

Re: [lustre-discuss] LUG 2017

2017-06-14 Thread E.S. Rosenberg
> > > *From: *lustre-discuss <lustre-discuss-boun...@lists.lustre.org> on > behalf of "Jones, Peter A" <peter.a.jo...@intel.com> > *Date: *Monday, June 12, 2017 at 10:39 AM > *To: *Colin Faber <colin.fa...@seagate.com>, "E.S. Rosenberg" <

Re: [lustre-discuss] lfs_migrate

2017-05-07 Thread E.S. Rosenberg
s > to the new file with "ln -f". > > That is something that has been on the todo list for lfs_migrate for a > while, so if you wanted to implement that in the script and submit a patch > to Gerrit it would be appreciated. > > Cheers, Andreas > > On May 1, 2017, at 06:59,

Re: [lustre-discuss] client fails to mount

2017-05-01 Thread E.S. Rosenberg
elp/advice/hints. Good to see how this active > community works! > Indeed. Eli > > > > > On Tue, Apr 25, 2017 at 8:17 PM, E.S. Rosenberg < > esr+lus...@mail.hebrew.edu> wrote: > >> >> >> On Tue, Apr 25, 2017 at 7:41 PM, Oucharek, Doug S < >>

Re: [lustre-discuss] lfs_migrate

2017-05-01 Thread E.S. Rosenberg
n 2.7.0. I was trying to hold out for progressive file layout to land. > > Allen > > -Original Message- > From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On > Behalf Of Dilger, Andreas > Sent: Wednesday, April 12, 2017 8:19 AM > To: Todd, Allen <a

Re: [lustre-discuss] kerberised lustre performance

2017-05-01 Thread E.S. Rosenberg
it is only to authenticate/authorize the client system and not the user that is trying to access files? Thanks, Eli > > Cheers, > Sebastien. > > > Le 27 avr. 2017 à 13:10, E.S. Rosenberg <esr+lus...@mail.hebrew.edu> a > écrit : > > > > Hi everyone, > > I

Re: [lustre-discuss] client fails to mount

2017-05-01 Thread E.S. Rosenberg
n why is unknown. Could be faulty firmware. During the > weekend the system was running fine. > Did anything specific make you look in the switch, or just after all other things were checked you checked there? > > > > > > > On Mon, May 1, 2017 at 2:18 PM, E.S. Rosenberg <

Re: [lustre-discuss] lustre-dkms-2.10.0 fails to install on kernel 4.4

2017-08-20 Thread E.S. Rosenberg
Shouldn't you use kmod with RHEL? I may be wrong but that is how we installed it On Thu, Aug 17, 2017 at 1:58 AM, Riccardo Veraldi wrote: > hello. > > I am installing lustre-dkms-2.10.0 on RHEL74 running kernel > 4.4.82-1.el7.elrepo.x86_64 > > dkms.conf:

  1   2   >