I am setting up a filesystem for some tests, so this is not mission critical.
This is on an OS with systemd
When I create a new filesystem, named gpfstest, then mmmount it the filesystem
is logged as being mounted then immediately dismounted.
Having fought with this for several hours I now find
sclosure or distribution of the material in this
information is strictly forbidden.
Von:
gpfsug-discuss-boun...@spectrumscale.org<mailto:gpfsug-discuss-boun...@spectrumscale.org>
[mailto:gpfsug-discuss-boun...@spectrumscale.org] Im Auftrag von John Hearns
Gesendet:
I agree with Jonathan.
In my experience, if you look at why there are many small files being stored by
researchers, these are either the results of data acquisition - high speed
cameras, microscopes, or in my experience a wind tunnel. Or the images are a
sequence of images produced by a
Truong, thanks again for the response. I shall implement what is suggested in
the FAQ.
As we are in polite company I shall maintain a smiley face when mentioning
systemd
From: John Hearns
Sent: Wednesday, August 02, 2017 4:49 PM
To: 'gpfsug main discussion list' <gpfsug-disc
iscuss digest..."
Today's Topics:
1. Re: Systemd will not allow the mount of a filesystem (John Hearns)
--
Message: 1
Date: Wed, 2 Aug 2017 10:50:29 +
From: John Hearns <john.hea...@asml.com<mailto:john.he
F31KD1iuOmtSNWRW%2FnHBSPyiOsEMBd6zBUzU3588%3D=0>
My two cents.
Regards,
-Kums
From:John Hearns <john.hea...@asml.com<mailto:john.hea...@asml.com>>
To:gpfsug main discussion list
<gpfsug-discuss@spectrumscale.org<mailto:gpfsug-discuss@spectrumscale.org>&
the production storage. If anyone has a setup like this I would be interested
in chatting with you.
Is it feasible to create filesets which have higher/lower priority than others?
Thankyou for any insights or feedback
John Hearns
-- The information contained in this communication and any attachments
e never used the product but it might be able to do what you're asking.
Sent from my iPhone
On Jun 23, 2017, at 04:13, John Hearns
<john.hea...@asml.com<mailto:john.hea...@asml.com>> wrote:
I guess this is a rather ill-defined question, and I realise it will be open to
a lot of interpr
Good afternoon all, my name is John Hearns.
I am currently working with the HPC Team at ASML in the Netherlands, the market
sector is manufacturing.
-- The information contained in this communication and any attachments is
confidential and may be privileged, and is for the sole use
Andreas,
This is a stupid reply, but please bear with me.
Not exactly GPFS related, but I once managed an SGI CXFS (Clustered XFS
filesystem) setup.
We also had a new application which did post-processing One of the users
reported that a post-processing job would take about 30 minutes.
However
I am investigating setting up Quality of Service parameters on an Infiniband
fabric.
The specific goal is to reduce the bandwidth which certain servers can use,
ie if there are untested or development codes running on these servers in our
cluster then they cannot
adversely affect production
: gpfsug-discuss-boun...@spectrumscale.org
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of John Hearns
Sent: Tuesday, June 13, 2017 3:37 PM
To: gpfsug main discussion list
Subject: [gpfsug-discuss] Infiniband Quality of Service settings?
I am investigating setting up Quality
This is very probably off topic here.. I would be happy to get any responses
off list.
My question is has anyone here set up NFS re-export / proxy with nfs-ganesha?
John Hearns
-- The information contained in this communication and any attachments is
confidential and may be privileged
> The queues are steadily rising and we've seen them over 100 ...
There is definitely a song here... I see you playing the blues guitar...
I can't answer your question directly.
As I recall you are at the latest version? We recently had to update to 4.2.3.4
due to an AFM issue - where if
May I ask how to size pagepool on clients? Somehow I hear an enormous tin can
being opened behind me... and what sounds like lots of worms...
Anyway, I currently have mmhealth reporting gpfs_pagepool_small. Pagepool is
set to 1024M on clients,
and I now note the documentation says you get this
I have set up a small testbed, consisting of three nodes. Two of the nodes have
a disk which is being used as an NSD.
This is being done for some preparation for fun and games with some whizzy new
servers. The testbed has spinning drives.
I have created two NSDs and have set the data replication
for me:
mmunlinkfileset device fset -f
mmdelsnapshot device snapname -j fset
mmdelfileset device fset -f
Sandra
From:
gpfsug-discuss-boun...@spectrumscale.org<mailto:gpfsug-discuss-boun...@spectrumscale.org>
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of John Hearns
Sent:
oun...@spectrumscale.org<mailto:gpfsug-discuss-boun...@spectrumscale.org>
I had similar issue, I had to recover connection to home
From: "John Hearns" <john.hea...@asml.com<mailto:john.hea...@asml.com>
device fset -f
Sandra
From:
gpfsug-discuss-boun...@spectrumscale.org<mailto:gpfsug-discuss-boun...@spectrumscale.org>
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of John Hearns
Sent: 08 September 2017 08:26
To: gpfsug main discussion list
<gpfsug-discuss@spectrumscale.or
If I have an AFM setup where the home is located on a generic NFS share, let's
say server:/volume/share
When I come ot set this up does it make sense to run mmafmconfig on
/volume/share ?
I can mount the share as a plain old NFS mount in order to run this operation,
before I create the cache
Firmly lining myself up for a smack round the chops with a wet haddock...
I try to delete an AFM cache fileset which I create da few days ago (it has an
NFS home)
Mmdelfileset responds that :
Fileset obfuscated has 1 fileset snapshot(s).
When I try to delete the snapshot:
Snapshot
Simon,
I would appreciate a heads up on that AFM issue.
I upgraded to 4.2.3.4 this morning, to deal with an AFM issue, which is if a
remote NFS mount goes down then an asynchronous operation such as a read can be
stopped.
I must admit to being not clued up on how the efixes are distributed. I
I guess this is not news on this list, however I did see a reference to
SpectrumScale on The Register this morning,
which linked to this paper:
https://s3.amazonaws.com/quickstart-reference/ibm/spectrum/scale/latest/doc/ibm-spectrum-scale-on-the-aws-cloud.pdf
The article is here
Richard,
The date format changed at an update level.
We recently updated to 4.2.3 and when you run mmchconfig release=LATEST you are
prompted to confirm that the new log format can be used.
I guess you might not have cut all nodes over yet on your update over the
weekend?
Cut and paste from the
We have a GPFS setup which is completely Infiniband connected. Version 4.2.3.4
I see that verbsRdmaCm is set to Disabled. Reading up about this, I am
inclined to leave this disabled.
Can anyone comment on the likely effects of changing it, and if there are any
real benefits in performance?
Aaron,
The reply you just got her is absolutely the correct one.
However, its worth contributing something here. I have recently bene dealing
with the parameter verbsPorts - which is a list of the interfaces which verbs
should use. I found on our cluyster it was set to use dual ports for all
this node?
John Hearns
-- The information contained in this communication and any attachments is
confidential and may be privileged, and is for the sole use of the intended
recipient(s). Any unauthorized review, use, disclosure or distribution is
prohibited. Unless explicitly stated otherwise i
I have downloaded several versions of Spectrum Scale 4.X from the MyIBM site.
For the life of me I cannot summon the spell needed to put Spectrum Scale 5 on
my orders list.
Can some kindly witch give me the incantation please?
I would like to install on a test cluster, as the wisdom of the mages
Kerner, Senior Storage Engineer
Storage Enabling Technologies
National Center for Supercomputing Applications University of Illinois,
Urbana-Champaign
On 11/7/17, John Hearns <john.hea...@asml.com> wrote:
> I am looking for anyone with experience of using Spectrum Scale with
> nvme de
I am looking for anyone with experience of using Spectrum Scale with nvme
devices.
I could use an offline brain dump...
The specific issue I have is with the nsd device discovery and the naming.
Before anyone replies, I am gettign excellent support from IBM and have been
directed to the
Thnkyou both. I tapped on the door of Fix Central with my wand, and now have
the eye of newt, wing of bat and a Spectrum Scale 5 installer.
From: gpfsug-discuss-boun...@spectrumscale.org
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Simon Thompson
(IT Research Support)
Sent:
Ed,
This is not a perfect answer. You need to look at policies for this. I have
been doing something similar recently.
Something like:
RULE 'list_file' EXTERNAL LIST 'all-files' EXEC
'/var/mmfs/etc/mmpolicyExec-list'
RULE 'listall' list 'all-files'
SHOW( varchar(kb_allocated) || ' ' ||
Gesellschaft: Ehningen / Registergericht: Amtsgericht Stuttgart, HRB
14562 WEEE-Reg.-Nr. DE 99369940
From: John Hearns <john.hea...@asml.com<mailto:john.hea...@asml.com>>
To:gpfsug main discussion list
<gpfsug-discuss@spectrumscale.org<mailto:gpfsug-di
I am having problems with GPFS servers running out of memory.
We have an open PMR for this, however if anyone has seen this or has any ideas
I would be grateful for a heads up.
Servers have 128 Gbytes f RAM, kernel 2.6.32-573.18.1.el6.x86_64, GPFS
version 4.2.3.4
In the latest incident the
Hello Egonle. I looked at this scenario recently (H Mark!)
Maybe you could send me an email off-list?
From: gpfsug-discuss-boun...@spectrumscale.org
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Marc A Kaplan
Sent: Sunday, January 28, 2018 4:54 PM
To: gpfsug main discussion
I am sure this is a known behavior and I am going to feel very foolish in a few
minutes...
We often see this behavior on a GPFS filesystem.
I log into a client.
[jhearns@pn715 test]$ ls -la ../
ls: cannot access ../..: Permission denied
total 160
drwx-- 4 jhearns root 4096 Feb 14 09:46 .
Simon, Kevin
Thankyou for your responses.
Simon, indeed we do see this behavior on AFM filesets which have an 'old' view
- and we can watch the AFM fileset change as the information is updated.
In this case, this filesystem is not involved with AFM.
I changed the locking semantics from NFSv4
Simon, Kevin
Thankyou for your responses.
Simon, indeed we do see this behavior on AFM filesets which have an ‘old’ view
– and we can watch the AFM fileset change as the information is updated.
In this case, this filesystem is not involved with AFM.
I Changed the locking semantics from NFSv4
Would someone else kindly go to this webpage:
https://www.ibm.com/support/home/product/1060/IBM%20Spectrum%20Scale
Click on Downloads then confirm you get a choice of two identical Spectrum
Scale products.
Neither of which has a version fix level you can select on the check box below.
I
Firstly, let me apologise for not thanking people who hav ereplied to me on
this list with help.
I have indeed replied and thanked you - however the list software has taken a
dislike to my email address.
I am currently on the myibm support site. I am looking for a specific APAR on
Spectrum
I would dearly like to use mmfind in a project I am working on (version
4.2.3.4 at the moment)
mmfind /hpc/bscratch -type f work fine
mmfind /hpc/bscratch -type f -exec /bin/ls {}\ ; crashes and burns
I know there are supposed to be problems with exec and mmfind, and
Ps. Her is how to get mmfind to run some operation on the files it finds.
(I installed mmfind in /usr/local/bin)
I find this very hacky, though I suppose it is idiomatic bash
#!/bin/bash
while read filename
do
echo -n $filename " "
done <<< "`/usr/local/bin/mmfind /hpc/bscratch -type f`"
eam.
From: John Hearns <john.hea...@asml.com<mailto:john.hea...@asml.com>>
To:gpfsug main discussion list
<gpfsug-discuss@spectrumscale.org<mailto:gpfsug-discuss@spectrumscale.org>>
Date:02/21/2018 06:45 PM
Subject:[gpfsug-discuss] mmfind w
Lukas,
It looks like you are proposing a setup which uses your compute servers as
storage servers also?
* I'm thinking about the following setup:
~ 60 nodes, each with two enterprise NVMe SSDs, FDR IB interconnected
There is nothing wrong with this concept, for instance see
Following up from my previous email (I should reply to that email I know)
What we really want to achieve is changing the FQDN of an existing server.
The server will be reinstalled with an updated OS (RHEL 6---> RHEL 7)
During the move we wish to change the domain name of the server.
So we will be
, and to seek out beer. I am sure IBMers can point you
all in the correct direction for that.
From: John Hearns
Sent: Monday, April 09, 2018 4:37 PM
To: gpfsug main discussion list <gpfsug-discuss@spectrumscale.org>
Subject: Installer cannot find libdbgwrapper70.so
I am running the Spectru
Fbeel Tnergu. Pnaabg nqq nalguvta hfrshy urer.
-Original Message-
From: gpfsug-discuss-boun...@spectrumscale.org
[mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Gareth Horton
Sent: Monday, March 26, 2018 1:25 PM
To: gpfsug-discuss@spectrumscale.org
Subject: Re:
47 matches
Mail list logo
