Advanced edition uses exactly the same RPMs as the standard edition and indeed so does Express edition.
The only difference in terms of RPMs is that Advanced edition includes extra RPMs (and Express less).
Daniel
Dr.Dani
It looks like no one has attempted to answer this, so I will step in to start the conversation.
There are two issues when considering how many services to run on the same nodes - in this case the NSD servers.
1. Performance.
Spectrum Scale's (nee GPFS) core differentiator is performance. The mo
Tomasz,
There is no meaningful maximum size of a GPFS filesystem as it is at least a million times bigger than the biggest filesystem (of any type) in the world today. Current limit is 633825300114114700748351602688 bytes
The largest tested to date according to the FAQ is a mere 18 Petabytes, I
Spectrum scale already supports external tiering to say tape.
http://www.zurich.ibm.com/sto/systems/bigdata.html
Here the GPFS policy engine is used to select which files to migrate based on say the filesize or date of last access.
The file metadata remains in the filesystem and so 'ls -l' etc st
Hi Paul,
I guess you didn't mean to send that email to the whole list?
Daniel
Dr.Daniel KidgerNo. 1 The Square,
I work for IBM and in particular support OEMs and other Business Partners
I am not sure if Simon is using try true IBM speak here as any OEM
purchase of Spectrum Scale inherently has tin included, be it from DDN,
Seagate, Lenovo, etc.
Remember there are 4 main ways to buy Spectrum Scale:
1. as
Richard,
Sounds unusual.
When you registered your IBM ID for login - did you choose your country
from the drop-down list as North Korea ? ;-)
Daniel
Dr.Daniel Kidger
No. 1 The Square,
Technical Specialist SDI (formerly Platform Computing)
Temple Quay,
Bristol BS1 6DG
Mobile:
+44-07818 522
aniel
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution
Fortunately the licences issue is simple.
The rules state that the sum of licences of all VMs on a node is capped at the
number of sockets that server has.
So if you have 9 VMs using a mixture of different core counts each then you do
not need more than 2 client licences if all hosted on a stand
obvious a security risk as allowing a backdoor to an interactive ksh shell as root.
Daniel
Dr Daniel
pfs.gpl as an rpm even if / etc/debian_version exists as was my case (since it *was* a Debain system).
Daniel
Gaurang,
Nice blog .. I must try and find some time to set a system up and try it for
myself when I am not travelling ( which seems to be all the time at the moment).
Daniel
IBM Spectrum Storage Software
+44 (0)7818 522266
Sent from my iPad using IBM Verse
On 22 Jun 2016,
Does anyone in the field have much experience with using file heat for
migration, whether for object or more generically? In particular using policies
to move files both ways dependant on recent usage patterns.
And also if you ever move files to colder storage without necessarily
waiting
Informally I hear that we a still a couple of weeks away.
Daniel
IBM Spectrum Storage Software
+44 (0)7818 522266
Sent from my iPad using IBM Verse
On 29 Jun 2016, 18:19:07, s.j.thomp...@bham.ac.uk wrote:
From: s.j.thomp...@bham.ac.uk
To: gpfsug-discuss@spectrumscale.org
Cc:
Dat
n false;+ }+ TALLOC_FREE(smb_fname.base_name);+ return true;+}+
Daniel
Dr Daniel KidgerIBM
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-07818 522 266 daniel.kid...@uk.ibm.com
Yes they have been re arranged.
My observation is that the Admin and Advanced Admin have merged into one
PDFs,
and the DMAPI manual is now a chapter of the new Programming guide (along
with the complete set of man pages which have moved out of the Admin guide).
Table 3 on page 26
The other 'Exception' is when a rule is used to convert a 1 way replicated file
to 2 way, or when only one failure group is up due to HW problems. It that case
the (re-replication) is done by whatever nodes are used for the rule or
command-line, which may include an NSD server.
Daniel
IBM
Aaron,
GNR is a key differentiator for IBM's (and Lenovo's) Storage hardware
appliance.
ESS and GSS are otherwise commodity storage arrays connected to commodity
NSD servers, albeit with a high degree of tuning and rigorous testing and
validation.
This competes with equivalent DD
determines which '3' out of 4 failure groups, a particular block is written to.
Daniel
I wholeheartedly agree with Sven here.The Request for Engineering (RFE) is a powerful feedback mechanism to help steer the product's direction.On the topic of GNR, the (free) alternative to compete with GNR is ZFS. Although not yet used in any production GPFS system, it is widely used under Lustre.
erience?
Daniel
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales
v
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solu
that restricts simply downlaod a fresh copy every few months?
Daniel
Dr Daniel Kidger
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266
Great papers !
@Yuri: do you want to add entries at the top of that page to:
a) help people find those papers, and
b) make it more obvious that this page is not obsolete and no longer
maintained.
Daniel
IBM Spectrum Storage Software
+44 (0)7818 522266
Sent f
o extra software cost.
Daniel
Dr Daniel KidgerIBM Technical Sales SpecialistS
disk.
Daniel
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266 daniel.ki
Valdis wrote:
Keep in mind that if you have multiple NSD servers in the cluster, there
is *no* guarantee that the names for a device will be consistent across
the servers, or across reboots. And when multipath is involved, you may
have 4 or 8 or even more names for the same device
On the subject of using zvols for software Raid/ replication, can ask as a
quick poll, how many people are doing this?
And any feedback on stability, tuning and performance?
Daniel
IBM Technical Presales
> On 10 Mar 2017, at 22:44, Aaron Knister wrote:
>
> Those look like zvol's. Out of curios
I often hear requests for Spectrum Scale on ARM.
It is always for clients. In general people are happy to have their NSD
servers, etc. on x86 or POWER.
It is also an anomaly that for a HPC cluster, IBM supports LSF on ARM v7/v8 but
not Spectrum Scale on ARM.
Daniel
Daniel Kidger
Technical
hard-to-fix way.
Daniel
Dr Daniel KidgerIBM Technical Sales Specialist
Well George is not the only one to have replied to the list with a one to one
message.
😀
Remember folks, this mailing list has a *lot* of people on it.
Hope my message is last that forgets who is in the 'To' field.
Daniel
Daniel Kidger
Technical Sales Specialist, IBM UK
IBM Spectr
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266 daniel.kid...@uk.ibm.com
/com.ibm.spectrum.scale.v4r23.doc/bl1adv_dpauditlogging.htm
Daniel
Dr Daniel KidgerIBM
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales
using a TCT in more
than the simplest use case of a single small isolated x86 cluster?
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+ 44-(0)7818 522 266
daniel.kid...@uk.ibm.com
> On 6 Nov 2017, at 09:20, Chase, Peter wrote:
>
&
block could be 10th in a a block that already
has 9 used. Later on, the file grows to need an 11th subblock and so on. So at
what point does this growing file at 8MB occupy all 32 sunblocks of 8 full
blocks?
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266 daniel.kid...@uk.ibm.com
I understand that this near linear performance is one of the differentiators of
Spectrum Scale.
Others with more field experience than me might want to comment on how Lustre
and other distributed filesystem perform as they approaches near full capacity.
Daniel
Dr Daniel Kidger
when designing for the long term usage of the
filesystem. But this is due to the distributed location of the blocks not how
full the filesystem is.
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+ 44-(0)7818 522 266
daniel.kid
If you think about it, if a CES node opens a file for an NFS client and then a
client in a remote MC mounted cluster opens the same file then that MC client
node needs to talk to that CES node to negotiate the lock.
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
point, and indeed mmcrfileset doesn’t set the mount
point either.
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+ 44-(0)7818 522 266
daniel.kid...@uk.ibm.com
> On 3 Jan 2018, at 10:38, Sobey, Richard A wrote:
>
&g
me from that).
>
> Ultimately though I cannot change the mount point of the fileset without
> mmunlink / mmlink, right?
>
> Thanks
> Richard
>
>
> From: gpfsug-discuss-boun...@spectrumscale.org
> [mailto:gpfsug-discuss-boun...@spectrumscale.org] On Behalf Of Daniel
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266 daniel.kid
do?
Daniel
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales
course and IBM does not cross reference products when they change names very well).
Daniel
Dr Daniel
I tried a dictionary attack, but “nalguvta” was a typo. Should have been:
“Fbeel Tnergu. Pnaabg nqq nalguvat hfrshy urer” ?
John: anythign (sic) to add?
:-)
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+44-(0)7818
?openform&seminar=B223GVES
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+44-(0)7818 522 266
daniel.kid...@uk.ibm.com
> On 3 Apr 2018, at 04:56, Secretary GPFS UG wrote:
>
> Hi Richard,
>
valid.
Daniel
Dr Daniel Kidger
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266
One additional point to consider is what happens on a hardware failure.
eg. If you have two NSD servers that are both CES servers and one fails, then
there is a double-failure at exactly the same point in time.
Daniel
Dr Daniel Kidger
IBM Technical Sales
onally ordinary
NSD servers are merely ‘routers’ and as such are often using low spec cpus
which may not be fast enough for the extra load?
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+ 44-(0)7818 522 266
daniel.kid...@uk.ibm.com
>
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined Solution Sales+44-(0)7818 522 266 daniel.kid...@uk.ibm.com
Kieran,
You can also add x86 nodes to run CES and Ganesha NFS.
Either in the same cluster or perhaps neater in a separate multi-cluster Mount.
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+44-(0)7818 522 266
le ugly?
Daniel
Dr Daniel KidgerIBM Technical Sales SpecialistSoftware Defined
nodes are
naturally big and fast (as well as benefitting from parallel threads working
together on the GNR).
Daniel
Dr Daniel Kidger
IBM Technical Sales Specialist
Software Defined Solution Sales
+44-(0)7818 522 266
daniel.kid...@uk.ibm.com
>
Henrik,
Note too that Spectrum Scale 4.1.x being almost 4 years old is close to retirement :
GA. 19-Jun-2015, 215-147
EOM. 19-Jan-2018, 917-114
EOS. 30-Apr-2019, 917-114
ref. https://www-01.ibm.com/software/support/lifecycleapp/PLCDetail.wss?q45=G222117W12805R88
Daniel
___
I agree with Simon,
That character before the p is not 2D. aka the dash or minus sign, but E2 80 93 which is unicode for the en dash
https://www.utf8-chartable.de/unicode-utf8-table.pl?start=8192&number=128
cut'n'paste from a MS-Word document strikes again. :-)
Daniel
Alvise,
Also note that that DeveloperWorks page was maintained by Scott Faddon. He has since left IBM and that page has unfortunately not been updated for almost 2 years. :-(
This page predates the current version 5.x of SpectrumScale which has been available since the beginning of 2018.
In v
can explain the exact
restrictions.
Daniel
_
Daniel Kidger
IBM Technical Sales Specialist
Spectrum Scale, Spectrum NAS and IBM Cloud Object Store
+44-(0)7818 522 266
daniel.kid...@uk.ibm.com
On 3 Apr 2019, at 19:47
3.19.Regards,Richard Rupp, Sales Specialist, Phone: 1-347-510-6746"Daniel Kidger" ---04/06/2019 10:12:12 AM---There is a non-technical issue you may need to consider. IBM has set licensing rules about mixing inFrom: "Daniel Kidger" To: "gpfsug main discussion list" Dat
9 at 21:38, Daniel Kidger <daniel.kid...@uk.ibm.com> wrote:
Yes I am aware of the FAQ, and it particular Q13.17 which says:
No, systems from OEM vendors are considered distinct products even when they embed IBM Spectrum Scale. They cannot be part of the same cluster as IBM licenses.
But if t
Remember though that HPSS is an archiving solution much more than it is a backup solution.
Also it still has a very high entry point to justfy using it - I would suggest over 20 PetaBytes as a minimum.
Having said that HPSS is fully supported by IBM and used by most of the very largest GPFS sites.
Alexander,
Can you then confirm then that the inodes in the snapshot will now point to fewer but compressed blocks ?
Daniel
_Daniel Kidger
IBM Technical Sales Specialist
Spectrum Scale, Spectrum NAS and IBM Cloud Object Store+44-(0)7818 52
ion & Communication TechnologiesImperial College London,South Kensington Campus London, SW7 2AZT: 07712388129E: b.cre...@imperial.ac.ukW: www.imperial.ac.uk/ict/rcs
@imperialRCS @imperialRSE
From: gpfsug-discuss-boun...@spectrumscale.org on behalf of Daniel Kidger
standard 4U60 shelves daisy-chained together?
Daniel
_
Daniel Kidger
IBM Technical Sales Specialist
Spectrum Scale, Spectrum Discover and IBM Cloud Object Store
+44-(0)7818 522 266
daniel.kid...@uk.ibm.com
> On 5 Dec 2
I can confirm that I also find that it is v 4.2.2
Additionally the license terns that you click to accept say that it is limited to 90 days use, and that the downloading person has to delete all copies with 10 days of the end of this period.
Hopefully it is a simple bug on the https://www.ibm.c
The migration rule is only for modifying files without changing their filename or which directory they are in, so changing things like:
compressionreplication (eg 1way to 2way)physical storage eg flash to diskstubbing a file to move content to external storage such a
It is worth noting that Independent Filesets are a relatively recent addition to Spectrum Scale, compared to Dependant Filesets. They havesolved some of the limitations of the former.
My view would be to always use Independent FIlesets unless there is a particular reason to use Dependant ones.
I think you need to think about which node the file is being decompressed on (and if that node has plenty of space in the page pool.)
iirc mmchattr works on one of the 'manager' nodes not necessarily the node you typed the command on?
Daniel
___
To me, it feels like you need to do the search the other way around.
Firstly, from the target of say "4 weekdays ago", work out how many real days ago that was.
Then use that as a criteria in mmfind or mmapplypolicy.
Daniel
_Daniel Kidge
73 matches
Mail list logo
