Hi Robert,
i refered to your posting i assume ^_^
Note the following is from what I know, Since i did not had any change to work
with GPFS in the last 2 years my knowledge will be outdated.
The current GPFS tiering options depending on the DMAPI which i am not a big fan
since it had in the
Without getting into a whole lot of detail - The service is not based around
the existing DMAPI interface. This service uses the Cluster Export Service
(CES) nodes in GPFS 4.2 to perform the work. There is a process running on
these nodes that’s configured to use a cloud provider and it
Simon is right - we are using DMAPI to tier off to WOS our object store and to
StrongBox NAS-fronted tape.
We are very interested in the new “lightweight” protocols as they may allow us
to do stuff that DMAPI makes hard - like tiering off to more than one DMAPI
service from a single
>Er no the DMAPI was only ever required for HSM as far as I am aware. Now
>while HSM is a form of tiering, in GPFS parlance tiering generally
>referred to disk pools of varying "speeds", with file placement and
>movement being done via the policy engine.
DMAPI can do more than just HSM though. I
Spectrum scale already supports external tiering to say tape.
http://www.zurich.ibm.com/sto/systems/bigdata.html
Here the GPFS policy engine is used to select which files to migrate based on say the filesize or date of last access.
The file metadata remains in the filesystem and so 'ls -l' etc
Hi Hajo
I was involved in a closed beta of this service. You can read a bit more about
it from the developer at this IBM DevelperWorks posting:
https://www.ibm.com/developerworks/community/forums/html/topic?id=e9a43f16-4ab2-4edf-a253-83931840895e=25
If this doesn’t cover your questions, let me
Hi
i saw in the GPFS Forum somebody mentioning IBM Spectrum Scale transparent cloud
tiering
http://www.ibm.com/developerworks/servicemanagement/tc/gpfs/evaluate.html
Thus the question. Does somebody knows how that - the tiering into clould
services - is technical done and what limitations
Take a look at the new Transparent Cloud Tiering – it works with S3 and on-prem
cloud as well – we have a local swift cluster and it’s works perfectly.
Bob Oesterlin
Sr Storage Engineer, Nuance HPC Grid
From:
Since this official IBM website (pre)announces transparent cloud tiering
...
http://www.ibm.com/developerworks/servicemanagement/tc/gpfs/evaluate.html?ce=sm6024=IBMSocial=M16402YW=h=BSYS=blog=casyst=us_tact=M16402YW
And since Oesterlin mentioned Cluster Export Service (CES), please allow
me to
we wrapped something base on zookeeper around rsync to be able to use
rsync in parallel by splitting the path in subdirectories, and
distribute those
https://github.com/hpcugent/vsc-zk
works really well if the number of files in directories is somewhat
balanced. we use it to rsync some gpfs
10 matches
Mail list logo
