Thanks, Ronny, for the suggestion on adapting the cluster to Ceph.
Youssef Eldakar
Bibliotheca Alexandrina
From: ceph-users [ceph-users-boun...@lists.ceph.com] on behalf of Ronny Aasen
[ronny+ceph-us...@aasen.cx]
Sent: Thursday, March 16, 2017 19:10
I found this
http://ceph.com/geen-categorie/ceph-osd-where-is-my-data/
which leads me to think I can perhaps directly process the files on the OSD by
going to the /var/lib/ceph/osd directory.
Would that make sense?
Youssef Eldakar
Bibliotheca Alexandrina
From
. This obviously has been requiring a good deal of
manual work and as such has not been very effective.
Given that description, do you feel Ceph could be an appropriate choice?
Thanks once again for the reply.
Youssef Eldakar
Bibliotheca Alexandrina
From: ceph-users
in the cluster:
dsh -Mca 'find /{0..3}/items -name \*.warc.gz | xargs md5sum
>/tmp/$HOSTNAME.md5sum'
And that nicely allows each node to process its own files using the local CPU.
Would this scenario still be possible where Ceph is managing the storage?
Thanks in advance for any feedback.
Yous
