Hi all,
trying to test ceph with hadoop without success.
I deployed the ceph cluster using ceph-deploy.
Hadoop - 1.1.3
ceph version 0.67.3
Does anyone had success on making this work?
ceph.conf
[global]
fsid = d9ca74d0-d9f4-436d-92de-762af67c6534
mon initial members = hyrax1, hyrax2, hyrax3, hyrax4, hyrax5, hyrax6,
hyrax7, hyrax8, hyrax9
mon host =
10.10.10.10,10.10.10.12,10.10.10.15,10.10.10.13,10.10.10.16,10.10.10.14,10.1
0.10.18,10.10.10.17,10.10.10.11
auth supported = cephx
osd journal size = 1024
filestore xattr use omap = true
<property>
<name>fs.hdfs.impl</name>
<value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
</property>
<property>
<name>fs.ceph.impl</name>
<value>org.apache.hadoop.fs.ceph.CephFileSystem</value>
</property>
<property>
<name>fs.default.name</name>
<value>ceph://hyrax1:6789/</value>
</property>
<property>
<name>ceph.conf.file</name>
<value>/hyrax/hadoop-ceph/ceph/ceph.conf</value>
</property>
<property>
<name>ceph.root.dir</name>
<value>/mnt/mycephfs</value>
</property>
<property>
<name>ceph.mon.address</name>
<value>hyrax1:6789</value>
</property>
<property>
<name>ceph.auth.keyfile</name>
<value>/hyrax/hadoop-ceph/ceph/admin.secret</value>
</property>
<property>
<name>ceph.auth.keyring</name>
<value>/hyrax/hadoop-ceph/ceph/ceph.mon.keyring</value>
</property>
Trace:
2013-09-23 00:00:02,407 ERROR
org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
as:ubuntu cause:java.io.FileNotFoundException:
2013-09-23 00:00:02,407 INFO org.apache.hadoop.mapred.JobTracker: Problem
connecting to HDFS Namenode... re-trying
java.io.FileNotFoundException:
at com.ceph.fs.CephMount.native_ceph_mount(Native Method)
at com.ceph.fs.CephMount.mount(CephMount.java:154)
at
org.apache.hadoop.fs.ceph.CephTalker.initialize(CephTalker.java:103)
at
org.apache.hadoop.fs.ceph.CephFileSystem.initialize(CephFileSystem.java:98)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1411)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1429)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:1908)
at org.apache.hadoop.mapred.JobTracker$2.run(JobTracker.java:1906)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.ja
va:1149)
at
org.apache.hadoop.mapred.JobTracker.initializeFilesystem(JobTracker.java:190
6)
at
org.apache.hadoop.mapred.JobTracker.offerService(JobTracker.java:2324)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4792)
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
