Re: [ceph-users] Hadoop on Ceph error

2018-01-18 Thread Bishoy Mikhael
here is my core-site.xml file fs.default.name ceph://host01:6789/ fs.defaultFS ceph://host01:6789 io.file.buffer.size 131072 hadoop.tmp.dir /mnt/hadoop/hadoop_tmp ceph.conf.file /etc/ceph/ceph.conf

Re: [ceph-users] Hadoop on Ceph error

2018-01-18 Thread Jean-Charles Lopez
Hi, What’s your Hadoop xml config file like? Have you checked the permissions of the ceph.conf and keyring file? In case all good may be consider setting debug option in ceph.conf.options with Hadoop xml config file JC > On Jan 18, 2018, at 16:55, Bishoy Mikhael wrote: > > Hi All, > > I'v

[ceph-users] Hadoop on Ceph error

2018-01-18 Thread Bishoy Mikhael
Hi All, I've a tiny Ceph 12.2.2 cluster setup with three nodes, 17 OSDs, 3 MON,MDS,MGR (spanned across the three nodes). Hadoop 2.7.3 is configured on only one of the three nodes as follows: - Hadoop binaries was extracted to /opt/hadoop/bin/ - Hadoop config files where at /opt/hadoop/etc/hadoop/

Re: [ceph-users] hadoop on ceph

2015-08-04 Thread jingxia....@baifendian.com
In hadoop 2.6 the namenode must be on , but hadoop 1.1.2 the namenode is down is ok. below is the configuration. fs.default.name ceph://ceph0:6789/ in hadoop2.6 the raise exceptions like this: 15/07/28 11:26:55 INFO mapreduce.Cluster: Failed to use org.apache.hadoop.mapred.Y

Re: [ceph-users] hadoop on ceph

2015-07-28 Thread Gregory Farnum
On Mon, Jul 27, 2015 at 6:34 PM, Patrick McGarry wrote: > Moving this to the ceph-user list where it has a better chance of > being answered. > > > > On Mon, Jul 27, 2015 at 5:35 AM, jingxia@baifendian.com > wrote: >> Dear , >> I have questions to ask. >> The doc says hadoop on ceph but requi

Re: [ceph-users] hadoop on ceph

2015-07-27 Thread Patrick McGarry
Moving this to the ceph-user list where it has a better chance of being answered. On Mon, Jul 27, 2015 at 5:35 AM, jingxia@baifendian.com wrote: > Dear , > I have questions to ask. > The doc says hadoop on ceph but requires Hadoop 1.1.X stable series > I want to know if CephFS Hadoop plugin