Re: [Openstack] [Sahara]Cloudera-Manager generate empty Hadoop/HDFS configration

[fuguangping]

This way solves my problem, thanks Vitaly.
 
-- Original --
From:  "Vitaly Gridnev"<vgrid...@mirantis.com>;
Date:  Mon, Aug 8, 2016 06:44 PM
To:  "fuguangping"<fuguangp...@unitedstack.com>; 
Cc:  "openstack"<openstack@lists.openstack.org>; 
Subject:  Re: [Openstack] [Sahara]Cloudera-Manager generate empty Hadoop/HDFS 
configration

 
Hello. Seems like an issue around Cloudera (not sure). I faced with something 
like that when cluster was deployed without Oozie. Could please try to deploy 
cluster with Oozie server?

On Mon, Aug 8, 2016 at 11:56 AM, fuguangping <fuguangp...@unitedstack.com> 
wrote:
Hi all,


I installed sahara on Openstack liberty version, and I succeed to deploy 
CDH-5.4 without any error. But When I login to the Cloudera-manager VM, I found 
some wrong Hadoop/HDFS configurations:


[root@int32bit-hadoop-1-cdh-master-001 hdfs]# hdfs dfs -df
Filesystem SizeUsedAvailable  Use%
file:///20061442048  5187198976  14874243072   26%


I checked the hadoop config file in /etc/hadoop/conf, it seemed that the 
Cloudera-manager fail to update config:


[root@int32bit-hadoop-1-cdh-master-001 hdfs]# cat /etc/hadoop/conf/core-site.xml
 








As showed above, the core-site.xml is empty.


Then I checked other config files, it showed the same result with empty 
configuration.


Here's my master role processes:


CLOUDERA_MANAGER
YARN_JOBHISTORY
YARN_RESOURCEMANAGER
HDFS_SECONDARYNAMENODE
HDFS_NAMENODE 


and slave role processes:


HBASE_REGIONSERVER
HDFS_DATANODE
YARN_NODEMANAGER



sahara.conf:


[DEFAULT]
debug=true
verbose = true
log_dir = /var/log/sahara
use_syslog = false
use_stderr = true
rpc_backend = rabbit
use_floating_ips= True
use_neutron = true
use_namespaces = true
use_rootwrap = true
rootwrap_command="sudo sahara-rootwrap /etc/sahara/rootwrap.conf"


plugins = vanilla,hdp,spark,cdh,ambari,fake,mapr,storm
infrastructure_engine = heat


...


Any help is greatly appreciated.


Regards,

Guangping Fu




___
 Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 Post to : openstack@lists.openstack.org
 Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
 





-- 
Best Regards,

Vitaly Gridnev,
Project Technical Lead of OpenStack DataProcessing Program (Sahara)
Mirantis, Inc___
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

Re: [Openstack] [Sahara]Cloudera-Manager generate empty Hadoop/HDFS configration

[Vitaly Gridnev]

Hello. Seems like an issue around Cloudera (not sure). I faced with
something like that when cluster was deployed without Oozie. Could please
try to deploy cluster with Oozie server?

On Mon, Aug 8, 2016 at 11:56 AM, fuguangping 
wrote:

> Hi all,
>
> I installed sahara on Openstack liberty version, and I succeed to deploy
> CDH-5.4 without any error. But When I login to the Cloudera-manager VM, I
> found some wrong Hadoop/HDFS configurations:
>
> *[root@int32bit-hadoop-1-cdh-master-001 hdfs]# hdfs dfs -df*
> *Filesystem SizeUsedAvailable  Use%*
> *file:///20061442048  5187198976  14874243072   26%*
>
> I checked the hadoop config file in /etc/hadoop/conf, it seemed that the
> Cloudera-manager fail to update config:
>
> *[root@int32bit-hadoop-1-cdh-master-001 hdfs]# cat
> /etc/hadoop/conf/core-site.xml*
> * *
>
> **
> **
>
> As showed above, the core-site.xml is empty.
>
> Then I checked other config files, it showed the same result with empty
> configuration.
>
> Here's my master role processes:
>
> CLOUDERA_MANAGER
> YARN_JOBHISTORY
> YARN_RESOURCEMANAGER
> HDFS_SECONDARYNAMENODE
> HDFS_NAMENODE
>
> and slave role processes:
>
> HBASE_REGIONSERVER
> HDFS_DATANODE
> YARN_NODEMANAGER
>
> *sahara.conf:*
>
> [DEFAULT]
> debug=true
> verbose = true
> log_dir = /var/log/sahara
> use_syslog = false
> use_stderr = true
> rpc_backend = rabbit
> use_floating_ips= True
> use_neutron = true
> use_namespaces = true
> use_rootwrap = true
> rootwrap_command="sudo sahara-rootwrap /etc/sahara/rootwrap.conf"
>
> plugins = vanilla,hdp,spark,cdh,ambari,fake,mapr,storm
> infrastructure_engine = heat
>
> ...
>
> Any help is greatly appreciated.
>
> Regards,
>
> Guangping Fu
>
> ___
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
> openstack
> Post to : openstack@lists.openstack.org
> Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/
> openstack
>
>


-- 
Best Regards,
Vitaly Gridnev,
Project Technical Lead of OpenStack DataProcessing Program (Sahara)
Mirantis, Inc
___
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack