Hi Sahara,
I'm a new bird here for both sahara & HDP.
I just installed a total fresh all-in-one Openstack environment by devstack,
and want to build my first Hadoop cluster.
Limited to my knowledge about Hadoop and HDP, I hope to build a cluster as
small as I can.
All things are build based on plugin HDP 2.0.6.
1. I created 2 node-group templates:
a. Master
NAMENODE
ZOOKEEPER_SERVER
AMBARI_SERVER
HISTORYSERVER
RESOURCEMANAGER
b. slave
NODEMANAGER
2. I create a cluster template which include the above 2 node groups.
3. I launched the cluster in Horizon, and started waiting...
4. The cluster stalled at status "Configuring".
Anyone know why this happened ??
Thanks.
-chen
I did a little check, as "nova list" showed:
nova list
+--------------------------------------+-----------------------+--------+------------+-------------+--------------------------------+
| ID | Name | Status |
Task State | Power State | Networks |
+--------------------------------------+-----------------------+--------+------------+-------------+--------------------------------+
| f2e27b00-858e-4c71-822d-abc1bd35b0d4 | kk-basic-master-001 | ACTIVE | -
| Running | private=10.0.0.4, 192.169.14.3 |
| e757756c-7d53-49e0-91b1-af7e67b85f03 | kk-smallest-slave-001 | ACTIVE | -
| Running | private=10.0.0.5, 192.169.14.4 |
+--------------------------------------+-----------------------+--------+------------+-------------+--------------------------------+
Instances were started successfully and network is working well too.
The sahara log keeps printing:
2015-02-28 16:30:27.908 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001]
Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command
/opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:27.909 DEBUG sahara.utils.ssh_remote [-] cached HTTP session
for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450>
from (pid=28144) _get_http_client
/opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:27.910 DEBUG urllib3.util.retry [-] Converted retries value: 0
-> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144)
from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:27.911 INFO urllib3.connectionpool [-] Resetting dropped
connection: proxy-socks.sc.intel.com
2015-02-28 16:30:28.216 DEBUG urllib3.connectionpool [-] "GET
http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144)
_make_request
/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:28.219 INFO
sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect
to ambari server ...
2015-02-28 16:30:32.277 DEBUG sahara.openstack.common.periodic_task [-] Running
periodic task SaharaPeriodicTasks.terminate_unneeded_transient_clusters from
(pid=28144) run_periodic_tasks
/opt/stack/sahara/sahara/openstack/common/periodic_task.py:219
2015-02-28 16:30:32.277 DEBUG sahara.service.periodic [-] Terminating unneeded
transient clusters from (pid=28144) terminate_unneeded_transient_clusters
/opt/stack/sahara/sahara/service/periodic.py:131
2015-02-28 16:30:32.316 DEBUG sahara.openstack.common.loopingcall [-] Dynamic
looping call <bound method SaharaPeriodicTasks.run_periodic_tasks of
<sahara.service.periodic.SaharaPeriodicTasks object at 0x7f3edb415950>>
sleeping for 9.96 seconds from (pid=28144) _inner
/opt/stack/sahara/sahara/openstack/common/loopingcall.py:132
2015-02-28 16:30:33.278 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001]
Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command
/opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:33.279 DEBUG sahara.utils.ssh_remote [-] cached HTTP session
for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450>
from (pid=28144) _get_http_client
/opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:33.280 DEBUG urllib3.util.retry [-] Converted retries value: 0
-> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144)
from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:33.281 INFO urllib3.connectionpool [-] Resetting dropped
connection: proxy-socks.sc.intel.com
2015-02-28 16:30:33.573 DEBUG urllib3.connectionpool [-] "GET
http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144)
_make_request
/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:33.574 INFO
sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect
to ambari server ...
2015-02-28 16:30:38.634 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001]
Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command
/opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:38.634 DEBUG sahara.utils.ssh_remote [-] cached HTTP session
for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450>
from (pid=28144) _get_http_client
/opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:38.635 DEBUG urllib3.util.retry [-] Converted retries value: 0
-> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144)
from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:38.636 INFO urllib3.connectionpool [-] Resetting dropped
connection: proxy-socks.sc.intel.com
2015-02-28 16:30:38.927 DEBUG urllib3.connectionpool [-] "GET
http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144)
_make_request
/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:38.929 INFO
sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect
to ambari server ...
2015-02-28 16:30:42.280 DEBUG sahara.openstack.common.periodic_task [-] Running
periodic task SaharaPeriodicTasks.update_job_statuses from (pid=28144)
run_periodic_tasks
/opt/stack/sahara/sahara/openstack/common/periodic_task.py:219
2015-02-28 16:30:42.282 DEBUG sahara.service.periodic [-] Updating job statuses
from (pid=28144) update_job_statuses
/opt/stack/sahara/sahara/service/periodic.py:123
2015-02-28 16:30:42.290 DEBUG sahara.openstack.common.loopingcall [-] Dynamic
looping call <bound method SaharaPeriodicTasks.run_periodic_tasks of
<sahara.service.periodic.SaharaPeriodicTasks object at 0x7f3edb415950>>
sleeping for 45.00 seconds from (pid=28144) _inner
/opt/stack/sahara/sahara/openstack/common/loopingcall.py:132
2015-02-28 16:30:43.995 DEBUG sahara.utils.ssh_remote [-] [kk-basic-master-001]
Retrieving HTTP session for 192.169.14.3:8080 from (pid=28144) _log_command
/opt/stack/sahara/sahara/utils/ssh_remote.py:759
2015-02-28 16:30:43.995 DEBUG sahara.utils.ssh_remote [-] cached HTTP session
for 192.169.14.3:8080 is <requests.sessions.Session object at 0x7f3ed9aa9450>
from (pid=28144) _get_http_client
/opt/stack/sahara/sahara/utils/ssh_remote.py:200
2015-02-28 16:30:43.999 DEBUG urllib3.util.retry [-] Converted retries value: 0
-> Retry(total=0, connect=None, read=None, redirect=0) from (pid=28144)
from_int /usr/local/lib/python2.7/dist-packages/urllib3/util/retry.py:155
2015-02-28 16:30:44.000 INFO urllib3.connectionpool [-] Resetting dropped
connection: proxy-socks.sc.intel.com
2015-02-28 16:30:44.289 DEBUG urllib3.connectionpool [-] "GET
http://192.169.14.3:8080/api/v1/hosts HTTP/1.1" 503 784 from (pid=28144)
_make_request
/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:368
2015-02-28 16:30:44.290 INFO
sahara.plugins.hdp.versions.version_2_0_6.versionhandler [-] Waiting to connect
to ambari server ...
"proxy-socks.sc.intel.com" is the proxy I'm using on the physical machine, but
I didn't know why sahara would use it.
__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [email protected]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev