check 8088 ui - how many cores and memory available - how many slaves are active
run teragen or pi from hadoop examples to make sure that yarn works On Tue, Mar 29, 2016 at 1:25 PM, Surendra , Manchikanti < surendra.manchika...@gmail.com> wrote: > Hi Vineeth, > > Can you please check resource(RAM,Cores) availability in your local > cluster, And change accordingly. > > Regards, > Surendra M > > -- Surendra Manchikanti > > On Tue, Mar 29, 2016 at 1:15 PM, Vineet Mishra <clearmido...@gmail.com> > wrote: > >> Hi All, >> >> While starting Spark on Yarn on local cluster(Single Node Hadoop 2.6 >> yarn) I am facing some issues. >> >> As I try to start the Spark Shell it keeps on iterating in a endless loop >> while initiating, >> >> *6/03/30 01:32:38 DEBUG ipc.Client: IPC Client (1782965120) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost sending >> #11971* >> *16/03/30 01:32:38 DEBUG ipc.Client: IPC Client (1782965120) connection >> to myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost got >> value #11971* >> *16/03/30 01:32:38 DEBUG ipc.ProtobufRpcEngine: Call: >> getApplicationReport took 1ms* >> *16/03/30 01:32:38 INFO yarn.Client: Application report for >> application_1459260674306_0003 (state: ACCEPTED)* >> *16/03/30 01:32:38 DEBUG yarn.Client: * >> * client token: N/A* >> * diagnostics: N/A* >> * ApplicationMaster host: N/A* >> * ApplicationMaster RPC port: -1* >> * queue: root.thequeue* >> * start time: 1459269797431* >> * final status: UNDEFINED* >> * tracking URL: http://myhost:8088/proxy/application_1459260674306_0003/ >> <http://myhost:8088/proxy/application_1459260674306_0003/>* >> * user: myhost* >> >> *16/03/30 01:45:07 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost sending >> #338* >> *16/03/30 01:45:07 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost got value >> #338* >> *16/03/30 01:45:07 DEBUG ipc.ProtobufRpcEngine: Call: >> getApplicationReport took 2ms* >> *16/03/30 01:45:08 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost sending >> #339* >> *16/03/30 01:45:08 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost got value >> #339* >> *16/03/30 01:45:08 DEBUG ipc.ProtobufRpcEngine: Call: >> getApplicationReport took 2ms* >> *16/03/30 01:45:09 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost sending >> #340* >> *16/03/30 01:45:09 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost got value >> #340* >> *16/03/30 01:45:09 DEBUG ipc.ProtobufRpcEngine: Call: >> getApplicationReport took 2ms* >> *16/03/30 01:45:10 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost sending >> #341* >> *16/03/30 01:45:10 DEBUG ipc.Client: IPC Client (101088744) connection to >> myhost/192.168.1.108:8032 <http://192.168.1.108:8032> from myhost got value >> #341* >> *16/03/30 01:45:10 DEBUG ipc.ProtobufRpcEngine: Call: >> getApplicationReport took 1ms* >> >> Any leads would be appreciated. >> >> Thanks! >> > >
