I have a simple query insert into table eslogs select * from eslogs_ext; Hive and elasticsearch are running on the same host.
To execute the script I'm following the directions from the link. http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/hive.html There are two elasticsearch nodes, and they can recognize each other (as indicated by start up process) , but why would hive not be able to pick them up ? Can you explain what could have gone wrong ? On Thursday, March 13, 2014 4:28:14 PM UTC-5, Costin Leau wrote: > > What does your Hive script look like? Can you confirm the ip/address of > your Hive and Elasticsearch ? How are you > executing the script? > The error indicates an error in your network configuration. > > Cheers, > > P.S. Feel free to post a gist or whatever it's convenient. > > On 3/13/2014 10:38 PM, P lva wrote: > > Hi, I have few weblogs in a hive table that I'd like to visualize in > kibana. > > ES is on the same node as hive server. > > > > Followed directions from this page > http://www.elasticsearch.org/guide/en/elasticsearch/hadoop/current/hive.html > > > > I can create a table using esstorage handler, but when I tried to > ingest data into this table I got > > > > Error: java.lang.RuntimeException: > org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while > processing > > row {***first row of my table**} > > at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:175) > > at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54) > > at > org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:429) > > at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) > > at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:162) > > at java.security.AccessController.doPrivileged(Native Method) > > at javax.security.auth.Subject.doAs(Subject.java:415) > > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491) > > > > at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:157) > > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive > Runtime Error while processing row {*** first row of > > my table**} > > Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: > java.io.IOException: Out of nodes and retries; caught exception > > at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:652) > > > > at > org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:504) > > at > org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:842) > > at > org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:88) > > > > at > org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:504) > > at > org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:842) > > at > org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:91) > > > > at > org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:504) > > at > org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:842) > > at > org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:534) > > ... 9 more > > Caused by: java.io.IOException: Out of nodes and retries; caught > exception > > at > org.elasticsearch.hadoop.rest.NetworkClient.execute(NetworkClient.java:81) > > at > org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:221) > > at > org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:205) > > at > org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:209) > > at > org.elasticsearch.hadoop.rest.RestClient.get(RestClient.java:103) > > at > org.elasticsearch.hadoop.rest.RestClient.discoverNodes(RestClient.java:85) > > at > org.elasticsearch.hadoop.rest.InitializationUtils.discoverNodesIfNeeded(InitializationUtils.java:60) > > > > at > org.elasticsearch.hadoop.mr.EsOutputFormat$ESRecordWriter.init(EsOutputFormat.java:165) > > > > at > org.elasticsearch.hadoop.hive.EsHiveOutputFormat$ESHiveRecordWriter.write(EsHiveOutputFormat.java:50) > > > > at > org.apache.hadoop.hive.ql.exec.FileSinkOperator.processOp(FileSinkOperator.java:638) > > > > ... 18 more > > Caused by: java.net.ConnectException: Connection refused > > at java.net.PlainSocketImpl.socketConnect(Native Method) > > at > java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) > > > at > java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) > > > > at > java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) > > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) > > at java.net.Socket.connect(Socket.java:579) > > at java.net.Socket.connect(Socket.java:528) > > at java.net.Socket.<init>(Socket.java:425) > > at java.net.Socket.<init>(Socket.java:280) > > at > > > org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:80) > > > > at > > > org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:122) > > > > at > org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) > > at > org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) > > > > at > org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) > > > > at > org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) > > at > org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) > > at > org.elasticsearch.hadoop.rest.commonshttp.CommonsHttpTransport.execute(CommonsHttpTransport.java:160) > > > > at > org.elasticsearch.hadoop.rest.NetworkClient.execute(NetworkClient.java:74) > > ... 27 more > > > > Now, I changed the config network.host to the ipadress of the server. > Now when I run hive insert data i get > > FAILED: IllegalStateException Cannot discover Elasticsearch version > > > > > > -- > > You received this message because you are subscribed to the Google > Groups "elasticsearch" group. > > To unsubscribe from this group and stop receiving emails from it, send > an email to > > [email protected] <javascript:> <mailto: > [email protected] <javascript:>>. > > To view this discussion on the web visit > > > https://groups.google.com/d/msgid/elasticsearch/a9878590-71b9-46e5-8bd7-7ee3878f959e%40googlegroups.com > > > < > https://groups.google.com/d/msgid/elasticsearch/a9878590-71b9-46e5-8bd7-7ee3878f959e%40googlegroups.com?utm_medium=email&utm_source=footer>. > > > > For more options, visit https://groups.google.com/d/optout. > > -- > Costin > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/97ef1333-eb9d-43d7-a3fe-b5e48d072643%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
