I am trying to run a simple Map/reduce task. This is the config part:
conf.set("es.nodes", "localhost:9200");
conf.set("es.resource", "twitter/tweet");
but I am getting this error: (Btw, I am able to run ES on that machine)
14/07/28 11:58:23 INFO jvm.JvmMetrics: Initializing JVM Metrics with
processName=JobTracker, sessionId=
14/07/28 11:58:23 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
14/07/28 11:58:23 WARN mapred.JobClient: No job jar file set. User classes
may not be found. See JobConf(Class) or JobConf#setJar(String).
14/07/28 11:58:23 WARN mr.EsOutputFormat: Speculative execution enabled for
reducer - consider disabling it to prevent data corruption
14/07/28 11:58:23 INFO util.Version: Elasticsearch Hadoop v2.0.0
[eb4487f75f]
14/07/28 11:58:23 INFO mr.EsOutputFormat: Writing to [twitter/tweet]
14/07/28 11:58:23 INFO mapred.FileInputFormat: Total input paths to process
: 1
14/07/28 11:58:23 INFO mapred.LocalJobRunner: OutputCommitter set in config
null
14/07/28 11:58:23 INFO mapred.JobClient: Running job:
job_local596152416_0001
14/07/28 11:58:23 INFO mapred.LocalJobRunner: OutputCommitter is
org.apache.hadoop.mapred.FileOutputCommitter
14/07/28 11:58:23 INFO mapred.LocalJobRunner: Waiting for map tasks
14/07/28 11:58:23 INFO mapred.LocalJobRunner: Starting task:
attempt_local596152416_0001_m_000000_0
14/07/28 11:58:24 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
14/07/28 11:58:24 INFO util.ProcessTree: setsid exited with exit code 0
14/07/28 11:58:24 INFO mapred.Task: Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@7fcebc9f
14/07/28 11:58:24 INFO mapred.MapTask: Processing split:
file:/disk/workspace/HadoopCodes/EsHad/firstExample/input/f0:0+72
14/07/28 11:58:24 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is
deprecated. Use FileInputFormatCounters as group name and BYTES_READ as
counter name instead
14/07/28 11:58:24 INFO mapred.MapTask: numReduceTasks: 1
14/07/28 11:58:24 INFO mapred.MapTask: Map output collector class =
org.apache.hadoop.mapred.MapTask$MapOutputBuffer
14/07/28 11:58:24 INFO mapred.MapTask: io.sort.mb = 100
14/07/28 11:58:24 INFO mapred.MapTask: data buffer = 79691776/99614720
14/07/28 11:58:24 INFO mapred.MapTask: record buffer = 262144/327680
14/07/28 11:58:24 INFO mapred.MapTask: Starting flush of map output
14/07/28 11:58:24 INFO mapred.MapTask: Finished spill 0
14/07/28 11:58:24 INFO mapred.Task:
Task:attempt_local596152416_0001_m_000000_0 is done. And is in the process
of commiting
14/07/28 11:58:24 INFO mapred.LocalJobRunner:
file:/disk/workspace/HadoopCodes/EsHad/firstExample/input/f0:0+72
14/07/28 11:58:24 INFO mapred.Task: Task
'attempt_local596152416_0001_m_000000_0' done.
14/07/28 11:58:24 INFO mapred.LocalJobRunner: Finishing task:
attempt_local596152416_0001_m_000000_0
14/07/28 11:58:24 INFO mapred.LocalJobRunner: Map task executor complete.
14/07/28 11:58:24 WARN mapreduce.Counters: Group
org.apache.hadoop.mapred.Task$Counter is deprecated. Use
org.apache.hadoop.mapreduce.TaskCounter instead
14/07/28 11:58:24 INFO mapred.Task: Using ResourceCalculatorPlugin :
org.apache.hadoop.util.LinuxResourceCalculatorPlugin@3e152f4
14/07/28 11:58:24 INFO mapred.LocalJobRunner:
14/07/28 11:58:24 INFO mapred.Merger: Merging 1 sorted segments
14/07/28 11:58:24 INFO mapred.Merger: Down to the last merge-pass, with 1
segments left of total size: 88 bytes
14/07/28 11:58:24 INFO mapred.LocalJobRunner:
14/07/28 11:58:24 INFO httpclient.HttpMethodDirector: I/O exception
(java.net.ConnectException) caught when processing request: Connection
refused
14/07/28 11:58:24 INFO httpclient.HttpMethodDirector: Retrying request
14/07/28 11:58:24 INFO httpclient.HttpMethodDirector: I/O exception
(java.net.ConnectException) caught when processing request: Connection
refused
14/07/28 11:58:24 INFO httpclient.HttpMethodDirector: Retrying request
14/07/28 11:58:24 INFO httpclient.HttpMethodDirector: I/O exception
(java.net.ConnectException) caught when processing request: Connection
refused
14/07/28 11:58:24 INFO httpclient.HttpMethodDirector: Retrying request
14/07/28 11:58:24 ERROR rest.NetworkClient: Node [Connection refused]
failed (localhost:9200); no other nodes left - aborting...
14/07/28 11:58:24 WARN mapred.LocalJobRunner: job_local596152416_0001
org.elasticsearch.hadoop.rest.EsHadoopNoNodesLeftException: Connection
error (check network and/or proxy settings)- all nodes failed; tried
[[localhost:9200]]
at
org.elasticsearch.hadoop.rest.NetworkClient.execute(NetworkClient.java:102)
at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:282)
at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:266)
at org.elasticsearch.hadoop.rest.RestClient.execute(RestClient.java:270)
at org.elasticsearch.hadoop.rest.RestClient.get(RestClient.java:108)
at
org.elasticsearch.hadoop.rest.RestClient.discoverNodes(RestClient.java:90)
at
org.elasticsearch.hadoop.rest.InitializationUtils.discoverNodesIfNeeded(InitializationUtils.java:61)
at
org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.init(EsOutputFormat.java:182)
at
org.elasticsearch.hadoop.mr.EsOutputFormat$EsRecordWriter.write(EsOutputFormat.java:159)
at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:483)
at hadoES.MyReducerES.reduce(MyReducerES.java:34)
at hadoES.MyReducerES.reduce(MyReducerES.java:1)
at
org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:506)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:447)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:449)
14/07/28 11:58:24 INFO mapred.JobClient: map 100% reduce 0%
14/07/28 11:58:24 INFO mapred.JobClient: Job complete:
job_local596152416_0001
14/07/28 11:58:24 INFO mapred.JobClient: Counters: 21
14/07/28 11:58:24 INFO mapred.JobClient: File System Counters
14/07/28 11:58:24 INFO mapred.JobClient: FILE: Number of bytes read=239
14/07/28 11:58:24 INFO mapred.JobClient: FILE: Number of bytes
written=65639
14/07/28 11:58:24 INFO mapred.JobClient: FILE: Number of read
operations=0
14/07/28 11:58:24 INFO mapred.JobClient: FILE: Number of large read
operations=0
14/07/28 11:58:24 INFO mapred.JobClient: FILE: Number of write
operations=0
14/07/28 11:58:24 INFO mapred.JobClient: Map-Reduce Framework
14/07/28 11:58:24 INFO mapred.JobClient: Map input records=2
14/07/28 11:58:24 INFO mapred.JobClient: Map output records=2
14/07/28 11:58:24 INFO mapred.JobClient: Map output bytes=82
14/07/28 11:58:24 INFO mapred.JobClient: Input split bytes=113
14/07/28 11:58:24 INFO mapred.JobClient: Combine input records=0
14/07/28 11:58:24 INFO mapred.JobClient: Combine output records=0
14/07/28 11:58:24 INFO mapred.JobClient: Reduce input groups=1
14/07/28 11:58:24 INFO mapred.JobClient: Reduce shuffle bytes=0
14/07/28 11:58:24 INFO mapred.JobClient: Reduce input records=1
14/07/28 11:58:24 INFO mapred.JobClient: Reduce output records=0
14/07/28 11:58:24 INFO mapred.JobClient: Spilled Records=2
14/07/28 11:58:24 INFO mapred.JobClient: CPU time spent (ms)=0
14/07/28 11:58:24 INFO mapred.JobClient: Physical memory (bytes)
snapshot=0
14/07/28 11:58:24 INFO mapred.JobClient: Virtual memory (bytes)
snapshot=0
14/07/28 11:58:24 INFO mapred.JobClient: Total committed heap usage
(bytes)=1004929024
14/07/28 11:58:24 INFO mapred.JobClient:
org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
14/07/28 11:58:24 INFO mapred.JobClient: BYTES_READ=72
14/07/28 11:58:24 INFO mapred.JobClient: Job Failed: NA
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
Caused by: java.io.IOException: Job failed!
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/69d33517-2bde-4ba9-98f1-abad0e69fa5c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
