I am successfully running mapreduce jobs using Ignite but I haven't been able
to use the Ignite job tracker. I'm running my job like this:
$ /bin/hadoop --config ~/ignite/ignite_conf jar wc.jar WordCount
/user/ignite/ /tmp/output
2018-08-03 15:09:32,751 WARN [main] mapreduce.JobResourceUploader
(JobResourceUploader.java:uploadFiles(64)) - Hadoop command-line option
parsing not performed. Implement the Tool interface and execute your
application with ToolRunner to remedy this.
2018-08-03 15:09:32,960 INFO [main] input.FileInputFormat
(FileInputFormat.java:listStatus(283)) - Total input paths to process : 1
2018-08-03 15:09:33,016 INFO [main] mapreduce.JobSubmitter
(JobSubmitter.java:submitJobInternal(198)) - number of splits:1
2018-08-03 15:09:33,099 INFO [main] mapreduce.JobSubmitter
(JobSubmitter.java:printTokens(287)) - Submitting tokens for job:
job_a217f633-f2d7-4255-adad-be19b9cda204_0003
2018-08-03 15:09:35,906 INFO [main] mapreduce.Job (Job.java:submit(1294)) -
The url to track the job: N/A
2018-08-03 15:09:35,906 INFO [main] mapreduce.Job
(Job.java:monitorAndPrintJob(1339)) - Running job:
job_a217f633-f2d7-4255-adad-be19b9cda204_0003
2018-08-03 15:09:37,230 INFO [main] mapreduce.Job
(Job.java:monitorAndPrintJob(1360)) - Job
job_a217f633-f2d7-4255-adad-be19b9cda204_0003 running in uber mode : false
2018-08-03 15:09:37,232 INFO [main] mapreduce.Job
(Job.java:monitorAndPrintJob(1367)) - map 0% reduce 0%
2018-08-03 15:09:38,531 INFO [main] mapreduce.Job
(Job.java:monitorAndPrintJob(1367)) - map 100% reduce 100%
2018-08-03 15:09:38,548 INFO [main] mapreduce.Job
(Job.java:monitorAndPrintJob(1378)) - Job
job_a217f633-f2d7-4255-adad-be19b9cda204_0003 completed successfully
2018-08-03 15:09:38,564 INFO [main] mapreduce.Job
(Job.java:monitorAndPrintJob(1385)) - Counters: 0
As you can see, it lists the job tracker url as "N/A". I believe I have
correctly set the url in the mapred-site.xml:
$ grep -C 2 mapreduce.jobtracker.address ignite_conf/mapred-site.xml
<property>
<name>mapreduce.jobtracker.address</name>
<value>myserver.com:11211</value>
</property>
However, I'm getting an empty reply from the server:
$ curl http://myserver.com:11211
curl: (52) Empty reply from server
I can see the port is up:
$ netstat -luptn | grep 11211
(Not all processes could be identified, non-owned process info
will not be shown, you would have to be root to see it all.)
tcp 0 0 0.0.0.0:11211 0.0.0.0:* LISTEN
11709/java
What am I missing here?
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
