I am testing scoop to load data from mysql. I am following the example in the hadoop book. I am running the code in pseudo-distributed mode on Centos.
In the cluster/schedule, the ID is listed with state = ACCEPTED, finalstatus=UNDEFINED, tracking UI = UNASSIGNED. If I browse the HDFS file system, I do not see the file. I also looked at the hadoop-hdfs-datanode/namenode logs but I don't see an error. Below is the output from running the command. It looks like it is hung up - it stops at 'running the job' Any suggestions on how I can trouble shoot this? Thank you, David [hadoop@localhost javaFiles]$ /usr/bin/sqoop import --connect jdbc:mysql://localhost/test --table variant -m 1 13/10/04 12:51:11 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset. 13/10/04 12:51:11 INFO tool.CodeGenTool: Beginning code generation 13/10/04 12:51:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `variant` AS t LIMIT 1 13/10/04 12:51:12 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `variant` AS t LIMIT 1 13/10/04 12:51:12 INFO orm.CompilationManager: HADOOP_HOME is /usr/lib/hadoop Note: /tmp/sqoop-hadoop/compile/d5af2fc350428ba0e6d2396bee566452/variant.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. 13/10/04 12:51:19 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-hadoop/compile/d5af2fc350428ba0e6d2396bee566452/variant.jar 13/10/04 12:51:19 WARN manager.MySQLManager: It looks like you are importing from mysql. 13/10/04 12:51:19 WARN manager.MySQLManager: This transfer can be faster! Use the --direct 13/10/04 12:51:19 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path. 13/10/04 12:51:19 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql) 13/10/04 12:51:19 INFO mapreduce.ImportJobBase: Beginning import of variant 13/10/04 12:51:19 WARN conf.Configuration: mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address 13/10/04 12:51:20 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar 13/10/04 12:51:21 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 13/10/04 12:51:22 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is inited. 13/10/04 12:51:22 INFO service.AbstractService: Service:org.apache.hadoop.yarn.client.YarnClientImpl is started. 13/10/04 12:51:24 INFO mapreduce.JobSubmitter: number of splits:1 13/10/04 12:51:24 WARN conf.Configuration: mapred.job.classpath.files is deprecated. Instead, use mapreduce.job.classpath.files 13/10/04 12:51:24 WARN conf.Configuration: mapred.cache.files is deprecated. Instead, use mapreduce.job.cache.files 13/10/04 12:51:24 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 13/10/04 12:51:24 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class 13/10/04 12:51:24 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class 13/10/04 12:51:24 WARN conf.Configuration: mapred.job.name<http://mapred.job.name> is deprecated. Instead, use mapreduce.job.name<http://mapreduce.job.name> 13/10/04 12:51:24 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class 13/10/04 12:51:24 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 13/10/04 12:51:24 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class 13/10/04 12:51:24 WARN conf.Configuration: mapred.cache.files.timestamps is deprecated. Instead, use mapreduce.job.cache.files.timestamps 13/10/04 12:51:24 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class 13/10/04 12:51:24 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir 13/10/04 12:51:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1380724403185_0002 13/10/04 12:51:26 INFO client.YarnClientImpl: Submitted application application_1380724403185_0002 to ResourceManager at /0.0.0.0:8032<http://0.0.0.0:8032> 13/10/04 12:51:26 INFO mapreduce.Job: The url to track the job: http://localhost.localdomain:8088/proxy/application_1380724403185_0002/ 13/10/04 12:51:26 INFO mapreduce.Job: Running job: job_1380724403185_0002 The information contained in this electronic e-mail transmission and any attachments are intended only for the use of the individual or entity to whom or to which it is addressed, and may contain information that is privileged, confidential and exempt from disclosure under applicable law. If the reader of this communication is not the intended recipient, or the employee or agent responsible for delivering this communication to the intended recipient, you are hereby notified that any dissemination, distribution, copying or disclosure of this communication and any attachment is strictly prohibited. If you have received this transmission in error, please notify the sender immediately by telephone and electronic mail, and delete the original communication and any attachment from any computer, server or other electronic recording or storage device or medium. Receipt by anyone other than the intended recipient is not a waiver of any attorney-client, physician-patient or other privilege.
