Hi Prabhu, could you please verify that you can connect to your mysql from the same box where you're running sqoop? Something like:
mysql --host=10.10.10.10 --port=54310 --database=books --user=root password=<password> Jarcec On Jul 16, 2012, at 2:12 PM, prabhu k wrote: > Thanks for the reply Bejoy, > > I have done following > > 1. created table in mysql databse table called authors in 10.10.10.10:54310 ip > > 2. in10.10.10.10:54310 same ip i have executed the bin/sqoop import > .......command. > > 3. I am able to ping 10.10.10.10 > > Please suggest anything needs to change execution query? > > On Mon, Jul 16, 2012 at 1:10 PM, Bejoy KS <[email protected]> wrote: > Hi Prabhu > > For Sqoop to work as desired the client node where sqoop commands are > triggered as well as the task tracker nodes should be able to locate the db > server. It looks like the database server is not reachable from the sqoop > client or hadoop cluster . > > Are you able to ping successfully form the client node to db server? If that > works try executing a sample jdbc pgm from clinet node and see whether that > is able to connect and successfully retrieve data from db. > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > From: prabhu k <[email protected]> > Date: Mon, 16 Jul 2012 13:00:08 +0530 > To: <[email protected]> > ReplyTo: [email protected] > Subject: import mysql db table to HDFS > > Hi Users, > > While I am trying to import mysql db table to HDFS, i am getting following > error. > > I have used this commmand: > > bin/sqoop import --connect jdbc:mysql://10.10.10.10:54310/books --username > root --table authors --target-dir /user/authors > > > sqoop-1.4.1-incubating__hadoop-0.20# bin/sqoop import --connect > jdbc:mysql://10.10.10.10:54310/books --username root --table authors > --target-dir /user/authors > Warning: /usr/lib/hbase does not exist! HBase imports will fail. > Please set $HBASE_HOME to the root of your HBase installation. > Warning: $HADOOP_HOME is deprecated. > 12/07/16 12:54:39 INFO manager.MySQLManager: Preparing to use a MySQL > streaming resultset. > 12/07/16 12:54:39 INFO tool.CodeGenTool: Beginning code generation > 12/07/16 12:54:39 ERROR manager.SqlManager: Error executing statement: > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link > failure > > The last packet sent successfully to the server was 0 milliseconds ago. The > driver has not received any packets from the server. > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link > failure > > The last packet sent successfully to the server was 0 milliseconds ago. The > driver has not received any packets from the server. > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:348) > at com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2391) > at > com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2428) > at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2213) > at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:797) > at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:389) > at > com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305) > at java.sql.DriverManager.getConnection(DriverManager.java:582) > at java.sql.DriverManager.getConnection(DriverManager.java:185) > at > org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:686) > at > org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) > at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:473) > at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:496) > at > org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:194) > at > org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:178) > at > org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:114) > at > org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060) > at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) > at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:367) > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:453) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) > at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > at java.net.Socket.connect(Socket.java:529) > at java.net.Socket.connect(Socket.java:478) > at java.net.Socket.<init>(Socket.java:375) > at java.net.Socket.<init>(Socket.java:218) > at > com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:257) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:298) > ... 33 more > 12/07/16 12:54:39 ERROR manager.CatalogQueryManager: Failed to list columns > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link > failure > > The last packet sent successfully to the server was 0 milliseconds ago. The > driver has not received any packets from the server. > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:348) > at com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2391) > at > com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2428) > at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2213) > at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:797) > at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:389) > at > com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305) > at java.sql.DriverManager.getConnection(DriverManager.java:582) > at java.sql.DriverManager.getConnection(DriverManager.java:185) > at > org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:686) > at > org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) > at > org.apache.sqoop.manager.CatalogQueryManager.getColumnNames(CatalogQueryManager.java:146) > at > org.apache.sqoop.orm.ClassWriter.getColumnNames(ClassWriter.java:1207) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1062) > at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) > at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:367) > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:453) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) > at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > at java.net.Socket.connect(Socket.java:529) > at java.net.Socket.connect(Socket.java:478) > at java.net.Socket.<init>(Socket.java:375) > at java.net.Socket.<init>(Socket.java:218) > at > com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:257) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:298) > ... 29 more > 12/07/16 12:54:39 ERROR sqoop.Sqoop: Got exception running Sqoop: > java.lang.RuntimeException: > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link > failure > > The last packet sent successfully to the server was 0 milliseconds ago. The > driver has not received any packets from the server. > java.lang.RuntimeException: > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link > failure > > The last packet sent successfully to the server was 0 milliseconds ago. The > driver has not received any packets from the server. > at > org.apache.sqoop.manager.CatalogQueryManager.getColumnNames(CatalogQueryManager.java:162) > at > org.apache.sqoop.orm.ClassWriter.getColumnNames(ClassWriter.java:1207) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1062) > at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) > at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:367) > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:453) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) > Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: > Communications link failure > > The last packet sent successfully to the server was 0 milliseconds ago. The > driver has not received any packets from the server. > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:348) > at com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2391) > at > com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2428) > at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2213) > at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:797) > at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:389) > at > com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305) > at java.sql.DriverManager.getConnection(DriverManager.java:582) > at java.sql.DriverManager.getConnection(DriverManager.java:185) > at > org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:686) > at > org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) > at > org.apache.sqoop.manager.CatalogQueryManager.getColumnNames(CatalogQueryManager.java:146) > ... 12 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) > at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > at java.net.Socket.connect(Socket.java:529) > at java.net.Socket.connect(Socket.java:478) > at java.net.Socket.<init>(Socket.java:375) > at java.net.Socket.<init>(Socket.java:218) > at > com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:257) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:298) > > Please suggest and help me on this issue. > > Thanks, > Prabhu. >
signature.asc
Description: Message signed with OpenPGP using GPGMail
