Thanks for the reply Bejoy, I have done following
1. created table in mysql databse table called authors in 10.10.10.10:54310<http://10.10.10.10:54310/books> ip 2. in10.10.10.10:54310 <http://10.10.10.10:54310/books> same ip i have executed the bin/sqoop import .......command. 3. I am able to ping 10.10.10.10 Please suggest anything needs to change execution query? On Mon, Jul 16, 2012 at 1:10 PM, Bejoy KS <[email protected]> wrote: > ** > Hi Prabhu > > For Sqoop to work as desired the client node where sqoop commands are > triggered as well as the task tracker nodes should be able to locate the db > server. It looks like the database server is not reachable from the sqoop > client or hadoop cluster . > > Are you able to ping successfully form the client node to db server? If > that works try executing a sample jdbc pgm from clinet node and see whether > that is able to connect and successfully retrieve data from db. > Regards > Bejoy KS > > Sent from handheld, please excuse typos. > ------------------------------ > *From: *prabhu k <[email protected]> > *Date: *Mon, 16 Jul 2012 13:00:08 +0530 > *To: *<[email protected]> > *ReplyTo: *[email protected] > *Subject: *import mysql db table to HDFS > > Hi Users, > > While I am trying to import mysql db table to HDFS, i am getting following > error. > > I have used this commmand: > > bin/sqoop import --connect jdbc:mysql://10.10.10.10:54310/books--username > root --table authors --target-dir /user/authors > > > sqoop-1.4.1-incubating__hadoop-0.20# bin/sqoop import --connect > jdbc:mysql://10.10.10.10:54310/books --username root --table authors > --target-dir /user/authors > Warning: /usr/lib/hbase does not exist! HBase imports will fail. > Please set $HBASE_HOME to the root of your HBase installation. > Warning: $HADOOP_HOME is deprecated. > > 12/07/16 12:54:39 INFO manager.MySQLManager: Preparing to use a MySQL > streaming resultset. > 12/07/16 12:54:39 INFO tool.CodeGenTool: Beginning code generation > 12/07/16 12:54:39 ERROR manager.SqlManager: Error executing statement: > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications > link failure > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server. > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications > link failure > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server. > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:348) > at > com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2391) > at > com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2428) > at > com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2213) > at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:797) > at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:389) > at > com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305) > at java.sql.DriverManager.getConnection(DriverManager.java:582) > at java.sql.DriverManager.getConnection(DriverManager.java:185) > at > org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:686) > at > org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) > at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:473) > at org.apache.sqoop.manager.SqlManager.execute(SqlManager.java:496) > at > org.apache.sqoop.manager.SqlManager.getColumnTypesForRawQuery(SqlManager.java:194) > at > org.apache.sqoop.manager.SqlManager.getColumnTypes(SqlManager.java:178) > at > org.apache.sqoop.manager.ConnManager.getColumnTypes(ConnManager.java:114) > at > org.apache.sqoop.orm.ClassWriter.getColumnTypes(ClassWriter.java:1235) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1060) > at > org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) > at > org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:367) > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:453) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) > at > java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > at java.net.Socket.connect(Socket.java:529) > at java.net.Socket.connect(Socket.java:478) > at java.net.Socket.<init>(Socket.java:375) > at java.net.Socket.<init>(Socket.java:218) > at > com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:257) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:298) > ... 33 more > 12/07/16 12:54:39 ERROR manager.CatalogQueryManager: Failed to list columns > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications > link failure > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server. > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:348) > at > com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2391) > at > com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2428) > at > com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2213) > at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:797) > at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:389) > at > com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305) > at java.sql.DriverManager.getConnection(DriverManager.java:582) > at java.sql.DriverManager.getConnection(DriverManager.java:185) > at > org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:686) > at > org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) > at > org.apache.sqoop.manager.CatalogQueryManager.getColumnNames(CatalogQueryManager.java:146) > at > org.apache.sqoop.orm.ClassWriter.getColumnNames(ClassWriter.java:1207) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1062) > at > org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) > at > org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:367) > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:453) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) > at > java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > at java.net.Socket.connect(Socket.java:529) > at java.net.Socket.connect(Socket.java:478) > at java.net.Socket.<init>(Socket.java:375) > at java.net.Socket.<init>(Socket.java:218) > at > com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:257) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:298) > ... 29 more > 12/07/16 12:54:39 ERROR sqoop.Sqoop: Got exception running Sqoop: > java.lang.RuntimeException: > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications > link failure > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server. > java.lang.RuntimeException: > com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications > link failure > > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server. > at > org.apache.sqoop.manager.CatalogQueryManager.getColumnNames(CatalogQueryManager.java:162) > at > org.apache.sqoop.orm.ClassWriter.getColumnNames(ClassWriter.java:1207) > at org.apache.sqoop.orm.ClassWriter.generate(ClassWriter.java:1062) > at > org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:82) > at > org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:367) > at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:453) > at org.apache.sqoop.Sqoop.run(Sqoop.java:145) > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65) > at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:220) > at org.apache.sqoop.Sqoop.runTool(Sqoop.java:229) > at org.apache.sqoop.Sqoop.main(Sqoop.java:238) > at com.cloudera.sqoop.Sqoop.main(Sqoop.java:57) > Caused by: com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: > Communications link failure > The last packet sent successfully to the server was 0 milliseconds ago. > The driver has not received any packets from the server. > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.SQLError.createCommunicationsException(SQLError.java:1116) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:348) > at > com.mysql.jdbc.ConnectionImpl.coreConnect(ConnectionImpl.java:2391) > at > com.mysql.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:2428) > at > com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2213) > at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:797) > at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:47) > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at com.mysql.jdbc.Util.handleNewInstance(Util.java:411) > at > com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:389) > at > com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:305) > at java.sql.DriverManager.getConnection(DriverManager.java:582) > at java.sql.DriverManager.getConnection(DriverManager.java:185) > at > org.apache.sqoop.manager.SqlManager.makeConnection(SqlManager.java:686) > at > org.apache.sqoop.manager.GenericJdbcManager.getConnection(GenericJdbcManager.java:52) > at > org.apache.sqoop.manager.CatalogQueryManager.getColumnNames(CatalogQueryManager.java:146) > ... 12 more > Caused by: java.net.ConnectException: Connection refused > at java.net.PlainSocketImpl.socketConnect(Native Method) > at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) > at > java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) > at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) > at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) > at java.net.Socket.connect(Socket.java:529) > at java.net.Socket.connect(Socket.java:478) > at java.net.Socket.<init>(Socket.java:375) > at java.net.Socket.<init>(Socket.java:218) > at > com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:257) > at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:298) > > Please suggest and help me on this issue. > > Thanks, > Prabhu. >
