Chaitanya Krishna Kande created SQOOP-3277:
----------------------------------------------
Summary: Sqoop from Oracle RDB database is failing with exception
SQLException in nextKeyValue
Key: SQOOP-3277
URL: https://issues.apache.org/jira/browse/SQOOP-3277
Project: Sqoop
Issue Type: Bug
Components: test
Affects Versions: 1.4.6
Environment: Production :
Sqoop from Oracle RDB database is failing with exception SQLException in
nextKeyValue
Sqoop from Oracle RDB database is failing with exception SQLException in
nextKeyValue. Below is the error log
17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is
deprecated. Instead, use mapreduce.job.queuename
17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1512111796128_818880
17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized
external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager
17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application
application_1512111796128_818880
17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job:
https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in
uber mode : false
17/12/22 11:20:43 INFO mapreduce.Job: map 0% reduce 0%
17/12/22 15:13:18 INFO mapreduce.Job: Task Id :
attempt_1512111796128_818880_m_000000_0, Status : FAILED
Error: java.io.IOException: SQLException in nextKeyValue
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
at
oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
... 12 more
Caused by: oracle.net.ns.NetException: End of TNS data channel
at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
at
oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
at
oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
at
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
... 15 more
--> Database from which we are sqooping data is Oracle RDB. We have tried out
different work arounds.
1. Mapping all the columns to String while sqooping
2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null
while sqooping.
This work around successfully sqooped most of the tables but still we are
facing the exception for few tables.
Does any one came across this issue whie sqooping? Could you please provide any
suggestions/help on how to resolve this
Reporter: Chaitanya Krishna Kande
Sqoop from Oracle RDB database is failing with exception SQLException in
nextKeyValue. Below is the error log
17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is
deprecated. Instead, use mapreduce.job.queuename
17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
job_1512111796128_818880
17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized
external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager
17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application
application_1512111796128_818880
17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job:
https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in
uber mode : false
17/12/22 11:20:43 INFO mapreduce.Job: map 0% reduce 0%
17/12/22 15:13:18 INFO mapreduce.Job: Task Id :
attempt_1512111796128_818880_m_000000_0, Status : FAILED
Error: java.io.IOException: SQLException in nextKeyValue
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
at
org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
at
org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
at
org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
at
oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
at
org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
... 12 more
Caused by: oracle.net.ns.NetException: End of TNS data channel
at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
at
oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
at
oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
at
oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
at oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
... 15 more
--> Database from which we are sqooping data is Oracle RDB. We have tried out
different work arounds.
1. Mapping all the columns to String while sqooping
2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null
while sqooping.
This work around successfully sqooped most of the tables but still we are
facing the exception for few tables.
Does any one came across this issue whie sqooping? Could you please provide any
suggestions/help on how to resolve this
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
