[
https://issues.apache.org/jira/browse/SQOOP-3277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Attila Szabo resolved SQOOP-3277.
---------------------------------
Resolution: Not A Bug
> Sqoop from Oracle RDB database is failing with exception SQLException in
> nextKeyValue
> -------------------------------------------------------------------------------------
>
> Key: SQOOP-3277
> URL: https://issues.apache.org/jira/browse/SQOOP-3277
> Project: Sqoop
> Issue Type: Bug
> Components: test
> Affects Versions: 1.4.6
> Environment: Production :
> Sqoop from Oracle RDB database is failing with exception SQLException in
> nextKeyValue
> Sqoop from Oracle RDB database is failing with exception SQLException in
> nextKeyValue. Below is the error log
> 17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is
> deprecated. Instead, use mapreduce.job.queuename
> 17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1512111796128_818880
> 17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized
> external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager
> 17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application
> application_1512111796128_818880
> 17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job:
> https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
> 17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
> 17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in
> uber mode : false
> 17/12/22 11:20:43 INFO mapreduce.Job: map 0% reduce 0%
> 17/12/22 15:13:18 INFO mapreduce.Job: Task Id :
> attempt_1512111796128_818880_m_000000_0, Status : FAILED
> Error: java.io.IOException: SQLException in nextKeyValue
> at
> org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
> at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
> at
> org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
> at
> org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> at
> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
> at
> oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
> at
> oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
> at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
> at
> org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
> ... 12 more
> Caused by: oracle.net.ns.NetException: End of TNS data channel
> at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
> at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
> at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
> at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
> at
> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
> at
> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
> at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
> at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
> at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
> at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
> at
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
> at
> oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
> ... 15 more
>
>
> --> Database from which we are sqooping data is Oracle RDB. We have tried out
> different work arounds.
> 1. Mapping all the columns to String while sqooping
> 2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null
> while sqooping.
> This work around successfully sqooped most of the tables but still we are
> facing the exception for few tables.
> Does any one came across this issue whie sqooping? Could you please provide
> any suggestions/help on how to resolve this
> Reporter: Chaitanya Krishna Kande
> Assignee: Attila Szabo
> Priority: Blocker
>
> Sqoop from Oracle RDB database is failing with exception SQLException in
> nextKeyValue. Below is the error log
> 17/12/22 11:20:35 INFO Configuration.deprecation: mapred.job.queue.name is
> deprecated. Instead, use mapreduce.job.queuename
> 17/12/22 11:20:35 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1512111796128_818880
> 17/12/22 11:20:35 INFO security.ExternalTokenManagerFactory: Initialized
> external token manager class - com.mapr.hadoop.yarn.security.MapRTicketManager
> 17/12/22 11:20:35 INFO impl.YarnClientImpl: Submitted application
> application_1512111796128_818880
> 17/12/22 11:20:35 INFO mapreduce.Job: The url to track the job:
> https://dbsld0069.uhc.com:8090/proxy/application_1512111796128_818880/
> 17/12/22 11:20:35 INFO mapreduce.Job: Running job: job_1512111796128_818880
> 17/12/22 11:20:43 INFO mapreduce.Job: Job job_1512111796128_818880 running in
> uber mode : false
> 17/12/22 11:20:43 INFO mapreduce.Job: map 0% reduce 0%
> 17/12/22 15:13:18 INFO mapreduce.Job: Task Id :
> attempt_1512111796128_818880_m_000000_0, Status : FAILED
> Error: java.io.IOException: SQLException in nextKeyValue
> at
> org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:277)
> at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.nextKeyValue(MapTask.java:565)
> at
> org.apache.hadoop.mapreduce.task.MapContextImpl.nextKeyValue(MapContextImpl.java:80)
> at
> org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.nextKeyValue(WrappedMapper.java:91)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> at
> org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:796)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:346)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> Caused by: java.sql.SQLRecoverableException: IO Error: End of TNS data channel
> at
> oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1128)
> at
> oracle.jdbc.driver.OracleResultSetImpl.close_or_fetch_from_next(OracleResultSetImpl.java:373)
> at oracle.jdbc.driver.OracleResultSetImpl.next(OracleResultSetImpl.java:277)
> at
> org.apache.sqoop.mapreduce.db.DBRecordReader.nextKeyValue(DBRecordReader.java:237)
> ... 12 more
> Caused by: oracle.net.ns.NetException: End of TNS data channel
> at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:308)
> at oracle.net.ns.NetInputStream.read(NetInputStream.java:260)
> at oracle.net.ns.NetInputStream.read(NetInputStream.java:185)
> at oracle.net.ns.NetInputStream.read(NetInputStream.java:102)
> at
> oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:124)
> at
> oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:80)
> at oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1137)
> at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:290)
> at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:192)
> at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:531)
> at
> oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:207)
> at
> oracle.jdbc.driver.T4CPreparedStatement.fetch(T4CPreparedStatement.java:1119)
> ... 15 more
>
>
> --> Database from which we are sqooping data is Oracle RDB. We have tried out
> different work arounds.
> 1. Mapping all the columns to String while sqooping
> 2. Handling the Date/timestamp fields i.e, mapping 0000-00-00 value as null
> while sqooping.
> This work around successfully sqooped most of the tables but still we are
> facing the exception for few tables.
> Does any one came across this issue whie sqooping? Could you please provide
> any suggestions/help on how to resolve this
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
