[
https://issues.apache.org/jira/browse/TRAFODION-3171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16592117#comment-16592117
]
ASF GitHub Bot commented on TRAFODION-3171:
-------------------------------------------
GitHub user selvaganesang opened a pull request:
https://github.com/apache/trafodion/pull/1702
[TRAFODION-3171] Refactor Hive sequence file reading to use the new i…
…mplementation
Fix for the following exception seen while accessing hive sequence file
with the new implementation
*** ERROR[8447] An error occurred during hdfs access. Error Detail:
SETUP_HDFS_SCAN java.util.concurrent.ExecutionException:
java.nio.BufferOverflowException
java.util.concurrent.FutureTask.report(FutureTask.java:122)
java.util.concurrent.FutureTask.get(FutureTask.java:192)
org.trafodion.sql.HDFSClient.trafHdfsReadBuffer(HDFSClient.java:424)
org.trafodion.sql.HdfsScan.trafHdfsRead(HdfsScan.java:215) Caused by
java.nio.BufferOverflowException
java.nio.DirectByteBuffer.put(DirectByteBuffer.java:363)
org.trafodion.sql.HDFSClient.sequenceFileRead(HDFSClient.java:301)
org.trafodion.sql.HDFSClient$HDFSRead.call(HDFSClient.java:217)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:748) [2018-08-21 15:56:00]
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/selvaganesang/trafodion trafodion-3171
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/trafodion/pull/1702.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1702
----
commit 75dfb43cccb9562e20a23cd1ec38250f31759e5a
Author: selvaganesang <selva.govindarajan@...>
Date: 2018-08-24T19:58:47Z
[TRAFODION-3171] Refactor Hive sequence file reading to use the new
implementation
Fix for the following exception seen while accessing hive sequence file
with the new implementation
*** ERROR[8447] An error occurred during hdfs access. Error Detail:
SETUP_HDFS_SCAN java.util.concurrent.ExecutionException:
java.nio.BufferOverflowException
java.util.concurrent.FutureTask.report(FutureTask.java:122)
java.util.concurrent.FutureTask.get(FutureTask.java:192)
org.trafodion.sql.HDFSClient.trafHdfsReadBuffer(HDFSClient.java:424)
org.trafodion.sql.HdfsScan.trafHdfsRead(HdfsScan.java:215) Caused by
java.nio.BufferOverflowException
java.nio.DirectByteBuffer.put(DirectByteBuffer.java:363)
org.trafodion.sql.HDFSClient.sequenceFileRead(HDFSClient.java:301)
org.trafodion.sql.HDFSClient$HDFSRead.call(HDFSClient.java:217)
java.util.concurrent.FutureTask.run(FutureTask.java:266)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
java.lang.Thread.run(Thread.java:748) [2018-08-21 15:56:00]
----
> Refactor Sequence File Reading to use the new implementation
> ------------------------------------------------------------
>
> Key: TRAFODION-3171
> URL: https://issues.apache.org/jira/browse/TRAFODION-3171
> Project: Apache Trafodion
> Issue Type: Bug
> Components: sql-exe
> Reporter: Selvaganesan Govindarajan
> Assignee: Selvaganesan Govindarajan
> Priority: Major
>
> SequenceFileReader is done via JNI/Java earlier. However, the HdfsScan was
> traversing the older states in ExHdfsScanTcb work method. This new
> implementation should use the current ByteBuffer infrastructure to enable
> obsoleting the older implemenation
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
