-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19392/#review38066
-----------------------------------------------------------
Thanks Jinho.
I've tested your patch on local cluster as follows:
1. table schema
create external table table1 (id int, name text, score float, type text) using
csv with ('csvfile.delimiter'='|') location
'hdfs://localhost:9010/tajo/warehouse/table1' ;
2. queries
2.1 select * from table1;
2.2 select id from table1;
2.3 select count(*) from table1;
Query 2.1 and query 2.2 finished successfully. But query 2.2 failed as follows:
2014-03-21 15:38:47,537 ERROR pullserver.TajoPullServerService
(TajoPullServerService.java:exceptionCaught(533)) - PullServer error:
java.lang.NoClassDefFoundError: org/apache/hadoop/mapred/FadvisedFileRegion
at
org.apache.tajo.pullserver.TajoPullServerService$PullServer.sendFile(TajoPullServerService.java:489)
at
org.apache.tajo.pullserver.TajoPullServerService$PullServer.messageReceived(TajoPullServerService.java:462)
at
org.jboss.netty.handler.stream.ChunkedWriteHandler.handleUpstream(ChunkedWriteHandler.java:142)
at
org.jboss.netty.handler.codec.http.HttpChunkAggregator.messageReceived(HttpChunkAggregator.java:145)
at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
at
org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:459)
at
org.jboss.netty.handler.codec.replay.ReplayingDecoder.callDecode(ReplayingDecoder.java:536)
at
org.jboss.netty.handler.codec.replay.ReplayingDecoder.messageReceived(ReplayingDecoder.java:435)
at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268)
at
org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255)
at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88)
at
org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:109)
at
org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
at
org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:90)
at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
at java.lang.Thread.run(Thread.java:680)
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.mapred.FadvisedFileRegion
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 18 more
- Jung JaeHwa
On March 19, 2014, 1:41 p.m., Jinho Kim wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/19392/
> -----------------------------------------------------------
>
> (Updated March 19, 2014, 1:41 p.m.)
>
>
> Review request for Tajo.
>
>
> Bugs: TAJO-694
> https://issues.apache.org/jira/browse/TAJO-694
>
>
> Repository: tajo
>
>
> Description
> -------
>
> Currently, tajo uses the Hadoop 2.2.0. but Hadoop 2.3.0 has been released.
> We need to keep both 2.3.0 and 2.2.0
> * trunk default : 2.3.0
> * branch-0.8.0 default : 2.2.0
>
> {code:title=Build with hadoop version}
> mvn clean package -Pdist -Dhadoop.version=2.3.0 -DskipTests -Dtar
> {code}
>
>
> Diffs
> -----
>
> BUILDING.txt 8dcc179
> tajo-core/tajo-core-pullserver/pom.xml 0bdfed2
>
> tajo-core/tajo-core-pullserver/src/main/hadoop-2.2.0/org/apache/tajo/pullserver/listener/FileCloseListener.java
> PRE-CREATION
>
> tajo-core/tajo-core-pullserver/src/main/hadoop-2.3.0/org/apache/tajo/pullserver/listener/FileCloseListener.java
> PRE-CREATION
>
> tajo-core/tajo-core-pullserver/src/main/java/org/apache/tajo/pullserver/FadvisedChunkedFile.java
> ec34f00
>
> tajo-core/tajo-core-pullserver/src/main/java/org/apache/tajo/pullserver/FadvisedFileRegion.java
> 81e0bf1
>
> tajo-core/tajo-core-pullserver/src/main/java/org/apache/tajo/pullserver/PullServerAuxService.java
> 8054a40
>
> tajo-core/tajo-core-pullserver/src/main/java/org/apache/tajo/pullserver/TajoPullServerService.java
> a427635
> tajo-project/pom.xml 59628a9
>
> Diff: https://reviews.apache.org/r/19392/diff/
>
>
> Testing
> -------
>
>
> Thanks,
>
> Jinho Kim
>
>
