[
https://issues.apache.org/jira/browse/TAJO-2010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15039598#comment-15039598
]
ASF GitHub Bot commented on TAJO-2010:
--------------------------------------
Github user blrunner commented on a diff in the pull request:
https://github.com/apache/tajo/pull/903#discussion_r46641693
--- Diff:
tajo-storage/tajo-storage-hdfs/src/main/java/org/apache/tajo/storage/parquet/TajoRecordConverter.java
---
@@ -154,14 +157,6 @@ public void start() {
*/
@Override
public void end() {
- for (int i = 0; i < projectionMap.length; ++i) {
--- End diff --
Could you explain why you remove existing codes?
> Parquet can not read null value
> -------------------------------
>
> Key: TAJO-2010
> URL: https://issues.apache.org/jira/browse/TAJO-2010
> Project: Tajo
> Issue Type: Bug
> Components: Storage
> Affects Versions: 0.11.0
> Reporter: Jinho Kim
> Assignee: Jinho Kim
> Fix For: 0.12.0, 0.11.1
>
>
> If value are null, projection of parquet does not work.
> {noformat}
> parquet.io.ParquetDecodingException: Can not read value at 0 in block 0 in
> file
> file:/Users/jhkim/tajo/jinossy/tajo4/target/test-data/TestStorages/testProjection.data
> at
> org.apache.tajo.storage.thirdparty.parquet.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:184)
> at
> org.apache.tajo.storage.thirdparty.parquet.ParquetReader.read(ParquetReader.java:115)
> at
> org.apache.tajo.storage.thirdparty.parquet.ParquetReader.read(ParquetReader.java:119)
> at
> org.apache.tajo.storage.parquet.ParquetScanner.next(ParquetScanner.java:73)
> at
> org.apache.tajo.storage.TestStorages.testProjection(TestStorages.java:350)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.junit.runners.Suite.runChild(Suite.java:128)
> at org.junit.runners.Suite.runChild(Suite.java:27)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
> at
> com.intellij.junit4.JUnit4IdeaTestRunner.startRunnerWithArgs(JUnit4IdeaTestRunner.java:78)
> at
> com.intellij.rt.execution.junit.JUnitStarter.prepareStreamsAndStart(JUnitStarter.java:212)
> at
> com.intellij.rt.execution.junit.JUnitStarter.main(JUnitStarter.java:68)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at com.intellij.rt.execution.application.AppMain.main(AppMain.java:140)
> Caused by: java.lang.ArrayIndexOutOfBoundsException: 2
> at org.apache.tajo.storage.VTuple.put(VTuple.java:87)
> at
> org.apache.tajo.storage.parquet.TajoRecordConverter.set(TajoRecordConverter.java:92)
> at
> org.apache.tajo.storage.parquet.TajoRecordConverter.end(TajoRecordConverter.java:162)
> at
> parquet.io.RecordReaderImplementation.read(RecordReaderImplementation.java:413)
> at
> org.apache.tajo.storage.thirdparty.parquet.InternalParquetRecordReader.nextKeyValue(InternalParquetRecordReader.java:180)
> ... 38 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
