[
https://issues.apache.org/jira/browse/DRILL-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14393018#comment-14393018
]
Chun Chang commented on DRILL-2163:
-----------------------------------
The original issue is fixed. However, I encounter the following error which I
already filed a separate bug DRILL-2598. Close this one.
{code}
0: jdbc:drill:schema=dfs.drillTestDirComplexJ> select a.id, a.soa, b.sfa[0],
b.soa[1] from `complex.json` a inner join `complex.json` b on a.sia[0]=b.sia[0]
order by a.id limit 20;
+------------+------------+------------+------------+
| id | soa | EXPR$2 | EXPR$3 |
+------------+------------+------------+------------+
Query failed: RemoteRpcException: Failure while running fragment., Attempted to
close accountor with 25 buffer(s) still allocatedfor QueryId:
2ae282e6-a838-99a7-ba75-f5aa18902922, MajorFragmentId: 0, MinorFragmentId: 0.
Total 25 allocation(s) of byte size(s): 512, 512, 512, 512, 512, 512,
512, 512, 512, 512, 512, 512, 512, 512, 512, 512, 512, 512, 512, 512, 512, 512,
512, 512, 512, at stack location:
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:234)
org.apache.drill.exec.vector.BitVector.allocateNewSafe(BitVector.java:101)
org.apache.drill.exec.vector.BitVector.allocateNew(BitVector.java:84)
org.apache.drill.exec.vector.NullableBitVector.allocateNew(NullableBitVector.java:172)
org.apache.drill.exec.vector.complex.RepeatedMapVector$RepeatedMapTransferPair.<init>(RepeatedMapVector.java:308)
org.apache.drill.exec.vector.complex.RepeatedMapVector$RepeatedMapTransferPair.<init>(RepeatedMapVector.java:286)
org.apache.drill.exec.vector.complex.RepeatedMapVector.getTransferPair(RepeatedMapVector.java:132)
org.apache.drill.exec.physical.impl.sort.RecordBatchData.<init>(RecordBatchData.java:57)
org.apache.drill.exec.physical.impl.TopN.TopNBatch.innerNext(TopNBatch.java:222)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89)
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:96)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89)
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
org.apache.drill.exec.physical.impl.limit.LimitRecordBatch.innerNext(LimitRecordBatch.java:113)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89)
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:96)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:99)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:89)
org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:134)
org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:142)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:118)
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:68)
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:96)
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:58)
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:163)
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:744)
[ c627a645-a1a0-4173-bf04-b412190f0376 on qa-node120.qa.lab:31010 ]
[ c627a645-a1a0-4173-bf04-b412190f0376 on qa-node120.qa.lab:31010 ]
| 1 |
[{"in":1},{"in":1,"fl":1.12345},{"in":1,"fl":10.12345},{"in":1,"fl":10.6789,"bool":true,"str":"here
is a string at row 1"}] | 0.0 | {"in":1,"fl":1.12345} |
| 2 |
[{"in":2},{"in":2,"fl":2.12345},{"in":2,"fl":20.12345},{"in":2,"fl":20.6789,"bool":true,"str":"here
is a string at row 2","nul":"not null"}] | 0.0 | {"in":2,"fl":2.12345} |
| 3 | [{"in":3},{"in":3,"fl":3.12345},{"in":3,"fl":30.12345,"nul":"not
null"},{"in":3,"fl":30.6789,"bool":true,"str":"here is a string at row 3"}] |
0.0 | {"in":3,"fl":3.12345} |
| 4 | [{"in":4},{"in":4,"fl":4.12345},{"in":4,"fl":40.12345,"nul":"not
null"},{"in":4,"fl":40.6789,"bool":false,"str":"here is a string at row
4","nul":"not null"}] | 0.0 | {"in":4,"fl":4.12345} |
| 5 | [{"in":5},{"in":5,"fl":5.12345},{"in":5,"fl":50.12345,"nul":"not
null"},{"in":5,"fl":50.6789,"bool":false,"str":"here is a string at row 5"}] |
0.0 | {"in":5,"fl":5.12345} |
| 6 | [{"in":6},{"in":6,"fl":6.12345},{"in":6,"fl":60.12345,"nul":"not
null"},{"in":6,"fl":60.6789,"bool":false,"str":"here is a string at row 6"}] |
0.0 | {"in":6,"fl":6.12345} |
| 7 | [{"in":7},{"in":7,"fl":7.12345},{"in":7,"fl":70.12345,"nul":"not
null"},{"in":7,"fl":70.6789,"bool":false,"str":"here is a string at row
7","nul":"not null"}] | 0.0 | {"in":7,"fl":7.12345} |
| 8 | [{"in":8},{"in":8,"fl":8.12345},{"in":8,"fl":80.12345,"nul":"not
null"},{"in":8,"fl":80.6789,"bool":true,"str":"here is a string at row
8","nul":"not null"}] | 0.0 | {"in":8,"fl":8.12345} |
| 9 | [{"in":9},{"in":9,"fl":9.12345},{"in":9,"fl":90.12345,"nul":"not
null"},{"in":9,"fl":90.6789,"bool":true,"str":"here is a string at row 9"}] |
0.0 | {"in":9,"fl":9.12345} |
| 10 |
[{"in":10},{"in":10,"fl":10.12345},{"in":10,"fl":100.12345,"nul":"not
null"},{"in":10,"fl":100.6789,"bool":false,"str":"here is a string at row
10","nul":"not null"}] | 0.0 | {"in":10,"fl":10.12345} |
| 11 |
[{"in":11},{"in":11,"fl":11.12345},{"in":11,"fl":110.12345,"nul":"not
null"},{"in":11,"fl":110.6789,"bool":true,"str":"here is a string at row
11","nul":"not null"}] | 0.0 | {"in":11,"fl":11.12345} |
| 12 |
[{"in":12},{"in":12,"fl":12.12345},{"in":12,"fl":120.12345},{"in":12,"fl":120.6789,"bool":false,"str":"here
is a string at row 12","nul":"not null"}] | 0.0 |
{"in":12,"fl":12.12345} |
| 13 |
[{"in":13},{"in":13,"fl":13.12345},{"in":13,"fl":130.12345},{"in":13,"fl":130.6789,"bool":true,"str":"here
is a string at row 13"}] | 0.0 | {"in":13,"fl":13.12345} |
| 14 |
[{"in":14},{"in":14,"fl":14.12345},{"in":14,"fl":140.12345},{"in":14,"fl":140.6789,"bool":false,"str":"here
is a string at row 14","nul":"not null"}] | 0.0 |
{"in":14,"fl":14.12345} |
| 15 |
[{"in":15},{"in":15,"fl":15.12345},{"in":15,"fl":150.12345,"nul":"not
null"},{"in":15,"fl":150.6789,"bool":true,"str":"here is a string at row
15","nul":"not null"}] | 0.0 | {"in":15,"fl":15.12345} |
| 16 |
[{"in":16},{"in":16,"fl":16.12345},{"in":16,"fl":160.12345},{"in":16,"fl":160.6789,"bool":false,"str":"here
is a string at row 16","nul":"not null"}] | 0.0 |
{"in":16,"fl":16.12345} |
| 17 |
[{"in":17},{"in":17,"fl":17.12345},{"in":17,"fl":170.12345,"nul":"not
null"},{"in":17,"fl":170.6789,"bool":true,"str":"here is a string at row 17"}]
| 0.0 | {"in":17,"fl":17.12345} |
| 18 |
[{"in":18},{"in":18,"fl":18.12345},{"in":18,"fl":180.12345},{"in":18,"fl":180.6789,"bool":false,"str":"here
is a string at row 18"}] | 0.0 | {"in":18,"fl":18.12345} |
| 19 |
[{"in":19},{"in":19,"fl":19.12345},{"in":19,"fl":190.12345},{"in":19,"fl":190.6789,"bool":false,"str":"here
is a string at row 19"}] | 0.0 | {"in":19,"fl":19.12345} |
| 20 |
[{"in":20},{"in":20,"fl":20.12345},{"in":20,"fl":200.12345,"nul":"not
null"},{"in":20,"fl":200.6789,"bool":false,"str":"here is a string at row 20"}]
| 0.0 | {"in":20,"fl":20.12345} |
java.lang.RuntimeException: java.sql.SQLException: Failure while executing
query.
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)
{code}
> Projecting nested types past join returns invalid result
> --------------------------------------------------------
>
> Key: DRILL-2163
> URL: https://issues.apache.org/jira/browse/DRILL-2163
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Data Types
> Reporter: Hanifi Gunes
> Assignee: Chun Chang
> Priority: Critical
> Fix For: 0.8.0
>
> Attachments: DRILL-2163.1.patch.txt
>
>
> Take the following data files and query:
> {code:title=a.json}
> {
> "uid": 1,
> "events" : [
> { "evnt_id":"e1"}
> ]
> }
> {code}
> {code:title=b.json}
> {
> "uid": 1,
> "transactions" : [
> { "trans_id":"t1"}
> ]
> }
> {code}
> {code}
> select t1.events, t2.transactions from dfs.`local`.`2122/a.json` t1,
> dfs.`local`.`2122/b.json` t2 where t1.uid = t2.uid
> {code}
> The projection of a nested value -coming out of right side of join-,
> {{transactions}} as of b6a3878, reports empty result.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
