[
https://issues.apache.org/jira/browse/DRILL-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089085#comment-15089085
]
Khurram Faraaz commented on DRILL-4254:
---------------------------------------
Physical plan
{noformat}
00-00 Screen : rowType = RecordType(ANY *): rowcount = 10.0, cumulative cost
= {1.4143767E7 rows, 1.4143897E7 cpu, 0.0 io, 40960.0 network, 0.0 memory}, id
= 3423
00-01 Project(*=[$0]) : rowType = RecordType(ANY *): rowcount = 10.0,
cumulative cost = {1.4143766E7 rows, 1.4143896E7 cpu, 0.0 io, 40960.0 network,
0.0 memory}, id = 3422
00-02 SelectionVectorRemover : rowType = (DrillRecordRow[*]): rowcount =
10.0, cumulative cost = {1.4143766E7 rows, 1.4143896E7 cpu, 0.0 io, 40960.0
network, 0.0 memory}, id = 3421
00-03 Limit(fetch=[10]) : rowType = (DrillRecordRow[*]): rowcount =
10.0, cumulative cost = {1.4143756E7 rows, 1.4143886E7 cpu, 0.0 io, 40960.0
network, 0.0 memory}, id = 3420
00-04 UnionExchange : rowType = (DrillRecordRow[*]): rowcount =
10.0, cumulative cost = {1.4143746E7 rows, 1.4143846E7 cpu, 0.0 io, 40960.0
network, 0.0 memory}, id = 3419
01-01 SelectionVectorRemover : rowType = (DrillRecordRow[*]):
rowcount = 10.0, cumulative cost = {1.4143736E7 rows, 1.4143766E7 cpu, 0.0 io,
0.0 network, 0.0 memory}, id = 3418
01-02 Limit(fetch=[10]) : rowType = (DrillRecordRow[*]):
rowcount = 10.0, cumulative cost = {1.4143726E7 rows, 1.4143756E7 cpu, 0.0 io,
0.0 network, 0.0 memory}, id = 3417
01-03 Scan(groupscan=[EasyGroupScan
[selectionRoot=maprfs:/tmp/auditlogs, numFiles=31, columns=[`*`],
files=[maprfs:/tmp/auditlogs/DBAudit.log-2015-12-30-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-28-002.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-31-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-06-003.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-28-002.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-28-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-30-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-28-003.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-31-002.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-04-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2016-01-06-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-28-003.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-31-002.json,
maprfs:/tmp/auditlogs/DBAudit.log-2016-01-06-003.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-31-003.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-06-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-03-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-31-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-29-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2015-12-28-004.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-01-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-28-004.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-29-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2015-12-28-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2016-01-01-001.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-06-004.json,
maprfs:/tmp/auditlogs/DBAudit.log-2016-01-06-004.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-06-002.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-07-001.json,
maprfs:/tmp/auditlogs/DBAudit.log-2016-01-06-002.json,
maprfs:/tmp/auditlogs/FSAudit.log-2016-01-08-001.json]]]) : rowType =
(DrillRecordRow[*]): rowcount = 1.4143716E7, cumulative cost = {1.4143716E7
rows, 1.4143716E7 cpu, 0.0 io, 0.0 network, 0.0 memory}, id = 3416
{noformat}
> LIMIT query over mapr fs generated audit logs throws IOB Exception
> ------------------------------------------------------------------
>
> Key: DRILL-4254
> URL: https://issues.apache.org/jira/browse/DRILL-4254
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
> Affects Versions: 1.4.0
> Environment: CentOS
> Reporter: Khurram Faraaz
> Priority: Critical
>
> Querying mapr fs generated audit files through mapr Drill 1.4 results in IOB
> Exception
> MapR Drill 1.4.0, commit ID : 9627a80f
> MapRBuildVersion : 5.1.0.36488.GA
> OS : CentOS x86_64 GNU/Linux
> {noformat}
> 01:01 AM root atsqa8c27 :bin ✓ ./sqlline -u "jdbc:drill:schema=dfs.tmp -n
> mapr -p mapr"apache drill 1.4.0
> "the only truly happy people are children, the creative minority and drill
> users"
> 0: jdbc:drill:schema=dfs.tmp> select * from `auditlogs` limit 5;
> Error: SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1
> (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> (state=,code=0)
> {noformat}
> Stack trace from drillbit.log
> {noformat}
> 2016-01-08 09:43:22,932 [29707b45-6740-8462-cf83-9c2aaa2ed337:frag:0:0] ERROR
> o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR:
> IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> org.apache.drill.common.exceptions.UserException: SYSTEM ERROR:
> IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> at
> org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:534)
> ~[drill-common-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:321)
> [drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:184)
> [drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:290)
> [drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
> [drill-common-1.4.0.jar:1.4.0]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_65]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
> Caused by: java.lang.IndexOutOfBoundsException: index: 0, length: 1
> (expected: range(0, 0))
> at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:175)
> ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
> at io.netty.buffer.DrillBuf.chk(DrillBuf.java:197)
> ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
> at io.netty.buffer.DrillBuf.getByte(DrillBuf.java:732)
> ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
> at
> org.apache.drill.exec.vector.UInt1Vector$Accessor.get(UInt1Vector.java:356)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.vector.NullableIntVector$Accessor.isSet(NullableIntVector.java:378)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.vector.NullableIntVector$Accessor.isNull(NullableIntVector.java:374)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.vector.NullableIntVector.copyFrom(NullableIntVector.java:339)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.test.generated.CopierGen1050.doEval(CopierTemplate2.java:168)
> ~[na:na]
> at
> org.apache.drill.exec.test.generated.CopierGen1050.copyRecords(CopierTemplate2.java:59)
> ~[na:na]
> at
> org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.doWork(RemovingRecordBatch.java:100)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:93)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:94)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:81)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:256)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:250)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[na:1.7.0_65]
> at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_65]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
> ~[hadoop-common-2.7.0-mapr-1506.jar:na]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:250)
> [drill-java-exec-1.4.0.jar:1.4.0]
> ... 4 common frames omitted
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
