[
https://issues.apache.org/jira/browse/DRILL-4254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089003#comment-15089003
]
Khurram Faraaz commented on DRILL-4254:
---------------------------------------
Note that one the audit log file is big, ~14 GB
{noformat}
02:01 AM root atsqa8 :tmp ✗ hadoop fs -ls /tmp/auditlogs
Found 31 items
----------+ 3 root root 0 2015-12-28 04:32
/tmp/auditlogs/DBAudit.log-2015-12-28-001.json
----------+ 3 root root 0 2015-12-28 14:54
/tmp/auditlogs/DBAudit.log-2015-12-28-002.json
----------+ 3 root root 0 2015-12-28 15:29
/tmp/auditlogs/DBAudit.log-2015-12-28-003.json
----------+ 3 root root 0 2015-12-28 17:19
/tmp/auditlogs/DBAudit.log-2015-12-28-004.json
----------+ 3 root root 1215 2015-12-29 10:35
/tmp/auditlogs/DBAudit.log-2015-12-29-001.json
----------+ 3 root root 0 2015-12-30 07:05
/tmp/auditlogs/DBAudit.log-2015-12-30-001.json
----------+ 3 root root 0 2015-12-31 14:21
/tmp/auditlogs/DBAudit.log-2015-12-31-001.json
----------+ 3 root root 0 2015-12-31 14:14
/tmp/auditlogs/DBAudit.log-2015-12-31-002.json
----------+ 3 root root 0 2016-01-01 06:49
/tmp/auditlogs/DBAudit.log-2016-01-01-001.json
----------+ 3 root root 0 2016-01-06 06:30
/tmp/auditlogs/DBAudit.log-2016-01-06-001.json
----------+ 3 root root 207343422 2016-01-06 12:35
/tmp/auditlogs/DBAudit.log-2016-01-06-002.json
----------+ 3 root root 0 2016-01-06 13:56
/tmp/auditlogs/DBAudit.log-2016-01-06-003.json
----------+ 3 root root 0 2016-01-06 13:56
/tmp/auditlogs/DBAudit.log-2016-01-06-004.json
----------+ 3 root root 0 2015-12-28 04:32
/tmp/auditlogs/FSAudit.log-2015-12-28-001.json
----------+ 3 root root 0 2015-12-28 14:54
/tmp/auditlogs/FSAudit.log-2015-12-28-002.json
----------+ 3 root root 42030702 2015-12-28 17:17
/tmp/auditlogs/FSAudit.log-2015-12-28-003.json
----------+ 3 root root 359 2015-12-28 17:24
/tmp/auditlogs/FSAudit.log-2015-12-28-004.json
----------+ 3 root root 1055 2015-12-29 10:35
/tmp/auditlogs/FSAudit.log-2015-12-29-001.json
----------+ 3 root root 0 2015-12-30 07:05
/tmp/auditlogs/FSAudit.log-2015-12-30-001.json
----------+ 3 root root 14233781528 2015-12-31 14:19
/tmp/auditlogs/FSAudit.log-2015-12-31-001.json
----------+ 3 root root 0 2015-12-31 14:21
/tmp/auditlogs/FSAudit.log-2015-12-31-002.json
----------+ 3 root root 160 2015-12-31 14:20
/tmp/auditlogs/FSAudit.log-2015-12-31-003.json
----------+ 3 root root 507 2016-01-01 17:34
/tmp/auditlogs/FSAudit.log-2016-01-01-001.json
----------+ 3 root root 160 2016-01-03 17:37
/tmp/auditlogs/FSAudit.log-2016-01-03-001.json
----------+ 3 root root 160 2016-01-04 07:23
/tmp/auditlogs/FSAudit.log-2016-01-04-001.json
----------+ 3 root root 0 2016-01-06 06:30
/tmp/auditlogs/FSAudit.log-2016-01-06-001.json
----------+ 3 root root 374 2016-01-06 13:21
/tmp/auditlogs/FSAudit.log-2016-01-06-002.json
----------+ 3 root root 935 2016-01-06 22:06
/tmp/auditlogs/FSAudit.log-2016-01-06-003.json
----------+ 3 root root 935 2016-01-06 23:07
/tmp/auditlogs/FSAudit.log-2016-01-06-004.json
----------+ 3 root root 2992 2016-01-07 23:39
/tmp/auditlogs/FSAudit.log-2016-01-07-001.json
----------+ 3 root root 748 2016-01-08 04:49
/tmp/auditlogs/FSAudit.log-2016-01-08-001.json
{noformat}
> LIMIT query over mapr fs generated audit logs throws IOB Exception
> ------------------------------------------------------------------
>
> Key: DRILL-4254
> URL: https://issues.apache.org/jira/browse/DRILL-4254
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Flow
> Affects Versions: 1.4.0
> Environment: CentOS
> Reporter: Khurram Faraaz
> Priority: Critical
>
> Querying mapr fs generated audit files through mapr Drill 1.4 results in IOB
> Exception
> MapR Drill 1.4.0, commit ID : 9627a80f
> MapRBuildVersion : 5.1.0.36488.GA
> OS : CentOS x86_64 GNU/Linux
> {noformat}
> 01:01 AM root atsqa8c27 :bin ✓ ./sqlline -u "jdbc:drill:schema=dfs.tmp -n
> mapr -p mapr"apache drill 1.4.0
> "the only truly happy people are children, the creative minority and drill
> users"
> 0: jdbc:drill:schema=dfs.tmp> select * from `auditlogs` limit 5;
> Error: SYSTEM ERROR: IndexOutOfBoundsException: index: 0, length: 1
> (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> (state=,code=0)
> {noformat}
> Stack trace from drillbit.log
> {noformat}
> 2016-01-08 09:43:22,932 [29707b45-6740-8462-cf83-9c2aaa2ed337:frag:0:0] ERROR
> o.a.d.e.w.fragment.FragmentExecutor - SYSTEM ERROR:
> IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> org.apache.drill.common.exceptions.UserException: SYSTEM ERROR:
> IndexOutOfBoundsException: index: 0, length: 1 (expected: range(0, 0))
> Fragment 0:0
> [Error Id: a14e4178-cfca-4091-8811-df00517ad9bf on example.com:31010]
> at
> org.apache.drill.common.exceptions.UserException$Builder.build(UserException.java:534)
> ~[drill-common-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:321)
> [drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.cleanup(FragmentExecutor.java:184)
> [drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:290)
> [drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
> [drill-common-1.4.0.jar:1.4.0]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_65]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_65]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
> Caused by: java.lang.IndexOutOfBoundsException: index: 0, length: 1
> (expected: range(0, 0))
> at io.netty.buffer.DrillBuf.checkIndexD(DrillBuf.java:175)
> ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
> at io.netty.buffer.DrillBuf.chk(DrillBuf.java:197)
> ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
> at io.netty.buffer.DrillBuf.getByte(DrillBuf.java:732)
> ~[drill-memory-base-1.4.0.jar:4.0.27.Final]
> at
> org.apache.drill.exec.vector.UInt1Vector$Accessor.get(UInt1Vector.java:356)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.vector.NullableIntVector$Accessor.isSet(NullableIntVector.java:378)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.vector.NullableIntVector$Accessor.isNull(NullableIntVector.java:374)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.vector.NullableIntVector.copyFrom(NullableIntVector.java:339)
> ~[vector-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.test.generated.CopierGen1050.doEval(CopierTemplate2.java:168)
> ~[na:na]
> at
> org.apache.drill.exec.test.generated.CopierGen1050.copyRecords(CopierTemplate2.java:59)
> ~[na:na]
> at
> org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.doWork(RemovingRecordBatch.java:100)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:93)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.svremover.RemovingRecordBatch.innerNext(RemovingRecordBatch.java:94)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:119)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:109)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractSingleRecordBatch.innerNext(AbstractSingleRecordBatch.java:51)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.project.ProjectRecordBatch.innerNext(ProjectRecordBatch.java:132)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.record.AbstractRecordBatch.next(AbstractRecordBatch.java:162)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:104)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:81)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:94)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:256)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor$1.run(FragmentExecutor.java:250)
> ~[drill-java-exec-1.4.0.jar:1.4.0]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[na:1.7.0_65]
> at javax.security.auth.Subject.doAs(Subject.java:415) ~[na:1.7.0_65]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1595)
> ~[hadoop-common-2.7.0-mapr-1506.jar:na]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:250)
> [drill-java-exec-1.4.0.jar:1.4.0]
> ... 4 common frames omitted
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
