Victoria Markman created DRILL-3067:
---------------------------------------
Summary: Index out of bounds exception when "in list" contains
10,000 integer values
Key: DRILL-3067
URL: https://issues.apache.org/jira/browse/DRILL-3067
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.0.0
Reporter: Victoria Markman
Index out of bounds exception when in list contains 10,000 integer values
Failing query looks like this: select count(*) from t1 where a1 in (<10,000
integer values>)
drillbit.log
{code}
org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR:
java.lang.IndexOutOfBoundsException: Index: 1, Size: 1
Fragment 0:0
[Error Id: 89dd9d30-ff0b-4513-bd79-624d63efb5f0 on atsqa4-133.qa.lab:31010]
at
org.apache.drill.exec.work.foreman.QueryManager$1.statusUpdate(QueryManager.java:481)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:461)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:90)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:86)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:291)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:255)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_71]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_71]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]
2015-05-13 22:22:26,153 [2aac315d-a333-fa7d-3534-94912b01e07d:frag:0:0] INFO
o.a.d.e.w.fragment.FragmentExecutor - 2aac315d-a333-fa7d-3534-94912b01e07d:0:0:
State change requested from FAILED --> CANCELLATION_REQUESTED for
2015-05-13 22:22:26,153 [2aac315d-a333-fa7d-3534-94912b01e07d:frag:0:0] WARN
o.a.d.e.w.fragment.FragmentExecutor - Ignoring unexpected state transition
FAILED => CANCELLATION_REQUESTED.
2015-05-13 22:22:26,153 [2aac315d-a333-fa7d-3534-94912b01e07d:frag:0:0] INFO
o.a.drill.exec.work.foreman.Foreman - foreman cleaning up.
2015-05-13 22:22:26,161 [2aac315d-a333-fa7d-3534-94912b01e07d:frag:0:0] ERROR
o.a.d.exec.work.foreman.QueryManager - Failure while storing Query Profile
java.lang.RuntimeException: java.io.IOException: java.lang.InterruptedException
at
org.apache.drill.exec.store.sys.local.FilePStore.put(FilePStore.java:148)
~[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager.writeFinalProfile(QueryManager.java:307)
~[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman$ForemanResult.close(Foreman.java:743)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman$StateSwitch.processEvent(Foreman.java:838)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman$StateSwitch.processEvent(Foreman.java:780)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.common.EventProcessor.sendEvent(EventProcessor.java:73)
[drill-common-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman$StateSwitch.moveToState(Foreman.java:782)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman.moveToState(Foreman.java:891)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman.access$2700(Foreman.java:107)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.Foreman$StateListener.moveToState(Foreman.java:1161)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager$1.statusUpdate(QueryManager.java:481)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:461)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:90)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:86)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.sendFinalState(FragmentExecutor.java:291)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:255)
[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.common.SelfCleaningRunnable.run(SelfCleaningRunnable.java:38)
[drill-common-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_71]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_71]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_71]
Caused by: java.io.IOException: java.lang.InterruptedException
at org.apache.hadoop.util.Shell.runCommand(Shell.java:508)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.util.Shell.run(Shell.java:418)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:650)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.util.Shell.execCommand(Shell.java:739)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.util.Shell.execCommand(Shell.java:722)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:676)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at
org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:467)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:456)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:942)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:923)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:820)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:809)
~[hadoop-common-2.4.1-mapr-1408.jar:na]
at
org.apache.drill.exec.store.dfs.DrillFileSystem.create(DrillFileSystem.java:152)
~[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
at
org.apache.drill.exec.store.sys.local.FilePStore.put(FilePStore.java:145)
~[drill-java-exec-1.0.0-SNAPSHOT-rebuffed.jar:1.0.0-SNAPSHOT]
... 19 common frames omitted
{code}
Attached:
in_list_integer.sql
t1.parquet
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
