[
https://issues.apache.org/jira/browse/DRILL-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sudheesh Katkam updated DRILL-2417:
-----------------------------------
Description:
Attempt to, alter system set `store.parquet.compression` = 'snappy'
results in an Exception
Details of -driblet- drillbit version that I am working with are
{code}
0: jdbc:drill:zk=local> select * from sys.version;
+------------+----------------+-------------+-------------+------------+
| commit_id | commit_message | commit_time | build_email | build_time |
+------------+----------------+-------------+-------------+------------+
| a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix
Decimal38/Decimal28 vector's get() to copy the scale and precision into the
holder | 02.03.2015 @ 14:13:27 EST | Unknown | 02.03.2015 @ 15:43:47 EST |
+------------+----------------+-------------+-------------+------------+
1 row selected (0.334 seconds)
{code}
Failing alter system set statement
{code}
0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy';
+------------+------------+
| ok | summary |
+------------+------------+
| true | store.parquet.compression updated. |
Query failed: RemoteRpcException: Failure while running fragment., Failure
while closing accountor. Expected private and shared pools to be set to
initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [
669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
[ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
java.lang.RuntimeException: java.sql.SQLException: Failure while executing
query.
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)
0: jdbc:drill:zk=local>
>From the log file
2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR
o.a.d.e.w.f.AbstractStatusReporter - Error
669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment.
java.lang.IllegalStateException: Failure while closing accountor. Expected
private and shared pools to be set to initial values. However, one or more
were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888.
at
org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO
o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING -->
FAILED
org.apache.drill.exec.rpc.RemoteRpcException: Failure while running fragment.,
Failure while closing accountor. Expected private and shared pools to be set
to initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [
669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
[ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
at
org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
...
2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN
o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources.
java.lang.IllegalStateException: Failure while trying to close child allocator:
Child level allocators not closed. Fragment 0:0. Stack trace:
org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43)
org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112)
org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35)
org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188)
org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97)
org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109)
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:745)
at
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
{code}
was:
Attempt to, alter system set `store.parquet.compression` = 'snappy'
results in an Exception
Details of driblet version that I am working with are
0: jdbc:drill:zk=local> select * from sys.version;
+------------+----------------+-------------+-------------+------------+
| commit_id | commit_message | commit_time | build_email | build_time |
+------------+----------------+-------------+-------------+------------+
| a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix
Decimal38/Decimal28 vector's get() to copy the scale and precision into the
holder | 02.03.2015 @ 14:13:27 EST | Unknown | 02.03.2015 @ 15:43:47 EST |
+------------+----------------+-------------+-------------+------------+
1 row selected (0.334 seconds)
Failing alter system set statement
0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy';
+------------+------------+
| ok | summary |
+------------+------------+
| true | store.parquet.compression updated. |
Query failed: RemoteRpcException: Failure while running fragment., Failure
while closing accountor. Expected private and shared pools to be set to
initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [
669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
[ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
java.lang.RuntimeException: java.sql.SQLException: Failure while executing
query.
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)
0: jdbc:drill:zk=local>
>From the log file
2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR
o.a.d.e.w.f.AbstractStatusReporter - Error
669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment.
java.lang.IllegalStateException: Failure while closing accountor. Expected
private and shared pools to be set to initial values. However, one or more
were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888.
at
org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO
o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING -->
FAILED
org.apache.drill.exec.rpc.RemoteRpcException: Failure while running fragment.,
Failure while closing accountor. Expected private and shared pools to be set
to initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [
669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
[ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
at
org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
...
2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN
o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources.
java.lang.IllegalStateException: Failure while trying to close child allocator:
Child level allocators not closed. Fragment 0:0. Stack trace:
org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43)
org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112)
org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35)
org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130)
org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188)
org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97)
org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109)
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
java.lang.Thread.run(Thread.java:745)
at
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317)
~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[na:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[na:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> Exception seen when system parameter is set to `store.parquet.compression` =
> 'snappy'
> -------------------------------------------------------------------------------------
>
> Key: DRILL-2417
> URL: https://issues.apache.org/jira/browse/DRILL-2417
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 0.8.0
> Environment: Administrators-MacBook-Pro-11:log kfaraaz$ uname -a
> Darwin Administrators-MacBook-Pro-11.local 14.0.0 Darwin Kernel Version
> 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64
> x86_64
> Reporter: Khurram Faraaz
> Assignee: Sudheesh Katkam
> Fix For: 0.9.0
>
>
> Attempt to, alter system set `store.parquet.compression` = 'snappy'
> results in an Exception
> Details of -driblet- drillbit version that I am working with are
> {code}
> 0: jdbc:drill:zk=local> select * from sys.version;
> +------------+----------------+-------------+-------------+------------+
> | commit_id | commit_message | commit_time | build_email | build_time |
> +------------+----------------+-------------+-------------+------------+
> | a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix
> Decimal38/Decimal28 vector's get() to copy the scale and precision into the
> holder | 02.03.2015 @ 14:13:27 EST | Unknown | 02.03.2015 @ 15:43:47 EST |
> +------------+----------------+-------------+-------------+------------+
> 1 row selected (0.334 seconds)
> {code}
> Failing alter system set statement
> {code}
> 0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy';
> +------------+------------+
> | ok | summary |
> +------------+------------+
> | true | store.parquet.compression updated. |
> Query failed: RemoteRpcException: Failure while running fragment., Failure
> while closing accountor. Expected private and shared pools to be set to
> initial values. However, one or more were not. Stats are
> zone init allocated delta
> private 1000000 738112 261888
> shared 9999000000 9999261888 -261888. [
> 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> java.lang.RuntimeException: java.sql.SQLException: Failure while executing
> query.
> at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
> at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> at sqlline.SqlLine.print(SqlLine.java:1809)
> at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> at sqlline.SqlLine.dispatch(SqlLine.java:889)
> at sqlline.SqlLine.begin(SqlLine.java:763)
> at sqlline.SqlLine.start(SqlLine.java:498)
> at sqlline.SqlLine.main(SqlLine.java:460)
> 0: jdbc:drill:zk=local>
> From the log file
> 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR
> o.a.d.e.w.f.AbstractStatusReporter - Error
> 669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment.
> java.lang.IllegalStateException: Failure while closing accountor. Expected
> private and shared pools to be set to initial values. However, one or more
> were not. Stats are
> zone init allocated delta
> private 1000000 738112 261888
> shared 9999000000 9999261888 -261888.
> at
> org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO
> o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING -->
> FAILED
> org.apache.drill.exec.rpc.RemoteRpcException: Failure while running
> fragment., Failure while closing accountor. Expected private and shared
> pools to be set to initial values. However, one or more were not. Stats are
> zone init allocated delta
> private 1000000 738112 261888
> shared 9999000000 9999261888 -261888. [
> 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> at
> org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> ...
> 2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN
> o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources.
> java.lang.IllegalStateException: Failure while trying to close child
> allocator: Child level allocators not closed. Fragment 0:0. Stack trace:
>
> org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43)
>
> org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112)
>
> org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35)
>
> org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
>
> org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39)
>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
>
> org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188)
>
> org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97)
>
> org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
>
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109)
>
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> java.lang.Thread.run(Thread.java:745)
> at
> org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
