[
https://issues.apache.org/jira/browse/DRILL-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14355417#comment-14355417
]
Khurram Faraaz commented on DRILL-2417:
---------------------------------------
Similar Exception is seen when session parameter
`store.parquet.vector_fill_check_threshold` = 10;
0: jdbc:drill:zk=local> alter session set
`store.parquet.vector_fill_check_threshold` = 10;
+------------+------------+
| ok | summary |
+------------+------------+
| true | store.parquet.vector_fill_check_threshold updated. |
Query failed: RemoteRpcException: Failure while running fragment., Failure
while closing accountor. Expected private and shared pools to be set to
initial values. However, one or more were not. Stats are
zone init allocated delta
private 1000000 738112 261888
shared 9999000000 9999261888 -261888. [
e5c36bf7-7eb9-4d20-a0ee-f8a5ca7b8a33 on 10.250.0.35:31010 ]
[ e5c36bf7-7eb9-4d20-a0ee-f8a5ca7b8a33 on 10.250.0.35:31010 ]
java.lang.RuntimeException: java.sql.SQLException: Failure while executing
query.
at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
at sqlline.SqlLine.print(SqlLine.java:1809)
at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
at sqlline.SqlLine.dispatch(SqlLine.java:889)
at sqlline.SqlLine.begin(SqlLine.java:763)
at sqlline.SqlLine.start(SqlLine.java:498)
at sqlline.SqlLine.main(SqlLine.java:460)
> Exception seen when system parameter is set to `store.parquet.compression` =
> 'snappy'
> -------------------------------------------------------------------------------------
>
> Key: DRILL-2417
> URL: https://issues.apache.org/jira/browse/DRILL-2417
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Affects Versions: 0.8.0
> Environment: Administrators-MacBook-Pro-11:log kfaraaz$ uname -a
> Darwin Administrators-MacBook-Pro-11.local 14.0.0 Darwin Kernel Version
> 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64
> x86_64
> Reporter: Khurram Faraaz
> Assignee: Steven Phillips
>
> Attempt to, alter system set `store.parquet.compression` = 'snappy'
> results in an Exception
> Details of driblet version that I am working with are
> 0: jdbc:drill:zk=local> select * from sys.version;
> +------------+----------------+-------------+-------------+------------+
> | commit_id | commit_message | commit_time | build_email | build_time |
> +------------+----------------+-------------+-------------+------------+
> | a84f7b9e88b1827e6b4da8cdd25c6d4f12dcdadc | DRILL-2338: Fix
> Decimal38/Decimal28 vector's get() to copy the scale and precision into the
> holder | 02.03.2015 @ 14:13:27 EST | Unknown | 02.03.2015 @ 15:43:47 EST |
> +------------+----------------+-------------+-------------+------------+
> 1 row selected (0.334 seconds)
> Failing alter system set statement
> 0: jdbc:drill:zk=local> alter system set `store.parquet.compression`='snappy';
> +------------+------------+
> | ok | summary |
> +------------+------------+
> | true | store.parquet.compression updated. |
> Query failed: RemoteRpcException: Failure while running fragment., Failure
> while closing accountor. Expected private and shared pools to be set to
> initial values. However, one or more were not. Stats are
> zone init allocated delta
> private 1000000 738112 261888
> shared 9999000000 9999261888 -261888. [
> 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> java.lang.RuntimeException: java.sql.SQLException: Failure while executing
> query.
> at sqlline.SqlLine$IncrementalRows.hasNext(SqlLine.java:2514)
> at sqlline.SqlLine$TableOutputFormat.print(SqlLine.java:2148)
> at sqlline.SqlLine.print(SqlLine.java:1809)
> at sqlline.SqlLine$Commands.execute(SqlLine.java:3766)
> at sqlline.SqlLine$Commands.sql(SqlLine.java:3663)
> at sqlline.SqlLine.dispatch(SqlLine.java:889)
> at sqlline.SqlLine.begin(SqlLine.java:763)
> at sqlline.SqlLine.start(SqlLine.java:498)
> at sqlline.SqlLine.main(SqlLine.java:460)
> 0: jdbc:drill:zk=local>
> From the log file
> 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] ERROR
> o.a.d.e.w.f.AbstractStatusReporter - Error
> 669998c2-d44f-446d-85b1-bc19b0a33003: Failure while running fragment.
> java.lang.IllegalStateException: Failure while closing accountor. Expected
> private and shared pools to be set to initial values. However, one or more
> were not. Stats are
> zone init allocated delta
> private 1000000 738112 261888
> shared 9999000000 9999261888 -261888.
> at
> org.apache.drill.exec.memory.AtomicRemainder.close(AtomicRemainder.java:200)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at org.apache.drill.exec.memory.Accountor.close(Accountor.java:376)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:284)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.ops.OperatorContext.close(OperatorContext.java:118)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScanBatch.cleanup(ScanBatch.java:351)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.cleanup(IteratorValidatorBatchIterator.java:148)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.internalStop(ScreenCreator.java:178)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.ScreenCreator$ScreenRoot.innerNext(ScreenCreator.java:124)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.physical.impl.BaseRootExec.next(BaseRootExec.java:57)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:121)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> 2015-03-10 10:29:05,183 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] INFO
> o.a.drill.exec.work.foreman.Foreman - State change requested. RUNNING -->
> FAILED
> org.apache.drill.exec.rpc.RemoteRpcException: Failure while running
> fragment., Failure while closing accountor. Expected private and shared
> pools to be set to initial values. However, one or more were not. Stats are
> zone init allocated delta
> private 1000000 738112 261888
> shared 9999000000 9999261888 -261888. [
> 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> [ 669998c2-d44f-446d-85b1-bc19b0a33003 on 10.250.0.35:31010 ]
> at
> org.apache.drill.exec.work.foreman.QueryManager.statusUpdate(QueryManager.java:95)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.foreman.QueryManager$RootStatusReporter.statusChange(QueryManager.java:154)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:114)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.AbstractStatusReporter.fail(AbstractStatusReporter.java:110)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.internalFail(FragmentExecutor.java:176)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:136)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
> ...
> 2015-03-10 10:29:05,191 [2b00d61d-b6c2-e7a4-2baa-6bb5f23f6098:frag:0:0] WARN
> o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out resources.
> java.lang.IllegalStateException: Failure while trying to close child
> allocator: Child level allocators not closed. Fragment 0:0. Stack trace:
>
> org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:43)
>
> org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:112)
>
> org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:35)
>
> org.apache.drill.exec.store.direct.DirectBatchCreator.getBatch(DirectBatchCreator.java:29)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:125)
>
> org.apache.drill.exec.physical.base.AbstractSubScan.accept(AbstractSubScan.java:39)
>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:208)
>
> org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
>
> org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
>
> org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitStore(AbstractPhysicalVisitor.java:130)
>
> org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitScreen(AbstractPhysicalVisitor.java:188)
>
> org.apache.drill.exec.physical.config.Screen.accept(Screen.java:97)
>
> org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
>
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:109)
>
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> java.lang.Thread.run(Thread.java:745)
> at
> org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:273)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:317)
> ~[drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:163)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:142)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:303)
> [drill-java-exec-0.8.0-SNAPSHOT-rebuffed.jar:0.8.0-SNAPSHOT]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> [na:1.7.0_75]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> [na:1.7.0_75]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_75]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
