Hi there, Are you running the latest master?
Tim On Thu, Oct 30, 2014 at 10:57 PM, Tridib Samanta <[email protected]> wrote: > No clue. :(. Now I am struggling to run distinct on parquet file. > >> From: [email protected] >> Subject: Re: Aggregation sum() fails on parquet file >> Date: Fri, 31 Oct 2014 07:14:43 +0200 >> To: [email protected] >> >> Hi, >> Any clue on that? I'm facing a similar problem >> >> Thanks, >> Daniel >> >> > On 30 באוק׳ 2014, at 21:28, Tridib Samanta <[email protected]> wrote: >> > >> > Hello, >> > I am running a query like: select sum(amount) from >> > myhdfs.parquet.`claim.parquet`; >> > This fails with the following error at sqlline: >> > >> > Query failed: Failure while running fragment. Schema is currently null. >> > You must call buildSchema(SelectionVectorMode) before this container can >> > return a schema. [00314ea1-342a-4322-ac00-f8307c554733] >> > Error: exception while executing query: Failure while trying to get next >> > result batch. (state=,code=0) >> > >> > >> > Here is the stack trace from drillbits.log: >> > >> > 2014-10-30 15:12:05,865 [3fb04943-c0e5-4801-a907-2bc3462a2997:frag:2:10] >> > WARN o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out >> > resources. >> > java.lang.IllegalStateException: Failure while trying to close child >> > allocator: Child level allocators not closed. Fragment 2:10. Stack trace: >> > >> > org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:41) >> > >> > org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:90) >> > >> > org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:148) >> > >> > org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:54) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) >> > >> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:113) >> > >> > org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) >> > >> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196) >> > >> > org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) >> > >> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashAggregate(AbstractPhysicalVisitor.java:93) >> > >> > org.apache.drill.exec.physical.config.HashAggregate.accept(HashAggregate.java:62) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) >> > >> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196) >> > >> > org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39) >> > >> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSender(AbstractPhysicalVisitor.java:98) >> > >> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashPartitionSender(AbstractPhysicalVisitor.java:141) >> > >> > org.apache.drill.exec.physical.config.HashPartitionSender.accept(HashPartitionSender.java:66) >> > >> > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87) >> > >> > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:94) >> > >> > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) >> > >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> > >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> > java.lang.Thread.run(Thread.java:745) >> > at >> > org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:215) >> > ~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating] >> > at >> > org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:271) >> > ~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating] >> > at >> > org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:139) >> > [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating] >> > at >> > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:107) >> > [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating] >> > at >> > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250) >> > [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating] >> > at >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> > [na:1.7.0_67] >> > at >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> > [na:1.7.0_67] >> > >> > Any help is greatly appreciated. >> > >> > Thanks & Regards >> > Tridib >> > >
