No clue. :(. Now I am struggling to run distinct on parquet file.
> From: [email protected]
> Subject: Re: Aggregation sum() fails on parquet file
> Date: Fri, 31 Oct 2014 07:14:43 +0200
> To: [email protected]
>
> Hi,
> Any clue on that? I'm facing a similar problem
>
> Thanks,
> Daniel
>
> > On 30 באוק׳ 2014, at 21:28, Tridib Samanta <[email protected]> wrote:
> >
> > Hello,
> > I am running a query like: select sum(amount) from
> > myhdfs.parquet.`claim.parquet`;
> > This fails with the following error at sqlline:
> >
> > Query failed: Failure while running fragment. Schema is currently null.
> > You must call buildSchema(SelectionVectorMode) before this container can
> > return a schema. [00314ea1-342a-4322-ac00-f8307c554733]
> > Error: exception while executing query: Failure while trying to get next
> > result batch. (state=,code=0)
> >
> >
> > Here is the stack trace from drillbits.log:
> >
> > 2014-10-30 15:12:05,865 [3fb04943-c0e5-4801-a907-2bc3462a2997:frag:2:10]
> > WARN o.a.d.e.w.fragment.FragmentExecutor - Failure while closing out
> > resources.
> > java.lang.IllegalStateException: Failure while trying to close child
> > allocator: Child level allocators not closed. Fragment 2:10. Stack trace:
> >
> > org.apache.drill.exec.ops.OperatorContext.<init>(OperatorContext.java:41)
> >
> > org.apache.drill.exec.physical.impl.ScanBatch.<init>(ScanBatch.java:90)
> >
> > org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:148)
> >
> > org.apache.drill.exec.store.parquet.ParquetScanBatchCreator.getBatch(ParquetScanBatchCreator.java:54)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> >
> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSubScan(AbstractPhysicalVisitor.java:113)
> >
> > org.apache.drill.exec.store.parquet.ParquetRowGroupScan.accept(ParquetRowGroupScan.java:107)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> >
> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196)
> >
> > org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> >
> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashAggregate(AbstractPhysicalVisitor.java:93)
> >
> > org.apache.drill.exec.physical.config.HashAggregate.accept(HashAggregate.java:62)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:62)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> >
> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitIteratorValidator(AbstractPhysicalVisitor.java:196)
> >
> > org.apache.drill.exec.physical.config.IteratorValidator.accept(IteratorValidator.java:34)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.getChildren(ImplCreator.java:74)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:59)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.visitOp(ImplCreator.java:39)
> >
> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitSender(AbstractPhysicalVisitor.java:98)
> >
> > org.apache.drill.exec.physical.base.AbstractPhysicalVisitor.visitHashPartitionSender(AbstractPhysicalVisitor.java:141)
> >
> > org.apache.drill.exec.physical.config.HashPartitionSender.accept(HashPartitionSender.java:66)
> >
> > org.apache.drill.exec.physical.impl.ImplCreator.getExec(ImplCreator.java:87)
> >
> > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:94)
> >
> > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > java.lang.Thread.run(Thread.java:745)
> > at
> > org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.close(TopLevelAllocator.java:215)
> > ~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
> > at
> > org.apache.drill.exec.ops.FragmentContext.close(FragmentContext.java:271)
> > ~[drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
> > at
> > org.apache.drill.exec.work.fragment.FragmentExecutor.closeOutResources(FragmentExecutor.java:139)
> > [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
> > at
> > org.apache.drill.exec.work.fragment.FragmentExecutor.run(FragmentExecutor.java:107)
> > [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
> > at
> > org.apache.drill.exec.work.WorkManager$RunnableWrapper.run(WorkManager.java:250)
> > [drill-java-exec-0.5.0-incubating-rebuffed.jar:0.5.0-incubating]
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > [na:1.7.0_67]
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > [na:1.7.0_67]
> >
> > Any help is greatly appreciated.
> >
> > Thanks & Regards
> > Tridib
> >
