[
https://issues.apache.org/jira/browse/CARBONDATA-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16505926#comment-16505926
]
Kevin Kong commented on CARBONDATA-2548:
----------------------------------------
schema:
CREATE TABLE IF NOT EXISTS pt2.order_detail (
id long,
order_code string,
sales_area_id integer,
sales_id integer,
order_inputer integer,
pro_type string,
currency integer,
exchange_rate decimal(10,0),
unit_cost_price decimal(10,0),
unit_selling_price decimal(10,0),
order_num integer,
order_amount decimal(10,0),
order_discount double,
order_account_amount decimal(10,0),
order_time timestamp,
delivery_channel integer,
delivery_address string,
recipients string,
contact string,
delivery_date date,
comments string)
STORED BY 'carbondata'
TBLPROPERTIES
('DICTIONARY_INCLUDE'='recipients,contact,sales_area_id,sales_id,order_inputer,pro_type,currency,exchange_rate,delivery_channel',
'NO_INVERTED_INDEX'='id,order_code', 'SORT_COLUMNS'='', 'TABLE_BLOCKSIZE'='8',
'streaming'='true'
)
> When using presto to query a table on carbondata, the "Could not read
> blocklet details" exception is reported
> -------------------------------------------------------------------------------------------------------------
>
> Key: CARBONDATA-2548
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2548
> Project: CarbonData
> Issue Type: Bug
> Components: presto-integration
> Affects Versions: 1.4.0
> Reporter: Kevin Kong
> Priority: Blocker
>
> I think it may be line 373 in CarbonTableInputFormat.java. When the
> CarbonInputSplit object was constructed, the detailInfo property was not
> initialized
>
> while (((double) bytesRemaining) / splitSize > 1.1) {
> int blkIndex = getBlockIndex(blkLocations, length -
> bytesRemaining);
> splits.add(makeSplit(segment.getSegmentNo(), path, length
> - bytesRemaining,
> splitSize, blkLocations[blkIndex].getHosts(),
> blkLocations[blkIndex].getCachedHosts(),
> FileFormat.ROW_V1));
>
>
>
> The detailed exception is as follows：
>
> 2018-05-28T00:43:23.903+0800 DEBUG query-execution-11
> com.facebook.presto.execution.QueryStateMachine Query
> 20180527_164323_00008_2xnww failed
> java.lang.RuntimeException: Could not read blocklet details
> at
> org.apache.carbondata.presto.impl.CarbonLocalInputSplit.convertSplit(CarbonLocalInputSplit.java:131)
> at
> org.apache.carbondata.presto.CarbondataPageSourceProvider.createQueryModel(CarbondataPageSourceProvider.java:139)
> at
> org.apache.carbondata.presto.CarbondataPageSourceProvider.createReader(CarbondataPageSourceProvider.java:98)
> at
> org.apache.carbondata.presto.CarbondataPageSourceProvider.createPageSource(CarbondataPageSourceProvider.java:79)
> at
> com.facebook.presto.spi.connector.classloader.ClassLoaderSafeConnectorPageSourceProvider.createPageSource(ClassLoaderSafeConnectorPageSourceProvider.java:44)
> at
> com.facebook.presto.split.PageSourceManager.createPageSource(PageSourceManager.java:56)
> at
> com.facebook.presto.operator.TableScanOperator.getOutput(TableScanOperator.java:259)
> at com.facebook.presto.operator.Driver.processInternal(Driver.java:337)
> at com.facebook.presto.operator.Driver.lambda$processFor$6(Driver.java:241)
> at com.facebook.presto.operator.Driver.tryWithLock(Driver.java:614)
> at com.facebook.presto.operator.Driver.processFor(Driver.java:235)
> at
> com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:622)
> at
> com.facebook.presto.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:163)
> at
> com.facebook.presto.execution.executor.LegacyPrioritizedSplitRunner.process(LegacyPrioritizedSplitRunner.java:23)
> at
> com.facebook.presto.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:485)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
