deepix opened a new issue, #13815:
URL: https://github.com/apache/pinot/issues/13815
We are seeing an NPE in Pinot. We run Pinot 1.0.0 on Kubernetes via
statefulsets.
This happened when we were trying to increase disk space for Pinot, we made
the change and then restarted the statefulset.
We had about ~2k occurrences of this NPE.
Exception trace from the application (client) side:
```
Encountered exception: {'errorCode': 200, 'message': 'QueryExecutionError:
' 'Received error query execution result block: {1000=null '
'java.lang.NullPointerException ' '\tat '
'org.apache.pinot.core.query.aggregation.function.DistinctCountHLLAggregationFunction.extractFinalResult(DistinctCountHLLAggregationFunction.java:363)
' '\tat '
'org.apache.pinot.core.query.aggregation.function.DistinctCountHLLAggregationFunction.extractFinalResult(DistinctCountHLLAggregationFunction.java:41)
' '\tat '
'org.apache.pinot.query.runtime.operator.MultistageAggregationExecutor.getResult(MultistageAggregationExecutor.java:107)
' '\tat '
'org.apache.pinot.query.runtime.operator.AggregateOperator.produceAggregatedBlock(AggregateOperator.java:204)}
'
'org.apache.pinot.query.service.dispatch.QueryDispatcher.getResultTable(QueryDispatcher.java:268)
' 'org.ap
ache.pinot.query.service.dispatch.QueryDispatcher.runReducer(QueryDispatcher.java:207)
'
'org.apache.pinot.query.service.dispatch.QueryDispatcher.submitAndReduce(QueryDispatcher.java:96)
'
'org.apache.pinot.broker.requesthandler.MultiStageBrokerRequestHandler.handleRequest(MultiStageBrokerRequestHandler.java:179)
'}
```
This is the server-side logs for the corresponding time:
```
Aug 07 13:14:02.220
Caught exception executing request 2028772242000657384:
Aug 07 13:14:02.220
SELECT DISTINCTCOUNTHLL(doc_id) total,
Aug 07 13:14:02.220
DISTINCTCOUNTHLL(doc_id) FILTER (
Aug 07 13:14:02.220
WHERE created_at_by_hr > 478623
Aug 07 13:14:02.220
) current_period,
Aug 07 13:14:02.220
DISTINCTCOUNTHLL(doc_id) FILTER (
Aug 07 13:14:02.220
WHERE created_at_by_hr
Aug 07 13:14:02.220
> 478617
Aug 07 13:14:02.220
AND created_at_by_hr <= 478623
Aug 07 13:14:02.220
) previous_period
Aug 07 13:14:02.220
FROM doc_metadata
Aug 07 13:14:02.220
WHERE
Aug 07 13:14:02.220
arrayToMv(channels) = '2b20d8d0-17d6-442a-8aa0-0765fe2e6036-twitter-api'
Aug 07 13:14:02.220
AND message_type = 'metadata-social'
Aug 07 13:14:02.220
AND created_at_by_hr >= 478604
Aug 07 13:14:02.220
AND created_at_by_hr < 478629
Aug 07 13:14:02.220
;
Aug 07 13:14:02.220
, Received error query execution result block: {1000=null
Aug 07 13:14:02.220
java.lang.NullPointerException
Aug 07 13:14:02.220
at
org.apache.pinot.core.query.aggregation.function.DistinctCountHLLAggregationFunction.extractFinalResult(DistinctCountHLLAggregationFunction.java:363)
Aug 07 13:14:02.220
at
org.apache.pinot.core.query.aggregation.function.DistinctCountHLLAggregationFunction.extractFinalResult(DistinctCountHLLAggregationFunction.java:41)
Aug 07 13:14:02.220
at
org.apache.pinot.query.runtime.operator.MultistageAggregationExecutor.getResult(MultistageAggregationExecutor.java:107)
Aug 07 13:14:02.220
at
org.apache.pinot.query.runtime.operator.AggregateOperator.produceAggregatedBlock(AggregateOperator.java:204)}
Aug 07 13:14:02.220
org.apache.pinot.query.service.dispatch.QueryDispatcher.getResultTable(QueryDispatcher.java:268)
Aug 07 13:14:02.220
org.apache.pinot.query.service.dispatch.QueryDispatcher.runReducer(QueryDispatcher.java:207)
Aug 07 13:14:02.220
org.apache.pinot.query.service.dispatch.QueryDispatcher.submitAndReduce(QueryDispatcher.java:96)
Aug 07 13:14:02.220
org.apache.pinot.broker.requesthandler.MultiStageBrokerRequestHandler.handleRequest(MultiStageBrokerRequestHandler.java:179)
Aug 07 13:14:02.220
Caught exception executing request 2028772242000657385:
Aug 07 13:14:02.220
SELECT DISTINCTCOUNTHLL(doc_id) total,
Aug 07 13:14:02.220
DISTINCTCOUNTHLL(doc_id) FILTER (
Aug 07 13:14:02.220
WHERE created_at_by_hr > 478623
Aug 07 13:14:02.220
) current_period,
Aug 07 13:14:02.220
DISTINCTCOUNTHLL(doc_id) FILTER (
Aug 07 13:14:02.220
WHERE created_at_by_hr
Aug 07 13:14:02.220
> 478617
Aug 07 13:14:02.220
AND created_at_by_hr <= 478623
Aug 07 13:14:02.220
) previous_period
Aug 07 13:14:02.220
FROM doc_metadata
Aug 07 13:14:02.220
WHERE
Aug 07 13:14:02.220
arrayToMv(channels) = '2b20d8d0-17d6-442a-8aa0-0765fe2e6036-twitter-api'
Aug 07 13:14:02.220
AND message_type = 'metadata-news'
Aug 07 13:14:02.220
AND created_at_by_hr >= 478604
Aug 07 13:14:02.220
AND created_at_by_hr < 478629
Aug 07 13:14:02.220
;
Aug 07 13:14:02.221
, Received error query execution result block: {1000=null
Aug 07 13:14:02.221
java.lang.NullPointerException
Aug 07 13:14:02.221
at
org.apache.pinot.core.query.aggregation.function.DistinctCountHLLAggregationFunction.extractFinalResult(DistinctCountHLLAggregationFunction.java:363)
Aug 07 13:14:02.221
at
org.apache.pinot.core.query.aggregation.function.DistinctCountHLLAggregationFunction.extractFinalResult(DistinctCountHLLAggregationFunction.java:41)
Aug 07 13:14:02.221
at
org.apache.pinot.query.runtime.operator.MultistageAggregationExecutor.getResult(MultistageAggregationExecutor.java:107)
Aug 07 13:14:02.221
at
org.apache.pinot.query.runtime.operator.AggregateOperator.produceAggregatedBlock(AggregateOperator.java:204)}
Aug 07 13:14:02.221
org.apache.pinot.query.service.dispatch.QueryDispatcher.getResultTable(QueryDispatcher.java:268)
Aug 07 13:14:02.221
org.apache.pinot.query.service.dispatch.QueryDispatcher.runReducer(QueryDispatcher.java:207)
Aug 07 13:14:02.221
org.apache.pinot.query.service.dispatch.QueryDispatcher.submitAndReduce(QueryDispatcher.java:96)
Aug 07 13:14:02.221
org.apache.pinot.broker.requesthandler.MultiStageBrokerRequestHandler.handleRequest(MultiStageBrokerRequestHandler.java:179)
Aug 07 13:14:02.313
Failed to load LLC segment: doc_metadata__86__738__20240727T1641Z,
downloading a new copy
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
