satish-mittal commented on issue #10861: URL: https://github.com/apache/pinot/issues/10861#issuecomment-1580172849
The entire 10 minutes seem to be taken in index building only. That explains why we are seeing SIGSEGV only now after enabling lucene index. ``` 2023/06/06 12:37:08.773 INFO [LLRealtimeSegmentDataManager_viewName__3__11117__20230606T1148Z] [viewName__3__11117__20230606T1148Z] Trying to build segment 2023/06/06 12:37:35.248 INFO [SegmentDictionaryCreator] [viewName__3__11117__20230606T1148Z] Created dictionary for STRING column: protocol_name with cardinality: 4, max length in bytes: 5, range: to HTTPS 2023/06/06 12:37:35.249 INFO [SegmentIndexCreationDriverImpl] [viewName__3__11117__20230606T1148Z] Start building IndexCreator! 2023/06/06 12:47:09.036 WARN [LLRealtimeSegmentDataManager_viewName__3__11117__20230606T1148Z] [HelixTaskExecutor-message_handle_thread_29] Failed to stop consumer thread within 10 minutes ``` If we look at the above timeline, consumer thread starts building segment at `12:37:08.773`. Dictionary creation finishes by `12:37:35.248`. Then it starts building index creator at `12:37:35.249`. But `SegmentIndexCreationDriverImpl` is not able to finish its work in next 10 minutes, and helix handler ends up deleting segment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
