siddharthteotia commented on issue #4876: Capture the exact UPDATE operation in DefaultColumnHandler URL: https://github.com/apache/incubator-pinot/pull/4876#issuecomment-560783008 > Can you copy paste the sample exception log here? > > Plus, it seems there's no code change in `V3DefaultColumnHandler`, which means we still don't know what action we're trying to do. Can you adjust the code there? @jackjlli , See the exception trace below. Note that I have removed the table name and column name. Change to V3DefaultColumnHandler is not needed since we print the action today. However, since we only capture UPDATE_METRIC or UPDATE_DIMENSION, the log doesn't indicate what kind of update is asked by the schema for the particular column. `2019/11/28 17:44:52.322 INFO [HelixInstanceDataManager] [HelixTaskExecutor-message_handle_thread] [pinot-server] [] Reloading all segments in table: blah_table 2019/11/28 17:44:52.325 INFO [HelixInstanceDataManager] [HelixTaskExecutor-message_handle_thread] [pinot-server] [] Reloading segment: blah_table_segment in blah_table 2019/11/28 17:44:53.058 INFO [V3DefaultColumnHandler] [HelixTaskExecutor-message_handle_thread] [pinot-server] [] Starting default column action: **UPDATE_METRIC** on column: blah_column 2019/11/28 17:44:53.058 INFO [LoaderUtils] [HelixTaskExecutor-message_handle_thread] [pinot-server] [] Trying to recover index directory: blah blah blah 715149 2019/11/28 17:44:53.058 INFO [LoaderUtils] [HelixTaskExecutor-message_handle_thread] [pinot-server] [] Deleting index directory: blah blah blah 715150 2019/11/28 17:44:53.149 ERROR [HelixTask] [HelixTaskExecutor-message_handle_thread] [pinot-server] [] Exception while executing a message.java.lang.RuntimeException: Caught exception while reloading segment: in table 715151 java.lang.RuntimeException: Caught exception while reloading segment: in table: blah_table 715152 at org.apache.pinot.server.starter.helix.SegmentMessageHandlerFactory$SegmentReloadMessageHandler.handleMessage(SegmentMessageHandlerFactory.java:182) 715153 at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:97) ~[helix-core-0.8.4.905.jar:0.8.4.905] 715154 at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:49) ~[helix-core-0.8.4.905.jar:0.8.4.905] 715155 at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_172] 715156 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_172] 715157 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_172] 715158 at java.lang.Thread.run(Thread.java:748) [?:1.8.0_172] 715159 Caused by: org.apache.pinot.core.segment.index.loader.V3RemoveIndexException: Default value indices for column: appHotLaunchDurationT cannot be removed for V3 format segment. 715160 at org.apache.pinot.core.segment.index.loader.defaultcolumn.V3DefaultColumnHandler.updateDefaultColumn(V3DefaultColumnHandler.java:54) 715161 at org.apache.pinot.core.segment.index.loader.defaultcolumn.BaseDefaultColumnHandler.updateDefaultColumns(BaseDefaultColumnHandler.java:100) 715162 at org.apache.pinot.core.segment.index.loader.SegmentPreProcessor.process(SegmentPreProcessor.java:90) 715163 at org.apache.pinot.core.indexsegment.immutable.ImmutableSegmentLoader.load(ImmutableSegmentLoader.java:101) 715164 at org.apache.pinot.server.starter.helix.HelixInstanceDataManager.reloadSegment(HelixInstanceDataManager.java:223) 715165 at org.apache.pinot.server.starter.helix.HelixInstanceDataManager.reloadAllSegments(HelixInstanceDataManager.java:183) 715166 at org.apache.pinot.server.starter.helix.SegmentMessageHandlerFactory$SegmentReloadMessageHandler.handleMessage(SegmentMessageHandlerFactory.java:171) `
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
