jadami10 commented on issue #11603: URL: https://github.com/apache/pinot/issues/11603#issuecomment-1758216417
i've replicated this locally. it happens when you have several thousands segments and reload several times back to back, so it's not pervasive. But it does seem to be to clock skew. You effectively see small, single digit millisecond differences where the load time on the server is 2-4ms earlier than the job submission time. There's really no non-hacky way to solve this without storing some state that ties the segment name to the reload job id it reloaded for. I'm not sure how feasible that is. I think for now I'll probably just change the check internally to give it like a 5 second buffer. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
