fx19880617 commented on issue #3420: Deep Storage Support for Realtime URL: https://github.com/apache/incubator-pinot/issues/3420#issuecomment-437806568 > > -Then, we commit the segment metadata. In the first pass, we will still need to download the segment from deep storage or send the entire segment with .tar.gz in order to to get the segment metadata. > > Why do we need to download the segment again to get segment metadata info? Which kind of info we can get from a download? Can we get them the query parameters of segCommitEnd request? I think this is the first phase which we follow the same steps as offline segment push to download segment from remote storage in controller and load segment metadata from it. Eventually we should be able to get rid of controller downloading segments and only push segment metadata.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
