mluvin-stripe opened a new issue, #17578: URL: https://github.com/apache/pinot/issues/17578
https://docs.pinot.apache.org/operators/tutorials/performance-optimization-configurations#enabling-server-side-segment-stream-download-untar-with-rate-limiter currently only supports http-based segment downloads (using [HttpSegmentFetcher](https://github.com/apache/pinot/blob/master/pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/HttpSegmentFetcher.java)). I’d like to add support for [PinotFSSegmentFetcher](https://github.com/apache/pinot/blob/master/pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/PinotFSSegmentFetcher.java) to use this feature as well, as we’re downloading files from S3. Currently, when I try to enable pinot.server.instance.segment.stream.download.untar, while using PinotFSSegmentFetcher, servers fail to download segments since [fetchUntarSegmentToLocalStreamed](https://github.com/apache/pinot/blob/234d38239643914c5c193e4f297e4d4f2432c1a7/pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/BaseSegmentFetcher.java#L109) is not implemented. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
