fx19880617 opened a new issue #6772: URL: https://github.com/apache/incubator-pinot/issues/6772
Since we support segment name with start/end time in it, if the time format is in `yy/mm/dd` then it introduces special characters like '/' into segment name. Segment upload path if fine, we can see the segment is loaded into the controller, but it's stored into a directory format. E.g. segment name: `covid_cases_OFFLINE_2020/10/23_2021/01/28_0` is stored into many levels of directory: ``` ➜ find pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases/covid_cases_OFFLINE_2020 pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases/covid_cases_OFFLINE_2020/10 pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases/covid_cases_OFFLINE_2020/10/23_2021 pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases/covid_cases_OFFLINE_2020/10/23_2021/01 pinot-docker-demo/pinot/controller/data/Deleted_Segments/covid_cases/covid_cases_OFFLINE_2020/10/23_2021/01/28_0 ``` From zk side, the segment is also stored into many levels:  Then this prevents segment download from pinot server: The log is: ``` pinot-server_1 | Got temporary error status code: 500 while downloading segment from: http://pinot-controller:9000/segments/covid_cases/covid_cases_OFFLINE_2020%2F10%2F23_2021%2F01%2F28_0 to: /tmp/data/server/data/segment/covid_cases_OFFLINE/tmp-covid_cases_OFFLINE_2020/10/23_2021/01/28_0-b65e3a35-d867-4a83-8404-707172c18e4e/covid_cases_OFFLINE_2020/10/23_2021/01/28_0.enc pinot-server_1 | org.apache.pinot.common.exception.HttpErrorStatusException: Got error status code: 500 (Internal Server Error) with reason: "Failed to get reason" while sending request: http://pinot-controller:9000/segments/covid_cases/covid_cases_OFFLINE_2020%2F10%2F23_2021%2F01%2F28_0 pinot-server_1 | at org.apache.pinot.common.utils.FileUploadDownloadClient.downloadFile(FileUploadDownloadClient.java:670) ~[pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-04e2bcce5026f5911183a27f5e8fed259572dfaf] ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
