beyond1920 opened a new issue, #11030: URL: https://github.com/apache/hudi/issues/11030
Dear community, I encounter some spark writer jobs failed. <img width="1696" alt="image" src="https://github.com/apache/hudi/assets/1525333/fef39f4b-89c9-44be-b034-ae58c2615764";> The error happened when each append task initialized. <img width="1072" alt="image" src="https://github.com/apache/hudi/assets/1525333/5c96940c-f187-4363-8f70-1c6f3888347f";> And using embed timeline server by default. so here `RemoteHoodieTableFileSystemView` would send `LATEST_PARTITION_SLICE_URL` request to the driver. After the handler thread in thread pool of timeline service in driver received this request, it would call the `sliceHandler` to `getLatestFileSlice`. And it would create partition path dir if it not exists <img width="970" alt="image" src="https://github.com/apache/hudi/assets/1525333/dc83d8eb-93c3-45e1-857f-bcb2f78dea52";> <img width="670" alt="image" src="https://github.com/apache/hudi/assets/1525333/0c618e03-32d0-4bf9-b28b-eed4004ddbb0";> I add some logs in the main thread and the new thread of the timeline service. And found that the user group information in the main thread of driver is right, but that of new thread is wrong. <img width="1258" alt="image" src="https://github.com/apache/hudi/assets/1525333/07043261-453c-4cd3-8a91-58bf56f4d7f5";> <img width="776" alt="image" src="https://github.com/apache/hudi/assets/1525333/17a575d4-ed76-43a6-a5d6-71918a6274af";> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
