wForget commented on code in PR #1260:
URL: https://github.com/apache/auron/pull/1260#discussion_r2315836684
##########
spark-extension/src/main/java/org/apache/spark/sql/auron/JniBridge.java:
##########
@@ -89,10 +90,14 @@ public static boolean isDriverSide() {
public static FSDataInputWrapper openFileAsDataInputWrapper(FileSystem fs,
String path) throws Exception {
// the path is a URI string, so we need to convert it to a URI object,
ref:
// org.apache.spark.paths.SparkPath.toPath
+ TaskContextHelper$.MODULE$.setThreadNameFromTaskContext();
+ TaskContextHelper$.MODULE$.setHDFSCallerContext();
Review Comment:
HDFS caller context also seems to be a threa local object, maybe we can
initialize it in `tokio_runtime_builder.on_thread_start` .
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@auron.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
