dongjoon-hyun commented on PR #38277: URL: https://github.com/apache/spark/pull/38277#issuecomment-1302482432
I also confirmed it fails on Java 11 although the symlink is read by Spark. ``` 10:56:59.862 Executor task launch worker for task 0.0 in stage 575.0 (TID 805) INFO HadoopRDD: Input split: file:/Users/dongjoon/APACHE/spark-merge/sql/hive/target/tmp/hive_execution_test_group/spark-8291c0da-bb82-4337-b3e2-14ae18722e60/symlink/symlink.txt:0+6 10:56:59.865 Executor task launch worker for task 0.0 in stage 575.0 (TID 805) INFO Executor: Finished task 0.0 in stage 575.0 (TID 805). 1421 bytes result sent to driver 10:56:59.865 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 1.0 in stage 575.0 (TID 806) (localhost, executor driver, partition 1, PROCESS_LOCAL, 7833 bytes) 10:56:59.865 Executor task launch worker for task 1.0 in stage 575.0 (TID 806) INFO Executor: Running task 1.0 in stage 575.0 (TID 806) 10:56:59.865 task-result-getter-1 INFO TaskSetManager: Finished task 0.0 in stage 575.0 (TID 805) in 8 ms on localhost (executor driver) (1/4) 10:56:59.866 Executor task launch worker for task 1.0 in stage 575.0 (TID 806) INFO HadoopRDD: Input split: file:/Users/dongjoon/APACHE/spark-merge/sql/hive/target/tmp/hive_execution_test_group/spark-8291c0da-bb82-4337-b3e2-14ae18722e60/symlink/symlink.txt:0+4 10:56:59.867 Executor task launch worker for task 1.0 in stage 575.0 (TID 806) INFO Executor: Finished task 1.0 in stage 575.0 (TID 806). 1378 bytes result sent to driver 10:56:59.868 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 2.0 in stage 575.0 (TID 807) (localhost, executor driver, partition 2, PROCESS_LOCAL, 7833 bytes) 10:56:59.868 task-result-getter-2 INFO TaskSetManager: Finished task 1.0 in stage 575.0 (TID 806) in 3 ms on localhost (executor driver) (2/4) 10:56:59.868 Executor task launch worker for task 2.0 in stage 575.0 (TID 807) INFO Executor: Running task 2.0 in stage 575.0 (TID 807) 10:56:59.869 Executor task launch worker for task 2.0 in stage 575.0 (TID 807) INFO HadoopRDD: Input split: file:/Users/dongjoon/APACHE/spark-merge/sql/hive/target/tmp/hive_execution_test_group/spark-8291c0da-bb82-4337-b3e2-14ae18722e60/symlink/symlink.txt:0+4 10:56:59.870 Executor task launch worker for task 2.0 in stage 575.0 (TID 807) INFO Executor: Finished task 2.0 in stage 575.0 (TID 807). 1378 bytes result sent to driver 10:56:59.870 dispatcher-event-loop-1 INFO TaskSetManager: Starting task 3.0 in stage 575.0 (TID 808) (localhost, executor driver, partition 3, PROCESS_LOCAL, 7833 bytes) 10:56:59.870 task-result-getter-3 INFO TaskSetManager: Finished task 2.0 in stage 575.0 (TID 807) in 2 ms on localhost (executor driver) (3/4) 10:56:59.870 Executor task launch worker for task 3.0 in stage 575.0 (TID 808) INFO Executor: Running task 3.0 in stage 575.0 (TID 808) 10:56:59.871 Executor task launch worker for task 3.0 in stage 575.0 (TID 808) INFO HadoopRDD: Input split: file:/Users/dongjoon/APACHE/spark-merge/sql/hive/target/tmp/hive_execution_test_group/spark-8291c0da-bb82-4337-b3e2-14ae18722e60/symlink/symlink.txt:0+6 10:56:59.872 Executor task launch worker for task 3.0 in stage 575.0 (TID 808) INFO Executor: Finished task 3.0 in stage 575.0 (TID 808). 1378 bytes result sent to driver 10:56:59.873 task-result-getter-0 INFO TaskSetManager: Finished task 3.0 in stage 575.0 (TID 808) in 3 ms on localhost (executor driver) (4/4) ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
