[GitHub] [spark] jerryshao commented on issue #25058: [SPARK-21067][SQL] Fix Thrift Server - CTAS fail with Unable to move source
jerryshao commented on issue #25058: [SPARK-21067][SQL] Fix Thrift Server - CTAS fail with Unable to move source URL: https://github.com/apache/spark/pull/25058#issuecomment-510790332 Yes, you can carefully track which thread to create FS and guarantee the same thread to close FS, then this problem could be solved, but it is a little hard to track. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jerryshao commented on issue #25058: [SPARK-21067][SQL] Fix Thrift Server - CTAS fail with Unable to move source
jerryshao commented on issue #25058: [SPARK-21067][SQL] Fix Thrift Server - CTAS fail with Unable to move source URL: https://github.com/apache/spark/pull/25058#issuecomment-509053862 I don't think it is necessary to do some code changes for this, may be adding docs is enough. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] [spark] jerryshao commented on issue #25058: [SPARK-21067][SQL] Fix Thrift Server - CTAS fail with Unable to move source
jerryshao commented on issue #25058: [SPARK-21067][SQL] Fix Thrift Server - CTAS fail with Unable to move source URL: https://github.com/apache/spark/pull/25058#issuecomment-508752145 This is a known issue (due to the design of Hadoop FileSystem interface), you can set hadoop configuration explicitly to disable cache either via Spark or via hadoop conf file. I don't think it is necessary to add another configuration. Besides this only works for HDFS. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
