ajithme opened a new pull request #27039: [SPARK-29174][SQL] LOCAL is not 
supported in INSERT OVERWRITE DIRECTORY to data source
URL: https://github.com/apache/spark/pull/27039
 
 
   ``` insert overwrite local directory <location> using ```
   
   throws exception 
   
   ```
   Error: org.apache.spark.sql.catalyst.parser.ParseException:
   
   LOCAL is not supported in INSERT OVERWRITE DIRECTORY to data source(line 1, 
pos 0)
   ```
   which was introduced in https://github.com/apache/spark/pull/18975, but this 
restriction is not needed, hence dropping the same.
   
   ### What changes were proposed in this pull request?
   Parser do not throw exception if  `INSERT OVERWRITE LOCAL DIRECTORY`
   
   ### Why are the changes needed?
   Keep behaviour consistent for local and remote file-system in  `INSERT 
OVERWRITE DIRECTORY`
   
   ### Does this PR introduce any user-facing change?
   Yes, after this change `INSERT OVERWRITE LOCAL DIRECTORY` will not throw 
exception
   
   ### How was this patch tested?
   Added UT

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to