AngersZhuuuu commented on a change in pull request #30973:
URL: https://github.com/apache/spark/pull/30973#discussion_r550979149
##########
File path:
sql/core/src/main/scala/org/apache/spark/sql/execution/BaseScriptTransformationExec.scala
##########
@@ -69,9 +75,19 @@ trait BaseScriptTransformationExec extends UnaryExecNode {
}
}
- protected def initProc: (OutputStream, Process, InputStream, CircularBuffer)
= {
- val cmd = List("/bin/bash", "-c", script)
Review comment:
> Yeah, I don't feel strongly. Why don't you just fix the issue you face
first without the configuration first?
>
> The new configuration looks orthogonal with the issue you faced anyway.
Because I didn't figured out why `/bin/bash -c` in the spark root dir can't
run the program `xx.py`.
So I check the code about hive and with hive's code we can support all case
then make this pr.
After you say add Spark root dir to `PATH` I make it clear.... we treat
`xx.py` as a program, we need to find it in `PATH`.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
