viirya commented on a change in pull request #30735:
URL: https://github.com/apache/spark/pull/30735#discussion_r541705354
##########
File path: docs/running-on-kubernetes.md
##########
@@ -1083,14 +1083,6 @@ See the [configuration page](configuration.html) for
information on Spark config
</td>
<td>2.4.0</td>
</tr>
-<tr>
- <td><code>spark.kubernetes.pyspark.pythonVersion</code></td>
- <td><code>"3"</code></td>
- <td>
- This sets the major Python version of the docker image used to run the
driver and executor containers. Can be 3.
- </td>
- <td>2.4.0</td>
-</tr>
Review comment:
The disappearance of the `pythonVersion` might make end users a bit hard
to follow quickly. Seems no migration guide is there for kubernetes. Should we
mention the removing and the support of PYSPARK_PYTHON and
PYSPARK_DRIVER_PYTHON env variables in this doc?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
