HyukjinKwon opened a new pull request, #41206:
URL: https://github.com/apache/spark/pull/41206

   ### What changes were proposed in this pull request?
   
   This PR is a followup of https://github.com/apache/spark/pull/41013 that 
sets `SPARK_CONNECT_MODE_ENABLED` when running PySpark shell via `bin/pyspark 
--remote=local` so it works.
   
   ### Why are the changes needed?
   
   It is broken after the PR:
   
   ```
   % ./bin/pyspark --remote local
   ...
   Traceback (most recent call last):
     File "/.../python/pyspark/shell.py", line 78, in <module>
       sc = spark.sparkContext
     File "/.../python/pyspark/sql/connect/session.py", line 567, in 
sparkContext
       raise PySparkNotImplementedError(
   pyspark.errors.exceptions.base.PySparkNotImplementedError: [NOT_IMPLEMENTED] 
sparkContext() is not implemented.
   ```
   
   
   ### Does this PR introduce _any_ user-facing change?
   
   No to end users.
   
   Yes to the dev as described above.
   
   
   ### How was this patch tested?
   
   Manually tested via `./bin/pyspark --remote local`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to