sunchao commented on pull request #34613:
URL: https://github.com/apache/spark/pull/34613#issuecomment-971785896
Thanks for the merge @HyukjinKwon !
Sorry for the delay, I'm still trying to test this. I followed the steps you
mentioned above:
```
pip install -r dev/requirements.txt
pip install pyarrow==6.0.0
python/run-tests --modules pyspark-sql
```
and also set `SPARK_HOME` to the `dist` directory under my Spark repo.
However I'm getting this error:
```
======================================================================
ERROR [0.000s]: setUpClass (pyspark.sql.tests.test_arrow.MaxResultArrowTests)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/Users/sunchao/git/spark/dist/python/pyspark/sql/tests/test_arrow.py", line
672, in setUpClass
"local[4]", cls.__name__,
conf=SparkConf().set("spark.driver.maxResultSize", "10k")
File "/Users/sunchao/git/spark/dist/python/pyspark/conf.py", line 131, in
__init__
self._jconf = _jvm.SparkConf(loadDefaults)
File
"/Users/sunchao/git/spark/dist/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py",
line 1697, in __getattr__
answer = self._gateway_client.send_command(
File
"/Users/sunchao/git/spark/dist/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py",
line 1036, in send_command
connection = self._get_connection()
File
"/Users/sunchao/git/spark/dist/python/lib/py4j-0.10.9.2-src.zip/py4j/clientserver.py",
line 281, in _get_connection
connection = self._create_new_connection()
File
"/Users/sunchao/git/spark/dist/python/lib/py4j-0.10.9.2-src.zip/py4j/clientserver.py",
line 288, in _create_new_connection
connection.connect_to_java_server()
File
"/Users/sunchao/git/spark/dist/python/lib/py4j-0.10.9.2-src.zip/py4j/clientserver.py",
line 402, in connect_to_java_server
self.socket.connect((self.java_address, self.java_port))
ConnectionRefusedError: [Errno 61] Connection refused
```
Do you know what I could have missed here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
