This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new a9df2ecd806 [MINOR][DOCS] Remove Python 3.9 and Apache Arrow warning
comment
a9df2ecd806 is described below
commit a9df2ecd806c3241d531df197170944746b343a4
Author: panbingkun <[email protected]>
AuthorDate: Fri Jan 20 16:13:30 2023 -0800
[MINOR][DOCS] Remove Python 3.9 and Apache Arrow warning comment
### What changes were proposed in this pull request?
The pr aims to update the doc of arrow.
### Why are the changes needed?
Our docs (https://spark.apache.org/docs/latest/index.html#downloading):
<img width="904" alt="image"
src="https://user-images.githubusercontent.com/15246973/213698727-fb75490a-9713-4215-ba92-078b8c9d9c32.png">
But, PyArrow is currently compatible with Python 3.9.
https://arrow.apache.org/docs/python/install.html#python-compatibility
<img width="489" alt="image"
src="https://user-images.githubusercontent.com/15246973/213697081-18ee63f7-9db6-4ba7-9351-213d40ddf980.png">
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Manual test.
Closes #39675 from panbingkun/docs_arrow.
Authored-by: panbingkun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/index.md | 1 -
1 file changed, 1 deletion(-)
diff --git a/docs/index.md b/docs/index.md
index aabf6adc222..f6310c41ba7 100644
--- a/docs/index.md
+++ b/docs/index.md
@@ -45,7 +45,6 @@ Java 8 prior to version 8u362 support is deprecated as of
Spark 3.4.0.
When using the Scala API, it is necessary for applications to use the same
version of Scala that Spark was compiled for.
For example, when using Scala 2.13, use Spark compiled for 2.13, and compile
code/applications for Scala 2.13 as well.
-For Python 3.9, Arrow optimization and pandas UDFs might not work due to the
supported Python versions in Apache Arrow. Please refer to the latest [Python
Compatibility](https://arrow.apache.org/docs/python/install.html#python-compatibility)
page.
For Java 11, `-Dio.netty.tryReflectionSetAccessible=true` is required
additionally for Apache Arrow library. This prevents
`java.lang.UnsupportedOperationException: sun.misc.Unsafe or
java.nio.DirectByteBuffer.(long, int) not available` when Apache Arrow uses
Netty internally.
# Running the Examples and Shell
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]