itholic commented on PR #37671:
URL: https://github.com/apache/spark/pull/37671#issuecomment-1237515485
The `read_excel` tests still failed for some reason with error below:
```
======================================================================
FAIL [1.476s]: test_read_excel
(pyspark.pandas.tests.test_dataframe_spark_io.DataFrameSparkIOTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/__w/spark/spark/python/pyspark/pandas/tests/test_dataframe_spark_io.py", line
278, in test_read_excel
ps.read_excel(tmp, index_col=0).sort_index(),
File "/__w/spark/spark/python/pyspark/pandas/namespace.py", line 1224, in
read_excel
return read_excel_on_spark(pdf_or_psers, sheet_name)
File "/__w/spark/spark/python/pyspark/pandas/namespace.py", line 1213, in
read_excel_on_spark
psdf = DataFrame(psdf._internal.with_new_sdf(sdf))
File "/__w/spark/spark/python/pyspark/pandas/internal.py", line 1223, in
with_new_sdf
return self.copy(
File "/__w/spark/spark/python/pyspark/pandas/internal.py", line 1427, in
copy
return InternalFrame(
File "/__w/spark/spark/python/pyspark/pandas/internal.py", line 755, in
__init__
assert all(
AssertionError: ([InternalField(dtype=float64,
struct_field=StructField('__index_level_0__', DoubleType(), False))],
[StructField('__index_level_0__', DoubleType(), True)])
----------------------------------------------------------------------
Ran 8 tests in 34.923s
```
I failed to reproduce this error although I use the same version of related
envs (e.g. `Python`, `pandas`, `openpyxl`).
Let me leave the re-enabling `read_excel` tests as TODO, and just re-enable
the `to_excel` tests here for now.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
