ebyhr commented on PR #3436:
URL: https://github.com/apache/iceberg-python/pull/3436#issuecomment-4581005395
```
___________________ test_spark_writes_orc_pyiceberg_reads[1]
___________________
...
@pytest.mark.integration
@pytest.mark.parametrize("format_version", [1, 2])
def test_spark_writes_orc_pyiceberg_reads(spark: SparkSession,
session_catalog: Catalog, format_version: int) -> None:
"""Test that ORC files written by Spark can be read by PyIceberg."""
identifier =
f"default.spark_writes_orc_pyiceberg_reads_v{format_version}"
# Create test data
test_data = [
(1, "Alice", 25, True),
(2, "Bob", 30, False),
(3, "Charlie", 35, True),
(4, "David", 28, True),
(5, "Eve", 32, False),
]
# Create Spark DataFrame
> spark_df = spark.createDataFrame(test_data, ["id", "name", "age",
"is_active"])
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...
details = "[SQL_CONF_NOT_FOUND] The
SQL...rk.sql.session.localRelationChunkSizeRows\" cannot be found. Please
verify that the config exists. SQLSTATE: 42K0I"}"
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
