shehabgamin commented on PR #696:
URL:
https://github.com/apache/arrow-rs-object-store/pull/696#issuecomment-4783752844
> @shehabgamin i checked internally, this is now deployed
@kevinjqliu Still doesn't work for me. Here's a reproducible example:
```
>>> import os
... os.environ["SAIL_CATALOG__LIST"] = (
... '[{type="onelake", name="ls-onelake", '
... 'url="SOME_ONELAKE_URL/LakeSail.Lakehouse", '
... 'bearer_token="' + BEARER_TOKEN + '"}]'
... )
... os.environ["AZURE_STORAGE_TOKEN"] = BEARER_TOKEN
...
>>> from pysail.spark import SparkConnectServer
... from pyspark.sql import SparkSession
... server = SparkConnectServer(); server.start()
... _, port = server.listening_address
... spark =
SparkSession.builder.remote(f"sc://localhost:{port}").getOrCreate()
...
[2026-06-23T21:41:59Z INFO sail_python::spark::server] Starting the Spark
Connect server on 127.0.0.1:49728...
>>> spark.sql("SHOW NAMESPACES").show()
[2026-06-23T21:42:04Z INFO sail_session::session_manager::actor::handler]
creating session bef5cd8d-c4fe-4bac-bf25-c98e7233c9dd
+----+----------+-----------+-----------+
|name| catalog|description|locationUri|
+----+----------+-----------+-----------+
| dbo|ls-onelake| NULL| NULL|
+----+----------+-----------+-----------+
>>>
>>> spark.sql("SHOW TABLES IN dbo").show()
+--------+--------------------+-----------+
|database| tableName|isTemporary|
+--------+--------------------+-----------+
| dbo|iceberg_dim_products| false|
| dbo| delta_dim_products| false|
+--------+--------------------+-----------+
>>>
>>> df = spark.read.format("csv").option("header", "true").load(
... "abfss://[email protected]/"
... "LakeSail.Lakehouse/Files/Dim_Products.csv"
... )
>>>
>>> df.write.format("delta").save(
... "abfss://[email protected]/"
... "LakeSail.Lakehouse/Tables/dbo/delta_dim_products_test"
... )
[2026-06-23T21:42:46Z WARN sail_delta_lake::kernel::transaction]
Post-commit: failed to load state for version 0 (post-commit activities
skipped): Missing commit file: expected final version 0, replay reached -1
>>>
>>> spark.sql("SHOW TABLES IN dbo").show()
+--------+--------------------+-----------+
|database| tableName|isTemporary|
+--------+--------------------+-----------+
| dbo|delta_dim_product...| false|
| dbo|iceberg_dim_products| false|
| dbo| delta_dim_products| false|
+--------+--------------------+-----------+
>>> spark.read.format("delta").load(
... "abfss://[email protected]/"
... "LakeSail.Lakehouse/Tables/dbo/delta_dim_products_test"
... ).show(5)
Traceback (most recent call last):
... [TRUNCATED]
pyspark.errors.exceptions.connect.AnalysisException: Invalid table location:
No commit files found in _delta_log
>>>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
