andygrove commented on PR #1683:
URL:
https://github.com/apache/datafusion-comet/pull/1683#issuecomment-2835167691
For now, I went with the approach of updating Iceberg to stop shading
Parquet. This now seems to be working, but the plan says it is not running
natively.
```
scala> spark.sql(s"SELECT * from t1").show()
25/04/28 06:59:19 INFO core/src/lib.rs: Comet native library version 0.9.0
initialized
25/04/28 06:59:19 WARN CometSparkSessionExtensions$CometExecRule: Comet
cannot execute some parts of this plan natively (set
spark.comet.explainFallback.enabled=false to disable this logging):
CollectLimit [COMET: CollectLimit is not supported]
+- Project [COMET: Project is not native because the following children are
not native (BatchScan spark_catalog.default.t1)]
+- BatchScan spark_catalog.default.t1 [COMET: Comet Scan only supports
Parquet and Iceberg Parquet file formats, BatchScan spark_catalog.default.t1 is
not supported]
+---+---+
| c0| c1|
+---+---+
| 0| 0|
| 1| 1|
| 2| 2|
| 3| 3|
| 4| 4|
| 5| 5|
| 6| 6|
| 7| 7|
| 8| 8|
| 9| 9|
| 10| 10|
| 11| 11|
| 12| 12|
| 13| 13|
| 14| 14|
| 15| 15|
| 16| 16|
| 17| 17|
| 18| 18|
| 19| 19|
+---+---+
only showing top 20 rows
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
