This is an automated email from the ASF dual-hosted git repository.
mbutrovich pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion-comet.git
The following commit(s) were added to refs/heads/main by this push:
new 702298319 docs: update roadmap (#3543)
702298319 is described below
commit 7022983198f00469c6bb830b38f13c9e83513528
Author: Matt Butrovich <[email protected]>
AuthorDate: Tue Feb 17 14:20:10 2026 -0500
docs: update roadmap (#3543)
---
docs/source/contributor-guide/roadmap.md | 19 +++++++++++++++----
1 file changed, 15 insertions(+), 4 deletions(-)
diff --git a/docs/source/contributor-guide/roadmap.md
b/docs/source/contributor-guide/roadmap.md
index 3abe6f3f1..ce9c41416 100644
--- a/docs/source/contributor-guide/roadmap.md
+++ b/docs/source/contributor-guide/roadmap.md
@@ -26,11 +26,11 @@ helpful to have a roadmap for some of the major items that
require coordination
### Iceberg Integration
-Iceberg integration is still a work-in-progress ([#2060]), with major
improvements expected in the next few
-releases. The default `auto` scan mode now uses `native_iceberg_compat`
instead of `native_comet`, enabling
-support for complex types.
+Iceberg tables reads are now fully native, powered by a scan operator backed
by Iceberg-rust ([#2528]). We anticipate
+major improvements expected in the next few releases, including bringing
Iceberg table format V3 features (_e.g._,
+encryption) to the reader.
-[#2060]: https://github.com/apache/datafusion-comet/issues/2060
+[#2528]: https://github.com/apache/datafusion-comet/pull/2528
### Spark 4.0 Support
@@ -40,6 +40,17 @@ more Spark SQL tests and fully implementing ANSI support
([#313]) for all suppor
[#313]: https://github.com/apache/datafusion-comet/issues/313
[#1637]: https://github.com/apache/datafusion-comet/issues/1637
+### Dynamic Partition Pruning
+
+Iceberg table scans support Dynamic Partition Pruning (DPP) filters generated
by Spark's `PlanDynamicPruningFilters`
+optimizer rule ([#3349]). However, we still need to bring this functionality
to our Parquet reader. Furthermore,
+Spark's `PlanAdaptiveDynamicPruningFilters` optimizer rule runs after Comet's
rules, so DPP with Adaptive Query
+Execution requires a redesign of Comet's plan translation. We are focused on
implementing DPP to keep Comet competitive
+with benchmarks that benefit from this feature like TPC-DS. This effort can be
tracked at [#3510].
+
+[#3349]: https://github.com/apache/datafusion-comet/pull/3349
+[#3510]: https://github.com/apache/datafusion-comet/issues/3510
+
### Removing the native_comet scan implementation
The `native_comet` scan implementation is now deprecated and will be removed
in a future release ([#2186], [#2177]).
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
