RussellSpitzer commented on code in PR #6534:
URL: https://github.com/apache/iceberg/pull/6534#discussion_r1063832281
##########
spark/v3.3/spark-extensions/src/main/scala/org/apache/spark/sql/execution/datasources/v2/RowLevelCommandScanRelationPushDown.scala:
##########
@@ -38,8 +40,16 @@ object RowLevelCommandScanRelationPushDown extends
Rule[LogicalPlan] with Predic
import ExtendedDataSourceV2Implicits._
override def apply(plan: LogicalPlan): LogicalPlan = plan transformDown {
+ // use native Spark planning for delta-based plans and copy-on-write MERGE
operations
+ // unlike other commands, these plans have filters that can be pushed down
directly
Review Comment:
Thanks this makes it much clearer
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
