RussellSpitzer commented on a change in pull request #2460:
URL: https://github.com/apache/iceberg/pull/2460#discussion_r612564843
##########
File path:
spark3-extensions/src/main/scala/org/apache/spark/sql/catalyst/optimizer/RewriteUpdate.scala
##########
@@ -59,7 +62,7 @@ case class RewriteUpdate(spark: SparkSession) extends
Rule[LogicalPlan] with Rew
// so the first job uses DynamicFileFilter and the second one uses the
underlying scan plan
// both jobs share the same SparkMergeScan instance to ensure they
operate on same files
val matchingRowsPlanBuilder = scanRelation => Filter(cond, scanRelation)
- val scanPlan = buildDynamicFilterScanPlan(spark, r.table, r.output,
mergeBuilder, cond, matchingRowsPlanBuilder)
+ val scanPlan = buildDynamicFilterScanPlan(spark, r, r.output,
mergeBuilder, cond, matchingRowsPlanBuilder)
Review comment:
Nvm I see this is our code so we could keep this change and alter
buildDynamic to be compatible with both spark builds
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
