KnightChess opened a new issue, #6037:
URL: https://github.com/apache/hudi/issues/6037
Hi, team, I have some doubt when use `merge into` with spark sql
1.
eg:
```sql
merge into delete_error_test target
using (select 'wlq_new3' as name, 1 as id, 29 as age, '20210101' as dt)
source
on target.id = source.id
when matched and target.age = 28 then update set age = source.age, dt =
source.dt
when not matched then insert (id, age, name, dt)
values (source.id, source.age, source.name, '20210102')").explain(true)
```
the matched condition col is target table, it will throw cannot resolve,
consider the below code, I'm not sure if it considers `mor` table. If so,
`condition.map(resolveExpressionFrom(resolvedSource, target)(_))` for `cow` may
be ok.
Are there any other considerations?
```scala
val resolvedCondition =
condition.map(resolveExpressionFrom(resolvedSource)(_))
// ...
private def resolveExpressionFrom(left: LogicalPlan, right:
Option[LogicalPlan] = None)
(expression: Expression): Expression = {
// Fake a project for the expression based on the source plan.
val fakeProject = if (right.isDefined) {
Project(Seq(Alias(expression, "_c0")()),
sparkAdapter.createJoin(left, right.get, Inner))
} else {
Project(Seq(Alias(expression, "_c0")()),
left)
}
// Resolve the fake project
val resolvedProject =
analyzer.ResolveReferences.apply(fakeProject).asInstanceOf[Project]
val unResolvedAttrs = resolvedProject.projectList.head.collect {
case attr: UnresolvedAttribute => attr
}
if (unResolvedAttrs.nonEmpty) {
throw new AnalysisException(s"Cannot resolve
${unResolvedAttrs.mkString(",")} in " +
s"${expression.sql}, the input " + s"columns is:
[${fakeProject.child.output.mkString(", ")}]")
}
// Fetch the resolved expression from the fake project.
resolvedProject.projectList.head.asInstanceOf[Alias].child
}
```
2.
I have the need to use multi updateActions, Are there any considerations for
the below limit？
```scala
assert(updateActions.size <= 1, s"Only support one updateAction currently,
current update action count is: ${updateActions.size}")
```
Hope to get confused
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
