nsivabalan commented on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-1016000719
@YannByron : there are some failures in sql-dml related tests. TestMergeInfo etc. after we create the table, first merge into fails bcoz, with the proposed fix, we return an empty relation which return NIL schema. https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_apis/build/builds/5326/logs/23 ``` 2022-01-18T15:06:16.2111934Z TestMergeIntoTable: 2022-01-18T15:06:16.3784048Z - Test MergeInto Basic *** FAILED *** 2022-01-18T15:06:16.3785444Z org.apache.spark.sql.AnalysisException: Cannot resolve 'h0.id in (`s0.id` = `h0.id`), the input columns is: [id#5461, name#5462, price#5463, ts#5464, flag#5465]; 2022-01-18T15:06:16.3786516Z at org.apache.spark.sql.hudi.analysis.HoodieResolveReferences.org$apache$spark$sql$hudi$analysis$HoodieResolveReferences$$resolveExpressionFrom(HoodieAnalysis.scala:387) 2022-01-18T15:06:16.3787449Z at org.apache.spark.sql.hudi.analysis.HoodieResolveReferences$$anonfun$apply$1.applyOrElse(HoodieAnalysis.scala:200) 2022-01-18T15:06:16.3788267Z at org.apache.spark.sql.hudi.analysis.HoodieResolveReferences$$anonfun$apply$1.applyOrElse(HoodieAnalysis.scala:122) 2022-01-18T15:06:16.3789124Z at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$$anonfun$resolveOperatorsUp$1$$anonfun$apply$1.apply(AnalysisHelper.scala:90) 2022-01-18T15:06:16.3790035Z at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$$anonfun$resolveOperatorsUp$1$$anonfun$apply$1.apply(AnalysisHelper.scala:90) 2022-01-18T15:06:16.3790833Z at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:70) 2022-01-18T15:06:16.3791607Z at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$$anonfun$resolveOperatorsUp$1.apply(AnalysisHelper.scala:89) 2022-01-18T15:06:16.3792441Z at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$$anonfun$resolveOperatorsUp$1.apply(AnalysisHelper.scala:86) 2022-01-18T15:06:16.3793269Z at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransformsInAnalyzer(AnalysisHelper.scala:194) 2022-01-18T15:06:16.3794064Z at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$class.resolveOperatorsUp(AnalysisHelper.scala:86) 2022-01-18T15:06:16.3794661Z ... ``` So, I guess we might need some fix on sql-dml classes. Can you help put in a fix for this. Feel free to open up a new PR if need be. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
