[
https://issues.apache.org/jira/browse/HUDI-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17922260#comment-17922260
]
Y Ethan Guo commented on HUDI-8938:
-----------------------------------
Failed tests are excluded and marked with "HUDI-8938" in
[https://github.com/apache/hudi/pull/12725.]
A few things to check:
* See if disabling the file group reader can return the correct query results
in the test
* Check if there is any gap on FG reader or existing log scanner reading table
version 6; and if the backwards compatible writer writing table version 6 has
issues, around log file naming, file slicing, etc.
> INSERT INTO generates unexpected result on table version 6
> ----------------------------------------------------------
>
> Key: HUDI-8938
> URL: https://issues.apache.org/jira/browse/HUDI-8938
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Y Ethan Guo
> Assignee: Lin Liu
> Priority: Blocker
> Fix For: 1.0.1
>
>
> After fixing HUDI-8850 on existing tests,
> [https://github.com/apache/hudi/pull/12725] introduces more test cases on
> COMMIT_TIME_ORDERING, and one of them failed because after INSERT INTO the
> query result is wrong
> Test dimensions:
> TestMergeModeCommitTimeOrdering
> "mor,6,true,true"
> TestMergeModeEventTimeOrdering
> "mor,6,true", "mor,6,false"
>
> Error:
> {code:java}
> Expected Array([1,A,10.0,100], [1,A_equal,60.0,100], [2,B,20.0,100],
> [2,B_equal,70.0,100]), but got Array([1,A_equal,60.0,100],
> [2,B_equal,70.0,100])
> ScalaTestFailureLocation:
> org.apache.spark.sql.hudi.common.HoodieSparkSqlTestBase at
> (HoodieSparkSqlTestBase.scala:130)
> org.scalatest.exceptions.TestFailedException: Expected Array([1,A,10.0,100],
> [1,A_equal,60.0,100], [2,B,20.0,100], [2,B_equal,70.0,100]), but got
> Array([1,A_equal,60.0,100], [2,B_equal,70.0,100])
> at
> org.scalatest.Assertions.newAssertionFailedException(Assertions.scala:472)
> at
> org.scalatest.Assertions.newAssertionFailedException$(Assertions.scala:471)
> at
> org.scalatest.funsuite.AnyFunSuite.newAssertionFailedException(AnyFunSuite.scala:1562)
> at org.scalatest.Assertions.assertResult(Assertions.scala:867)
> at org.scalatest.Assertions.assertResult$(Assertions.scala:863)
> at org.scalatest.funsuite.AnyFunSuite.assertResult(AnyFunSuite.scala:1562)
> at
> org.apache.spark.sql.hudi.common.HoodieSparkSqlTestBase.checkAnswer(HoodieSparkSqlTestBase.scala:130)
> at
> org.apache.spark.sql.hudi.dml.TestMergeModeCommitTimeOrdering.$anonfun$new$5(TestMergeModeCommitTimeOrdering.scala:144)
> at
> org.apache.spark.sql.hudi.dml.TestMergeModeCommitTimeOrdering.$anonfun$new$5$adapted(TestMergeModeCommitTimeOrdering.scala:93)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
