[
https://issues.apache.org/jira/browse/HUDI-2472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444758#comment-17444758
]
Manoj Govindassamy commented on HUDI-2472:
------------------------------------------
# -`TestHoodieIndex#testSimpleTagLocationAndUpdateWithRollback`- Fixed. Test
is passing after enabling the metadata table.
#
`TestHoodieIndex#testSimpleGlobalIndexTagLocationWhenShouldUpdatePartitionPath`
** Test is using `HoodieSparkWriteableTestTable` which is not a
`HoodieMetadataTestTable`. So, all the addCommit() done in the test is not
visible to the metadata table
** Needs test fix.
# `TestHoodieMergeOnReadTable#testLogFileCountsAfterCompaction`
** Test is inserting records, later updating them and then triggering the
compaction
** In between it does latest file slice listing to make sure the log files
from updates are available. It fails here.
** `HoodieSparkWriteableTestTable` is not a `HoodieMetadataTestTable` and so
all the commit and delta commits added are not visible to the metadata table
> Tests failure follow up when metadata is enabled by default
> -----------------------------------------------------------
>
> Key: HUDI-2472
> URL: https://issues.apache.org/jira/browse/HUDI-2472
> Project: Apache Hudi
> Issue Type: Sub-task
> Components: Testing
> Reporter: sivabalan narayanan
> Assignee: Manoj Govindassamy
> Priority: Blocker
> Labels: pull-request-available
> Fix For: 0.10.0
>
>
> We plan to enable metadata by default. but there are some tests that fail
> with this. Dumping details on tests for which metadata is disabled for now.
> We need to fix them one by one.
>
> hudi-spark-client: // this is the module that has lot of tests that could
> potentially have issues.
> TestHoodieSparkMergeOnReadTableIncrementalRead.testIncrementalReadsWithCompaction.
> disabled metadata for now. directly accesses files.
> TestHoodieIndex.
> testSimpleTagLocationAndUpdateWithRollback. known issue.
> https://issues.apache.org/jira/browse/HUDI-2468
> testSimpleGlobalIndexTagLocationWhenShouldUpdatePartitionPath. uses test
> table. disabled metadata.
> TestHoodieRowCreateHandle.testInstantiationFailure. disabled metadata. not a
> real issue.
> TestHoodieCompactor.testWriteStatusContentsAfterCompaction. uses
> HoodieSparkWriteableTestTable. have disabled metadata.
>
> TestHoodieSparkMergeOnReadTableRollback.testMultiRollbackWithDeltaAndCompactionCommit.
> restore fails. bcoz, there is an inflight rollback in dataset timeline.
> disabling for now. https://issues.apache.org/jira/browse/HUDI-2477
> TestHoodieMergeOnReadTable.testLogFileCountsAfterCompaction. uses
> HoodieSparkWriteableTestTable. disabled metadata for now.
> TestHoodieCompactor.testWriteStatusContentsAfterCompaction. uses
> HoodieSparkWriteableTestTable. have disabled metadata.
> TestHbaseIndex.testEnsureTagLocationUsesCommitTimeline. rolling back 1st
> commit. known issue. disabling metadata.
> https://issues.apache.org/jira/browse/HUDI-2468
> TestHbaseIndex.testSimpleTagLocationAndUpdateWithRollback. rolling back 1st
> commit. known issue. disabling metadata.
> https://issues.apache.org/jira/browse/HUDI-2468
> TestCleaner. lot of tests. uses test table.
> TestHoodieTimelineArchiveLog. lot of tests. uses test table.
> TestHoodieSparkMergeOnReadTableRollback.testRollbackWithDeltaAndCompactionCommit.
> uses test table.
> TestMergeOnReadRollbackActionExecutor.testRollbackWhenFirstCommitFail known
> issue. https://issues.apache.org/jira/browse/HUDI-2468
> hudi-utilities:
> TestHoodieDeltaStreamer. testCleanerDeleteReplacedDataWithArchive. fails.
> relating to archival. disabling metadata. need to look into it.
> hudi-client-common: all passed.
> hudi-flink-client: all passed.
> hudi-java-client: disabled metadata for java. all ok.
> hudi-common: all passed.
> hudi-spark java:
> Testbootstrap class fully fails. rollback of 1st commit. have disbaled
> metadata. https://issues.apache.org/jira/browse/HUDI-2477
> hudi-spark scala tests: all good except couple of key gen related failures
> (https://issues.apache.org/jira/browse/HUDI-2494)
> hudi-utilities: one test in deltastreamer.
> hudi-timelineserver: all good.
> hudi-sync:
> hudi-dla-sync: all good.
> hudi-hive-sync: all good.
> hudi-spark3: all good.
> hudi-spark2: all good.
> hudi-examples: no tests.
>
>
>
> Disabled flink tests:
> TestStreamWriteOperatorCoordinator.testSyncMetadataTable
> TestFileIndex.testFileListingEmptyTable
>
>
>
>
>
>
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
