[
https://issues.apache.org/jira/browse/HUDI-1487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar closed HUDI-1487.
--------------------------------
Resolution: Fixed
> after HUDI-1376 merged unit test testCopyOnWriteStorage will failed random
> --------------------------------------------------------------------------
>
> Key: HUDI-1487
> URL: https://issues.apache.org/jira/browse/HUDI-1487
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: liwei
> Assignee: liwei
> Priority: Major
> Labels: pull-request-available
> Fix For: 0.7.0
>
>
>
>
> TestCOWDataSource.testCopyOnWriteStorage will failed random. Because before
> the incremental read, add a new upsert commit.
> // pull the latest commit
> val hoodieIncViewDF2 = spark.read.format("org.apache.hudi")
> .option(DataSourceReadOptions.QUERY_TYPE_OPT_KEY,
> DataSourceReadOptions.QUERY_TYPE_INCREMENTAL_OPT_VAL)
> .option(DataSourceReadOptions.BEGIN_INSTANTTIME_OPT_KEY, commitInstantTime2)
> .load(basePath)
> the new commit is :
> // Upsert based on the written table with Hudi metadata columns
> val verificationRowKey =
> snapshotDF1.limit(1).select("_row_key").first.getString(0)
> as verificationRowKey will contains in "uniqueKeyCnt", so will failed as :
> "expected: <65> but was: <66>"
>
>
> [https://travis-ci.com/github/apache/hudi/jobs/463879606]
>
> org.apache.hudi.common.table.view.RemoteHoodieTableFileSystemView.executeRequest(RemoteHoodieTableFileSystemView.java:173)
> at
> org.apache.hudi.common.table.view.RemoteHoodieTableFileSystemView.getLatestFileSlices(RemoteHoodieTableFileSystemView.java:275)
> ... 30 more
> [WARN ] 2020-12-22 12:32:40,788
> org.apache.hudi.testutils.HoodieClientTestHarness - Closing file-system
> instance used in previous test-run
> [ERROR] Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed:
> 35.352 s <<< FAILURE! - in org.apache.hudi.functional.TestCOWDataSource
> [ERROR] org.apache.hudi.functional.TestCOWDataSource.testCopyOnWriteStorage
> Time elapsed: 15.275 s <<< FAILURE!
> org.opentest4j.AssertionFailedError: expected: <65> but was: <66>
> at
> org.apache.hudi.functional.TestCOWDataSource.testCopyOnWriteStorage(TestCOWDataSource.scala:160)
> [INFO] Running org.apache.hudi.functional.TestDataSourceForBootstrap
> [WARN ] 2020-12-22 12:32:43,641 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:32:47,818 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:32:50,921 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:32:56,169 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:32:56,793 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:32:57,388 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:33:05,191 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:33:10,221 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:33:17,985 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
> [WARN ] 2020-12-22 12:33:22,498 org.apache.hudi.DefaultSource - Loading Base
> File Only View.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
