[
https://issues.apache.org/jira/browse/HUDI-289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16943731#comment-16943731
]
Vinoth Chandar commented on HUDI-289:
-------------------------------------
Awesome!
https://github.com/apache/incubator-hudi/pull/623 was an intial attempt at
this.
High level thinking now is to use the existing DistributedTestDataSource to
generata some workload and then compare state of the datasource (backed by
rocksdb and the dataset) after each commit or action.. Just raw thoughts.. Feel
free to completely change approach as well.
> Implement a long running test for Hudi writing and querying end-end
> -------------------------------------------------------------------
>
> Key: HUDI-289
> URL: https://issues.apache.org/jira/browse/HUDI-289
> Project: Apache Hudi (incubating)
> Issue Type: Test
> Components: Usability
> Reporter: Vinoth Chandar
> Assignee: Vinoth Chandar
> Priority: Major
>
> We would need an equivalent of an end-end test which runs some workload for
> few hours atleast, triggers various actions like commit, deltacopmmit,
> rollback, compaction and ensures correctness of code before every release
> P.S: Learn from all the CSS issues managing compaction..
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
