n3nash commented on a change in pull request #626: Adding documentation for
hudi test suite
URL: https://github.com/apache/incubator-hudi/pull/626#discussion_r344415528
##########
File path: docs/test_suite.md
##########
@@ -0,0 +1,155 @@
+---
+title: Test Suite
+keywords: test suite
+sidebar: mydoc_sidebar
+permalink: test_suite.html
+toc: false
+summary: In this page, we will discuss the Hudi Test suite to perform end to
end tests
+
+This page describes in detail how to run end to end tests on a hudi dataset
that helps in improving our confidence
+in a release as well as perform large scale performance benchmarks.
+
+### Objectives
+
+1. Test with different versions of core libraries and components such as
`hdfs`, `parquet`, `spark`,
+`hive` and `avro`.
+2. Generate different types of workloads across different dimensions such as
`payload size`, `number of updates`,
+`number of inserts`, `number of partitions`
+3. Perform multiple types of operations such as `insert`, `bulk_insert`,
`upsert`, `compact`, `query`
+4. Support custom post process actions and validations
+
+### High Level Design
+
+{% include image.html file="hudi_test_suite_design.png"
alt="hudi_test_suite_design.png" %}
Review comment:
The image is old, let me fix it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
