I have zero knowledge about Gora so can't say much. But yes jenkins is a good way to do it. We can leverage Bigtop docker provisioner to provision a cluster and have gora installed. Then you can run bigtop integration tests to test the interoperability of Gora with Hadoop MapReduce, Spark, Flink and Pig.
A Bigtop example: https://ci.bigtop.apache.org/view/Test/job/Bigtop-1.5.0-smoke-tests/ What it does at a very high level view: # Destroy dangling cluster (cd provisioner/docker && ./docker-hadoop.sh -d || true) # Provision & test (cd provisioner/docker && ./docker-hadoop.sh -C ${CONFIG} -c 3 -s) # Destroy provisinoed cluster (cd provisioner/docker && ./docker-hadoop.sh -d) Ref doc: https://cwiki.apache.org/confluence/display/BIGTOP/Quickstart+Guide%3A+Bigtop+Integration+Test+Framework+2.0 (gradlw is just a wrapper. Underlying it calls docker-hadoop.sh) Lewis John McGibbney <lewi...@apache.org> 於 2021年5月10日 週一 上午8:38寫道： > Hi user@, > I've never used Bigtop but I have been aware of the project for quite some > time. > I am a developer of Gora (Generic Object Representation using Avro) > http://gora.apache.org > Gora is a framework which provides an in-memory data model and persistence > for big data. Gora supports persisting to column stores, key value stores, > document stores and RDBMSs, and analyzing the data with Apache Hadoop > MapReduce, Apache Spark, Apache Flink and Apache Pig support. > Does anyone have any advice as to how, if at all possible, the Bigtop test > framework could be employed in Gora (Jenkins???) to compatibility test Gora > against target datastores. > Thanks for any consideration. > lewismc >
