Yingyi Bu has submitted this change and it was merged. Change subject: Add cluster performance testing scripts. ......................................................................
Add cluster performance testing scripts. - Wait SSH instead of sleep in the AWS installation script; - Remove Java code and generate config files in Ansible; - TPC-H is one benchmark, and more benchmarks could be added into the framework. Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb Reviewed-on: https://asterix-gerrit.ics.uci.edu/1504 Sonar-Qube: Jenkins <[email protected]> Tested-by: Jenkins <[email protected]> Reviewed-by: Till Westmann <[email protected]> --- A asterixdb/asterix-benchmark/pom.xml A asterixdb/asterix-benchmark/src/main/assembly/binary-assembly.xml A asterixdb/asterix-benchmark/src/main/resources/ansible/runquery.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/compile.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/gen.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/gendata.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/genscript.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/gen/settings.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/gendml_centralized.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/gendml_partitioned.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/load.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/loadgen.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/settings.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/load/template.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q1.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q10.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q11.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q12.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q13.sqlpp C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q14.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q15.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q16.sqlpp C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q17.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q18.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q19.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q2.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q20.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q21.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q22.sqlpp.dis C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q3.sqlpp C asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q4.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q5.sqlpp.dis R asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q6.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q7.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q8.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/queries/q9.sqlpp.dis A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/setup/create.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/setup/setup.yml A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/teardown/drop.sqlpp A asterixdb/asterix-benchmark/src/main/resources/benchmarks/tpch/teardown/teardown.yml A asterixdb/asterix-benchmark/src/main/resources/bin/runall.sh A asterixdb/asterix-benchmark/src/main/resources/conf/benchmark_setting.yml D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q01_pricing_summary_report_nt.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q02_minimum_cost_supplier.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q03_shipping_priority_nt.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q04_order_priority.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q05_local_supplier_volume.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q07_volume_shipping.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q08_national_market_share.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q09_product_type_profit_nt.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q10_returned_item.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q11_important_stock.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q12_shipping.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q13_customer_distribution.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q14_promotion_effect.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q15_top_supplier.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q16_parts_supplier_relationship.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q17_small_quantity_order_revenue.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q18_large_volume_customer.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q19_discounted_revenue.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q20_potential_part_promotion.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q21_suppliers_who_kept_orders_waiting.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q21_suppliers_who_kept_orders_waiting.3.query_2.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/queries/q22_global_sales_opportunity.3.query.aql D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q01_pricing_summary_report_nt.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q02_minimum_cost_supplier.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q03_shipping_priority_nt.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q04_order_priority.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q06_forecast_revenue_change.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q07_volume_shipping.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q10_returned_item.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q11_important_stock.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q12_shipping.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q13_customer_distribution.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q15_top_supplier.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q16_parts_supplier_relationship.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q17_small_quantity_order_revenue.3.query.adm D asterixdb/asterix-benchmarks/src/main/resources/tpc-h/results/q20_potential_part_promotion.3.query.adm M asterixdb/asterix-server/pom.xml D asterixdb/asterix-server/src/main/java/org/apache/asterixdb/aws/AwsNode.java D asterixdb/asterix-server/src/main/java/org/apache/asterixdb/aws/ConfigGenerator.java M asterixdb/asterix-server/src/main/opt/aws/README M asterixdb/asterix-server/src/main/opt/aws/ansible/aws_start.yml M asterixdb/asterix-server/src/main/opt/aws/ansible/instance_start.yml M asterixdb/asterix-server/src/main/opt/aws/bin/start.sh M asterixdb/asterix-server/src/main/opt/aws/conf/aws_settings.yml M asterixdb/asterix-server/src/main/opt/aws/conf/instance_settings.yml M asterixdb/pom.xml 88 files changed, 1,877 insertions(+), 21,374 deletions(-) Approvals: Till Westmann: Looks good to me, approved Jenkins: Verified; No violations found Objections: Jenkins: Violations found -- To view, visit https://asterix-gerrit.ics.uci.edu/1504 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-MessageType: merged Gerrit-Change-Id: Ie17f20dc87694a865aebc561d8eded064c66f5bb Gerrit-PatchSet: 7 Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-Owner: Yingyi Bu <[email protected]> Gerrit-Reviewer: Ian Maxon <[email protected]> Gerrit-Reviewer: Jenkins <[email protected]> Gerrit-Reviewer: Michael Blow <[email protected]> Gerrit-Reviewer: Till Westmann <[email protected]> Gerrit-Reviewer: Yingyi Bu <[email protected]>
