Hello Anon. E. Moose (1000171), Jenkins, I'd like you to reexamine a change. Please visit
https://asterix-gerrit.ics.uci.edu/3437 to look at the new patch set (#4). Change subject: [ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables ...................................................................... [ASTERIXDB-2593][FUN] TPC-DS always parallelize + gen all tables - user model changes: yes - user can call the tpcds_datagen() by passing only the scaling factor, and that will automatically generate all the tables. - storage format changes: no - interface changes: no Details: - Added support to a second version of the tpcds_datagen() function to take only a single parameter that will result in generating the data for all the tables in one go. The user now can generate the data for a single table at a time, or all the tables in one go. - Overridden the behavior for activating the parallelism. Before, the library wouldn't activate parallelism unless the tables are big, and the number of data generated per table is over 1,000,000. With this change, the parallelism is always activated, regardless of the table size or the data size being generated. - Added a new test, TPCExecutionTest, to execute the long tests for the TPC. Some of the TPC tests take longer than 5 minutes to finish and could result in high usage of disk space. Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 --- M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/FunctionRewriter.java R asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSAllTablesDataGeneratorDatasource.java C asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSAllTablesDataGeneratorRewriter.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSDataGeneratorFunction.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSDataGeneratorReader.java C asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSSingleTableDataGeneratorDatasource.java R asterixdb/asterix-app/src/main/java/org/apache/asterix/app/function/TPCDSSingleTableDataGeneratorRewriter.java M asterixdb/asterix-app/src/main/java/org/apache/asterix/util/MetadataBuiltinFunctions.java A asterixdb/asterix-app/src/test/java/org/apache/asterix/test/runtime/TPCExecutionTest.java A asterixdb/asterix-app/src/test/resources/runtimets/only_tpc.xml R asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/datagen_sf_1_all_tables_1/datagen_sf_1_all_tables_1.1.query.sqlpp A asterixdb/asterix-app/src/test/resources/runtimets/queries_sqlpp/tpcds/datagen_sf_1_all_tables_2/datagen_sf_1_all_tables_2.1.query.sqlpp R asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/datagen_sf_1_all_tables_1/datagen_sf_1_all_tables_1.1.adm A asterixdb/asterix-app/src/test/resources/runtimets/results/tpcds/datagen_sf_1_all_tables_2/datagen_sf_1_all_tables_2.1.adm M asterixdb/asterix-app/src/test/resources/runtimets/testsuite_sqlpp.xml A asterixdb/asterix-app/src/test/resources/runtimets/testsuite_tpc.xml M asterixdb/asterix-metadata/src/main/java/org/apache/asterix/metadata/declared/FunctionDataSource.java 17 files changed, 543 insertions(+), 154 deletions(-) git pull ssh://asterix-gerrit.ics.uci.edu:29418/asterixdb refs/changes/37/3437/4 -- To view, visit https://asterix-gerrit.ics.uci.edu/3437 To unsubscribe, visit https://asterix-gerrit.ics.uci.edu/settings Gerrit-Project: asterixdb Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Iff199b0c533d22bcae1caf5057788b257ba4e486 Gerrit-Change-Number: 3437 Gerrit-PatchSet: 4 Gerrit-Owner: Hussain Towaileb <hussai...@gmail.com> Gerrit-Reviewer: Anon. E. Moose (1000171) Gerrit-Reviewer: Jenkins <jenk...@fulliautomatix.ics.uci.edu>