See <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-examples-spark2/926/display/redirect?page=changes>
Changes: [chenliang613] [CARBONDATA-2837] Added MVExample in example module ------------------------------------------ [...truncated 225.92 KB...] | 6| Success|2018-09-03 08:53:...|2018-09-03 08:53:...| NA|COLUMNAR_V3| | 5|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 3.1|COLUMNAR_V3| | 4|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 3.1|COLUMNAR_V3| | 3.1|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 0.2|COLUMNAR_V3| | 3|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 3.1|COLUMNAR_V3| | 2|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 0.1|COLUMNAR_V3| | 1|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 0.1|COLUMNAR_V3| | 0.2| Success|2018-09-03 08:53:...|2018-09-03 08:53:...| NA|COLUMNAR_V3| | 0.1|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 0.2|COLUMNAR_V3| | 0|Compacted|2018-09-03 08:53:...|2018-09-03 08:53:...| 0.1|COLUMNAR_V3| +-----------------+---------+--------------------+--------------------+---------+-----------+ 18/09/03 08:53:15 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/03 08:53:16 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/03 08:53:16 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/03 08:53:16 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:16 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/03 08:53:16 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/03 08:53:16 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/03 08:53:16 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:16 AUDIT CarbonAlterTableCompactionCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/03 08:53:16 AUDIT CarbonTableCompactor: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request completed for table default.tablecompaction_table 18/09/03 08:53:16 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Merge index for compaction called 18/09/03 08:53:16 AUDIT CarbonStore$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The clean files request has been received for default.tablecompaction_table 18/09/03 08:53:16 AUDIT CarbonStore$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Clean files operation is success for default.tablecompaction_table. +-----------------+-------+--------------------+--------------------+---------+-----------+ |SegmentSequenceId| Status| Load Start Time| Load End Time|Merged To|File Format| +-----------------+-------+--------------------+--------------------+---------+-----------+ | 9|Success|2018-09-03 08:53:...|2018-09-03 08:53:...| NA|COLUMNAR_V3| | 8|Success|2018-09-03 08:53:...|2018-09-03 08:53:...| NA|COLUMNAR_V3| | 0.3|Success|2018-09-03 08:53:...|2018-09-03 08:53:...| NA|COLUMNAR_V3| +-----------------+-------+--------------------+--------------------+---------+-----------+ 18/09/03 08:53:16 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [tablecompaction_table] under database [default] 18/09/03 08:53:16 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [tablecompaction_table] under database [default] [32m- TableLevelCompactionOptionExample[0m 18/09/03 08:53:16 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable] 18/09/03 08:53:16 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable] 18/09/03 08:53:16 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/03 08:53:17 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/03 08:53:17 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_hour successfully added 18/09/03 08:53:17 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/03 08:53:17 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/03 08:53:17 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_day successfully added 18/09/03 08:53:17 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable 18/09/03 08:53:18 ERROR DataLoadExecutor: Executor task launch worker for task 2153 Data Load is partially success for table timeseriestable 18/09/03 08:53:18 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable with value 0 added in the session param 18/09/03 08:53:18 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable with value false added in the session param 18/09/03 08:53:18 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/03 08:53:18 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_hour 18/09/03 08:53:19 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_hour 18/09/03 08:53:19 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:19 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable_agg0_hour with value 0 added in the session param 18/09/03 08:53:19 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable_agg0_hour with value false added in the session param 18/09/03 08:53:19 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/03 08:53:19 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_day 18/09/03 08:53:21 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_day 18/09/03 08:53:21 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:21 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable 18/09/03 08:53:21 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:21 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param +--------+----------------------------+ |sum(age)|UDF:timeseries(mytime, hour)| +--------+----------------------------+ | 64| 2000-06-02 01:00:00| | 52| 2001-01-20 07:00:00| | 70| 2000-07-20 01:00:00| | 24| 2002-05-02 04:00:00| | 0| 2002-06-06 04:00:00| | 72| 2003-05-21 05:00:00| | 10| 2003-10-26 03:00:00| | 92| 2004-01-16 09:00:00| | 8| 2006-03-04 10:00:00| | 74| 2007-08-19 07:00:00| | 20| 2008-05-03 02:00:00| | 12| 2009-02-24 03:00:00| | 66| 2009-09-08 10:00:00| | 44| 2010-02-09 04:00:00| | 98| 2010-09-27 02:00:00| | 56| 2010-10-05 05:00:00| | 72| 2012-01-06 01:00:00| | 22| 2012-05-12 09:00:00| | 92| 2012-11-16 08:00:00| | 92| 2013-06-27 10:00:00| +--------+----------------------------+ only showing top 20 rows +------------------+----------------------------+ | avg(age)|UDF:timeseries(mytime, year)| +------------------+----------------------------+ |31.368852459016395| 2019-01-01 00:00:00| |30.778688524590162| 2006-01-01 00:00:00| |27.941964285714285| 2010-01-01 00:00:00| | 36.5| null| |29.293617021276596| 2018-01-01 00:00:00| |28.672131147540984| 2017-01-01 00:00:00| |31.318548387096776| 2003-01-01 00:00:00| | 29.17872340425532| 2005-01-01 00:00:00| |29.818181818181817| 2014-01-01 00:00:00| | 31.5327868852459| 2016-01-01 00:00:00| | 30.4484126984127| 2011-01-01 00:00:00| |29.477443609022558| 2015-01-01 00:00:00| |30.773946360153257| 2009-01-01 00:00:00| |29.169291338582678| 2002-01-01 00:00:00| | 26.67037037037037| 2004-01-01 00:00:00| |29.845833333333335| 2000-01-01 00:00:00| |30.062043795620436| 2008-01-01 00:00:00| |29.506122448979593| 2012-01-01 00:00:00| | 30.6793893129771| 2007-01-01 00:00:00| | 29.92452830188679| 2013-01-01 00:00:00| +------------------+----------------------------+ only showing top 20 rows 18/09/03 08:53:22 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable] under database [default] 18/09/03 08:53:22 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_hour] under database [default] 18/09/03 08:53:22 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_hour] under database [default] 18/09/03 08:53:22 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_day] under database [default] 18/09/03 08:53:22 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_day] under database [default] 18/09/03 08:53:22 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable] under database [default] [32m- TimeSeriesPreAggregateTableExample[0m 18/09/03 08:53:22 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [persontable] 18/09/03 08:53:23 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [persontable] 18/09/03 08:53:23 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.personTable 18/09/03 08:53:24 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.personTable 18/09/03 08:53:24 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:24 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap dm successfully added +--------+ |count(1)| +--------+ | 10| +--------+ +--------+ |count(1)| +--------+ | 10| +--------+ time for query on table with lucene datamap table:0.353 time for query on table without lucene datamap table:0.402 +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good0|who and name4| |which test1 good0|who and name4| |which test1 good3|who and name5| |which test1 good3|who and name5| |which test1 good4|who and name5| |which test1 good4|who and name5| |which test1 good7|who and name2| |which test1 good7|who and name2| +-----------------+-------------+ +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good0|who and name4| |which test1 good0|who and name4| |which test1 good1|who and name3| |which test1 good1|who and name3| |which test1 good3|who and name5| |which test1 good3|who and name5| |which test1 good4|who and name5| |which test1 good4|who and name5| |which test1 good7|who and name2| |which test1 good7|who and name2| +-----------------+-------------+ 18/09/03 08:53:27 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [persontable] under database [default] 18/09/03 08:53:27 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [persontable] under database [default] [32m- LuceneDataMapExample[0m 18/09/03 08:53:27 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [origin_table] 18/09/03 08:53:28 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [origin_table] 18/09/03 08:53:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/03 08:53:28 ERROR DataLoadExecutor: [Executor task launch worker for task 2377][partitionID:table;queryID:1016771060488538] Data Load is partially success for table origin_table 18/09/03 08:53:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/03 08:53:28 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/03 08:53:28 ERROR DataLoadExecutor: [Executor task launch worker for task 2379][partitionID:table;queryID:1016771455280372] Data Load is partially success for table origin_table 18/09/03 08:53:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/03 08:53:28 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/03 08:53:29 ERROR DataLoadExecutor: [Executor task launch worker for task 2381][partitionID:table;queryID:1016771773050962] Data Load is partially success for table origin_table 18/09/03 08:53:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/03 08:53:29 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/03 08:53:29 ERROR DataLoadExecutor: [Executor task launch worker for task 2383][partitionID:table;queryID:1016772082150589] Data Load is partially success for table origin_table 18/09/03 08:53:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/03 08:53:29 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/03 08:53:29 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [external_table] 18/09/03 08:53:29 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [external_table] +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/03 08:53:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/03 08:53:29 ERROR DataLoadExecutor: [Executor task launch worker for task 2389][partitionID:table;queryID:1016772686415342] Data Load is partially success for table origin_table 18/09/03 08:53:30 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/03 08:53:30 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:30 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/03 08:53:30 ERROR DataLoadExecutor: [Executor task launch worker for task 2391][partitionID:table;queryID:1016773575335560] Data Load is partially success for table origin_table 18/09/03 08:53:30 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/03 08:53:30 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 60| +--------+ 18/09/03 08:53:30 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [origin_table] under database [default] 18/09/03 08:53:30 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [origin_table] under database [default] [32m- ExternalTableExample[0m 18/09/03 08:53:31 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [maintable] 18/09/03 08:53:31 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [maintable] 18/09/03 08:53:31 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [dimtable] 18/09/03 08:53:31 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [dimtable] 18/09/03 08:53:31 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.maintable 18/09/03 08:53:31 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.maintable 18/09/03 08:53:31 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/03 08:53:31 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.dimtable 18/09/03 08:53:32 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.dimtable 18/09/03 08:53:32 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index [31m- MVDataMapExample *** FAILED ***[0m [31m java.lang.ClassNotFoundException: org.apache.carbondata.mv.datamap.MVDataMapProvider[0m [31m at java.net.URLClassLoader.findClass(URLClassLoader.java:381)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:424)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:357)[0m [31m at java.lang.Class.forName0(Native Method)[0m [31m at java.lang.Class.forName(Class.java:348)[0m [31m at org.apache.spark.util.Utils$.classForName(Utils.scala:230)[0m [31m at org.apache.spark.util.CarbonReflectionUtils$.createObject(CarbonReflectionUtils.scala:252)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil$.createDataMapProvider(CarbonScalaUtil.scala:480)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil.createDataMapProvider(CarbonScalaUtil.scala)[0m [31m at org.apache.carbondata.datamap.DataMapManager.getDataMapProvider(DataMapManager.java:57)[0m [31m ...[0m [36mRun completed in 2 minutes, 48 seconds.[0m [36mTotal number of tests run: 18[0m [36mSuites: completed 2, aborted 0[0m [36mTests: succeeded 17, failed 1, canceled 0, ignored 0, pending 0[0m [31m*** 1 TEST FAILED ***[0m [JENKINS] Recording test results
