See <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-examples-spark2/1057/display/redirect>
------------------------------------------ [...truncated 219.55 KB...] | 1|Compacted|2018-09-25 08:39:...|2018-09-25 08:39:...| 0.1|COLUMNAR_V3| 2.27KB| 1.28KB| | 0.2| Success|2018-09-25 08:39:...|2018-09-25 08:39:...| NA|COLUMNAR_V3| 2.67KB| 1.29KB| | 0.1|Compacted|2018-09-25 08:39:...|2018-09-25 08:39:...| 0.2|COLUMNAR_V3| 2.58KB| 1.29KB| | 0|Compacted|2018-09-25 08:39:...|2018-09-25 08:39:...| 0.1|COLUMNAR_V3| 2.27KB| 1.28KB| +-----------------+---------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/25 08:39:28 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/25 08:39:28 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/25 08:39:28 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/25 08:39:28 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:28 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/25 08:39:29 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/25 08:39:29 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/25 08:39:29 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:29 AUDIT CarbonAlterTableCompactionCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/25 08:39:29 AUDIT MergeBloomIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge bloom index 18/09/25 08:39:29 AUDIT CarbonTableCompactor: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Compaction request completed for table default.tablecompaction_table 18/09/25 08:39:29 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Merge index for compaction called 18/09/25 08:39:29 AUDIT CarbonStore$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The clean files request has been received for default.tablecompaction_table 18/09/25 08:39:29 AUDIT CarbonStore$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Clean files operation is success for default.tablecompaction_table. +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ |SegmentSequenceId| Status| Load Start Time| Load End Time|Merged To|File Format|Data Size|Index Size| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ | 9|Success|2018-09-25 08:39:...|2018-09-25 08:39:...| NA|COLUMNAR_V3| 2.27KB| 1.28KB| | 8|Success|2018-09-25 08:39:...|2018-09-25 08:39:...| NA|COLUMNAR_V3| 2.27KB| 1.28KB| | 0.3|Success|2018-09-25 08:39:...|2018-09-25 08:39:...| NA|COLUMNAR_V3| 2.77KB| 1.29KB| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/25 08:39:29 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [tablecompaction_table] under database [default] 18/09/25 08:39:29 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [tablecompaction_table] under database [default] [32m- TableLevelCompactionOptionExample[0m 18/09/25 08:39:29 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable] 18/09/25 08:39:29 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable] 18/09/25 08:39:29 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/25 08:39:29 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/25 08:39:29 AUDIT CarbonCreateDataMapCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_hour successfully added 18/09/25 08:39:29 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/25 08:39:29 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/25 08:39:29 AUDIT CarbonCreateDataMapCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_day successfully added 18/09/25 08:39:29 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable 18/09/25 08:39:30 ERROR DataLoadExecutor: Executor task launch worker for task 2162 Data Load is partially success for table timeseriestable 18/09/25 08:39:30 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable with value 0 added in the session param 18/09/25 08:39:30 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable with value false added in the session param 18/09/25 08:39:30 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/25 08:39:30 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_hour 18/09/25 08:39:31 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_hour 18/09/25 08:39:31 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:31 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable_agg0_hour with value 0 added in the session param 18/09/25 08:39:31 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable_agg0_hour with value false added in the session param 18/09/25 08:39:31 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/25 08:39:31 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_day 18/09/25 08:39:32 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_day 18/09/25 08:39:32 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:32 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable 18/09/25 08:39:32 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:32 AUDIT CacheProvider: [asf925.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param +--------+----------------------------+ |sum(age)|UDF:timeseries(mytime, hour)| +--------+----------------------------+ | 2| 2001-05-03 11:00:00| | 52| 2002-04-18 09:00:00| | 32| 2005-05-04 10:00:00| | 84| 2006-03-04 10:00:00| | 70| 2007-03-06 05:00:00| | 80| 2009-03-17 07:00:00| | 48| 2009-03-27 09:00:00| | 116| 2009-05-05 10:00:00| | 96| 2010-11-19 04:00:00| | 112| 2011-06-19 11:00:00| | 36| 2012-05-04 00:00:00| | 102| 2016-02-07 03:00:00| | 44| 2016-08-01 01:00:00| | 88| 2016-11-20 01:00:00| | 98| 2017-01-11 00:00:00| | 90| 2017-02-26 05:00:00| | 22| 2017-04-06 07:00:00| | 78| 2017-08-22 08:00:00| | 102| 2017-11-09 06:00:00| | 74| 2000-05-11 07:00:00| +--------+----------------------------+ only showing top 20 rows +------------------+----------------------------+ | avg(age)|UDF:timeseries(mytime, year)| +------------------+----------------------------+ | 28.12970711297071| 2019-01-01 00:00:00| |25.975247524752476| 2006-01-01 00:00:00| | 31.20152091254753| 2010-01-01 00:00:00| | 29.5| null| |30.616326530612245| 2018-01-01 00:00:00| |29.928057553956833| 2017-01-01 00:00:00| | 28.7125| 2003-01-01 00:00:00| |31.846473029045644| 2005-01-01 00:00:00| |29.751968503937007| 2014-01-01 00:00:00| |29.338078291814945| 2016-01-01 00:00:00| |29.247899159663866| 2011-01-01 00:00:00| | 29.03146853146853| 2015-01-01 00:00:00| |30.518939393939394| 2009-01-01 00:00:00| |27.233201581027668| 2002-01-01 00:00:00| |29.577405857740587| 2004-01-01 00:00:00| |29.017543859649123| 2000-01-01 00:00:00| | 29.19341563786008| 2008-01-01 00:00:00| |30.519685039370078| 2012-01-01 00:00:00| |29.766536964980546| 2007-01-01 00:00:00| |29.019455252918288| 2013-01-01 00:00:00| +------------------+----------------------------+ only showing top 20 rows 18/09/25 08:39:33 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable] under database [default] 18/09/25 08:39:33 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_hour] under database [default] 18/09/25 08:39:33 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_hour] under database [default] 18/09/25 08:39:33 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_day] under database [default] 18/09/25 08:39:33 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_day] under database [default] 18/09/25 08:39:33 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable] under database [default] [32m- TimeSeriesPreAggregateTableExample[0m 18/09/25 08:39:33 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [persontable] 18/09/25 08:39:33 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [persontable] 18/09/25 08:39:33 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.persontable 18/09/25 08:39:34 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.persontable 18/09/25 08:39:34 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:34 AUDIT CarbonCreateDataMapCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]DataMap dm successfully added 18/09/25 08:39:36 AUDIT MergeBloomIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge bloom index +--------+ |count(1)| +--------+ | 12| +--------+ +--------+ |count(1)| +--------+ | 12| +--------+ time for query on table with lucene datamap table:0.227 time for query on table without lucene datamap table:0.263 +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good2|who and name1| |which test1 good2|who and name1| |which test1 good4|who and name6| |which test1 good4|who and name6| |which test1 good5|who and name3| |which test1 good5|who and name3| |which test1 good6|who and name0| |which test1 good6|who and name0| |which test1 good7|who and name0| |which test1 good7|who and name0| |which test1 good8|who and name6| |which test1 good8|who and name6| +-----------------+-------------+ +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good2|who and name1| |which test1 good2|who and name1| |which test1 good4|who and name6| |which test1 good4|who and name6| |which test1 good5|who and name3| |which test1 good5|who and name3| |which test1 good6|who and name0| |which test1 good6|who and name0| |which test1 good7|who and name0| |which test1 good7|who and name0| +-----------------+-------------+ 18/09/25 08:39:37 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [persontable] under database [default] 18/09/25 08:39:37 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [persontable] under database [default] [32m- LuceneDataMapExample[0m 18/09/25 08:39:37 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [origin_table] 18/09/25 08:39:37 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [origin_table] 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/25 08:39:37 ERROR DataLoadExecutor: [Executor task launch worker for task 2387][partitionID:table;queryID:2916001889296629] Data Load is partially success for table origin_table 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/25 08:39:37 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/25 08:39:37 ERROR DataLoadExecutor: [Executor task launch worker for task 2389][partitionID:table;queryID:2916002120380295] Data Load is partially success for table origin_table 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/25 08:39:37 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/25 08:39:37 ERROR DataLoadExecutor: [Executor task launch worker for task 2391][partitionID:table;queryID:2916002344904360] Data Load is partially success for table origin_table 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/25 08:39:37 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:37 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/25 08:39:38 ERROR DataLoadExecutor: [Executor task launch worker for task 2393][partitionID:table;queryID:2916002555643347] Data Load is partially success for table origin_table 18/09/25 08:39:38 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/25 08:39:38 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/25 08:39:38 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [external_table] 18/09/25 08:39:38 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [external_table] +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/25 08:39:38 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/25 08:39:38 ERROR DataLoadExecutor: [Executor task launch worker for task 2399][partitionID:table;queryID:2916002911515736] Data Load is partially success for table origin_table 18/09/25 08:39:38 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/25 08:39:38 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:38 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/25 08:39:38 ERROR DataLoadExecutor: [Executor task launch worker for task 2401][partitionID:table;queryID:2916003123816658] Data Load is partially success for table origin_table 18/09/25 08:39:38 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/25 08:39:38 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 60| +--------+ 18/09/25 08:39:38 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [origin_table] under database [default] 18/09/25 08:39:38 AUDIT CarbonDropTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [origin_table] under database [default] [32m- ExternalTableExample[0m 18/09/25 08:39:38 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [maintable] 18/09/25 08:39:38 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [maintable] 18/09/25 08:39:38 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [dimtable] 18/09/25 08:39:38 AUDIT CarbonCreateTableCommand: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [dimtable] 18/09/25 08:39:39 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.maintable 18/09/25 08:39:39 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.maintable 18/09/25 08:39:39 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/25 08:39:39 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.dimtable 18/09/25 08:39:39 AUDIT CarbonDataRDDFactory$: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.dimtable 18/09/25 08:39:39 AUDIT MergeIndexEventListener: [asf925.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index [31m- MVDataMapExample *** FAILED ***[0m [31m java.lang.ClassNotFoundException: org.apache.carbondata.mv.datamap.MVDataMapProvider[0m [31m at java.net.URLClassLoader.findClass(URLClassLoader.java:381)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:424)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:357)[0m [31m at java.lang.Class.forName0(Native Method)[0m [31m at java.lang.Class.forName(Class.java:348)[0m [31m at org.apache.spark.util.Utils$.classForName(Utils.scala:230)[0m [31m at org.apache.spark.util.CarbonReflectionUtils$.createObject(CarbonReflectionUtils.scala:320)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil$.createDataMapProvider(CarbonScalaUtil.scala:480)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil.createDataMapProvider(CarbonScalaUtil.scala)[0m [31m at org.apache.carbondata.datamap.DataMapManager.getDataMapProvider(DataMapManager.java:57)[0m [31m ...[0m [36mRun completed in 2 minutes.[0m [36mTotal number of tests run: 18[0m [36mSuites: completed 2, aborted 0[0m [36mTests: succeeded 17, failed 1, canceled 0, ignored 0, pending 0[0m [31m*** 1 TEST FAILED ***[0m [JENKINS] Recording test results
