See <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-examples-spark2/948/display/redirect>
------------------------------------------ [...truncated 218.00 KB...] | 3|Compacted|2018-09-08 01:08:...|2018-09-08 01:08:...| 3.1|COLUMNAR_V3| 2.22KB| 1.32KB| | 2|Compacted|2018-09-08 01:08:...|2018-09-08 01:08:...| 0.1|COLUMNAR_V3| 2.22KB| 1.32KB| | 1|Compacted|2018-09-08 01:08:...|2018-09-08 01:08:...| 0.1|COLUMNAR_V3| 2.22KB| 1.32KB| | 0.2| Success|2018-09-08 01:08:...|2018-09-08 01:08:...| NA|COLUMNAR_V3| 2.50KB| 1.32KB| | 0.1|Compacted|2018-09-08 01:08:...|2018-09-08 01:08:...| 0.2|COLUMNAR_V3| 2.49KB| 1.32KB| | 0|Compacted|2018-09-08 01:08:...|2018-09-08 01:08:...| 0.1|COLUMNAR_V3| 2.22KB| 1.32KB| +-----------------+---------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/08 01:08:46 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/08 01:08:46 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/08 01:08:46 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/08 01:08:46 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:47 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/08 01:08:47 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/08 01:08:47 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/08 01:08:47 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:47 AUDIT CarbonAlterTableCompactionCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/08 01:08:47 AUDIT CarbonTableCompactor: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request completed for table default.tablecompaction_table 18/09/08 01:08:47 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Merge index for compaction called 18/09/08 01:08:47 AUDIT CarbonStore$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The clean files request has been received for default.tablecompaction_table 18/09/08 01:08:47 AUDIT CarbonStore$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Clean files operation is success for default.tablecompaction_table. +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ |SegmentSequenceId| Status| Load Start Time| Load End Time|Merged To|File Format|Data Size|Index Size| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ | 9|Success| 2018-09-08 01:08:47|2018-09-08 01:08:...| NA|COLUMNAR_V3| 2.22KB| 1.32KB| | 8|Success|2018-09-08 01:08:...|2018-09-08 01:08:...| NA|COLUMNAR_V3| 2.22KB| 1.32KB| | 0.3|Success|2018-09-08 01:08:...|2018-09-08 01:08:...| NA|COLUMNAR_V3| 2.56KB| 1.33KB| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/08 01:08:47 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [tablecompaction_table] under database [default] 18/09/08 01:08:47 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [tablecompaction_table] under database [default] [32m- TableLevelCompactionOptionExample[0m 18/09/08 01:08:47 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable] 18/09/08 01:08:47 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable] 18/09/08 01:08:47 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/08 01:08:47 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/08 01:08:48 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_hour successfully added 18/09/08 01:08:48 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/08 01:08:48 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/08 01:08:48 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_day successfully added 18/09/08 01:08:48 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable 18/09/08 01:08:49 ERROR DataLoadExecutor: Executor task launch worker for task 2161 Data Load is partially success for table timeseriestable 18/09/08 01:08:49 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable with value 0 added in the session param 18/09/08 01:08:49 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable with value false added in the session param 18/09/08 01:08:49 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/08 01:08:49 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_hour 18/09/08 01:08:50 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_hour 18/09/08 01:08:50 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:50 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable_agg0_hour with value 0 added in the session param 18/09/08 01:08:50 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable_agg0_hour with value false added in the session param 18/09/08 01:08:50 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/08 01:08:50 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_day 18/09/08 01:08:52 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_day 18/09/08 01:08:52 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:52 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable 18/09/08 01:08:52 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:52 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param +--------+----------------------------+ |sum(age)|UDF:timeseries(mytime, hour)| +--------+----------------------------+ | 92| 2000-06-02 01:00:00| | 4| 2000-07-05 10:00:00| | 12| 2001-11-21 06:00:00| | 52| 2002-03-04 01:00:00| | 80| 2002-10-26 08:00:00| | 44| 2003-06-11 07:00:00| | 54| 2004-01-27 09:00:00| | 20| 2006-05-20 07:00:00| | 86| 2006-05-21 06:00:00| | 10| 2007-08-19 07:00:00| | 78| 2009-02-24 03:00:00| | 54| 2009-03-09 04:00:00| | 108| 2009-06-13 09:00:00| | 158| 2011-03-12 10:00:00| | 76| 2012-05-27 07:00:00| | 40| 2013-06-14 01:00:00| | 26| 2014-03-08 01:00:00| | 104| 2015-08-19 01:00:00| | 14| 2015-10-20 03:00:00| | 66| 2016-03-09 04:00:00| +--------+----------------------------+ only showing top 20 rows +------------------+----------------------------+ | avg(age)|UDF:timeseries(mytime, year)| +------------------+----------------------------+ |30.667910447761194| 2019-01-01 00:00:00| | 29.31620553359684| 2006-01-01 00:00:00| |30.286259541984734| 2010-01-01 00:00:00| | 18.0| null| | 30.66030534351145| 2018-01-01 00:00:00| | 29.94047619047619| 2017-01-01 00:00:00| | 28.83211678832117| 2003-01-01 00:00:00| | 30.22672064777328| 2005-01-01 00:00:00| | 31.75813953488372| 2014-01-01 00:00:00| |28.326771653543307| 2016-01-01 00:00:00| |28.797520661157026| 2011-01-01 00:00:00| |28.888059701492537| 2015-01-01 00:00:00| |30.698473282442748| 2009-01-01 00:00:00| |28.745247148288975| 2002-01-01 00:00:00| |28.075396825396826| 2004-01-01 00:00:00| |29.809128630705395| 2000-01-01 00:00:00| |30.897058823529413| 2008-01-01 00:00:00| | 30.58411214953271| 2012-01-01 00:00:00| | 30.13469387755102| 2007-01-01 00:00:00| |29.456221198156683| 2013-01-01 00:00:00| +------------------+----------------------------+ only showing top 20 rows 18/09/08 01:08:53 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable] under database [default] 18/09/08 01:08:53 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_hour] under database [default] 18/09/08 01:08:53 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_hour] under database [default] 18/09/08 01:08:53 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_day] under database [default] 18/09/08 01:08:53 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_day] under database [default] 18/09/08 01:08:53 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable] under database [default] [32m- TimeSeriesPreAggregateTableExample[0m 18/09/08 01:08:53 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [persontable] 18/09/08 01:08:53 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [persontable] 18/09/08 01:08:53 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.persontable 18/09/08 01:08:55 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.persontable 18/09/08 01:08:55 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:55 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap dm successfully added +--------+ |count(1)| +--------+ | 12| +--------+ +--------+ |count(1)| +--------+ | 12| +--------+ time for query on table with lucene datamap table:0.314 time for query on table without lucene datamap table:0.45 +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good0|who and name6| |which test1 good0|who and name6| |which test1 good2|who and name1| |which test1 good2|who and name1| |which test1 good3|who and name0| |which test1 good3|who and name0| |which test1 good5|who and name1| |which test1 good5|who and name1| |which test1 good6|who and name4| |which test1 good6|who and name4| |which test1 good9|who and name1| |which test1 good9|who and name1| +-----------------+-------------+ +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good0|who and name6| |which test1 good0|who and name6| |which test1 good2|who and name1| |which test1 good2|who and name1| |which test1 good3|who and name0| |which test1 good3|who and name0| |which test1 good5|who and name1| |which test1 good5|who and name1| |which test1 good6|who and name4| |which test1 good6|who and name4| +-----------------+-------------+ 18/09/08 01:08:58 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [persontable] under database [default] 18/09/08 01:08:58 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [persontable] under database [default] [32m- LuceneDataMapExample[0m 18/09/08 01:08:58 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [origin_table] 18/09/08 01:08:58 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [origin_table] 18/09/08 01:08:58 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/08 01:08:58 ERROR DataLoadExecutor: [Executor task launch worker for task 2385][partitionID:table;queryID:1420901631941574] Data Load is partially success for table origin_table 18/09/08 01:08:58 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/08 01:08:58 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:59 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/08 01:08:59 ERROR DataLoadExecutor: [Executor task launch worker for task 2387][partitionID:table;queryID:1420902010803427] Data Load is partially success for table origin_table 18/09/08 01:08:59 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/08 01:08:59 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:59 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/08 01:08:59 ERROR DataLoadExecutor: [Executor task launch worker for task 2389][partitionID:table;queryID:1420902305956104] Data Load is partially success for table origin_table 18/09/08 01:08:59 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/08 01:08:59 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:08:59 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/08 01:08:59 ERROR DataLoadExecutor: [Executor task launch worker for task 2391][partitionID:table;queryID:1420902631542417] Data Load is partially success for table origin_table 18/09/08 01:08:59 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/08 01:08:59 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/08 01:09:00 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [external_table] 18/09/08 01:09:00 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [external_table] +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/08 01:09:00 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/08 01:09:00 ERROR DataLoadExecutor: [Executor task launch worker for task 2397][partitionID:table;queryID:1420903252406758] Data Load is partially success for table origin_table 18/09/08 01:09:00 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/08 01:09:00 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:09:00 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/08 01:09:00 ERROR DataLoadExecutor: [Executor task launch worker for task 2399][partitionID:table;queryID:1420903546114444] Data Load is partially success for table origin_table 18/09/08 01:09:00 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/08 01:09:00 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 60| +--------+ 18/09/08 01:09:00 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [origin_table] under database [default] 18/09/08 01:09:01 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [origin_table] under database [default] [32m- ExternalTableExample[0m 18/09/08 01:09:01 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [maintable] 18/09/08 01:09:01 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [maintable] 18/09/08 01:09:01 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [dimtable] 18/09/08 01:09:01 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [dimtable] 18/09/08 01:09:01 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.maintable 18/09/08 01:09:01 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.maintable 18/09/08 01:09:01 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/08 01:09:01 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.dimtable 18/09/08 01:09:02 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.dimtable 18/09/08 01:09:02 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index [31m- MVDataMapExample *** FAILED ***[0m [31m java.lang.ClassNotFoundException: org.apache.carbondata.mv.datamap.MVDataMapProvider[0m [31m at java.net.URLClassLoader.findClass(URLClassLoader.java:381)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:424)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:357)[0m [31m at java.lang.Class.forName0(Native Method)[0m [31m at java.lang.Class.forName(Class.java:348)[0m [31m at org.apache.spark.util.Utils$.classForName(Utils.scala:230)[0m [31m at org.apache.spark.util.CarbonReflectionUtils$.createObject(CarbonReflectionUtils.scala:305)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil$.createDataMapProvider(CarbonScalaUtil.scala:480)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil.createDataMapProvider(CarbonScalaUtil.scala)[0m [31m at org.apache.carbondata.datamap.DataMapManager.getDataMapProvider(DataMapManager.java:57)[0m [31m ...[0m [36mRun completed in 2 minutes, 42 seconds.[0m [36mTotal number of tests run: 18[0m [36mSuites: completed 2, aborted 0[0m [36mTests: succeeded 17, failed 1, canceled 0, ignored 0, pending 0[0m [31m*** 1 TEST FAILED ***[0m [JENKINS] Recording test results
