See <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-examples-spark2/1011/display/redirect?page=changes>
Changes: [ravipesala] [CARBONDATA-2932] FIx CarbonReader Projection cann't be empty exception ------------------------------------------ [...truncated 220.14 KB...] +-----------------+---------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/18 07:07:24 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/18 07:07:25 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/18 07:07:25 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/18 07:07:25 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:25 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/18 07:07:25 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/18 07:07:25 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/18 07:07:25 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:25 AUDIT CarbonAlterTableCompactionCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/18 07:07:25 AUDIT MergeBloomIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge bloom index 18/09/18 07:07:25 AUDIT CarbonTableCompactor: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Compaction request completed for table default.tablecompaction_table 18/09/18 07:07:25 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Merge index for compaction called 18/09/18 07:07:25 AUDIT CarbonStore$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The clean files request has been received for default.tablecompaction_table 18/09/18 07:07:25 AUDIT CarbonStore$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Clean files operation is success for default.tablecompaction_table. +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ |SegmentSequenceId| Status| Load Start Time| Load End Time|Merged To|File Format|Data Size|Index Size| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ | 9|Success|2018-09-18 07:07:...|2018-09-18 07:07:...| NA|COLUMNAR_V3| 2.32KB| 1.33KB| | 8|Success|2018-09-18 07:07:...|2018-09-18 07:07:...| NA|COLUMNAR_V3| 2.32KB| 1.33KB| | 0.3|Success|2018-09-18 07:07:...|2018-09-18 07:07:...| NA|COLUMNAR_V3| 2.66KB| 1.34KB| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/18 07:07:25 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [tablecompaction_table] under database [default] 18/09/18 07:07:25 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [tablecompaction_table] under database [default] [32m- TableLevelCompactionOptionExample[0m 18/09/18 07:07:25 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable] 18/09/18 07:07:25 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable] 18/09/18 07:07:25 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/18 07:07:25 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/18 07:07:26 AUDIT CarbonCreateDataMapCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_hour successfully added 18/09/18 07:07:26 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/18 07:07:26 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/18 07:07:26 AUDIT CarbonCreateDataMapCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_day successfully added 18/09/18 07:07:26 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable 18/09/18 07:07:27 ERROR DataLoadExecutor: Executor task launch worker for task 2160 Data Load is partially success for table timeseriestable 18/09/18 07:07:27 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable with value 0 added in the session param 18/09/18 07:07:27 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable with value false added in the session param 18/09/18 07:07:27 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/18 07:07:27 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_hour 18/09/18 07:07:28 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_hour 18/09/18 07:07:28 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:28 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable_agg0_hour with value 0 added in the session param 18/09/18 07:07:28 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable_agg0_hour with value false added in the session param 18/09/18 07:07:28 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/18 07:07:28 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_day 18/09/18 07:07:29 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_day 18/09/18 07:07:29 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:29 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable 18/09/18 07:07:29 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:29 AUDIT CacheProvider: [asf920.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param +--------+----------------------------+ |sum(age)|UDF:timeseries(mytime, hour)| +--------+----------------------------+ | 62| 2001-06-10 04:00:00| | 98| 2000-11-18 00:00:00| | 30| 2001-04-06 09:00:00| | 12| 2002-03-26 10:00:00| | 62| 2004-04-17 00:00:00| | 0| 2005-05-12 08:00:00| | 94| 2006-07-11 02:00:00| | 28| 2006-07-19 04:00:00| | 30| 2008-11-04 11:00:00| | 60| 2009-06-13 09:00:00| | 72| 2011-09-16 05:00:00| | 82| 2013-04-15 11:00:00| | 100| 2013-06-27 10:00:00| | 78| 2015-07-27 11:00:00| | 110| 2016-06-20 00:00:00| | 36| 2016-07-05 04:00:00| | 98| 2016-08-22 11:00:00| | 86| 2017-04-21 10:00:00| | 94| 2017-05-06 08:00:00| | 42| 2017-07-21 03:00:00| +--------+----------------------------+ only showing top 20 rows +------------------+----------------------------+ | avg(age)|UDF:timeseries(mytime, year)| +------------------+----------------------------+ | 29.59622641509434| 2019-01-01 00:00:00| |31.243445692883896| 2006-01-01 00:00:00| | 29.65546218487395| 2010-01-01 00:00:00| |25.666666666666668| null| |27.405109489051096| 2018-01-01 00:00:00| | 28.23015873015873| 2017-01-01 00:00:00| |29.404347826086955| 2003-01-01 00:00:00| |30.988372093023255| 2005-01-01 00:00:00| | 30.44943820224719| 2014-01-01 00:00:00| | 28.20888888888889| 2016-01-01 00:00:00| | 28.21268656716418| 2011-01-01 00:00:00| |29.869565217391305| 2015-01-01 00:00:00| |28.796747967479675| 2009-01-01 00:00:00| |28.555118110236222| 2002-01-01 00:00:00| |28.892561983471076| 2004-01-01 00:00:00| |29.556962025316455| 2000-01-01 00:00:00| | 29.85774058577406| 2008-01-01 00:00:00| | 28.18595041322314| 2012-01-01 00:00:00| | 29.80708661417323| 2007-01-01 00:00:00| |29.368821292775664| 2013-01-01 00:00:00| +------------------+----------------------------+ only showing top 20 rows 18/09/18 07:07:30 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable] under database [default] 18/09/18 07:07:30 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_hour] under database [default] 18/09/18 07:07:30 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_hour] under database [default] 18/09/18 07:07:30 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_day] under database [default] 18/09/18 07:07:30 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_day] under database [default] 18/09/18 07:07:30 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable] under database [default] [32m- TimeSeriesPreAggregateTableExample[0m 18/09/18 07:07:31 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [persontable] 18/09/18 07:07:31 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [persontable] 18/09/18 07:07:31 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.persontable 18/09/18 07:07:32 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.persontable 18/09/18 07:07:32 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:32 AUDIT CarbonCreateDataMapCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]DataMap dm successfully added 18/09/18 07:07:33 AUDIT MergeBloomIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge bloom index +--------+ |count(1)| +--------+ | 16| +--------+ +--------+ |count(1)| +--------+ | 16| +--------+ time for query on table with lucene datamap table:0.201 time for query on table without lucene datamap table:0.298 +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good2|who and name3| |which test1 good2|who and name3| |which test1 good3|who and name5| |which test1 good3|who and name5| |which test1 good5|who and name1| |which test1 good5|who and name1| |which test1 good5|who and name3| |which test1 good5|who and name3| |which test1 good5|who and name5| |which test1 good5|who and name5| |which test1 good5|who and name7| |which test1 good5|who and name7| |which test1 good8|who and name5| |which test1 good8|who and name5| |which test1 good9|who and name0| |which test1 good9|who and name0| +-----------------+-------------+ +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good2|who and name3| |which test1 good2|who and name3| |which test1 good3|who and name5| |which test1 good3|who and name5| |which test1 good5|who and name1| |which test1 good5|who and name1| |which test1 good5|who and name3| |which test1 good5|who and name3| |which test1 good5|who and name5| |which test1 good5|who and name5| +-----------------+-------------+ 18/09/18 07:07:34 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [persontable] under database [default] 18/09/18 07:07:34 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [persontable] under database [default] [32m- LuceneDataMapExample[0m 18/09/18 07:07:34 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [origin_table] 18/09/18 07:07:34 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [origin_table] 18/09/18 07:07:34 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/18 07:07:34 ERROR DataLoadExecutor: [Executor task launch worker for task 2384][partitionID:table;queryID:2306381603871001] Data Load is partially success for table origin_table 18/09/18 07:07:34 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/18 07:07:34 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:34 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/18 07:07:34 ERROR DataLoadExecutor: [Executor task launch worker for task 2386][partitionID:table;queryID:2306381852649575] Data Load is partially success for table origin_table 18/09/18 07:07:34 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/18 07:07:34 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:34 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/18 07:07:35 ERROR DataLoadExecutor: [Executor task launch worker for task 2388][partitionID:table;queryID:2306382090440428] Data Load is partially success for table origin_table 18/09/18 07:07:35 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/18 07:07:35 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:35 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/18 07:07:35 ERROR DataLoadExecutor: [Executor task launch worker for task 2390][partitionID:table;queryID:2306382478747946] Data Load is partially success for table origin_table 18/09/18 07:07:35 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/18 07:07:35 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/18 07:07:35 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [external_table] 18/09/18 07:07:35 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [external_table] +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/18 07:07:35 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/18 07:07:35 ERROR DataLoadExecutor: [Executor task launch worker for task 2396][partitionID:table;queryID:2306382907379194] Data Load is partially success for table origin_table 18/09/18 07:07:36 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/18 07:07:36 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:36 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/18 07:07:36 ERROR DataLoadExecutor: [Executor task launch worker for task 2398][partitionID:table;queryID:2306383130681644] Data Load is partially success for table origin_table 18/09/18 07:07:36 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/18 07:07:36 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 60| +--------+ 18/09/18 07:07:36 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [origin_table] under database [default] 18/09/18 07:07:36 AUDIT CarbonDropTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [origin_table] under database [default] [32m- ExternalTableExample[0m 18/09/18 07:07:36 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [maintable] 18/09/18 07:07:36 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [maintable] 18/09/18 07:07:36 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [dimtable] 18/09/18 07:07:36 AUDIT CarbonCreateTableCommand: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [dimtable] 18/09/18 07:07:36 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.maintable 18/09/18 07:07:36 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.maintable 18/09/18 07:07:36 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/18 07:07:36 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.dimtable 18/09/18 07:07:37 AUDIT CarbonDataRDDFactory$: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.dimtable 18/09/18 07:07:37 AUDIT MergeIndexEventListener: [asf920.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index [31m- MVDataMapExample *** FAILED ***[0m [31m java.lang.ClassNotFoundException: org.apache.carbondata.mv.datamap.MVDataMapProvider[0m [31m at java.net.URLClassLoader.findClass(URLClassLoader.java:381)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:424)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:357)[0m [31m at java.lang.Class.forName0(Native Method)[0m [31m at java.lang.Class.forName(Class.java:348)[0m [31m at org.apache.spark.util.Utils$.classForName(Utils.scala:230)[0m [31m at org.apache.spark.util.CarbonReflectionUtils$.createObject(CarbonReflectionUtils.scala:305)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil$.createDataMapProvider(CarbonScalaUtil.scala:480)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil.createDataMapProvider(CarbonScalaUtil.scala)[0m [31m at org.apache.carbondata.datamap.DataMapManager.getDataMapProvider(DataMapManager.java:57)[0m [31m ...[0m [36mRun completed in 2 minutes, 19 seconds.[0m [36mTotal number of tests run: 18[0m [36mSuites: completed 2, aborted 0[0m [36mTests: succeeded 17, failed 1, canceled 0, ignored 0, pending 0[0m [31m*** 1 TEST FAILED ***[0m [JENKINS] Recording test results
