See <https://builds.apache.org/job/carbondata-master-spark-2.2/org.apache.carbondata$carbondata-examples-spark2/963/display/redirect?page=changes>
Changes: [ravipesala] [CARBONDATA-2909] Multi user support for SDK on S3 ------------------------------------------ [...truncated 218.22 KB...] | 1|Compacted|2018-09-11 07:40:...|2018-09-11 07:40:...| 0.1|COLUMNAR_V3| 2.22KB| 1.32KB| | 0.2| Success|2018-09-11 07:40:...|2018-09-11 07:40:...| NA|COLUMNAR_V3| 2.50KB| 1.32KB| | 0.1|Compacted|2018-09-11 07:40:...|2018-09-11 07:40:...| 0.2|COLUMNAR_V3| 2.49KB| 1.32KB| | 0|Compacted|2018-09-11 07:40:...|2018-09-11 07:40:...| 0.1|COLUMNAR_V3| 2.22KB| 1.32KB| +-----------------+---------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/11 07:40:13 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/11 07:40:13 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/11 07:40:13 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/11 07:40:13 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:13 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.tablecompaction_table 18/09/11 07:40:13 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.tablecompaction_table 18/09/11 07:40:13 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/11 07:40:13 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:14 AUDIT CarbonAlterTableCompactionCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request received for table default.tablecompaction_table 18/09/11 07:40:14 AUDIT CarbonTableCompactor: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Compaction request completed for table default.tablecompaction_table 18/09/11 07:40:14 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Merge index for compaction called 18/09/11 07:40:14 AUDIT CarbonStore$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The clean files request has been received for default.tablecompaction_table 18/09/11 07:40:14 AUDIT CarbonStore$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Clean files operation is success for default.tablecompaction_table. +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ |SegmentSequenceId| Status| Load Start Time| Load End Time|Merged To|File Format|Data Size|Index Size| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ | 9|Success|2018-09-11 07:40:...|2018-09-11 07:40:...| NA|COLUMNAR_V3| 2.22KB| 1.32KB| | 8|Success|2018-09-11 07:40:...|2018-09-11 07:40:...| NA|COLUMNAR_V3| 2.22KB| 1.32KB| | 0.3|Success|2018-09-11 07:40:...|2018-09-11 07:40:...| NA|COLUMNAR_V3| 2.56KB| 1.33KB| +-----------------+-------+--------------------+--------------------+---------+-----------+---------+----------+ 18/09/11 07:40:14 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [tablecompaction_table] under database [default] 18/09/11 07:40:14 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [tablecompaction_table] under database [default] [32m- TableLevelCompactionOptionExample[0m 18/09/11 07:40:14 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable] 18/09/11 07:40:14 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable] 18/09/11 07:40:14 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/11 07:40:14 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_hour] 18/09/11 07:40:14 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_hour successfully added 18/09/11 07:40:14 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/11 07:40:15 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [timeseriestable_agg0_day] 18/09/11 07:40:15 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap agg0_day successfully added 18/09/11 07:40:15 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable 18/09/11 07:40:16 ERROR DataLoadExecutor: Executor task launch worker for task 2157 Data Load is partially success for table timeseriestable 18/09/11 07:40:16 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable with value 0 added in the session param 18/09/11 07:40:16 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable with value false added in the session param 18/09/11 07:40:16 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/11 07:40:16 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_hour 18/09/11 07:40:18 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_hour 18/09/11 07:40:18 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:18 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.input.segments.default.timeseriestable_agg0_hour with value 0 added in the session param 18/09/11 07:40:18 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key validate.carbon.input.segments.default.timeseriestable_agg0_hour with value false added in the session param 18/09/11 07:40:18 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param 18/09/11 07:40:18 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.timeseriestable_agg0_day 18/09/11 07:40:19 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable_agg0_day 18/09/11 07:40:19 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:19 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.timeseriestable 18/09/11 07:40:19 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:19 AUDIT CacheProvider: [asf933.gq1.ygridcore.net][jenkins][Thread-1]The key carbon.query.directQueryOnDataMap.enabled with value true added in the session param +--------+----------------------------+ |sum(age)|UDF:timeseries(mytime, hour)| +--------+----------------------------+ | 110| 2003-09-20 05:00:00| | 106| 2003-10-24 10:00:00| | 118| 2003-11-12 04:00:00| | 38| 2004-04-20 00:00:00| | 92| 2004-08-11 04:00:00| | 36| 2004-10-01 11:00:00| | 36| 2006-05-20 07:00:00| | 48| 2006-11-05 03:00:00| | 88| 2007-07-13 00:00:00| | 82| 2009-03-01 05:00:00| | 56| 2009-10-12 04:00:00| | 76| 2010-06-20 10:00:00| | 38| 2011-07-24 03:00:00| | 36| 2012-03-07 10:00:00| | 94| 2015-03-08 03:00:00| | 24| 2016-07-05 04:00:00| | 114| 2016-09-17 09:00:00| | 72| 2017-02-25 03:00:00| | 10| 2017-03-12 06:00:00| | 46| 2018-07-08 10:00:00| +--------+----------------------------+ only showing top 20 rows +------------------+----------------------------+ | avg(age)|UDF:timeseries(mytime, year)| +------------------+----------------------------+ |30.846456692913385| 2019-01-01 00:00:00| |27.703703703703702| 2006-01-01 00:00:00| |31.665289256198346| 2010-01-01 00:00:00| | 23.0| null| | 30.72222222222222| 2018-01-01 00:00:00| | 30.11111111111111| 2017-01-01 00:00:00| | 29.15953307392996| 2003-01-01 00:00:00| | 30.9375| 2005-01-01 00:00:00| | 29.25968992248062| 2014-01-01 00:00:00| |29.438053097345133| 2016-01-01 00:00:00| | 27.42127659574468| 2011-01-01 00:00:00| |30.025641025641026| 2015-01-01 00:00:00| | 29.08016877637131| 2009-01-01 00:00:00| | 28.95149253731343| 2002-01-01 00:00:00| |29.631799163179917| 2004-01-01 00:00:00| |29.909448818897637| 2000-01-01 00:00:00| |28.813432835820894| 2008-01-01 00:00:00| |28.932773109243698| 2012-01-01 00:00:00| |29.428571428571427| 2007-01-01 00:00:00| |29.125984251968504| 2013-01-01 00:00:00| +------------------+----------------------------+ only showing top 20 rows 18/09/11 07:40:21 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable] under database [default] 18/09/11 07:40:21 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_hour] under database [default] 18/09/11 07:40:21 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_hour] under database [default] 18/09/11 07:40:21 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [timeseriestable_agg0_day] under database [default] 18/09/11 07:40:21 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable_agg0_day] under database [default] 18/09/11 07:40:21 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [timeseriestable] under database [default] [32m- TimeSeriesPreAggregateTableExample[0m 18/09/11 07:40:21 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [persontable] 18/09/11 07:40:21 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [persontable] 18/09/11 07:40:21 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.persontable 18/09/11 07:40:23 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.persontable 18/09/11 07:40:23 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:23 AUDIT CarbonCreateDataMapCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]DataMap dm successfully added +--------+ |count(1)| +--------+ | 14| +--------+ +--------+ |count(1)| +--------+ | 14| +--------+ time for query on table with lucene datamap table:0.308 time for query on table without lucene datamap table:0.375 +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good0|who and name0| |which test1 good0|who and name0| |which test1 good0|who and name1| |which test1 good0|who and name1| |which test1 good2|who and name7| |which test1 good2|who and name7| |which test1 good3|who and name7| |which test1 good3|who and name7| |which test1 good6|who and name1| |which test1 good6|who and name1| |which test1 good9|who and name0| |which test1 good9|who and name0| |which test1 good9|who and name2| |which test1 good9|who and name2| +-----------------+-------------+ +-----------------+-------------+ | id| name| +-----------------+-------------+ |which test1 good0|who and name0| |which test1 good0|who and name0| |which test1 good0|who and name1| |which test1 good0|who and name1| |which test1 good2|who and name7| |which test1 good2|who and name7| |which test1 good3|who and name7| |which test1 good3|who and name7| |which test1 good6|who and name1| |which test1 good6|who and name1| +-----------------+-------------+ 18/09/11 07:40:26 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [persontable] under database [default] 18/09/11 07:40:26 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [persontable] under database [default] [32m- LuceneDataMapExample[0m 18/09/11 07:40:26 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [origin_table] 18/09/11 07:40:26 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [origin_table] 18/09/11 07:40:26 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/11 07:40:26 ERROR DataLoadExecutor: [Executor task launch worker for task 2382][partitionID:table;queryID:1703589412437692] Data Load is partially success for table origin_table 18/09/11 07:40:26 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/11 07:40:26 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:26 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/11 07:40:27 ERROR DataLoadExecutor: [Executor task launch worker for task 2384][partitionID:table;queryID:1703589773977116] Data Load is partially success for table origin_table 18/09/11 07:40:27 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/11 07:40:27 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:27 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/11 07:40:27 ERROR DataLoadExecutor: [Executor task launch worker for task 2386][partitionID:table;queryID:1703590096660009] Data Load is partially success for table origin_table 18/09/11 07:40:27 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/11 07:40:27 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:27 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/11 07:40:27 ERROR DataLoadExecutor: [Executor task launch worker for task 2388][partitionID:table;queryID:1703590434027531] Data Load is partially success for table origin_table 18/09/11 07:40:27 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/11 07:40:27 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/11 07:40:27 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [external_table] 18/09/11 07:40:27 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [external_table] +--------+ |count(1)| +--------+ | 40| +--------+ 18/09/11 07:40:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/11 07:40:28 ERROR DataLoadExecutor: [Executor task launch worker for task 2394][partitionID:table;queryID:1703591042665741] Data Load is partially success for table origin_table 18/09/11 07:40:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/11 07:40:28 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.origin_table 18/09/11 07:40:28 ERROR DataLoadExecutor: [Executor task launch worker for task 2396][partitionID:table;queryID:1703591415604581] Data Load is partially success for table origin_table 18/09/11 07:40:28 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.origin_table 18/09/11 07:40:28 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index +--------+ |count(1)| +--------+ | 60| +--------+ 18/09/11 07:40:28 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleting table [origin_table] under database [default] 18/09/11 07:40:28 AUDIT CarbonDropTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Deleted table [origin_table] under database [default] [32m- ExternalTableExample[0m 18/09/11 07:40:28 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [maintable] 18/09/11 07:40:29 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [maintable] 18/09/11 07:40:29 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Creating Table with Database name [default] and Table name [dimtable] 18/09/11 07:40:29 AUDIT CarbonCreateTableCommand: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Table created with Database name [default] and Table name [dimtable] 18/09/11 07:40:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.maintable 18/09/11 07:40:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.maintable 18/09/11 07:40:29 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index 18/09/11 07:40:29 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load request has been received for table default.dimtable 18/09/11 07:40:30 AUDIT CarbonDataRDDFactory$: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Data load is successful for default.dimtable 18/09/11 07:40:30 AUDIT MergeIndexEventListener: [asf933.gq1.ygridcore.net][jenkins][Thread-1]Load post status event-listener called for merge index [31m- MVDataMapExample *** FAILED ***[0m [31m java.lang.ClassNotFoundException: org.apache.carbondata.mv.datamap.MVDataMapProvider[0m [31m at java.net.URLClassLoader.findClass(URLClassLoader.java:381)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:424)[0m [31m at java.lang.ClassLoader.loadClass(ClassLoader.java:357)[0m [31m at java.lang.Class.forName0(Native Method)[0m [31m at java.lang.Class.forName(Class.java:348)[0m [31m at org.apache.spark.util.Utils$.classForName(Utils.scala:230)[0m [31m at org.apache.spark.util.CarbonReflectionUtils$.createObject(CarbonReflectionUtils.scala:305)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil$.createDataMapProvider(CarbonScalaUtil.scala:480)[0m [31m at org.apache.carbondata.spark.util.CarbonScalaUtil.createDataMapProvider(CarbonScalaUtil.scala)[0m [31m at org.apache.carbondata.datamap.DataMapManager.getDataMapProvider(DataMapManager.java:57)[0m [31m ...[0m [36mRun completed in 2 minutes, 42 seconds.[0m [36mTotal number of tests run: 18[0m [36mSuites: completed 2, aborted 0[0m [36mTests: succeeded 17, failed 1, canceled 0, ignored 0, pending 0[0m [31m*** 1 TEST FAILED ***[0m [JENKINS] Recording test results
