[GitHub] carbondata issue #1278: [CARBONDATA-1326] Fixed high priority findbug issues

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1278
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7145/



---


[GitHub] carbondata issue #1291: [CARBONDATA-1343] Hive can't query data when the car...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1291
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7143/



---


[GitHub] carbondata issue #1284: [CARBONDATA-1330] Not able to drop temporary table b...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1284
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7144/



---


[GitHub] carbondata issue #2507: [CABONDATA-2741]Fix for fetching random query order ...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2507
  
SDV Build Fail , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5838/



---


[GitHub] carbondata issue #2047: [CARBONDATA-2240] Refactored TestPreaggregateExpress...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2047
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5895/



---


[GitHub] carbondata issue #1351: Add maven-antrun-plugin into build profiles so that ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1351
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7142/



---


[GitHub] carbondata issue #1363: [CARBONDATA-1378] support creating table in hive

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1363
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7141/



---


[GitHub] carbondata issue #2095: [CARBONDATA-2273] Added sdv test cases for boolean f...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2095
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5894/



---


[GitHub] carbondata issue #1380: [CARBONDATA-1485] Timestamp no dictionary bug

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1380
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7140/



---


[GitHub] carbondata issue #1386: [CARBONDATA-1513] bad-record for complex data type s...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1386
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7138/



---


[GitHub] carbondata issue #1385: [WIP] [CARBONDATA-1492] Alter add and remove struct ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1385
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7139/



---


[GitHub] carbondata issue #1390: [CARBONDATA-1360] fix for update table failures for ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1390
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7136/



---


[GitHub] carbondata issue #1387: [CARBONDATA-1503][WIP]Support CarbonFileInputFormat

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1387
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7137/



---


[GitHub] carbondata issue #1399: [CARBONDATA-1570] [WIP] Lucene Datamap Implementatio...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1399
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7135/



---


[GitHub] carbondata issue #2504: [wip][CARBONDATA-2740]flat folder handling for impli...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2504
  
SDV Build Fail , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5837/



---


[GitHub] carbondata issue #1413: [CARBONDATA-1548] resolved bug for creating table wi...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1413
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7133/



---


[GitHub] carbondata issue #1409: [WIP][CARBODNATA-1377] support hive partition

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1409
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7134/



---


[GitHub] carbondata issue #2105: [CARBONDATA-2286][SDV] Added sdv test cases for stre...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2105
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5893/



---


[GitHub] carbondata issue #1431: [WIP] DataMap Access Path Optimization

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1431
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7132/



---


[GitHub] carbondata pull request #2453: [CARBONDATA-2528][MV] Fixed order by in mv an...

2018-07-13 Thread jackylk
Github user jackylk commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/2453#discussion_r202504966
  
--- Diff: 
datamap/mv/core/src/main/scala/org/apache/carbondata/mv/datamap/MVHelper.scala 
---
@@ -147,6 +149,34 @@ object MVHelper {
 }.filter(_.isDefined).map(_.get)
   }
 
+
+  /**
+   * Check if we can do incremental load on the mv table. Some cases like 
aggregation functions
+   * which are present inside other expressions like sum(a)+sum(b) cannot 
be incremental loaded.
+   */
+  private def isFullReload(logicalPlan: LogicalPlan): Boolean = {
+var isFullReload = false
+logicalPlan.transformAllExpressions {
+  case a: Alias =>
+a
+  case agg: AggregateExpression => agg
+  case c: Cast =>
+isFullReload = c.child.find {
+  case agg: AggregateExpression => false
+  case _ => false
+}.isDefined || isFullReload
+c
+  case exp: Expression =>
+// Check any aggregation function present inside other expression.
+isFullReload = exp.find {
+  case agg: AggregateExpression => true
--- End diff --

Can you modify comment to tell like `return true if  `



---


[GitHub] carbondata issue #1460: [Docs] Fix partition-guide.md docs NUM_PARTITIONS wr...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1460
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7130/



---


[GitHub] carbondata issue #1441: [CARBONDATA-1489] Added testcases Insert and Delete ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1441
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7131/



---


[GitHub] carbondata pull request #2400: [HOTFIX] Removed BatchedDataSourceScanExec cl...

2018-07-13 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/2400


---


[GitHub] carbondata issue #2400: [HOTFIX] Removed BatchedDataSourceScanExec class and...

2018-07-13 Thread jackylk
Github user jackylk commented on the issue:

https://github.com/apache/carbondata/pull/2400
  
LGTM


---


[GitHub] carbondata issue #2501: [CARBONDATA-2738]Block Preaggregate, Dictionary Excl...

2018-07-13 Thread Indhumathi27
Github user Indhumathi27 commented on the issue:

https://github.com/apache/carbondata/pull/2501
  
Retest this please


---


[GitHub] carbondata issue #2502: [CARBONDATA-2738]Update documentation for Complex da...

2018-07-13 Thread Indhumathi27
Github user Indhumathi27 commented on the issue:

https://github.com/apache/carbondata/pull/2502
  
Retest this please


---


[GitHub] carbondata issue #2489: [CARBONDATA-2606][Complex DataType Enhancements]Fix ...

2018-07-13 Thread Indhumathi27
Github user Indhumathi27 commented on the issue:

https://github.com/apache/carbondata/pull/2489
  
Retest this please


---


[GitHub] carbondata issue #2282: [CARBONDATA-2456] Support handle request by shard in...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2282
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5891/



---


[GitHub] carbondata issue #1545: [CARBONDATA-1710]Resolved The Bug For Alter Tabel on...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1545
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7128/



---


[GitHub] carbondata issue #1540: [CARBONDATA-1784] clear column group code

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1540
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7129/



---


[GitHub] carbondata issue #1664: [CARBONDATA-1890][Improvement]-Changes for Struct Op...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1664
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7126/



---


[GitHub] carbondata issue #1570: [CARBONDATA-1730] Support skip.header.line.count opt...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1570
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7127/



---


[GitHub] carbondata issue #1751: [CARBONDATA-1971][Blocklet Prunning] Measure Null va...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1751
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7125/



---


[GitHub] carbondata issue #2484: [WIP] added hadoop conf to thread local

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2484
  
SDV Build Fail , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5836/



---


[GitHub] carbondata issue #2305: [CARBONDATA-2478] Added datamap-developer-guide.md f...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2305
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5890/



---


[GitHub] carbondata issue #2161: [CARBONDATA-2218] AlluxioCarbonFile while trying to ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2161
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5892/



---


[GitHub] carbondata issue #1904: [CARBONDATA-2059] - Changes to support compaction fo...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1904
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7123/



---


[GitHub] carbondata issue #1872: [TEST-FRAMEWORK] Added test framework to ensure proc...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1872
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7124/



---


[GitHub] carbondata issue #2339: [WIP][CARBONDATA-2525] Search mode can not register ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2339
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5888/



---


[GitHub] carbondata issue #2039: [CARBONDATA-2233] [Test] Improve test cases of DBLoc...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2039
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7121/



---


[GitHub] carbondata issue #2484: [WIP] added hadoop conf to thread local

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2484
  
SDV Build Fail , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5835/



---


[GitHub] carbondata issue #2504: [wip][CARBONDATA-2740]flat folder handling for impli...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2504
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5834/



---


[GitHub] carbondata issue #1933: [CARBONDATA-2132] [Partition] Fixed Error while load...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1933
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7122/



---


[GitHub] carbondata issue #2307: [CARBONDATA-2482] Pass uuid while writing segment fi...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2307
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5889/



---


[GitHub] carbondata issue #2381: [WIP] fixed SparkCarbonFileFormat for flat folder st...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2381
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5887/



---


[GitHub] carbondata issue #2391: [CARBONDATA-2625] Optimize the performance of Carbon...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2391
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5885/



---


[GitHub] carbondata issue #2488: [CARBONDATA-2724][DataMap]Unsupported create datamap...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2488
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5833/



---


[GitHub] carbondata issue #2046: [CARBONDATA-2239] Added sdv test cases for querying ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2046
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7120/



---


[GitHub] carbondata issue #2047: [CARBONDATA-2240] Refactored TestPreaggregateExpress...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2047
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7119/



---


[GitHub] carbondata issue #2387: [CARBONDATA-2621][BloomDataMap] Lock problem in inde...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2387
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5886/



---


[GitHub] carbondata issue #2095: [CARBONDATA-2273] Added sdv test cases for boolean f...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2095
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7118/



---


[GitHub] carbondata issue #2105: [CARBONDATA-2286][SDV] Added sdv test cases for stre...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2105
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7117/



---


[GitHub] carbondata issue #2452: [CARBONDATA-2693][BloomDataMap]Fix bug for alter ren...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2452
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5832/



---


[GitHub] carbondata issue #2282: [CARBONDATA-2456] Support handle request by shard in...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2282
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7115/



---


[GitHub] carbondata issue #2394: [CARBONDATA- 2243] Added test case for database and ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2394
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5884/



---


[GitHub] carbondata issue #2161: [CARBONDATA-2218] AlluxioCarbonFile while trying to ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2161
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7116/



---


[GitHub] carbondata issue #2305: [CARBONDATA-2478] Added datamap-developer-guide.md f...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2305
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7114/



---


[GitHub] carbondata issue #2400: [HOTFIX] Removed BatchedDataSourceScanExec class and...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2400
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5883/



---


[GitHub] carbondata issue #2307: [CARBONDATA-2482] Pass uuid while writing segment fi...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2307
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5831/



---


[GitHub] carbondata issue #2391: [CARBONDATA-2625] Optimize the performance of Carbon...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2391
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7109/



---


[GitHub] carbondata issue #2412: [CARBONDATA-2656] Presto vector stream readers perfo...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2412
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5882/



---


[GitHub] carbondata issue #2307: [CARBONDATA-2482] Pass uuid while writing segment fi...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2307
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7113/



---


[GitHub] carbondata issue #2339: [WIP][CARBONDATA-2525] Search mode can not register ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2339
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7112/



---


[GitHub] carbondata issue #2482: [CARBONDATA-2714] Support merge index files for the ...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2482
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5830/



---


[GitHub] carbondata issue #2415: [CARBONDATA-2659] Support partition table by DataFra...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2415
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5881/



---


[GitHub] carbondata issue #2423: [CARBONDATA-2530][MV] Fix wrong data displayed when ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2423
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5880/



---


[GitHub] carbondata issue #2381: [WIP] fixed SparkCarbonFileFormat for flat folder st...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2381
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7111/



---


[GitHub] carbondata issue #2387: [CARBONDATA-2621][BloomDataMap] Lock problem in inde...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2387
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7110/



---


[GitHub] carbondata issue #2486: [CARBONDATA-2723][DataMap] Fix bugs in recreate data...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2486
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5829/



---


[GitHub] carbondata issue #2441: [CARBONDATA-2625] optimize CarbonReader performance

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2441
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5878/



---


[GitHub] carbondata issue #2431: [MINOR] Adding a testcase for stream-table join in S...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2431
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5879/



---


[GitHub] carbondata issue #2394: [CARBONDATA- 2243] Added test case for database and ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2394
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7108/



---


[GitHub] carbondata issue #2400: [HOTFIX] Removed BatchedDataSourceScanExec class and...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2400
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7107/



---


[GitHub] carbondata issue #2448: [HotFix] Getting carbon table identifier to datamap ...

2018-07-13 Thread jatin9896
Github user jatin9896 commented on the issue:

https://github.com/apache/carbondata/pull/2448
  
retest sdv please


---


[GitHub] carbondata issue #2501: [CARBONDATA-2738]Block Preaggregate, Dictionary Excl...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2501
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5828/



---


[GitHub] carbondata issue #2453: [CARBONDATA-2528][MV] Fixed order by in mv and aggre...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2453
  
retest this please


---


[GitHub] carbondata pull request #2400: [HOTFIX] Removed BatchedDataSourceScanExec cl...

2018-07-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/2400#discussion_r202423922
  
--- Diff: 
integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonDataSourceScan.scala
 ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.spark.sql.execution.strategy
+
+import org.apache.spark.rdd.RDD
+import org.apache.spark.sql.catalyst.{InternalRow, TableIdentifier}
+import org.apache.spark.sql.catalyst.expressions.{Attribute, SortOrder}
+import org.apache.spark.sql.catalyst.plans.physical.Partitioning
+import org.apache.spark.sql.execution.FileSourceScanExec
+import org.apache.spark.sql.execution.datasources.{HadoopFsRelation, 
LogicalRelation}
+
+/**
+ *  Physical plan node for scanning data.
--- End diff --

added


---


[GitHub] carbondata issue #2448: [HotFix] Getting carbon table identifier to datamap ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2448
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5877/



---


[GitHub] carbondata pull request #2400: [HOTFIX] Removed BatchedDataSourceScanExec cl...

2018-07-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/2400#discussion_r202423226
  
--- Diff: 
integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonDataSourceScan.scala
 ---
@@ -0,0 +1,52 @@
+/*
+ * Licensed to the Apache Software Foundation (ASF) under one or more
+ * contributor license agreements.  See the NOTICE file distributed with
+ * this work for additional information regarding copyright ownership.
+ * The ASF licenses this file to You under the Apache License, Version 2.0
+ * (the "License"); you may not use this file except in compliance with
+ * the License.  You may obtain a copy of the License at
+ *
+ *http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing, software
+ * distributed under the License is distributed on an "AS IS" BASIS,
+ * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ * See the License for the specific language governing permissions and
+ * limitations under the License.
+ */
+package org.apache.spark.sql.execution.strategy
+
+import org.apache.spark.rdd.RDD
+import org.apache.spark.sql.catalyst.{InternalRow, TableIdentifier}
+import org.apache.spark.sql.catalyst.expressions.{Attribute, SortOrder}
+import org.apache.spark.sql.catalyst.plans.physical.Partitioning
+import org.apache.spark.sql.execution.FileSourceScanExec
+import org.apache.spark.sql.execution.datasources.{HadoopFsRelation, 
LogicalRelation}
+
+/**
+ *  Physical plan node for scanning data.
--- End diff --

At present we don't have the separate reader for `USING`


---


[GitHub] carbondata issue #2452: [CARBONDATA-2693][BloomDataMap]Fix bug for alter ren...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2452
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5876/



---


[GitHub] carbondata pull request #2400: [HOTFIX] Removed BatchedDataSourceScanExec cl...

2018-07-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/2400#discussion_r202422351
  
--- Diff: 
integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala
 ---
@@ -673,4 +673,26 @@ private[sql] class CarbonLateDecodeStrategy extends 
SparkStrategy {
 supportCodegen && vectorizedReader.toBoolean &&
 cols.forall(_.dataType.isInstanceOf[AtomicType])
   }
+
+  private def createHadoopFSRelation(relation: LogicalRelation) = {
+val sparkSession = relation.relation.sqlContext.sparkSession
+relation.catalogTable match {
+  case Some(catalogTable) =>
+HadoopFsRelation(new CatalogFileIndex(
+  sparkSession,
+  catalogTable, relation.relation.sizeInBytes),
+  catalogTable.partitionSchema,
+  catalogTable.schema,
+  catalogTable.bucketSpec,
+  new SparkCarbonTableFormat,
+  catalogTable.storage.properties)(sparkSession)
+  case _ =>
+HadoopFsRelation(new InMemoryFileIndex(sparkSession, Seq.empty, 
Map.empty, None),
--- End diff --

ok


---


[GitHub] carbondata issue #2415: [CARBONDATA-2659] Support partition table by DataFra...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2415
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7105/



---


[GitHub] carbondata pull request #2400: [HOTFIX] Removed BatchedDataSourceScanExec cl...

2018-07-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/2400#discussion_r202421814
  
--- Diff: 
integration/spark2/src/main/scala/org/apache/spark/sql/execution/strategy/CarbonLateDecodeStrategy.scala
 ---
@@ -673,4 +673,26 @@ private[sql] class CarbonLateDecodeStrategy extends 
SparkStrategy {
 supportCodegen && vectorizedReader.toBoolean &&
 cols.forall(_.dataType.isInstanceOf[AtomicType])
   }
+
+  private def createHadoopFSRelation(relation: LogicalRelation) = {
+val sparkSession = relation.relation.sqlContext.sparkSession
+relation.catalogTable match {
+  case Some(catalogTable) =>
+HadoopFsRelation(new CatalogFileIndex(
--- End diff --

Ok, moved down.


---


[GitHub] carbondata issue #2412: [CARBONDATA-2656] Presto vector stream readers perfo...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2412
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7106/



---


[GitHub] carbondata pull request #2507: [CABONDATA-2741]Fix for fetching random query...

2018-07-13 Thread jatin9896
GitHub user jatin9896 opened a pull request:

https://github.com/apache/carbondata/pull/2507

[CABONDATA-2741]Fix for fetching random query order by set in case of 
restructure

Description : 
Using AttributeSet changes the order id of the query, as a set does not 
maintain order. so, changes the same with Sequence.
Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [ ] Any interfaces changed? No
 
 - [ ] Any backward compatibility impacted? No
 
 - [ ] Document update required? No

 - [ ] Testing done
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required? yes
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance 
test report.
- Any additional information to help reviewers in testing this 
change.
   
 - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA.  Na



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jatin9896/incubator-carbondata CARBONDATA-2741

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/2507.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2507


commit d4fd5ef44b2528b00456f19f02cee73cd9d427c2
Author: Jatin 
Date:   2018-07-13T15:30:33Z

Fix for fetching random query order by set in case of restructure




---


[GitHub] carbondata issue #2490: [CARBONDATA-2727][BloomDataMap] Support create bloom...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2490
  
SDV Build Fail , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5827/



---


[GitHub] carbondata issue #2453: [CARBONDATA-2528][MV] Fixed order by in mv and aggre...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2453
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5875/



---


[GitHub] carbondata issue #2423: [CARBONDATA-2530][MV] Fix wrong data displayed when ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2423
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7104/



---


[GitHub] carbondata issue #2431: [MINOR] Adding a testcase for stream-table join in S...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2431
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7103/



---


[GitHub] carbondata issue #2489: [CARBONDATA-2606][Complex DataType Enhancements]Fix ...

2018-07-13 Thread kunal642
Github user kunal642 commented on the issue:

https://github.com/apache/carbondata/pull/2489
  
LGTM


---


[GitHub] carbondata issue #2455: [CARBONDATA-2512][32k] Support writing longstring th...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2455
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5874/



---


[jira] [Created] (CARBONDATA-2743) [MV] After MV creation limit queries Throws Exceptions for table which does not have mv data map

2018-07-13 Thread Babulal (JIRA)
Babulal created CARBONDATA-2743:
---

 Summary: [MV] After MV creation limit queries Throws Exceptions 
for table which does not have mv data map
 Key: CARBONDATA-2743
 URL: https://issues.apache.org/jira/browse/CARBONDATA-2743
 Project: CarbonData
  Issue Type: Bug
Reporter: Babulal


0: jdbc:hive2://10.18.16.173:23040/default> create table mytest_50_s13 (name 
string,rownumber string, m1 float) stored by 'carbondata' 
TBLPROPERTIES('sort_scope'='global_sort');
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (12.209 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> load data inpath 
'hdfs://hacluster/tmp/data/cbo_1.csv' into table mytest_50_s13 
options('FILEHEADER'='name,rownumber,m1');
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (79.901 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> create datamap map10 using 'mv' as 
select sum(m1),rownumber from mytest_50_s13 group by rownumber;
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (17.05 seconds)

0: jdbc:hive2://10.18.16.173:23040/default> show datamap on table mytest_50_s13;
+--++---+-+--+
| DataMapName  | ClassName  | Associated Table  | DataMap Properties  |
+--++---+-+--+
| map10    | mv | babu.map10_table  | |
+--++---+-+--+
1 row selected (0.815 seconds)



Now create one more table without mv

: jdbc:hive2://10.18.16.173:23040/default> create table mytest_50_s14 (name 
string,rownumber string, m1 float) stored by 'carbondata' 
TBLPROPERTIES('sort_scope'='global_sort');
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (12.209 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> load data inpath 
'hdfs://hacluster/tmp/data/cbo_1.csv'' into table mytest_50_s14 
options('FILEHEADER'='name,rownumber,m1');
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (79.901 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> select * from mytest_50_s14 limit 
10;
Error: java.lang.UnsupportedOperationException: unsupported operation: Modular 
plan not supported (e.g. has subquery expression) for
GlobalLimit 10
+- LocalLimit 10
   +- Relation[name#1026,rownumber#1027,m1#1028] CarbonDatasourceHadoopRelation 
[ Database name :babu, Table name :mytest_50_s14, Schema 
:Some(StructType(StructField(name,StringType,true), 
StructField(rownumber,StringType,true), StructField(m1,DoubleType,true))) ] 
(state=,code=0)





2018-07-13 00:42:51,540 | INFO  | [pool-25-thread-32] | 
OperationId=b5c2c8b2-1ef4-4894-a709-2a738bd81f76    Result=FAIL | 
org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execute(SparkExecuteStatementOperation.scala:280)
2018-07-13 00:42:51,540 | ERROR | [pool-25-thread-32] | Error executing query, 
currentState RUNNING,  | 
org.apache.spark.internal.Logging$class.logError(Logging.scala:91)
java.lang.UnsupportedOperationException: unsupported operation: Modular plan 
not supported (e.g. has subquery expression) for
GlobalLimit 10
+- LocalLimit 10
   +- Relation[name#1026,rownumber#1027,m1#1028] CarbonDatasourceHadoopRelation 
[ Database name :babu, Table name :mytest_50_s14, Schema 
:Some(StructType(StructField(name,StringType,true), 
StructField(rownumber,StringType,true), StructField(m1,DoubleType,true))) ]

    at org.apache.carbondata.mv.plans.package$.supports(package.scala:52)
    at 
org.apache.carbondata.mv.plans.modular.Modularizer.org$apache$carbondata$mv$plans$modular$Modularizer$$modularizeCore(Modularizer.scala:102)
    at 
org.apache.carbondata.mv.plans.modular.Modularizer.modularize(Modularizer.scala:65)
    at 
org.apache.carbondata.mv.rewrite.QueryRewrite.modularPlan$lzycompute(QueryRewrite.scala:50)
    at 
org.apache.carbondata.mv.rewrite.QueryRewrite.modularPlan(QueryRewrite.scala:49)
    at 
org.apache.carbondata.mv.rewrite.QueryRewrite.withSummaryData$lzycompute(QueryRewrite.scala:53)
    at 
org.apache.carbondata.mv.rewrite.QueryRewrite.withSummaryData(QueryRewrite.scala:52)
    at 
org.apache.carbondata.mv.rewrite.QueryRewrite.withMVTable$lzycompute(QueryRewrite.scala:55)
    at 
org.apache.carbondata.mv.rewrite.QueryRewrite.withMVTable(QueryRewrite.scala:55)
    at 
org.apache.carbondata.mv.datamap.MVAnalyzerRule.apply(MVAnalyzerRule.scala:68)
    at 
org.apache.carbondata.mv.datamap.MVAnalyzerRule.apply(MVAnalyzerRule.scala:38)
    at 
org.apache.spark.sql.hive.CarbonAnalyzer.execute(CarbonAnalyzer.scala:46)
    at 
org.apache.spark.sql.hive.CarbonAnalyzer.execute(CarbonAnalyzer.scala:27)
    at 

[jira] [Created] (CARBONDATA-2742) [MV] Wrong data displayed after MV creation.

2018-07-13 Thread Babulal (JIRA)
Babulal created CARBONDATA-2742:
---

 Summary: [MV] Wrong data displayed  after MV creation. 
 Key: CARBONDATA-2742
 URL: https://issues.apache.org/jira/browse/CARBONDATA-2742
 Project: CarbonData
  Issue Type: Bug
Reporter: Babulal


0: jdbc:hive2://10.18.16.173:23040/default> create table mytest_48 (rownumber 
int,name string, m1 int) stored by 'carbondata';
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (1.267 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> load data inpath 
'hdfs://hacluster/tmp/babu/testdata_1.csv' into table mytest_48 ;
+-+--+
| Result  |
+-+--+
+-+–+

 

0: jdbc:hive2://10.18.16.173:23040/default> show datamap  on table mytest_48;
+--++---+-+--+
| DataMapName  | ClassName  | Associated Table  | DataMap Properties  |
+--++---+-+--+
+--++---+-+--+
No rows selected (0.162 seconds)
0: jdbc:hive2://10.18.16.173:23040/default>
0: jdbc:hive2://10.18.16.173:23040/default> select * from mytest_48;
++---+--+--+
| rownumber  | name  |    m1    |
++---+--+--+
| 1  | aaa   | 1000 |
| 2  | aaa   | 65000    |
| 3  | aaa   | 100  |
| 1  | ddd   | 1000 |
| 2  | ddd   | 65000    |
| 3  | ddd   | 100  |
++---+--+--+
6 rows selected (1.266 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> create datamap map9 using 'mv' as 
select sum(m1),name from mytest_48 group by name;
+-+--+
| Result  |
+-+--+
+-+--+
No rows selected (0.82 seconds)
0: jdbc:hive2://10.18.16.173:23040/default> select sum(m1),name from mytest_48 
group by name;
+--+---+--+
| sum(m1)  | name  |
+--+---+--+
+--+---+--+
No rows selected (2.615 seconds)


0: jdbc:hive2://10.18.16.173:23040/default> explain select sum(m1),name from 
mytest_48 group by name;
+-+--+
|   


   plan 


  |
+-+--+
| == CarbonData Profiler ==





  |
| == Physical Plan ==
*HashAggregate(keys=[mytest_48_name#297], functions=[sum(sum_m1#296L)])
+- Exchange hashpartitioning(mytest_48_name#297, 200)
   +- *HashAggregate(keys=[mytest_48_name#297], 
functions=[partial_sum(sum_m1#296L)])
  +- *BatchedScan CarbonDatasourceHadoopRelation [ Database name :babu, 
Table name :map9_table, Schema 
:Some(StructType(StructField(sum_m1,LongType,true), 
StructField(mytest_48_name,StringType,true))) ] 
babu.map9_table[sum_m1#296L,mytest_48_name#297]  |

[GitHub] carbondata issue #2504: [CARBONDATA-2740]flat folder handling for implicit c...

2018-07-13 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2504
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/5826/



---


[jira] [Created] (CARBONDATA-2741) Exception occurs after alter add few columns and selecting in random order

2018-07-13 Thread Jatin (JIRA)
Jatin created CARBONDATA-2741:
-

 Summary: Exception occurs after alter add few columns and 
selecting in random order
 Key: CARBONDATA-2741
 URL: https://issues.apache.org/jira/browse/CARBONDATA-2741
 Project: CarbonData
  Issue Type: Bug
  Components: spark-integration
Affects Versions: 1.5.0
 Environment: 3 node cluster with spark2.2
Reporter: Jatin
Assignee: Jatin
 Fix For: 1.5.0


create table tb1 (imei string,AMSize string,channelsId string,ActiveCountry 
string, Activecity string,gamePointId double,deviceInformationId 
double,productionDate Timestamp,deliveryDate timestamp,deliverycharge double) 
STORED BY 'org.apache.carbondata.format' 
TBLPROPERTIES('table_blocksize'='1','COLUMN_META_CACHE'='AMSize');

 LOAD DATA INPATH 'hdfs://hacluster/csv/vardhandaterestruct.csv' INTO TABLE tb1 
OPTIONS('DELIMITER'=',', 'QUOTECHAR'= 
'"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'= 
'imei,deviceInformationId,AMSize,channelsId,ActiveCountry,Activecity,gamePointId,productionDate,deliveryDate,deliverycharge');

alter table tb1 add columns(age int, name string);

select * from tb1 where name is NULL or channelsId =4;

Exception occurs :

*Error: org.apache.spark.SparkException: Job aborted due to stage failure: Task 
0 in stage 6508.0 failed 4 times, most recent failure: Lost task 0.3 in stage 
6508.0 (TID 140476, linux-49, executor 3): java.lang.RuntimeException: internal 
error:* 
org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveFloatingCodec[src
 type: DOUBLE, target type: INT, stats(min: 1.0, max: 100.0, decimal: 1 )]
 at 
org.apache.carbondata.core.datastore.page.encoding.adaptive.AdaptiveFloatingCodec$3.decodeLong(AdaptiveFloatingCodec.java:185)
 at 
org.apache.carbondata.core.datastore.page.LazyColumnPage.getLong(LazyColumnPage.java:64)
 at 
org.apache.carbondata.core.scan.result.vector.MeasureDataVectorProcessor$IntegralMeasureVectorFiller.fillMeasureVector(MeasureDataVectorProcessor.java:73)
 at 
org.apache.carbondata.core.scan.result.impl.FilterQueryScannedResult.fillColumnarMeasureBatch(FilterQueryScannedResult.java:129)
 at 
org.apache.carbondata.core.scan.collector.impl.DictionaryBasedVectorResultCollector.fillResultToColumnarBatch(DictionaryBasedVectorResultCollector.java:167)
 at 
org.apache.carbondata.core.scan.collector.impl.RestructureBasedVectorResultCollector.collectResultInColumnarBatch(RestructureBasedVectorResultCollector.java:127)
 at 
org.apache.carbondata.core.scan.processor.DataBlockIterator.processNextBatch(DataBlockIterator.java:245)
 at 
org.apache.carbondata.core.scan.result.iterator.VectorDetailQueryResultIterator.processNextBatch(VectorDetailQueryResultIterator.java:48)
 at 
org.apache.carbondata.spark.vectorreader.VectorizedCarbonRecordReader.nextBatch(VectorizedCarbonRecordReader.java:290)
 at 
org.apache.carbondata.spark.vectorreader.VectorizedCarbonRecordReader.nextKeyValue(VectorizedCarbonRecordReader.java:180)
 at 
org.apache.carbondata.spark.rdd.CarbonScanRDD$$anon$1.hasNext(CarbonScanRDD.scala:497)
 at 
org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.scan_nextBatch$(Unknown
 Source)
 at 
org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown
 Source)
 at 
org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
 at 
org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:381)
 at 
org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown
 Source)
 at 
org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
 at 
org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:381)
 at 
org.apache.spark.sql.execution.SparkPlan$$anonfun$2.apply(SparkPlan.scala:231)
 at 
org.apache.spark.sql.execution.SparkPlan$$anonfun$2.apply(SparkPlan.scala:225)
 at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$25.apply(RDD.scala:828)
 at 
org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$25.apply(RDD.scala:828)
 at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
 at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324)
 at org.apache.spark.rdd.RDD.iterator(RDD.scala:288)
 at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
 at org.apache.spark.scheduler.Task.run(Task.scala:99)
 at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)

Driver stacktrace: (state=,code=0)

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata issue #2441: [CARBONDATA-2625] optimize CarbonReader performance

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2441
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7102/



---


[GitHub] carbondata issue #2448: [HotFix] Getting carbon table identifier to datamap ...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2448
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/7101/



---


[jira] [Resolved] (CARBONDATA-2721) [SDK] [JsonWriter] NPE when schema and data are not of same length or Data is null.

2018-07-13 Thread Ravindra Pesala (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-2721.
-
   Resolution: Fixed
Fix Version/s: 1.4.1

> [SDK] [JsonWriter] NPE when schema and data are not of same length or Data is 
> null.
> ---
>
> Key: CARBONDATA-2721
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2721
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Ajantha Bhat
>Assignee: Ajantha Bhat
>Priority: Major
> Fix For: 1.4.1
>
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (CARBONDATA-2722) [SDK] [JsonWriter] Json writer is writing only first element of an array and discarding the rest of the elements

2018-07-13 Thread Ravindra Pesala (JIRA)


 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-2722.
-
   Resolution: Fixed
Fix Version/s: 1.4.1

> [SDK] [JsonWriter] Json writer is writing only first element of an array and 
> discarding the rest of the elements
> 
>
> Key: CARBONDATA-2722
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2722
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Ajantha Bhat
>Assignee: Ajantha Bhat
>Priority: Major
> Fix For: 1.4.1
>
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata issue #2456: [CARBONDATA-2694][32k] Show longstring table propert...

2018-07-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2456
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/5873/



---


  1   2   3   >