[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-14 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
LGTM


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-14 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/450/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-14 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8520/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-14 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/281/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/449/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8519/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/280/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread xuchuanyin
Github user xuchuanyin commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
LGTM


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/438/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8508/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-13 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/269/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8503/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/433/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/264/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/427/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8497/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/258/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread jackylk
Github user jackylk commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
retest this please


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8494/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/424/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/255/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread jackylk
Github user jackylk commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
@xuchuanyin currently data summary command is designed for human. If a 
output for machine process is required, I want to first understand what 
information is needed, maybe it is better to add in as another command for this 
tool. But first we can discuss on the mail list what information is needed


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/254/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-12 Thread xuchuanyin
Github user xuchuanyin commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
@jackylk I have a proposal for this.

Current implement of the data summary has too many customize output with 
string concatenation, which I think it‘s not convenient for better extraction 
and parsing if someone provide the output of DataSummary to me.

I want the output can be better formatted, for example to export it in json 
format, so I can parse and do more analysis on it.


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/408/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8478/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/239/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/236/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/405/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8475/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-11 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/235/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-10 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/378/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-10 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8448/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-10 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/209/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-06 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
@jackylk Better print local_dictionary enabled or not in schema.
And also if possible please print the local dictionary size of each column 
in column details.


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-06 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
```
## Summary
1 blocks, 1 shards, 1 blocklets, 9 pages, 259,304 rows, 9.95MB

## Column Statistics (column 'L_DISCOUNT')
Shard #1 (72636812283890_batchno0-0-null-1536219825841)
BLK  BLKLT  Meta Size  Data Size  Card   Min/Max range (total width 
is 80 characters)  
00  1.06KB 9.75MB 2,147,483,647  

  
```
1. In the above, my actual file size is 10.4 MB but it shows only 9.95 MB. 
2. In column statistics of L_DISCOUNT it shows 9.95 MB, it means it does 
not show only that column size?
3. What is `Card` here?is it cardinality? It does not make senese to print 
Integer max I guess




---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-06 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
@jackylk Better create another folder under tools 


---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-06 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8348/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-06 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/278/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-06 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/110/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/107/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/106/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.3.1, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.3/8344/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/9/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/246/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8316/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/244/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-05 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8314/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-04 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed with Spark 2.2.1, Please check CI 
http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/242/



---


[GitHub] carbondata issue #2683: [CARBONDATA-2916] Add CarbonCli tool for data summar...

2018-09-04 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/2683
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/8312/



---