[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8

2018-02-03 Thread zzcclp
Github user zzcclp commented on the issue:

https://github.com/apache/carbondata/pull/1928
  
@chenliang613 @jackylk please review, thanks.


---


[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1928
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3357/



---


[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8

2018-02-03 Thread zzcclp
Github user zzcclp commented on the issue:

https://github.com/apache/carbondata/pull/1928
  
retest sdv please


---


[GitHub] carbondata pull request #1860: [CARBONDATA-2080] [S3-Implementation] Propaga...

2018-02-03 Thread jatin9896
Github user jatin9896 closed the pull request at:

https://github.com/apache/carbondata/pull/1860


---


[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1928
  
SDV Build Fail , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3356/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3510/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2273/



---


[GitHub] carbondata issue #1928: [HOTFIX]Remove dependency of Java 1.8

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1928
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2272/



---


[GitHub] carbondata issue #1928: [HOTFIX]Remove dependency of Java 1.8

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1928
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3509/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3355/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread xubo245
Github user xubo245 commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
retest this please


---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2271/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3508/



---


[GitHub] carbondata pull request #1928: [HOTFIX]Remove dependency of Java 1.8

2018-02-03 Thread zzcclp
GitHub user zzcclp opened a pull request:

https://github.com/apache/carbondata/pull/1928

[HOTFIX]Remove dependency of Java 1.8

Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [ ] Any interfaces changed?
 
 - [ ] Any backward compatibility impacted?
 
 - [ ] Document update required?

 - [ ] Testing done
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance 
test report.
- Any additional information to help reviewers in testing this 
change.
   
 - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zzcclp/carbondata 
hotfix_remove_dependency_of_Java1.8

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1928.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1928


commit 53c20575011b6ceff3d21549befc8942443d3ddd
Author: Zhang Zhichao <441586683@...>
Date:   2018-02-04T04:54:24Z

[HOTFIX]Remove dependency of Java 1.8




---


[jira] [Resolved] (CARBONDATA-1454) Block pruning not working when wrong data is given in filter

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-1454.
-
   Resolution: Fixed
Fix Version/s: 1.3.0

> Block pruning not working when wrong data is given in filter 
> -
>
> Key: CARBONDATA-1454
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1454
> Project: CarbonData
>  Issue Type: Bug
>  Components: spark-integration
>Affects Versions: 1.1.1
>Reporter: Babulal
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 3h
>  Remaining Estimate: 0h
>
> Load ~13 Million records all with 2013-07-25' date
> Q1
> select *  from test where  my_date='2013-07-25' ;
> This took ~.0.5 sec
> Q2
>  select * from test where  my_date='' limit 1;
> This tool ~30 sec .
> Q2 data will not be found in carbon so actually it should be handled in the 
> block pruning . and no job should be fired for it.
> Same need to hanlde for timestamp also.
> Solution :- 
> This to be consider as FalseExpression and handle same. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1915: [CARBONDATA-1454]false expression handling an...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1915


---


[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1915
  
LGTM


---


[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1915
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2269/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Add validation for empty bad recor...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3507/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Add validation for empty bad recor...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2270/



---


[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1915
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3506/



---


[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1915
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3354/



---


[GitHub] carbondata pull request #1924: [HOTFIX] Some basic fix for 1.3.0 release

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1924


---


[jira] [Resolved] (CARBONDATA-2122) Redirect Bad Record Path Should Throw Exception on Empty Location

2018-02-03 Thread Kunal Kapoor (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kunal Kapoor resolved CARBONDATA-2122.
--
Resolution: Fixed

> Redirect Bad Record Path Should Throw Exception on Empty Location
> -
>
> Key: CARBONDATA-2122
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2122
> Project: CarbonData
>  Issue Type: Bug
>  Components: data-load
>Affects Versions: 1.3.0
> Environment: Spark-2.1  
>Reporter: Jatin
>Assignee: Jatin
>Priority: Minor
> Fix For: 1.3.0
>
>  Time Spent: 7h 10m
>  Remaining Estimate: 0h
>
> Data Load having bad record redirect with empty location should throw 
> exception of Invalid Path.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1914: [CARBONDATA-2122] Add validation for empty ba...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1914


---


[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1924
  
LGTM


---


[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1924
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3504/



---


[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1915
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2268/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3505/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread kunal642
Github user kunal642 commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
LGTM


---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2267/



---


[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1924
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2266/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread brijoobopanna
Github user brijoobopanna commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
retest this please



---


[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...

2018-02-03 Thread kunal642
Github user kunal642 commented on the issue:

https://github.com/apache/carbondata/pull/1915
  
retest please


---


[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1831
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3353/



---


[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1831
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2265/



---


[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1831
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3503/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3352/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3502/



---


[GitHub] carbondata pull request #1909: [CARBONDATA-2125] like% filter is giving Arra...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1909


---


[GitHub] carbondata issue #1909: [CARBONDATA-2125] like% filter is giving ArrayIndexO...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1909
  
LGTM


---


[GitHub] carbondata issue #1909: [CARBONDATA-2125] like% filter is giving ArrayIndexO...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1909
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3351/



---


[jira] [Resolved] (CARBONDATA-2119) CarbonDataWriterException thrown when loading using global_sort

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-2119.
-
   Resolution: Fixed
Fix Version/s: 1.3.0

> CarbonDataWriterException thrown when loading using global_sort
> ---
>
> Key: CARBONDATA-2119
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2119
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Kunal Kapoor
>Assignee: Kunal Kapoor
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> CREATE TABLE uniqdata_globalsort1 (CUST_ID int,CUST_NAME 
> String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, 
> BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), 
> DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 
> double,INTEGER_COLUMN1 int) STORED BY 'carbondata' 
> TBLPROPERTIES('SORT_SCOPE'='GLOBAL_SORT')
> LOAD DATA INPATH 'hdfs://hacluster/chetan/2000_UniqData.csv' into table 
> uniqdata_globalsort1 OPTIONS('DELIMITER'=',' , 
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
>  
> *EXCEPTION*
> There is an unexpected error: unable to generate the mdkey 
> org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:222)org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:136)
>  
> org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:135)
>  
> org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) 
> org.apache.spark.scheduler.Task.run(Task.scala:99) 
> org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322)   
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> java.lang.Thread.run(Thread.java:748)
> at org.apache.spark.TaskContextImpl.invokeListeners(TaskContextImpl.scala:138)
> at org.apache.spark.TaskContextImpl.markTaskFailed(TaskContextImpl.scala:106)
> at org.apache.spark.scheduler.Task.run(Task.scala:104)
> ... 4 more
> Caused by: 
> org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException:
>  unable to generate the mdkey
> at 
> org.apache.carbondata.processing.loading.steps.DataWriterProcessorStepImpl.processRow(DataWriterProcessorStepImpl.java:189)
> at 
> org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:207)
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1911: [CARBONDATA-2119] Fixed deserialization issue...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1911


---


[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...

2018-02-03 Thread KanakaKumar
Github user KanakaKumar commented on the issue:

https://github.com/apache/carbondata/pull/1831
  
retest sdv please


---


[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1911
  
LGTM


---


[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1911
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3350/



---


[jira] [Updated] (CARBONDATA-2127) Documentation for Hive Standard Partition

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala updated CARBONDATA-2127:

Priority: Minor  (was: Major)

> Documentation for Hive Standard Partition
> -
>
> Key: CARBONDATA-2127
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2127
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
>Priority: Minor
> Fix For: 1.3.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Documentation for hive standard partition 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (CARBONDATA-2127) Documentation for Hive Standard Partition

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala updated CARBONDATA-2127:

Component/s: docs

> Documentation for Hive Standard Partition
> -
>
> Key: CARBONDATA-2127
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2127
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Documentation for hive standard partition 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (CARBONDATA-2127) Documentation for Hive Standard Partition

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-2127.
-
   Resolution: Fixed
Fix Version/s: 1.3.0

> Documentation for Hive Standard Partition
> -
>
> Key: CARBONDATA-2127
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2127
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> Documentation for hive standard partition 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1926: [CARBONDATA-2127] Documentation for Hive Stan...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1926


---


[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1926
  
LGTM


---


[jira] [Resolved] (CARBONDATA-2128) Documentation update for Table Path

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-2128.
-
   Resolution: Fixed
Fix Version/s: 1.3.0

> Documentation update for Table Path
> ---
>
> Key: CARBONDATA-2128
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2128
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> Add documentation for table path while creating the table



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Updated] (CARBONDATA-2128) Documentation update for Table Path

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala updated CARBONDATA-2128:

Component/s: docs

> Documentation update for Table Path
> ---
>
> Key: CARBONDATA-2128
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2128
> Project: CarbonData
>  Issue Type: Sub-task
>  Components: docs
>Reporter: Gururaj Shetty
>Assignee: Gururaj Shetty
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> Add documentation for table path while creating the table



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1927: [CARBONDATA-2128] Documentation for table pat...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1927


---


[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1927
  
LGTM


---


[GitHub] carbondata pull request #1926: [CARBONDATA-2127] Documentation for Hive Stan...

2018-02-03 Thread ravipesala
Github user ravipesala commented on a diff in the pull request:

https://github.com/apache/carbondata/pull/1926#discussion_r165818275
  
--- Diff: docs/data-management-on-carbondata.md ---
@@ -764,6 +765,107 @@ This tutorial is going to introduce all commands and 
data operations on CarbonDa
   * The partitioned column can be excluded from SORT_COLUMNS, this will 
let other columns to do the efficient sorting.
   * When writing SQL on a partition table, try to use filters on the 
partition column.
 
+## HIVE STANDARD PARTITION
+
+  Carbon supports the partition which is custom implemented by carbon but 
due to compatibility issue does not allow you to use the feature of Hive. By 
using this function, you can use the feature available in Hive.
+
+### Create Partition Table
+
+  This command allows you to create table with partition.
+  
+  ```
+  CREATE TABLE [IF NOT EXISTS] [db_name.]table_name 
+[(col_name data_type , ...)]
+[COMMENT table_comment]
+[PARTITIONED BY (col_name data_type , ...)]
+[STORED BY file_format]
+[TBLPROPERTIES (property_name=property_value, ...)]
+[AS select_statement];
+  ```
+  
+  Example:
+  ```
+   CREATE TABLE IF NOT EXISTS productSchema.productSalesTable (
+productNumber Int,
+productName String,
+storeCity String,
+storeProvince String,
+saleQuantity Int,
+revenue Int)
+  PARTITIONED BY (productCategory String, productBatch String)
+  STORED BY 'carbondata'
+  ```
+   
+### Load Data Using Static Partition
+
+  This command allows you to load data using static partition.
+  
+  ```
+  LOAD DATA [LOCAL] INPATH 'folder_path' 
+INTO TABLE [db_name.]table_name PARTITION (partition_spec) 
+OPTIONS(property_name=property_value, ...)
+  NSERT INTO INTO TABLE [db_name.]table_name PARTITION (partition_spec) 
SELECT STATMENT 
+  ```
+  
+  Example:
+  ```
+  LOAD DATA LOCAL INPATH '${env:HOME}/staticinput.txt'
+INTO TABLE locationTable
+PARTITION (country = 'US', state = 'CA')
+
+  INSERT INTO TABLE locationTable
+PARTITION (country = 'US', state = 'AL')
+SELECT * FROM another_user au 
+WHERE au.country = 'US' AND au.state = 'AL';
+  ```
+
+### Load Data Using Dynamic Partition
+
+  This command allows you to load data using dynamic partition. If 
partition spec is not specified, then the partition is considered as dynamic.
+
+  Example:
+  ```
+  LOAD DATA LOCAL INPATH '${env:HOME}/staticinput.txt'
+INTO TABLE locationTable
+  
+  INSERT INTO TABLE locationTable
+SELECT * FROM another_user au 
+WHERE au.country = 'US' AND au.state = 'AL';
+  ```
+
+### Show Partitions
+
+  This command gets the Hive partition information of the table
+
+  ```
+  SHOW PARTITIONS [db_name.]table_name
+  ```
+
+### Drop Partition
+
+  This command drops the specified Hive paritionOnly.
--- End diff --

typo parition only


---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
retest this please


---


[jira] [Resolved] (CARBONDATA-2101) Restrict Direct query on aggregation and timeseries data map

2018-02-03 Thread Ravindra Pesala (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ravindra Pesala resolved CARBONDATA-2101.
-
   Resolution: Fixed
Fix Version/s: 1.3.0

> Restrict Direct query on aggregation and timeseries data map
> 
>
> Key: CARBONDATA-2101
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2101
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: kumar vishal
>Assignee: kumar vishal
>Priority: Major
> Fix For: 1.3.0
>
>  Time Spent: 8h
>  Remaining Estimate: 0h
>
> Restrict direct query on timeseries and pre-aggregate data map
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1888: [CARBONDATA-2101]Restrict direct query on pre...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1888


---


[GitHub] carbondata issue #1888: [CARBONDATA-2101]Restrict direct query on pre aggreg...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1888
  
LGTM


---


[GitHub] carbondata issue #1888: [CARBONDATA-2101]Restrict direct query on pre aggreg...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1888
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3349/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2264/



---


[GitHub] carbondata issue #1772: [CARBONDATA-1995] Unify all writer steps and make te...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1772
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3500/



---


[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1926
  
Can one of the admins verify this patch?


---


[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1926
  
Can one of the admins verify this patch?


---


[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1927
  
Can one of the admins verify this patch?


---


[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1927
  
Can one of the admins verify this patch?


---


[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1911
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3501/



---


[GitHub] carbondata issue #1772: [CARBONDATA-1995] Unify all writer steps and make te...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1772
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2261/



---


[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1911
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2263/



---


[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1927
  
Can one of the admins verify this patch?


---


[GitHub] carbondata pull request #1927: [CARBONDATA-2128] Documentation for table pat...

2018-02-03 Thread sgururajshetty
GitHub user sgururajshetty opened a pull request:

https://github.com/apache/carbondata/pull/1927

[CARBONDATA-2128] Documentation for table path while creating the table

Documentation for table path while creating the table

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sgururajshetty/carbondata 2128

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1927.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1927


commit c640768a31f97cb5278d1804a9ceba8283889726
Author: sgururajshetty 
Date:   2018-02-03T15:50:41Z

Documentation for table path while creating the table




---


[jira] [Created] (CARBONDATA-2128) Documentation update for Table Path

2018-02-03 Thread Gururaj Shetty (JIRA)
Gururaj Shetty created CARBONDATA-2128:
--

 Summary: Documentation update for Table Path
 Key: CARBONDATA-2128
 URL: https://issues.apache.org/jira/browse/CARBONDATA-2128
 Project: CarbonData
  Issue Type: Sub-task
Reporter: Gururaj Shetty
Assignee: Gururaj Shetty


Add documentation for table path while creating the table



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread brijoobopanna
Github user brijoobopanna commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
retest this please



---


[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1926
  
Can one of the admins verify this patch?


---


[GitHub] carbondata pull request #1926: [CARBONDATA-2127] Documentation for Hive Stan...

2018-02-03 Thread sgururajshetty
GitHub user sgururajshetty opened a pull request:

https://github.com/apache/carbondata/pull/1926

[CARBONDATA-2127] Documentation for Hive Standard Partition

Documentation for Hive Standard Partition

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sgururajshetty/carbondata 2127

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1926.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1926


commit f97d0b5eca4d06d40d14436c7b62d93691d77e58
Author: sgururajshetty 
Date:   2018-02-03T15:34:23Z

Documentation for Hive Standard Partition




---


[jira] [Created] (CARBONDATA-2127) Documentation for Hive Standard Partition

2018-02-03 Thread Gururaj Shetty (JIRA)
Gururaj Shetty created CARBONDATA-2127:
--

 Summary: Documentation for Hive Standard Partition
 Key: CARBONDATA-2127
 URL: https://issues.apache.org/jira/browse/CARBONDATA-2127
 Project: CarbonData
  Issue Type: Sub-task
Reporter: Gururaj Shetty
Assignee: Gururaj Shetty


Documentation for hive standard partition 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3348/



---


[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...

2018-02-03 Thread mohammadshahidkhan
Github user mohammadshahidkhan commented on the issue:

https://github.com/apache/carbondata/pull/1831
  
retest this please


---


[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...

2018-02-03 Thread sgururajshetty
Github user sgururajshetty commented on the issue:

https://github.com/apache/carbondata/pull/1925
  
Closed


---


[GitHub] carbondata pull request #1925: [CARBONDATA-2126] Documentation for Create da...

2018-02-03 Thread sgururajshetty
Github user sgururajshetty closed the pull request at:

https://github.com/apache/carbondata/pull/1925


---


[GitHub] carbondata issue #1909: [CARBONDATA-2125] like% filter is giving ArrayIndexO...

2018-02-03 Thread dhatchayani
Github user dhatchayani commented on the issue:

https://github.com/apache/carbondata/pull/1909
  
Retest sdv please


---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3499/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3498/



---


[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1925
  
Can one of the admins verify this patch?


---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2262/



---


[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1856
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2259/



---


[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1911
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3347/



---


[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1924
  
Build Success with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2257/



---


[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1925
  
Can one of the admins verify this patch?


---


[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1925
  
Can one of the admins verify this patch?


---


[GitHub] carbondata pull request #1925: [CARBONDATA-2126] Documentation for Create da...

2018-02-03 Thread sgururajshetty
GitHub user sgururajshetty opened a pull request:

https://github.com/apache/carbondata/pull/1925

[CARBONDATA-2126] Documentation for Create database and custom location

Link issue fixed

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sgururajshetty/carbondata 2126

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1925.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1925


commit d66529dd9cca066b2030f3926a8d8c2945016cfc
Author: sgururajshetty 
Date:   2018-02-03T13:08:10Z

Documentation for create database and custom location

commit 241ba99b939ea3b14150485d016794b761d2fe50
Author: sgururajshetty 
Date:   2018-02-03T14:35:55Z

Link issue fixed




---


[GitHub] carbondata issue #1888: [CARBONDATA-2101]Restrict direct query on pre aggreg...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1888
  
retest sdv please


---


[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1924
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3496/



---


[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1914
  
Build Failed with Spark 2.2.1, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2258/



---


[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...

2018-02-03 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1911
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3495/



---


[jira] [Resolved] (CARBONDATA-2123) Refactor datamap schema thrift and datamap provider to use short name and classname

2018-02-03 Thread Jacky Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jacky Li resolved CARBONDATA-2123.
--
   Resolution: Fixed
Fix Version/s: 1.3.0

> Refactor datamap schema thrift and datamap provider to use short name and 
> classname
> ---
>
> Key: CARBONDATA-2123
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2123
> Project: CarbonData
>  Issue Type: Improvement
>Reporter: Ravindra Pesala
>Priority: Minor
> Fix For: 1.3.0
>
>  Time Spent: 5h
>  Remaining Estimate: 0h
>
> # Update schema thrift file for datamap schema to correct the typo errors and 
> updated the names.
>  # Added class name to schema file and updated short name for each enum.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] carbondata pull request #1919: [CARBONDATA-2123] Refactor datamap schema thr...

2018-02-03 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/carbondata/pull/1919


---


[GitHub] carbondata issue #1922: [HOTFIX] Fix streaming test case issue for file inpu...

2018-02-03 Thread ravipesala
Github user ravipesala commented on the issue:

https://github.com/apache/carbondata/pull/1922
  
SDV Build Success , Please check CI 
http://144.76.159.231:8080/job/ApacheSDVTests/3346/



---


  1   2   3   4   >