[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1928 @chenliang613 @jackylk please review, thanks. ---
[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1928 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3357/ ---
[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1928 retest sdv please ---
[GitHub] carbondata pull request #1860: [CARBONDATA-2080] [S3-Implementation] Propaga...
Github user jatin9896 closed the pull request at: https://github.com/apache/carbondata/pull/1860 ---
[GitHub] carbondata issue #1928: [MINOR]Remove dependency of Java 1.8
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1928 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3356/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1856 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3510/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1856 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2273/ ---
[GitHub] carbondata issue #1928: [HOTFIX]Remove dependency of Java 1.8
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1928 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2272/ ---
[GitHub] carbondata issue #1928: [HOTFIX]Remove dependency of Java 1.8
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1928 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3509/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1856 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3355/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user xubo245 commented on the issue: https://github.com/apache/carbondata/pull/1856 retest this please ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1856 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2271/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1856 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3508/ ---
[GitHub] carbondata pull request #1928: [HOTFIX]Remove dependency of Java 1.8
GitHub user zzcclp opened a pull request: https://github.com/apache/carbondata/pull/1928 [HOTFIX]Remove dependency of Java 1.8 Be sure to do all of the following checklist to help us incorporate your contribution quickly and easily: - [ ] Any interfaces changed? - [ ] Any backward compatibility impacted? - [ ] Document update required? - [ ] Testing done Please provide details on - Whether new unit test cases have been added or why no new tests are required? - How it is tested? Please attach test report. - Is it a performance related change? Please attach the performance test report. - Any additional information to help reviewers in testing this change. - [ ] For large changes, please consider breaking it into sub-tasks under an umbrella JIRA. You can merge this pull request into a Git repository by running: $ git pull https://github.com/zzcclp/carbondata hotfix_remove_dependency_of_Java1.8 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1928.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1928 commit 53c20575011b6ceff3d21549befc8942443d3ddd Author: Zhang Zhichao <441586683@...> Date: 2018-02-04T04:54:24Z [HOTFIX]Remove dependency of Java 1.8 ---
[jira] [Resolved] (CARBONDATA-1454) Block pruning not working when wrong data is given in filter
[ https://issues.apache.org/jira/browse/CARBONDATA-1454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-1454. - Resolution: Fixed Fix Version/s: 1.3.0 > Block pruning not working when wrong data is given in filter > - > > Key: CARBONDATA-1454 > URL: https://issues.apache.org/jira/browse/CARBONDATA-1454 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 1.1.1 >Reporter: Babulal >Priority: Major > Fix For: 1.3.0 > > Time Spent: 3h > Remaining Estimate: 0h > > Load ~13 Million records all with 2013-07-25' date > Q1 > select * from test where my_date='2013-07-25' ; > This took ~.0.5 sec > Q2 > select * from test where my_date='' limit 1; > This tool ~30 sec . > Q2 data will not be found in carbon so actually it should be handled in the > block pruning . and no job should be fired for it. > Same need to hanlde for timestamp also. > Solution :- > This to be consider as FalseExpression and handle same. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1915: [CARBONDATA-1454]false expression handling an...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1915 ---
[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1915 LGTM ---
[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1915 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2269/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Add validation for empty bad recor...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3507/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Add validation for empty bad recor...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2270/ ---
[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1915 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3506/ ---
[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1915 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3354/ ---
[GitHub] carbondata pull request #1924: [HOTFIX] Some basic fix for 1.3.0 release
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1924 ---
[jira] [Resolved] (CARBONDATA-2122) Redirect Bad Record Path Should Throw Exception on Empty Location
[ https://issues.apache.org/jira/browse/CARBONDATA-2122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kunal Kapoor resolved CARBONDATA-2122. -- Resolution: Fixed > Redirect Bad Record Path Should Throw Exception on Empty Location > - > > Key: CARBONDATA-2122 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2122 > Project: CarbonData > Issue Type: Bug > Components: data-load >Affects Versions: 1.3.0 > Environment: Spark-2.1 >Reporter: Jatin >Assignee: Jatin >Priority: Minor > Fix For: 1.3.0 > > Time Spent: 7h 10m > Remaining Estimate: 0h > > Data Load having bad record redirect with empty location should throw > exception of Invalid Path. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1914: [CARBONDATA-2122] Add validation for empty ba...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1914 ---
[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1924 LGTM ---
[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1924 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3504/ ---
[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1915 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2268/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3505/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user kunal642 commented on the issue: https://github.com/apache/carbondata/pull/1914 LGTM ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2267/ ---
[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1924 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2266/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user brijoobopanna commented on the issue: https://github.com/apache/carbondata/pull/1914 retest this please ---
[GitHub] carbondata issue #1915: [CARBONDATA-1454]false expression handling and block...
Github user kunal642 commented on the issue: https://github.com/apache/carbondata/pull/1915 retest please ---
[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1831 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3353/ ---
[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1831 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2265/ ---
[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1831 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3503/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1914 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3352/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3502/ ---
[GitHub] carbondata pull request #1909: [CARBONDATA-2125] like% filter is giving Arra...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1909 ---
[GitHub] carbondata issue #1909: [CARBONDATA-2125] like% filter is giving ArrayIndexO...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1909 LGTM ---
[GitHub] carbondata issue #1909: [CARBONDATA-2125] like% filter is giving ArrayIndexO...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1909 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3351/ ---
[jira] [Resolved] (CARBONDATA-2119) CarbonDataWriterException thrown when loading using global_sort
[ https://issues.apache.org/jira/browse/CARBONDATA-2119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2119. - Resolution: Fixed Fix Version/s: 1.3.0 > CarbonDataWriterException thrown when loading using global_sort > --- > > Key: CARBONDATA-2119 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2119 > Project: CarbonData > Issue Type: Bug >Reporter: Kunal Kapoor >Assignee: Kunal Kapoor >Priority: Major > Fix For: 1.3.0 > > Time Spent: 3h 10m > Remaining Estimate: 0h > > CREATE TABLE uniqdata_globalsort1 (CUST_ID int,CUST_NAME > String,ACTIVE_EMUI_VERSION string, DOB timestamp, DOJ timestamp, > BIGINT_COLUMN1 bigint,BIGINT_COLUMN2 bigint,DECIMAL_COLUMN1 decimal(30,10), > DECIMAL_COLUMN2 decimal(36,10),Double_COLUMN1 double, Double_COLUMN2 > double,INTEGER_COLUMN1 int) STORED BY 'carbondata' > TBLPROPERTIES('SORT_SCOPE'='GLOBAL_SORT') > LOAD DATA INPATH 'hdfs://hacluster/chetan/2000_UniqData.csv' into table > uniqdata_globalsort1 OPTIONS('DELIMITER'=',' , > 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1'); > > *EXCEPTION* > There is an unexpected error: unable to generate the mdkey > org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:222)org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:136) > > org.apache.carbondata.spark.load.DataLoadProcessBuilderOnSpark$$anonfun$loadDataUsingGlobalSort$1.apply(DataLoadProcessBuilderOnSpark.scala:135) > > org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87) > org.apache.spark.scheduler.Task.run(Task.scala:99) > org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:322) > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > java.lang.Thread.run(Thread.java:748) > at org.apache.spark.TaskContextImpl.invokeListeners(TaskContextImpl.scala:138) > at org.apache.spark.TaskContextImpl.markTaskFailed(TaskContextImpl.scala:106) > at org.apache.spark.scheduler.Task.run(Task.scala:104) > ... 4 more > Caused by: > org.apache.carbondata.processing.loading.exception.CarbonDataLoadingException: > unable to generate the mdkey > at > org.apache.carbondata.processing.loading.steps.DataWriterProcessorStepImpl.processRow(DataWriterProcessorStepImpl.java:189) > at > org.apache.carbondata.spark.load.DataLoadProcessorStepOnSpark$.writeFunc(DataLoadProcessorStepOnSpark.scala:207) > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1911: [CARBONDATA-2119] Fixed deserialization issue...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1911 ---
[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...
Github user KanakaKumar commented on the issue: https://github.com/apache/carbondata/pull/1831 retest sdv please ---
[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1911 LGTM ---
[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1911 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3350/ ---
[jira] [Updated] (CARBONDATA-2127) Documentation for Hive Standard Partition
[ https://issues.apache.org/jira/browse/CARBONDATA-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2127: Priority: Minor (was: Major) > Documentation for Hive Standard Partition > - > > Key: CARBONDATA-2127 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2127 > Project: CarbonData > Issue Type: Sub-task > Components: docs >Reporter: Gururaj Shetty >Assignee: Gururaj Shetty >Priority: Minor > Fix For: 1.3.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > Documentation for hive standard partition -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2127) Documentation for Hive Standard Partition
[ https://issues.apache.org/jira/browse/CARBONDATA-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2127: Component/s: docs > Documentation for Hive Standard Partition > - > > Key: CARBONDATA-2127 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2127 > Project: CarbonData > Issue Type: Sub-task > Components: docs >Reporter: Gururaj Shetty >Assignee: Gururaj Shetty >Priority: Major > Fix For: 1.3.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > Documentation for hive standard partition -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (CARBONDATA-2127) Documentation for Hive Standard Partition
[ https://issues.apache.org/jira/browse/CARBONDATA-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2127. - Resolution: Fixed Fix Version/s: 1.3.0 > Documentation for Hive Standard Partition > - > > Key: CARBONDATA-2127 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2127 > Project: CarbonData > Issue Type: Sub-task > Components: docs >Reporter: Gururaj Shetty >Assignee: Gururaj Shetty >Priority: Major > Fix For: 1.3.0 > > Time Spent: 1h 10m > Remaining Estimate: 0h > > Documentation for hive standard partition -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1926: [CARBONDATA-2127] Documentation for Hive Stan...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1926 ---
[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1926 LGTM ---
[jira] [Resolved] (CARBONDATA-2128) Documentation update for Table Path
[ https://issues.apache.org/jira/browse/CARBONDATA-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2128. - Resolution: Fixed Fix Version/s: 1.3.0 > Documentation update for Table Path > --- > > Key: CARBONDATA-2128 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2128 > Project: CarbonData > Issue Type: Sub-task > Components: docs >Reporter: Gururaj Shetty >Assignee: Gururaj Shetty >Priority: Major > Fix For: 1.3.0 > > Time Spent: 50m > Remaining Estimate: 0h > > Add documentation for table path while creating the table -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2128) Documentation update for Table Path
[ https://issues.apache.org/jira/browse/CARBONDATA-2128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2128: Component/s: docs > Documentation update for Table Path > --- > > Key: CARBONDATA-2128 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2128 > Project: CarbonData > Issue Type: Sub-task > Components: docs >Reporter: Gururaj Shetty >Assignee: Gururaj Shetty >Priority: Major > Fix For: 1.3.0 > > Time Spent: 1h > Remaining Estimate: 0h > > Add documentation for table path while creating the table -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1927: [CARBONDATA-2128] Documentation for table pat...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1927 ---
[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1927 LGTM ---
[GitHub] carbondata pull request #1926: [CARBONDATA-2127] Documentation for Hive Stan...
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1926#discussion_r165818275 --- Diff: docs/data-management-on-carbondata.md --- @@ -764,6 +765,107 @@ This tutorial is going to introduce all commands and data operations on CarbonDa * The partitioned column can be excluded from SORT_COLUMNS, this will let other columns to do the efficient sorting. * When writing SQL on a partition table, try to use filters on the partition column. +## HIVE STANDARD PARTITION + + Carbon supports the partition which is custom implemented by carbon but due to compatibility issue does not allow you to use the feature of Hive. By using this function, you can use the feature available in Hive. + +### Create Partition Table + + This command allows you to create table with partition. + + ``` + CREATE TABLE [IF NOT EXISTS] [db_name.]table_name +[(col_name data_type , ...)] +[COMMENT table_comment] +[PARTITIONED BY (col_name data_type , ...)] +[STORED BY file_format] +[TBLPROPERTIES (property_name=property_value, ...)] +[AS select_statement]; + ``` + + Example: + ``` + CREATE TABLE IF NOT EXISTS productSchema.productSalesTable ( +productNumber Int, +productName String, +storeCity String, +storeProvince String, +saleQuantity Int, +revenue Int) + PARTITIONED BY (productCategory String, productBatch String) + STORED BY 'carbondata' + ``` + +### Load Data Using Static Partition + + This command allows you to load data using static partition. + + ``` + LOAD DATA [LOCAL] INPATH 'folder_path' +INTO TABLE [db_name.]table_name PARTITION (partition_spec) +OPTIONS(property_name=property_value, ...) + NSERT INTO INTO TABLE [db_name.]table_name PARTITION (partition_spec) SELECT STATMENT + ``` + + Example: + ``` + LOAD DATA LOCAL INPATH '${env:HOME}/staticinput.txt' +INTO TABLE locationTable +PARTITION (country = 'US', state = 'CA') + + INSERT INTO TABLE locationTable +PARTITION (country = 'US', state = 'AL') +SELECT * FROM another_user au +WHERE au.country = 'US' AND au.state = 'AL'; + ``` + +### Load Data Using Dynamic Partition + + This command allows you to load data using dynamic partition. If partition spec is not specified, then the partition is considered as dynamic. + + Example: + ``` + LOAD DATA LOCAL INPATH '${env:HOME}/staticinput.txt' +INTO TABLE locationTable + + INSERT INTO TABLE locationTable +SELECT * FROM another_user au +WHERE au.country = 'US' AND au.state = 'AL'; + ``` + +### Show Partitions + + This command gets the Hive partition information of the table + + ``` + SHOW PARTITIONS [db_name.]table_name + ``` + +### Drop Partition + + This command drops the specified Hive paritionOnly. --- End diff -- typo parition only ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1914 retest this please ---
[jira] [Resolved] (CARBONDATA-2101) Restrict Direct query on aggregation and timeseries data map
[ https://issues.apache.org/jira/browse/CARBONDATA-2101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2101. - Resolution: Fixed Fix Version/s: 1.3.0 > Restrict Direct query on aggregation and timeseries data map > > > Key: CARBONDATA-2101 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2101 > Project: CarbonData > Issue Type: Improvement >Reporter: kumar vishal >Assignee: kumar vishal >Priority: Major > Fix For: 1.3.0 > > Time Spent: 8h > Remaining Estimate: 0h > > Restrict direct query on timeseries and pre-aggregate data map > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1888: [CARBONDATA-2101]Restrict direct query on pre...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1888 ---
[GitHub] carbondata issue #1888: [CARBONDATA-2101]Restrict direct query on pre aggreg...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1888 LGTM ---
[GitHub] carbondata issue #1888: [CARBONDATA-2101]Restrict direct query on pre aggreg...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1888 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3349/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2264/ ---
[GitHub] carbondata issue #1772: [CARBONDATA-1995] Unify all writer steps and make te...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1772 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3500/ ---
[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1926 Can one of the admins verify this patch? ---
[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1926 Can one of the admins verify this patch? ---
[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1927 Can one of the admins verify this patch? ---
[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1927 Can one of the admins verify this patch? ---
[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1911 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3501/ ---
[GitHub] carbondata issue #1772: [CARBONDATA-1995] Unify all writer steps and make te...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1772 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2261/ ---
[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1911 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2263/ ---
[GitHub] carbondata issue #1927: [CARBONDATA-2128] Documentation for table path while...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1927 Can one of the admins verify this patch? ---
[GitHub] carbondata pull request #1927: [CARBONDATA-2128] Documentation for table pat...
GitHub user sgururajshetty opened a pull request: https://github.com/apache/carbondata/pull/1927 [CARBONDATA-2128] Documentation for table path while creating the table Documentation for table path while creating the table You can merge this pull request into a Git repository by running: $ git pull https://github.com/sgururajshetty/carbondata 2128 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1927.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1927 commit c640768a31f97cb5278d1804a9ceba8283889726 Author: sgururajshetty Date: 2018-02-03T15:50:41Z Documentation for table path while creating the table ---
[jira] [Created] (CARBONDATA-2128) Documentation update for Table Path
Gururaj Shetty created CARBONDATA-2128: -- Summary: Documentation update for Table Path Key: CARBONDATA-2128 URL: https://issues.apache.org/jira/browse/CARBONDATA-2128 Project: CarbonData Issue Type: Sub-task Reporter: Gururaj Shetty Assignee: Gururaj Shetty Add documentation for table path while creating the table -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user brijoobopanna commented on the issue: https://github.com/apache/carbondata/pull/1914 retest this please ---
[GitHub] carbondata issue #1926: [CARBONDATA-2127] Documentation for Hive Standard Pa...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1926 Can one of the admins verify this patch? ---
[GitHub] carbondata pull request #1926: [CARBONDATA-2127] Documentation for Hive Stan...
GitHub user sgururajshetty opened a pull request: https://github.com/apache/carbondata/pull/1926 [CARBONDATA-2127] Documentation for Hive Standard Partition Documentation for Hive Standard Partition You can merge this pull request into a Git repository by running: $ git pull https://github.com/sgururajshetty/carbondata 2127 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1926.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1926 commit f97d0b5eca4d06d40d14436c7b62d93691d77e58 Author: sgururajshetty Date: 2018-02-03T15:34:23Z Documentation for Hive Standard Partition ---
[jira] [Created] (CARBONDATA-2127) Documentation for Hive Standard Partition
Gururaj Shetty created CARBONDATA-2127: -- Summary: Documentation for Hive Standard Partition Key: CARBONDATA-2127 URL: https://issues.apache.org/jira/browse/CARBONDATA-2127 Project: CarbonData Issue Type: Sub-task Reporter: Gururaj Shetty Assignee: Gururaj Shetty Documentation for hive standard partition -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1914 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3348/ ---
[GitHub] carbondata issue #1831: [CARBONDATA-1993] Carbon properties default values f...
Github user mohammadshahidkhan commented on the issue: https://github.com/apache/carbondata/pull/1831 retest this please ---
[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...
Github user sgururajshetty commented on the issue: https://github.com/apache/carbondata/pull/1925 Closed ---
[GitHub] carbondata pull request #1925: [CARBONDATA-2126] Documentation for Create da...
Github user sgururajshetty closed the pull request at: https://github.com/apache/carbondata/pull/1925 ---
[GitHub] carbondata issue #1909: [CARBONDATA-2125] like% filter is giving ArrayIndexO...
Github user dhatchayani commented on the issue: https://github.com/apache/carbondata/pull/1909 Retest sdv please ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3499/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1856 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3498/ ---
[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1925 Can one of the admins verify this patch? ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2262/ ---
[GitHub] carbondata issue #1856: [CARBONDATA-2073][CARBONDATA-1516][Tests] Add test c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1856 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2259/ ---
[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1911 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3347/ ---
[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1924 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2257/ ---
[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1925 Can one of the admins verify this patch? ---
[GitHub] carbondata issue #1925: [CARBONDATA-2126] Documentation for Create database ...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1925 Can one of the admins verify this patch? ---
[GitHub] carbondata pull request #1925: [CARBONDATA-2126] Documentation for Create da...
GitHub user sgururajshetty opened a pull request: https://github.com/apache/carbondata/pull/1925 [CARBONDATA-2126] Documentation for Create database and custom location Link issue fixed You can merge this pull request into a Git repository by running: $ git pull https://github.com/sgururajshetty/carbondata 2126 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/carbondata/pull/1925.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1925 commit d66529dd9cca066b2030f3926a8d8c2945016cfc Author: sgururajshetty Date: 2018-02-03T13:08:10Z Documentation for create database and custom location commit 241ba99b939ea3b14150485d016794b761d2fe50 Author: sgururajshetty Date: 2018-02-03T14:35:55Z Link issue fixed ---
[GitHub] carbondata issue #1888: [CARBONDATA-2101]Restrict direct query on pre aggreg...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1888 retest sdv please ---
[GitHub] carbondata issue #1924: [HOTFIX] Some basic fix for 1.3.0 release
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1924 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3496/ ---
[GitHub] carbondata issue #1914: [CARBONDATA-2122] Corrected bad record path validati...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1914 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/2258/ ---
[GitHub] carbondata issue #1911: [CARBONDATA-2119] Fixed deserialization issues for c...
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1911 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3495/ ---
[jira] [Resolved] (CARBONDATA-2123) Refactor datamap schema thrift and datamap provider to use short name and classname
[ https://issues.apache.org/jira/browse/CARBONDATA-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacky Li resolved CARBONDATA-2123. -- Resolution: Fixed Fix Version/s: 1.3.0 > Refactor datamap schema thrift and datamap provider to use short name and > classname > --- > > Key: CARBONDATA-2123 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2123 > Project: CarbonData > Issue Type: Improvement >Reporter: Ravindra Pesala >Priority: Minor > Fix For: 1.3.0 > > Time Spent: 5h > Remaining Estimate: 0h > > # Update schema thrift file for datamap schema to correct the typo errors and > updated the names. > # Added class name to schema file and updated short name for each enum. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] carbondata pull request #1919: [CARBONDATA-2123] Refactor datamap schema thr...
Github user asfgit closed the pull request at: https://github.com/apache/carbondata/pull/1919 ---
[GitHub] carbondata issue #1922: [HOTFIX] Fix streaming test case issue for file inpu...
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1922 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3346/ ---