[jira] [Created] (CARBONDATA-948) Delete DML support for Spark 2.1

2017-04-17 Thread Venkata Ramana G (JIRA)
Venkata Ramana G created CARBONDATA-948: --- Summary: Delete DML support for Spark 2.1 Key: CARBONDATA-948 URL: https://issues.apache.org/jira/browse/CARBONDATA-948 Project: CarbonData

[jira] [Created] (CARBONDATA-947) Update DML support for Spark 2.1

2017-04-17 Thread Venkata Ramana G (JIRA)
Venkata Ramana G created CARBONDATA-947: --- Summary: Update DML support for Spark 2.1 Key: CARBONDATA-947 URL: https://issues.apache.org/jira/browse/CARBONDATA-947 Project: CarbonData

[jira] [Created] (CARBONDATA-946) TUPLEID implicit column support in spark 2.1

2017-04-17 Thread Venkata Ramana G (JIRA)
Venkata Ramana G created CARBONDATA-946: --- Summary: TUPLEID implicit column support in spark 2.1 Key: CARBONDATA-946 URL: https://issues.apache.org/jira/browse/CARBONDATA-946 Project: CarbonData

[jira] [Created] (CARBONDATA-945) Support update/Delete for Spark 2.1

2017-04-17 Thread Venkata Ramana G (JIRA)
Venkata Ramana G created CARBONDATA-945: --- Summary: Support update/Delete for Spark 2.1 Key: CARBONDATA-945 URL: https://issues.apache.org/jira/browse/CARBONDATA-945 Project: CarbonData

Re: [DISCUSSION] Support new feature: bitmap encode

2017-04-17 Thread David QiangCai
Hi, In my opinion, we need the following points as least. 1. create table ddl can specify a bitmap option 2. add a new Encoding: BITMAP - Best Regards David QiangCai -- View this message in context:

Re: [DISCUSSION] Support new feature: bitmap encode

2017-04-17 Thread simafengyun
sub-task list of bitmap encode Feature: 1 data loading for bitmap encode columns generate bitmap encoded data and store to data page 2 query bitmap encode data read bitmap encode data from data page to dataChunk2 3 apply filter query on bitmap

[jira] [Created] (CARBONDATA-944) Fix wrong log info during drop table in spark-shell

2017-04-17 Thread Liang Chen (JIRA)
Liang Chen created CARBONDATA-944: - Summary: Fix wrong log info during drop table in spark-shell Key: CARBONDATA-944 URL: https://issues.apache.org/jira/browse/CARBONDATA-944 Project: CarbonData

[GitHub] incubator-carbondata-site pull request #29: updated table styling

2017-04-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata-site/pull/29 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

Re: java.io.FileNotFoundException: file:/data/carbon_data/default/carbon_table/Metadata/schema.write

2017-04-17 Thread Bhavya Aggarwal
Please use the below properties and don't append file:// and try again. val METASTORE_DB: String = "/data/carbon_meta" val SPARK_WAREHOUSE: String = "/data/spark-warehouse-carbon" val CARBON_FILES: String = "/data/carbon_data" Regards Bhavya On Mon, Apr 17, 2017 at 3:24 PM, xm_zzc

[jira] [Created] (CARBONDATA-943) Failing Mathematical functional in spark 2.1 is not displaying proper error message

2017-04-17 Thread Manohar Vanam (JIRA)
Manohar Vanam created CARBONDATA-943: Summary: Failing Mathematical functional in spark 2.1 is not displaying proper error message Key: CARBONDATA-943 URL: https://issues.apache.org/jira/browse/CARBONDATA-943

[jira] [Created] (CARBONDATA-942) OFF heap sort chunk size property doesnt have validation

2017-04-17 Thread ravikiran (JIRA)
ravikiran created CARBONDATA-942: Summary: OFF heap sort chunk size property doesnt have validation Key: CARBONDATA-942 URL: https://issues.apache.org/jira/browse/CARBONDATA-942 Project: CarbonData

Re: java.io.FileNotFoundException: file:/data/carbon_data/default/carbon_table/Metadata/schema.write

2017-04-17 Thread xm_zzc
Hi: val METASTORE_DB: String = "/data/carbon_meta" val SPARK_WAREHOUSE: String = "file:///data/spark-warehouse-carbon" val CARBON_FILES: String = "file:///data/carbon_data" The permissions on above paths: drwxrwxrwx 3 myubuntu myubuntu 4096 4月 17 17:50 /data/carbon_data/

[jira] [Created] (CARBONDATA-941) 7. Compaction of Partition Table

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-941: --- Summary: 7. Compaction of Partition Table Key: CARBONDATA-941 URL: https://issues.apache.org/jira/browse/CARBONDATA-941 Project: CarbonData Issue Type:

[jira] [Created] (CARBONDATA-940) 6. Alter table add/drop partition

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-940: --- Summary: 6. Alter table add/drop partition Key: CARBONDATA-940 URL: https://issues.apache.org/jira/browse/CARBONDATA-940 Project: CarbonData Issue Type:

[jira] [Created] (CARBONDATA-939) 5. Partition tables join on partition column

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-939: --- Summary: 5. Partition tables join on partition column Key: CARBONDATA-939 URL: https://issues.apache.org/jira/browse/CARBONDATA-939 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-938) 4. Detail filter query on partition column

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-938: --- Summary: 4. Detail filter query on partition column Key: CARBONDATA-938 URL: https://issues.apache.org/jira/browse/CARBONDATA-938 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-937) 3. Data loading of partition table

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-937: --- Summary: 3. Data loading of partition table Key: CARBONDATA-937 URL: https://issues.apache.org/jira/browse/CARBONDATA-937 Project: CarbonData Issue Type:

[jira] [Created] (CARBONDATA-936) 2. Create Table with Partition

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-936: --- Summary: 2. Create Table with Partition Key: CARBONDATA-936 URL: https://issues.apache.org/jira/browse/CARBONDATA-936 Project: CarbonData Issue Type: Sub-task

[jira] [Created] (CARBONDATA-935) 1. Define PartitionInfo model

2017-04-17 Thread QiangCai (JIRA)
QiangCai created CARBONDATA-935: --- Summary: 1. Define PartitionInfo model Key: CARBONDATA-935 URL: https://issues.apache.org/jira/browse/CARBONDATA-935 Project: CarbonData Issue Type: Sub-task

Re: [Discussion] Implement Partition Table Feature

2017-04-17 Thread Lu Cao
1. carbon use different sql parser in spark1.6 and 2.1, need to change CarbonSQLParser for 1.6 2. for interval range partition, no fixed partition name is defined in DDL, but need to keep partition name in schema and update when new partition is added. 3. one btree for one partition and one

Re: java.io.FileNotFoundException: file:/data/carbon_data/default/carbon_table/Metadata/schema.write

2017-04-17 Thread Bhavya Aggarwal
Hi, Can you please provide me the details of path for the following Constants.CARBON_FILES Constants.METASTORE_DB Also please let me know the permissions on /data/carbon_data directory, does the user you are using to run the example has permissions on directory /data or /data/carbondata

Re: java.io.FileNotFoundException: file:/data/carbon_data/default/carbon_table/Metadata/schema.write

2017-04-17 Thread xm_zzc
Hi Liang Chen: Thanks for your reply. I have added the '777' right to paths of 'Constants.CARBON_FILES' and 'Constants.METASTORE_DB'. but the error still exists. I have not idea how to resolve. -- View this message in context:

Re: [Discussion] Implement Partition Table Feature

2017-04-17 Thread QiangCai
sub-task list of Partition Table Feature: 1. Define PartitionInfo model modify schema.thrift to define PartitionInfo, add PartitionInfo to TableSchema 2. Create Table with Partition CarbonSparkSqlParser parse partition part to generate PartitionInfo, add PartitionInfo to TableModel. CreateTable