[jira] [Created] (CARBONDATA-2682) create table with long_string_columns property
lianganping created CARBONDATA-2682:
---
Summary: create table with long_string_columns property
Key: CARBONDATA-2682
URL: https://issues.apache.org/jira/browse/CARBONDATA-2682
Project: CarbonData
Issue Type: Bug
Components: spark-integration
Affects Versions: 1.4.1
Reporter: lianganping
1. create table with partition and no_inverted_index no long_string_columns
should be blocked. eg: create table local_no_inverted_index0(id int,name
string,description string,address string,note string) stored by 'carbondata'
tblproperties('no_inverted_index'='note','long_string_columns'='note') ;
create table local_partion(id int,name string,description string,address
string) partition by(note string) stored by 'carbondata'
tblproperties('long_string_columns'='note')
2. create table with duplicate long_string_column should be blocked.
eg:create table local_longstringtbl(id int,name string,description
string,address string,note string) stored by 'carbondata'
tblproperties('long_string_columns'='note,note') ;
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2682) create table with long_string_columns property
[
https://issues.apache.org/jira/browse/CARBONDATA-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping updated CARBONDATA-2682:
Issue Type: New Feature (was: Bug)
> create table with long_string_columns property
> --
>
> Key: CARBONDATA-2682
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2682
> Project: CarbonData
> Issue Type: New Feature
> Components: spark-integration
>Affects Versions: 1.4.1
>Reporter: lianganping
>Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> 1. create table with partition and no_inverted_index no long_string_columns
> should be blocked. eg: create table local_no_inverted_index0(id int,name
> string,description string,address string,note string) stored by 'carbondata'
> tblproperties('no_inverted_index'='note','long_string_columns'='note') ;
> create table local_partion(id int,name string,description string,address
> string) partition by(note string) stored by 'carbondata'
> tblproperties('long_string_columns'='note')
> 2. create table with duplicate long_string_column should be blocked.
> eg:create table local_longstringtbl(id int,name string,description
> string,address string,note string) stored by 'carbondata'
> tblproperties('long_string_columns'='note,note') ;
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2682) create table with long_string_columns property
[
https://issues.apache.org/jira/browse/CARBONDATA-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping updated CARBONDATA-2682:
Priority: Minor (was: Major)
> create table with long_string_columns property
> --
>
> Key: CARBONDATA-2682
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2682
> Project: CarbonData
> Issue Type: New Feature
> Components: spark-integration
>Affects Versions: 1.4.1
>Reporter: lianganping
>Priority: Minor
> Time Spent: 20m
> Remaining Estimate: 0h
>
> 1. create table with partition and no_inverted_index no long_string_columns
> should be blocked. eg: create table local_no_inverted_index0(id int,name
> string,description string,address string,note string) stored by 'carbondata'
> tblproperties('no_inverted_index'='note','long_string_columns'='note') ;
> create table local_partion(id int,name string,description string,address
> string) partition by(note string) stored by 'carbondata'
> tblproperties('long_string_columns'='note')
> 2. create table with duplicate long_string_column should be blocked.
> eg:create table local_longstringtbl(id int,name string,description
> string,address string,note string) stored by 'carbondata'
> tblproperties('long_string_columns'='note,note') ;
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (CARBONDATA-2819) cannot drop preagg datamap on table if the table has other index datamaps
lianganping created CARBONDATA-2819:
---
Summary: cannot drop preagg datamap on table if the table has
other index datamaps
Key: CARBONDATA-2819
URL: https://issues.apache.org/jira/browse/CARBONDATA-2819
Project: CarbonData
Issue Type: Improvement
Affects Versions: 1.4.1
Reporter: lianganping
1.create table student_test(id int,name string,class_number int,male int,female
int) stored by 'carbondata';
2.create datamap dm1_preaggr_student_test ON TABLE student_test USING
'preaggregate' as select class_number,sum(male) from student_test group by
class_number
3.create datamap dm_lucene_student_test on table student_test using 'lucene'
dmproperties('index_columns' = 'name');
4.drop datamap dm1_preaggr_student_test on table student_test;
and will get this error:
Error: org.apache.carbondata.common.exceptions.sql.NoSuchDataMapException:
Datamap with name dm1_preaggr_student_test does not exist (state=,code=0)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (CARBONDATA-2802) Creation of Bloomfilter Datamap is failing after UID,compaction,pre-aggregate datamap creation
[
https://issues.apache.org/jira/browse/CARBONDATA-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563072#comment-16563072
]
lianganping commented on CARBONDATA-2802:
-
i test it with github carbondata:master code, but i found if follow above test
steps, it maynot cause that error;
If follow these steps，it will certainly cause that error：
1.CREATE TABLE uniqdata(CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION
string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2
bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2
decimal(36,36),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1
int) STORED BY 'org.apache.carbondata.format';
2.LOAD DATA INPATH 'hdfs://hacluster/user/rahul/2000_UniqData.csv' into table
uniqdata OPTIONS('DELIMITER'=',' ,
'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
3.create datamap uniqdata_agg on table uniqdata using 'preaggregate' as select
cust_name, avg(cust_id) from uniqdata group by cust_id, cust_name;
{color:#FF}4.select cust_name, avg(cust_id) from uniqdata group by cust_id,
cust_name;{color}
5.CREATE DATAMAP bloom_dob ON TABLE uniqdata USING 'bloomfilter' DMPROPERTIES
('INDEX_COLUMNS' = 'dob', 'BLOOM_SIZE'='64', 'BLOOM_FPP'='0.1');
> Creation of Bloomfilter Datamap is failing after UID,compaction,pre-aggregate
> datamap creation
> --
>
> Key: CARBONDATA-2802
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2802
> Project: CarbonData
> Issue Type: Bug
> Components: other
>Affects Versions: 1.4.1
> Environment: Spark 2.2
>Reporter: Rahul Singha
>Priority: Minor
> Labels: bloom-filter
>
> *Steps :*
> 1.CREATE TABLE uniqdata(CUST_ID int,CUST_NAME String,ACTIVE_EMUI_VERSION
> string, DOB timestamp, DOJ timestamp, BIGINT_COLUMN1 bigint,BIGINT_COLUMN2
> bigint,DECIMAL_COLUMN1 decimal(30,10), DECIMAL_COLUMN2
> decimal(36,36),Double_COLUMN1 double, Double_COLUMN2 double,INTEGER_COLUMN1
> int) STORED BY 'org.apache.carbondata.format';
> 2.LOAD DATA INPATH 'hdfs://hacluster/user/rahul/2000_UniqData.csv' into table
> uniqdata OPTIONS('DELIMITER'=',' ,
> 'QUOTECHAR'='"','BAD_RECORDS_ACTION'='FORCE','FILEHEADER'='CUST_ID,CUST_NAME,ACTIVE_EMUI_VERSION,DOB,DOJ,BIGINT_COLUMN1,BIGINT_COLUMN2,DECIMAL_COLUMN1,DECIMAL_COLUMN2,Double_COLUMN1,Double_COLUMN2,INTEGER_COLUMN1');
> 3.update uniqdata set (active_emui_version) = ('ACTIVE_EMUI_VERSION_1')
> where cust_id = 9000;
> 4.delete from uniqdata where cust_id = 9000;
> 5.insert into uniqdata select
> 9000,'CUST_NAME_0','ACTIVE_EMUI_VERSION_0','1970-01-01
> 01:00:03.0','1970-01-01
> 02:00:03.0',123372036854,-223372036854,12345678901.123400,22345678901.123400,1.12345674897976E10,
> -1.12345674897976E10,1;
> 6.alter table uniqdata compact 'major';
> 7.create datamap uniqdata_agg on table uniqdata using 'preaggregate' as
> select cust_name, avg(cust_id) from uniqdata group by cust_id, cust_name;
> 8.CREATE DATAMAP bloom_dob ON TABLE uniqdata USING 'bloomfilter' DMPROPERTIES
> ('INDEX_COLUMNS' = 'dob', 'BLOOM_SIZE'='64', 'BLOOM_FPP'='0.1');
> *Actual output :*
> 0: jdbc:hive2://ha-cluster/default> CREATE DATAMAP bloom_dob ON TABLE
> uniqdata USING 'bloomfilter' DMPROPERTIES ('INDEX_COLUMNS' = 'dob',
> 'BLOOM_SIZE'='64', 'BLOOM_FPP'='0.1');
> Error: org.apache.spark.SparkException: Job aborted due to stage failure:
> Task 1 in stage 199.0 failed 4 times, most recent failure: Lost task 1.3 in
> stage 199.0 (TID 484, BLR125336, executor 182):
> java.io.InvalidClassException:
> scala.collection.convert.Wrappers$MutableSetWrapper; no valid constructor
> at
> java.io.ObjectStreamClass$ExceptionInfo.newInvalidClassException(ObjectStreamClass.java:157)
> at java.io.ObjectStreamClass.checkDeserialize(ObjectStreamClass.java:862)
> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2041)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
> at java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2285)
> at java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:2209)
> at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2067)
> at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1571)
> at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
> at java.util.ArrayList.readObject(ArrayList.java:797)
> at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at
[jira] [Updated] (CARBONDATA-2883) block some operations on external format table
[ https://issues.apache.org/jira/browse/CARBONDATA-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping updated CARBONDATA-2883: Description: Now some operatons are not supported for external format table, so those operations should be blocked as bellows: 1. update data on external format table 2. delete data on external format table 3. add columns on external format table 4. drop columns on external format table 5. change column datatype on external format table The operation in following scenario is not allowed: create external format table if table columns not in format.header And add external format information for command 'desc formatted table'. was: # update data on external format table # delete data on external format table # add columns on external format table # drop columns on external format table # change column datatype on external format table # create external format table if table columns not in format.header > block some operations on external format table > -- > > Key: CARBONDATA-2883 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2883 > Project: CarbonData > Issue Type: Sub-task >Reporter: lianganping >Assignee: lianganping >Priority: Minor > > Now some operatons are not supported for external format table, so those > operations should be blocked as bellows: > 1. update data on external format table > 2. delete data on external format table > 3. add columns on external format table > 4. drop columns on external format table > 5. change column datatype on external format table > The operation in following scenario is not allowed: > create external format table if table columns not in format.header > And add external format information for command 'desc formatted table'. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (CARBONDATA-2883) block some operations on external format table
[ https://issues.apache.org/jira/browse/CARBONDATA-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping reassigned CARBONDATA-2883: --- Assignee: lianganping > block some operations on external format table > -- > > Key: CARBONDATA-2883 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2883 > Project: CarbonData > Issue Type: Sub-task >Reporter: lianganping >Assignee: lianganping >Priority: Minor > > # update data on external format table > # delete data on external format table > # add columns on external format table > # drop columns on external format table > # change column datatype on external format table > # create external format table if table columns not in format.header -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (CARBONDATA-2883) block some operations on external format table
lianganping created CARBONDATA-2883: --- Summary: block some operations on external format table Key: CARBONDATA-2883 URL: https://issues.apache.org/jira/browse/CARBONDATA-2883 Project: CarbonData Issue Type: Sub-task Reporter: lianganping # update data on external format table # delete data on external format table # add columns on external format table # drop columns on external format table # change column datatype on external format table # create external format table if table columns not in format.header -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (CARBONDATA-2732) Block create bloomfilter datamap index on column which its datatype is complex type
[ https://issues.apache.org/jira/browse/CARBONDATA-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping resolved CARBONDATA-2732. - Resolution: Fixed Fix Version/s: 1.4.1 > Block create bloomfilter datamap index on column which its datatype is > complex type > --- > > Key: CARBONDATA-2732 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2732 > Project: CarbonData > Issue Type: Sub-task >Reporter: lianganping >Assignee: lianganping >Priority: Major > Fix For: 1.4.1 > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2698) Block alter datatype of bloom index columns
[ https://issues.apache.org/jira/browse/CARBONDATA-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping updated CARBONDATA-2698: Labels: resolved (was: ) > Block alter datatype of bloom index columns > --- > > Key: CARBONDATA-2698 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2698 > Project: CarbonData > Issue Type: Sub-task >Reporter: xuchuanyin >Assignee: lianganping >Priority: Major > Labels: resolved > Time Spent: 9h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2698) Block alter datatype of bloom index columns
[ https://issues.apache.org/jira/browse/CARBONDATA-2698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping updated CARBONDATA-2698: Labels: (was: resolved) > Block alter datatype of bloom index columns > --- > > Key: CARBONDATA-2698 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2698 > Project: CarbonData > Issue Type: Sub-task >Reporter: xuchuanyin >Assignee: lianganping >Priority: Major > Time Spent: 9h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (CARBONDATA-2782) dead code in class 'CarbonCleanFilesCommand'
lianganping created CARBONDATA-2782:
---
Summary: dead code in class 'CarbonCleanFilesCommand'
Key: CARBONDATA-2782
URL: https://issues.apache.org/jira/browse/CARBONDATA-2782
Project: CarbonData
Issue Type: Improvement
Reporter: lianganping
Fix For: 1.4.1
class:CarbonCleanFilesCommand
dead code:
override def processMetadata(sparkSession: SparkSession): Seq[Row] = {
carbonTable = CarbonEnv.getCarbonTable(databaseNameOp,
tableName.get)(sparkSession)
{color:#FF}val dms =
carbonTable.getTableInfo.getDataMapSchemaList.asScala.map(_.getDataMapName){color}
{color:#FF} val indexDms =
DataMapStoreManager.getInstance.getAllDataMap(carbonTable).asScala{color}
{color:#FF} .filter(_.getDataMapSchema.isIndexDataMap){color}
...
}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2782) dead code in class 'CarbonCleanFilesCommand'
[
https://issues.apache.org/jira/browse/CARBONDATA-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping updated CARBONDATA-2782:
Description:
class:CarbonCleanFilesCommand
dead code:
override def processMetadata(sparkSession: SparkSession): Seq[Row] = {
carbonTable = CarbonEnv.getCarbonTable(databaseNameOp,
tableName.get)(sparkSession)
{color:#ff}val dms =
carbonTable.getTableInfo.getDataMapSchemaList.asScala.map(_.getDataMapName){color}
{color:#ff} val indexDms =
DataMapStoreManager.getInstance.getAllDataMap(carbonTable).asScala{color}
{color:#ff} .filter(_.getDataMapSchema.isIndexDataMap){color}
...
}
the variables(dms、indexDms) are nerver used.
was:
class:CarbonCleanFilesCommand
dead code:
override def processMetadata(sparkSession: SparkSession): Seq[Row] = {
carbonTable = CarbonEnv.getCarbonTable(databaseNameOp,
tableName.get)(sparkSession)
{color:#FF}val dms =
carbonTable.getTableInfo.getDataMapSchemaList.asScala.map(_.getDataMapName){color}
{color:#FF} val indexDms =
DataMapStoreManager.getInstance.getAllDataMap(carbonTable).asScala{color}
{color:#FF} .filter(_.getDataMapSchema.isIndexDataMap){color}
...
}
> dead code in class 'CarbonCleanFilesCommand'
>
>
> Key: CARBONDATA-2782
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2782
> Project: CarbonData
> Issue Type: Improvement
>Reporter: lianganping
>Assignee: lianganping
>Priority: Trivial
> Fix For: 1.4.1
>
>
> class:CarbonCleanFilesCommand
> dead code:
> override def processMetadata(sparkSession: SparkSession): Seq[Row] = {
> carbonTable = CarbonEnv.getCarbonTable(databaseNameOp,
> tableName.get)(sparkSession)
> {color:#ff}val dms =
> carbonTable.getTableInfo.getDataMapSchemaList.asScala.map(_.getDataMapName){color}
> {color:#ff} val indexDms =
> DataMapStoreManager.getInstance.getAllDataMap(carbonTable).asScala{color}
> {color:#ff} .filter(_.getDataMapSchema.isIndexDataMap){color}
> ...
> }
> the variables(dms、indexDms) are nerver used.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (CARBONDATA-2782) dead code in class 'CarbonCleanFilesCommand'
[
https://issues.apache.org/jira/browse/CARBONDATA-2782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping reassigned CARBONDATA-2782:
---
Assignee: lianganping
> dead code in class 'CarbonCleanFilesCommand'
>
>
> Key: CARBONDATA-2782
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2782
> Project: CarbonData
> Issue Type: Improvement
>Reporter: lianganping
>Assignee: lianganping
>Priority: Trivial
> Fix For: 1.4.1
>
>
> class:CarbonCleanFilesCommand
> dead code:
> override def processMetadata(sparkSession: SparkSession): Seq[Row] = {
> carbonTable = CarbonEnv.getCarbonTable(databaseNameOp,
> tableName.get)(sparkSession)
> {color:#FF}val dms =
> carbonTable.getTableInfo.getDataMapSchemaList.asScala.map(_.getDataMapName){color}
> {color:#FF} val indexDms =
> DataMapStoreManager.getInstance.getAllDataMap(carbonTable).asScala{color}
> {color:#FF} .filter(_.getDataMapSchema.isIndexDataMap){color}
> ...
> }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (CARBONDATA-2730) Block create bloomfilter datamap index on local_dictionary column...
lianganping created CARBONDATA-2730: --- Summary: Block create bloomfilter datamap index on local_dictionary column... Key: CARBONDATA-2730 URL: https://issues.apache.org/jira/browse/CARBONDATA-2730 Project: CarbonData Issue Type: Sub-task Reporter: lianganping 1.Block create bloomfilter datamap index on column which its datatype is complex type; 2.Block create bloomfilter datamap index on local_dictionary column; -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (CARBONDATA-2732) Block create bloomfilter datamap index on column which its datatype is complex type
lianganping created CARBONDATA-2732: --- Summary: Block create bloomfilter datamap index on column which its datatype is complex type Key: CARBONDATA-2732 URL: https://issues.apache.org/jira/browse/CARBONDATA-2732 Project: CarbonData Issue Type: Sub-task Reporter: lianganping Assignee: lianganping -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (CARBONDATA-2730) Block create bloomfilter datamap index on local_dictionary column
[ https://issues.apache.org/jira/browse/CARBONDATA-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping updated CARBONDATA-2730: Description: Block create bloomfilter datamap index on local_dictionary column; (was: 1.Block create bloomfilter datamap index on column which its datatype is complex type; 2.Block create bloomfilter datamap index on local_dictionary column;) Summary: Block create bloomfilter datamap index on local_dictionary column (was: Block create bloomfilter datamap index on local_dictionary column...) > Block create bloomfilter datamap index on local_dictionary column > - > > Key: CARBONDATA-2730 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2730 > Project: CarbonData > Issue Type: Sub-task >Reporter: lianganping >Assignee: lianganping >Priority: Major > > Block create bloomfilter datamap index on local_dictionary column; -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (CARBONDATA-2682) create table with long_string_columns property
[
https://issues.apache.org/jira/browse/CARBONDATA-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping reassigned CARBONDATA-2682:
---
Assignee: lianganping
> create table with long_string_columns property
> --
>
> Key: CARBONDATA-2682
> URL: https://issues.apache.org/jira/browse/CARBONDATA-2682
> Project: CarbonData
> Issue Type: Sub-task
> Components: spark-integration
>Affects Versions: 1.4.1
>Reporter: lianganping
>Assignee: lianganping
>Priority: Minor
> Time Spent: 4h 20m
> Remaining Estimate: 0h
>
> 1. create table with partition and no_inverted_index no long_string_columns
> should be blocked. eg: create table local_no_inverted_index0(id int,name
> string,description string,address string,note string) stored by 'carbondata'
> tblproperties('no_inverted_index'='note','long_string_columns'='note') ;
> create table local_partion(id int,name string,description string,address
> string) partition by(note string) stored by 'carbondata'
> tblproperties('long_string_columns'='note')
> 2. create table with duplicate long_string_column should be blocked.
> eg:create table local_longstringtbl(id int,name string,description
> string,address string,note string) stored by 'carbondata'
> tblproperties('long_string_columns'='note,note') ;
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (CARBONDATA-2730) Block create bloomfilter datamap index on local_dictionary column...
[ https://issues.apache.org/jira/browse/CARBONDATA-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping reassigned CARBONDATA-2730: --- Assignee: lianganping > Block create bloomfilter datamap index on local_dictionary column... > > > Key: CARBONDATA-2730 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2730 > Project: CarbonData > Issue Type: Sub-task >Reporter: lianganping >Assignee: lianganping >Priority: Major > > 1.Block create bloomfilter datamap index on column which its datatype is > complex type; > 2.Block create bloomfilter datamap index on local_dictionary column; -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (CARBONDATA-2730) Block create bloomfilter datamap index on local_dictionary column
[ https://issues.apache.org/jira/browse/CARBONDATA-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping closed CARBONDATA-2730. --- Resolution: Not A Problem > Block create bloomfilter datamap index on local_dictionary column > - > > Key: CARBONDATA-2730 > URL: https://issues.apache.org/jira/browse/CARBONDATA-2730 > Project: CarbonData > Issue Type: Sub-task >Reporter: lianganping >Assignee: lianganping >Priority: Major > > Block create bloomfilter datamap index on local_dictionary column; -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
lianganping created CARBONDATA-3068: --- Summary: cannot load data from hdfs files without hdfs prefix Key: CARBONDATA-3068 URL: https://issues.apache.org/jira/browse/CARBONDATA-3068 Project: CarbonData Issue Type: Bug Components: spark-integration Affects Versions: 1.5.0 Reporter: lianganping Assignee: lianganping -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
[
https://issues.apache.org/jira/browse/CARBONDATA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping closed CARBONDATA-3068.
---
> cannot load data from hdfs files without hdfs prefix
>
>
> Key: CARBONDATA-3068
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3068
> Project: CarbonData
> Issue Type: Bug
> Components: spark-integration
>Affects Versions: 1.5.0
>Reporter: lianganping
>Assignee: lianganping
>Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> sql:
> LOAD DATA INPATH '/tmp/test.csv' INTO TABLE test
> OPTIONS('QUOTECHAR'='"','TIMESTAMPFORMAT'='/MM/dd HH:mm:ss');
> error:
> org.apache.carbondata.processing.exception.DataLoadingException: The input
> file does not exist: /tmp/test.csv (state=,code=0)
> but the file "test.csv" is in hdfs path, and hadoop conf "core-site.xml" has
> the property:
> fs.defaultFS
> hdfs://master:9000
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
[
https://issues.apache.org/jira/browse/CARBONDATA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping updated CARBONDATA-3068:
Description:
sql:
LOAD DATA INPATH '/tmp/test.csv' INTO TABLE test
OPTIONS('QUOTECHAR'='"','TIMESTAMPFORMAT'='/MM/dd HH:mm:ss');
error:
org.apache.carbondata.processing.exception.DataLoadingException: The input file
does not exist: /tmp/test.csv (state=,code=0)
but the file "test.csv" is in hdfs path, and hadoop conf "core-site.xml" has
the property:
fs.defaultFS
hdfs://master:9000
> cannot load data from hdfs files without hdfs prefix
>
>
> Key: CARBONDATA-3068
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3068
> Project: CarbonData
> Issue Type: Bug
> Components: spark-integration
>Affects Versions: 1.5.0
>Reporter: lianganping
>Assignee: lianganping
>Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> sql:
> LOAD DATA INPATH '/tmp/test.csv' INTO TABLE test
> OPTIONS('QUOTECHAR'='"','TIMESTAMPFORMAT'='/MM/dd HH:mm:ss');
> error:
> org.apache.carbondata.processing.exception.DataLoadingException: The input
> file does not exist: /tmp/test.csv (state=,code=0)
> but the file "test.csv" is in hdfs path, and hadoop conf "core-site.xml" has
> the property:
> fs.defaultFS
> hdfs://master:9000
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
[
https://issues.apache.org/jira/browse/CARBONDATA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
lianganping resolved CARBONDATA-3068.
-
Resolution: Fixed
> cannot load data from hdfs files without hdfs prefix
>
>
> Key: CARBONDATA-3068
> URL: https://issues.apache.org/jira/browse/CARBONDATA-3068
> Project: CarbonData
> Issue Type: Bug
> Components: spark-integration
>Affects Versions: 1.5.0
>Reporter: lianganping
>Assignee: lianganping
>Priority: Major
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> sql:
> LOAD DATA INPATH '/tmp/test.csv' INTO TABLE test
> OPTIONS('QUOTECHAR'='"','TIMESTAMPFORMAT'='/MM/dd HH:mm:ss');
> error:
> org.apache.carbondata.processing.exception.DataLoadingException: The input
> file does not exist: /tmp/test.csv (state=,code=0)
> but the file "test.csv" is in hdfs path, and hadoop conf "core-site.xml" has
> the property:
> fs.defaultFS
> hdfs://master:9000
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
[ https://issues.apache.org/jira/browse/CARBONDATA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping resolved CARBONDATA-3068. - Resolution: Fixed > cannot load data from hdfs files without hdfs prefix > > > Key: CARBONDATA-3068 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3068 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 1.5.0 >Reporter: lianganping >Assignee: lianganping >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
[ https://issues.apache.org/jira/browse/CARBONDATA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping closed CARBONDATA-3068. --- > cannot load data from hdfs files without hdfs prefix > > > Key: CARBONDATA-3068 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3068 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 1.5.0 >Reporter: lianganping >Assignee: lianganping >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Reopened] (CARBONDATA-3068) cannot load data from hdfs files without hdfs prefix
[ https://issues.apache.org/jira/browse/CARBONDATA-3068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lianganping reopened CARBONDATA-3068: - > cannot load data from hdfs files without hdfs prefix > > > Key: CARBONDATA-3068 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3068 > Project: CarbonData > Issue Type: Bug > Components: spark-integration >Affects Versions: 1.5.0 >Reporter: lianganping >Assignee: lianganping >Priority: Major > Time Spent: 1h 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
