[jira] [Created] (CARBONDATA-676) Code clean
zhangshunyu created CARBONDATA-676: -- Summary: Code clean Key: CARBONDATA-676 URL: https://issues.apache.org/jira/browse/CARBONDATA-676 Project: CarbonData Issue Type: Improvement Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor To clean some codeļ¼ Correct the spelling mistake Remove unused function Iterate the Array instead of transform it to List. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-104) To support varchar datatype
[ https://issues.apache.org/jira/browse/CARBONDATA-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu closed CARBONDATA-104. -- Resolution: Invalid > To support varchar datatype > --- > > Key: CARBONDATA-104 > URL: https://issues.apache.org/jira/browse/CARBONDATA-104 > Project: CarbonData > Issue Type: New Feature >Reporter: zhangshunyu >Assignee: zhangshunyu >Priority: Minor > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-274) Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo
[ https://issues.apache.org/jira/browse/CARBONDATA-274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu closed CARBONDATA-274. -- Resolution: Invalid > Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo > - > > Key: CARBONDATA-274 > URL: https://issues.apache.org/jira/browse/CARBONDATA-274 > Project: CarbonData > Issue Type: Improvement > Components: spark-integration >Affects Versions: 0.1.1-incubating >Reporter: zhangshunyu >Assignee: zhangshunyu >Priority: Minor > > Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-518) CarbonExample of spark moudle can not run as kettlehome and storepath shoug get form carbonproperties now
zhangshunyu created CARBONDATA-518: -- Summary: CarbonExample of spark moudle can not run as kettlehome and storepath shoug get form carbonproperties now Key: CARBONDATA-518 URL: https://issues.apache.org/jira/browse/CARBONDATA-518 Project: CarbonData Issue Type: Bug Components: examples Affects Versions: 0.2.0-incubating, 1.0.0-incubating Reporter: zhangshunyu Priority: Minor Fix For: 1.0.0-incubating -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-451) Can not run query on windows now
zhangshunyu created CARBONDATA-451: -- Summary: Can not run query on windows now Key: CARBONDATA-451 URL: https://issues.apache.org/jira/browse/CARBONDATA-451 Project: CarbonData Issue Type: Bug Components: core Reporter: zhangshunyu Assignee: zhangshunyu Fix For: 0.2.0-incubating As tablePath on windows has '/' and not replaced when substring, it would throw error when execute query. I have fixed this and will raise a pr. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-411) test
[ https://issues.apache.org/jira/browse/CARBONDATA-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu closed CARBONDATA-411. -- Resolution: Invalid > test > > > Key: CARBONDATA-411 > URL: https://issues.apache.org/jira/browse/CARBONDATA-411 > Project: CarbonData > Issue Type: Improvement > Components: core >Reporter: zhangshunyu >Priority: Minor > Fix For: 0.2.0-incubating > > Time Spent: 20m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-411) test
zhangshunyu created CARBONDATA-411: -- Summary: test Key: CARBONDATA-411 URL: https://issues.apache.org/jira/browse/CARBONDATA-411 Project: CarbonData Issue Type: Improvement Components: core Reporter: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (CARBONDATA-332) Create successfully Database, tables and columns using carbon reserve keywords
[ https://issues.apache.org/jira/browse/CARBONDATA-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599708#comment-15599708 ] zhangshunyu edited comment on CARBONDATA-332 at 10/23/16 1:40 PM: -- i think this is not a problem, since we dont need keep all behavior as hive. was (Author: zhangshunyu): i think this is not a problem, since we need not keep all behavior as hive. > Create successfully Database, tables and columns using carbon reserve keywords > -- > > Key: CARBONDATA-332 > URL: https://issues.apache.org/jira/browse/CARBONDATA-332 > Project: CarbonData > Issue Type: Bug >Reporter: Harmeet Singh > > Hey team, I am trying to create database, tables and columns with carbon > reserve keywords name and carbon allow us for creating. I am expecting an > error. In hive, we are facing an error. Following are the steps : > Step1: > 0: jdbc:hive2://127.0.0.1:1> create database double; > +-+--+ > | result | > +-+--+ > +-+--+ > No rows selected (6.225 seconds) > Step 2: > 0: jdbc:hive2://127.0.0.1:1> use double; > +-+--+ > | result | > +-+--+ > +-+--+ > No rows selected (0.104 seconds) > Step 3: > 0: jdbc:hive2://127.0.0.1:1> create table decimal(int int, string string) > stored by 'carbondata'; > +-+--+ > | Result | > +-+--+ > +-+--+ > No rows selected (2.372 seconds) > Step 4: > 0: jdbc:hive2://127.0.0.1:1> show tables; > ++--+--+ > | tableName | isTemporary | > ++--+--+ > | decimal| false| > ++--+--+ > 1 row selected (0.071 seconds) > Step 5: > 0: jdbc:hive2://127.0.0.1:1> desc decimal; > +---++--+--+ > | col_name | data_type | comment | > +---++--+--+ > | string| string | | > | int | bigint | | > +---++--+--+ > 2 rows selected (0.556 seconds) > Step 6: > 0: jdbc:hive2://127.0.0.1:1> load data inpath > 'hdfs://localhost:54310/home/harmeet/reservewords.csv' into table decimal; > +-+--+ > | Result | > +-+--+ > +-+--+ > No rows selected (0.863 seconds) > Step 7: > 0: jdbc:hive2://127.0.0.1:1> select * from decimal; > +-+--+--+ > | string | int | > +-+--+--+ > | james | 10 | > +-+--+--+ > 1 row selected (0.413 seconds) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (CARBONDATA-332) Create successfully Database, tables and columns using carbon reserve keywords
[ https://issues.apache.org/jira/browse/CARBONDATA-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599708#comment-15599708 ] zhangshunyu commented on CARBONDATA-332: i think this is not a problem, since we need not keep all behavior as hive. > Create successfully Database, tables and columns using carbon reserve keywords > -- > > Key: CARBONDATA-332 > URL: https://issues.apache.org/jira/browse/CARBONDATA-332 > Project: CarbonData > Issue Type: Bug >Reporter: Harmeet Singh > > Hey team, I am trying to create database, tables and columns with carbon > reserve keywords name and carbon allow us for creating. I am expecting an > error. In hive, we are facing an error. Following are the steps : > Step1: > 0: jdbc:hive2://127.0.0.1:1> create database double; > +-+--+ > | result | > +-+--+ > +-+--+ > No rows selected (6.225 seconds) > Step 2: > 0: jdbc:hive2://127.0.0.1:1> use double; > +-+--+ > | result | > +-+--+ > +-+--+ > No rows selected (0.104 seconds) > Step 3: > 0: jdbc:hive2://127.0.0.1:1> create table decimal(int int, string string) > stored by 'carbondata'; > +-+--+ > | Result | > +-+--+ > +-+--+ > No rows selected (2.372 seconds) > Step 4: > 0: jdbc:hive2://127.0.0.1:1> show tables; > ++--+--+ > | tableName | isTemporary | > ++--+--+ > | decimal| false| > ++--+--+ > 1 row selected (0.071 seconds) > Step 5: > 0: jdbc:hive2://127.0.0.1:1> desc decimal; > +---++--+--+ > | col_name | data_type | comment | > +---++--+--+ > | string| string | | > | int | bigint | | > +---++--+--+ > 2 rows selected (0.556 seconds) > Step 6: > 0: jdbc:hive2://127.0.0.1:1> load data inpath > 'hdfs://localhost:54310/home/harmeet/reservewords.csv' into table decimal; > +-+--+ > | Result | > +-+--+ > +-+--+ > No rows selected (0.863 seconds) > Step 7: > 0: jdbc:hive2://127.0.0.1:1> select * from decimal; > +-+--+--+ > | string | int | > +-+--+--+ > | james | 10 | > +-+--+--+ > 1 row selected (0.413 seconds) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-311) Log the data size of blocklet during data load.
zhangshunyu created CARBONDATA-311: -- Summary: Log the data size of blocklet during data load. Key: CARBONDATA-311 URL: https://issues.apache.org/jira/browse/CARBONDATA-311 Project: CarbonData Issue Type: Improvement Affects Versions: 0.1.1-incubating Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating Log the data size of blocklet during data load. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-295) Abstract Snappy interface and seperate it from Compressor interface
[ https://issues.apache.org/jira/browse/CARBONDATA-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu closed CARBONDATA-295. -- Resolution: Invalid > Abstract Snappy interface and seperate it from Compressor interface > --- > > Key: CARBONDATA-295 > URL: https://issues.apache.org/jira/browse/CARBONDATA-295 > Project: CarbonData > Issue Type: Improvement > Components: data-load >Affects Versions: 0.1.1-incubating >Reporter: zhangshunyu >Assignee: zhangshunyu >Priority: Minor > Fix For: 0.2.0-incubating > > > Currently, we only have snappy compressor who extends form Compressor > interface, for future expansion, we need to abstract Snappy interface and > seperate it from Compressor interface, it means Compressor interface is the > parent of all compressors, and SnappyCompressor interface and the other > compressor's interface(or abstract class) should extends Compressor > interface, as to different data type for different compressor, it would > extend its own interface/abstract class. > for example: Compressor -> SnappyCompressor -> SnappyDoubleCompression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-295) Abstract Snappy interface and seperate it from Compressor interface
zhangshunyu created CARBONDATA-295: -- Summary: Abstract Snappy interface and seperate it from Compressor interface Key: CARBONDATA-295 URL: https://issues.apache.org/jira/browse/CARBONDATA-295 Project: CarbonData Issue Type: Improvement Components: data-load Affects Versions: 0.1.1-incubating Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating Currently, we only have snappy compressor who extends form Compressor interface, for future expansion, we need to abstract Snappy interface and seperate it from Compressor interface, it means Compressor interface is the parent of all compressors, and SnappyCompressor interface and the other compressor's interface(or abstract class) should extends Compressor interface, as to different data type for different compressor, it would extend its own interface/abstract class. for example: Compressor -> SnappyCompressor -> SnappyDoubleCompression. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-293) Add scan_blocklet_num for query statistics
zhangshunyu created CARBONDATA-293: -- Summary: Add scan_blocklet_num for query statistics Key: CARBONDATA-293 URL: https://issues.apache.org/jira/browse/CARBONDATA-293 Project: CarbonData Issue Type: Improvement Components: data-query Affects Versions: 0.1.1-incubating Reporter: zhangshunyu Assignee: zhangshunyu Fix For: 0.2.0-incubating Add scan_blocklet_num for query statistics -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-289) Support MB/M for table block size and update the doc about this new feature.
zhangshunyu created CARBONDATA-289: -- Summary: Support MB/M for table block size and update the doc about this new feature. Key: CARBONDATA-289 URL: https://issues.apache.org/jira/browse/CARBONDATA-289 Project: CarbonData Issue Type: Bug Components: spark-integration Affects Versions: 0.1.0-incubating Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating Support MB/M for table block size and update the doc about this new feature. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-280) when table properties is repeated it only set the last one
zhangshunyu created CARBONDATA-280: -- Summary: when table properties is repeated it only set the last one Key: CARBONDATA-280 URL: https://issues.apache.org/jira/browse/CARBONDATA-280 Project: CarbonData Issue Type: Bug Components: sql Affects Versions: 0.1.1-incubating Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating when table properties is repeated it only set the last one: For example, CREATE TABLE IF NOT EXISTS carbontable (ID Int, date Timestamp, country String, name String, phonetype String, serialname String, salary Int) STORED BY 'carbondata' TBLPROPERTIES('DICTIONARY_EXCLUDE'='country','DICTIONARY_INCLUDE'='ID', 'DICTIONARY_EXCLUDE'='phonetype', 'DICTIONARY_INCLUDE'='salary') only salary is set to DICTIONARY_INCLUDE and only phonetype is set to DICTIONARY_EXCLUDE. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (CARBONDATA-266) support delete all carbon tables under one database
[ https://issues.apache.org/jira/browse/CARBONDATA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu closed CARBONDATA-266. -- Resolution: Invalid Assignee: (was: zhangshunyu) Fix Version/s: (was: 0.2.0-incubating) > support delete all carbon tables under one database > --- > > Key: CARBONDATA-266 > URL: https://issues.apache.org/jira/browse/CARBONDATA-266 > Project: CarbonData > Issue Type: New Feature > Components: spark-integration >Affects Versions: 0.1.0-incubating >Reporter: zhangshunyu >Priority: Minor > > support delete all carbon tables under one database, but nor delete the other > tables. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-274) Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo
zhangshunyu created CARBONDATA-274: -- Summary: Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo Key: CARBONDATA-274 URL: https://issues.apache.org/jira/browse/CARBONDATA-274 Project: CarbonData Issue Type: Improvement Components: spark-integration Affects Versions: 0.1.1-incubating Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-267) Set block_size for table on table level
zhangshunyu created CARBONDATA-267: -- Summary: Set block_size for table on table level Key: CARBONDATA-267 URL: https://issues.apache.org/jira/browse/CARBONDATA-267 Project: CarbonData Issue Type: New Feature Affects Versions: 0.1.0-incubating Reporter: zhangshunyu Assignee: zhangshunyu Fix For: 0.2.0-incubating Set block_size for table on table level -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-266) support delete all carbon tables under one database
zhangshunyu created CARBONDATA-266: -- Summary: support delete all carbon tables under one database Key: CARBONDATA-266 URL: https://issues.apache.org/jira/browse/CARBONDATA-266 Project: CarbonData Issue Type: New Feature Components: spark-integration Affects Versions: 0.1.0-incubating Reporter: zhangshunyu Assignee: zhangshunyu Priority: Minor Fix For: 0.2.0-incubating support delete all carbon tables under one database, but nor delete the other tables. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (CARBONDATA-199) when subquery with sort and filter the result is empty
[ https://issues.apache.org/jira/browse/CARBONDATA-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu resolved CARBONDATA-199. Resolution: Fixed Assignee: zhangshunyu Fix Version/s: 0.2.0-incubating > when subquery with sort and filter the result is empty > -- > > Key: CARBONDATA-199 > URL: https://issues.apache.org/jira/browse/CARBONDATA-199 > Project: CarbonData > Issue Type: Bug >Reporter: zhangshunyu >Assignee: zhangshunyu > Fix For: 0.2.0-incubating > > > When the query has subquery with sort and filter, it can not return resullt -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (CARBONDATA-254) Code Inspection Optiminization
[ https://issues.apache.org/jira/browse/CARBONDATA-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshunyu updated CARBONDATA-254: --- Affects Version/s: 0.1.0-incubating Fix Version/s: 0.2.0-incubating > Code Inspection Optiminization > -- > > Key: CARBONDATA-254 > URL: https://issues.apache.org/jira/browse/CARBONDATA-254 > Project: CarbonData > Issue Type: Improvement >Affects Versions: 0.1.0-incubating >Reporter: zhangshunyu > Fix For: 0.2.0-incubating > > > Code Inspection Optiminization -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-255) keyword SEGMENT should be used instead of LOAD In data management dml because LOAD is not supported now
zhangshunyu created CARBONDATA-255: -- Summary: keyword SEGMENT should be used instead of LOAD In data management dml because LOAD is not supported now Key: CARBONDATA-255 URL: https://issues.apache.org/jira/browse/CARBONDATA-255 Project: CarbonData Issue Type: Bug Affects Versions: 0.1.0-incubating Reporter: zhangshunyu Fix For: 0.2.0-incubating keyword SEGMENT should be used instead of LOAD In data management dml because LOAD is not supported now -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-254) Code Inspection Optiminization
zhangshunyu created CARBONDATA-254: -- Summary: Code Inspection Optiminization Key: CARBONDATA-254 URL: https://issues.apache.org/jira/browse/CARBONDATA-254 Project: CarbonData Issue Type: Improvement Reporter: zhangshunyu Code Inspection Optiminization -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-231) Rename repeared table names in same test file and add drop tables.
zhangshunyu created CARBONDATA-231: -- Summary: Rename repeared table names in same test file and add drop tables. Key: CARBONDATA-231 URL: https://issues.apache.org/jira/browse/CARBONDATA-231 Project: CarbonData Issue Type: Improvement Reporter: zhangshunyu -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (CARBONDATA-199) when subquery with sort and filter the result is empty
zhangshunyu created CARBONDATA-199: -- Summary: when subquery with sort and filter the result is empty Key: CARBONDATA-199 URL: https://issues.apache.org/jira/browse/CARBONDATA-199 Project: CarbonData Issue Type: Bug Reporter: zhangshunyu When the query has subquery with sort and filter, it can not return resullt -- This message was sent by Atlassian JIRA (v6.3.4#6332)