[jira] [Created] (CARBONDATA-676) Code clean

2017-01-21 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-676:
--

 Summary: Code clean
 Key: CARBONDATA-676
 URL: https://issues.apache.org/jira/browse/CARBONDATA-676
 Project: CarbonData
  Issue Type: Improvement
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor


To clean some codeļ¼š
Correct the spelling mistake
Remove unused function
Iterate the Array instead of transform it to List.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-104) To support varchar datatype

2017-01-16 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu closed CARBONDATA-104.
--
Resolution: Invalid

> To support varchar datatype
> ---
>
> Key: CARBONDATA-104
> URL: https://issues.apache.org/jira/browse/CARBONDATA-104
> Project: CarbonData
>  Issue Type: New Feature
>Reporter: zhangshunyu
>Assignee: zhangshunyu
>Priority: Minor
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-274) Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo

2017-01-16 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu closed CARBONDATA-274.
--
Resolution: Invalid

> Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo
> -
>
> Key: CARBONDATA-274
> URL: https://issues.apache.org/jira/browse/CARBONDATA-274
> Project: CarbonData
>  Issue Type: Improvement
>  Components: spark-integration
>Affects Versions: 0.1.1-incubating
>Reporter: zhangshunyu
>Assignee: zhangshunyu
>Priority: Minor
>
> Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-518) CarbonExample of spark moudle can not run as kettlehome and storepath shoug get form carbonproperties now

2016-12-09 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-518:
--

 Summary: CarbonExample of spark moudle can not run as kettlehome 
and storepath shoug get form carbonproperties now
 Key: CARBONDATA-518
 URL: https://issues.apache.org/jira/browse/CARBONDATA-518
 Project: CarbonData
  Issue Type: Bug
  Components: examples
Affects Versions: 0.2.0-incubating, 1.0.0-incubating
Reporter: zhangshunyu
Priority: Minor
 Fix For: 1.0.0-incubating






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-451) Can not run query on windows now

2016-11-26 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-451:
--

 Summary: Can not run query on windows now
 Key: CARBONDATA-451
 URL: https://issues.apache.org/jira/browse/CARBONDATA-451
 Project: CarbonData
  Issue Type: Bug
  Components: core
Reporter: zhangshunyu
Assignee: zhangshunyu
 Fix For: 0.2.0-incubating


As tablePath on windows has '/' and not replaced when substring, it would throw 
error when execute query.
I have fixed this and will raise a pr.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-411) test

2016-11-15 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu closed CARBONDATA-411.
--
Resolution: Invalid

> test
> 
>
> Key: CARBONDATA-411
> URL: https://issues.apache.org/jira/browse/CARBONDATA-411
> Project: CarbonData
>  Issue Type: Improvement
>  Components: core
>Reporter: zhangshunyu
>Priority: Minor
> Fix For: 0.2.0-incubating
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-411) test

2016-11-15 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-411:
--

 Summary: test
 Key: CARBONDATA-411
 URL: https://issues.apache.org/jira/browse/CARBONDATA-411
 Project: CarbonData
  Issue Type: Improvement
  Components: core
Reporter: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Comment Edited] (CARBONDATA-332) Create successfully Database, tables and columns using carbon reserve keywords

2016-10-23 Thread zhangshunyu (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599708#comment-15599708
 ] 

zhangshunyu edited comment on CARBONDATA-332 at 10/23/16 1:40 PM:
--

i think this is not a problem, since we dont need keep all behavior as hive.


was (Author: zhangshunyu):
i think this is not a problem, since we need not keep all behavior as hive.

> Create successfully Database, tables and columns using carbon reserve keywords
> --
>
> Key: CARBONDATA-332
> URL: https://issues.apache.org/jira/browse/CARBONDATA-332
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Harmeet Singh
>
> Hey team, I am trying to create database, tables and columns with carbon 
> reserve keywords name and carbon allow us for creating. I am expecting an 
> error. In hive, we are facing an error. Following are the steps : 
> Step1: 
> 0: jdbc:hive2://127.0.0.1:1> create database double;
> +-+--+
> | result  |
> +-+--+
> +-+--+
> No rows selected (6.225 seconds)
> Step 2: 
> 0: jdbc:hive2://127.0.0.1:1> use double;
> +-+--+
> | result  |
> +-+--+
> +-+--+
> No rows selected (0.104 seconds)
> Step 3:
> 0: jdbc:hive2://127.0.0.1:1> create table decimal(int int, string string) 
> stored by 'carbondata';
> +-+--+
> | Result  |
> +-+--+
> +-+--+
> No rows selected (2.372 seconds)
> Step 4:
> 0: jdbc:hive2://127.0.0.1:1> show tables;
> ++--+--+
> | tableName  | isTemporary  |
> ++--+--+
> | decimal| false|
> ++--+--+
> 1 row selected (0.071 seconds)
> Step 5:
> 0: jdbc:hive2://127.0.0.1:1> desc decimal;
> +---++--+--+
> | col_name  | data_type  | comment  |
> +---++--+--+
> | string| string |  |
> | int   | bigint |  |
> +---++--+--+
> 2 rows selected (0.556 seconds)
> Step 6:
> 0: jdbc:hive2://127.0.0.1:1> load data inpath 
> 'hdfs://localhost:54310/home/harmeet/reservewords.csv' into table decimal;
> +-+--+
> | Result  |
> +-+--+
> +-+--+
> No rows selected (0.863 seconds)
> Step 7:
> 0: jdbc:hive2://127.0.0.1:1> select * from decimal;
> +-+--+--+
> | string  | int  |
> +-+--+--+
> |  james  | 10   |
> +-+--+--+
> 1 row selected (0.413 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (CARBONDATA-332) Create successfully Database, tables and columns using carbon reserve keywords

2016-10-23 Thread zhangshunyu (JIRA)

[ 
https://issues.apache.org/jira/browse/CARBONDATA-332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15599708#comment-15599708
 ] 

zhangshunyu commented on CARBONDATA-332:


i think this is not a problem, since we need not keep all behavior as hive.

> Create successfully Database, tables and columns using carbon reserve keywords
> --
>
> Key: CARBONDATA-332
> URL: https://issues.apache.org/jira/browse/CARBONDATA-332
> Project: CarbonData
>  Issue Type: Bug
>Reporter: Harmeet Singh
>
> Hey team, I am trying to create database, tables and columns with carbon 
> reserve keywords name and carbon allow us for creating. I am expecting an 
> error. In hive, we are facing an error. Following are the steps : 
> Step1: 
> 0: jdbc:hive2://127.0.0.1:1> create database double;
> +-+--+
> | result  |
> +-+--+
> +-+--+
> No rows selected (6.225 seconds)
> Step 2: 
> 0: jdbc:hive2://127.0.0.1:1> use double;
> +-+--+
> | result  |
> +-+--+
> +-+--+
> No rows selected (0.104 seconds)
> Step 3:
> 0: jdbc:hive2://127.0.0.1:1> create table decimal(int int, string string) 
> stored by 'carbondata';
> +-+--+
> | Result  |
> +-+--+
> +-+--+
> No rows selected (2.372 seconds)
> Step 4:
> 0: jdbc:hive2://127.0.0.1:1> show tables;
> ++--+--+
> | tableName  | isTemporary  |
> ++--+--+
> | decimal| false|
> ++--+--+
> 1 row selected (0.071 seconds)
> Step 5:
> 0: jdbc:hive2://127.0.0.1:1> desc decimal;
> +---++--+--+
> | col_name  | data_type  | comment  |
> +---++--+--+
> | string| string |  |
> | int   | bigint |  |
> +---++--+--+
> 2 rows selected (0.556 seconds)
> Step 6:
> 0: jdbc:hive2://127.0.0.1:1> load data inpath 
> 'hdfs://localhost:54310/home/harmeet/reservewords.csv' into table decimal;
> +-+--+
> | Result  |
> +-+--+
> +-+--+
> No rows selected (0.863 seconds)
> Step 7:
> 0: jdbc:hive2://127.0.0.1:1> select * from decimal;
> +-+--+--+
> | string  | int  |
> +-+--+--+
> |  james  | 10   |
> +-+--+--+
> 1 row selected (0.413 seconds)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-311) Log the data size of blocklet during data load.

2016-10-12 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-311:
--

 Summary: Log the data size of blocklet during data load.
 Key: CARBONDATA-311
 URL: https://issues.apache.org/jira/browse/CARBONDATA-311
 Project: CarbonData
  Issue Type: Improvement
Affects Versions: 0.1.1-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating


Log the data size of blocklet during data load.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-295) Abstract Snappy interface and seperate it from Compressor interface

2016-10-10 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu closed CARBONDATA-295.
--
Resolution: Invalid

> Abstract Snappy interface and seperate it from Compressor interface
> ---
>
> Key: CARBONDATA-295
> URL: https://issues.apache.org/jira/browse/CARBONDATA-295
> Project: CarbonData
>  Issue Type: Improvement
>  Components: data-load
>Affects Versions: 0.1.1-incubating
>Reporter: zhangshunyu
>Assignee: zhangshunyu
>Priority: Minor
> Fix For: 0.2.0-incubating
>
>
> Currently, we only have snappy compressor who extends form Compressor 
> interface, for future expansion, we need to abstract Snappy interface and 
> seperate it from Compressor interface, it means Compressor interface is the 
> parent of all compressors, and SnappyCompressor interface and the other 
> compressor's interface(or abstract class) should extends Compressor 
> interface, as to different data type for different compressor, it would 
> extend its own interface/abstract class.
> for example: Compressor -> SnappyCompressor -> SnappyDoubleCompression.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-295) Abstract Snappy interface and seperate it from Compressor interface

2016-10-10 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-295:
--

 Summary: Abstract Snappy interface and seperate it from Compressor 
interface
 Key: CARBONDATA-295
 URL: https://issues.apache.org/jira/browse/CARBONDATA-295
 Project: CarbonData
  Issue Type: Improvement
  Components: data-load
Affects Versions: 0.1.1-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating


Currently, we only have snappy compressor who extends form Compressor 
interface, for future expansion, we need to abstract Snappy interface and 
seperate it from Compressor interface, it means Compressor interface is the 
parent of all compressors, and SnappyCompressor interface and the other 
compressor's interface(or abstract class) should extends Compressor interface, 
as to different data type for different compressor, it would extend its own 
interface/abstract class.
for example: Compressor -> SnappyCompressor -> SnappyDoubleCompression.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-293) Add scan_blocklet_num for query statistics

2016-10-09 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-293:
--

 Summary: Add scan_blocklet_num for query statistics
 Key: CARBONDATA-293
 URL: https://issues.apache.org/jira/browse/CARBONDATA-293
 Project: CarbonData
  Issue Type: Improvement
  Components: data-query
Affects Versions: 0.1.1-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
 Fix For: 0.2.0-incubating


Add scan_blocklet_num for query statistics



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-289) Support MB/M for table block size and update the doc about this new feature.

2016-10-08 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-289:
--

 Summary: Support MB/M for table block size and update the doc 
about this new feature. 
 Key: CARBONDATA-289
 URL: https://issues.apache.org/jira/browse/CARBONDATA-289
 Project: CarbonData
  Issue Type: Bug
  Components: spark-integration
Affects Versions: 0.1.0-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating


Support MB/M for table block size and update the doc about this new feature. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-280) when table properties is repeated it only set the last one

2016-09-27 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-280:
--

 Summary:  when table properties is repeated it only set the last 
one
 Key: CARBONDATA-280
 URL: https://issues.apache.org/jira/browse/CARBONDATA-280
 Project: CarbonData
  Issue Type: Bug
  Components: sql
Affects Versions: 0.1.1-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating


when table properties is repeated it only set the last one:
For example,
CREATE TABLE IF NOT EXISTS carbontable
(ID Int, date Timestamp, country String,
name String, phonetype String, serialname String, salary Int)
STORED BY 'carbondata'
 TBLPROPERTIES('DICTIONARY_EXCLUDE'='country','DICTIONARY_INCLUDE'='ID',
 'DICTIONARY_EXCLUDE'='phonetype', 'DICTIONARY_INCLUDE'='salary')

only salary is set to DICTIONARY_INCLUDE and only phonetype is set to 
DICTIONARY_EXCLUDE.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Closed] (CARBONDATA-266) support delete all carbon tables under one database

2016-09-27 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu closed CARBONDATA-266.
--
   Resolution: Invalid
 Assignee: (was: zhangshunyu)
Fix Version/s: (was: 0.2.0-incubating)

> support delete all carbon tables under one database
> ---
>
> Key: CARBONDATA-266
> URL: https://issues.apache.org/jira/browse/CARBONDATA-266
> Project: CarbonData
>  Issue Type: New Feature
>  Components: spark-integration
>Affects Versions: 0.1.0-incubating
>Reporter: zhangshunyu
>Priority: Minor
>
> support delete all carbon tables under one database, but nor delete the other 
> tables.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-274) Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo

2016-09-26 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-274:
--

 Summary: Use exist method in CarbonMetastoreCatalog to read/write 
thrift TableInfo
 Key: CARBONDATA-274
 URL: https://issues.apache.org/jira/browse/CARBONDATA-274
 Project: CarbonData
  Issue Type: Improvement
  Components: spark-integration
Affects Versions: 0.1.1-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating


Use exist method in CarbonMetastoreCatalog to read/write thrift TableInfo



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-267) Set block_size for table on table level

2016-09-22 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-267:
--

 Summary: Set block_size for table on table level
 Key: CARBONDATA-267
 URL: https://issues.apache.org/jira/browse/CARBONDATA-267
 Project: CarbonData
  Issue Type: New Feature
Affects Versions: 0.1.0-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
 Fix For: 0.2.0-incubating


Set block_size for table on table level



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-266) support delete all carbon tables under one database

2016-09-21 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-266:
--

 Summary: support delete all carbon tables under one database
 Key: CARBONDATA-266
 URL: https://issues.apache.org/jira/browse/CARBONDATA-266
 Project: CarbonData
  Issue Type: New Feature
  Components: spark-integration
Affects Versions: 0.1.0-incubating
Reporter: zhangshunyu
Assignee: zhangshunyu
Priority: Minor
 Fix For: 0.2.0-incubating


support delete all carbon tables under one database, but nor delete the other 
tables.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (CARBONDATA-199) when subquery with sort and filter the result is empty

2016-09-19 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu resolved CARBONDATA-199.

   Resolution: Fixed
 Assignee: zhangshunyu
Fix Version/s: 0.2.0-incubating

> when subquery with sort and filter the result is empty
> --
>
> Key: CARBONDATA-199
> URL: https://issues.apache.org/jira/browse/CARBONDATA-199
> Project: CarbonData
>  Issue Type: Bug
>Reporter: zhangshunyu
>Assignee: zhangshunyu
> Fix For: 0.2.0-incubating
>
>
> When the query has subquery with sort and filter, it can not return resullt



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (CARBONDATA-254) Code Inspection Optiminization

2016-09-17 Thread zhangshunyu (JIRA)

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhangshunyu updated CARBONDATA-254:
---
Affects Version/s: 0.1.0-incubating
Fix Version/s: 0.2.0-incubating

> Code Inspection Optiminization
> --
>
> Key: CARBONDATA-254
> URL: https://issues.apache.org/jira/browse/CARBONDATA-254
> Project: CarbonData
>  Issue Type: Improvement
>Affects Versions: 0.1.0-incubating
>Reporter: zhangshunyu
> Fix For: 0.2.0-incubating
>
>
> Code Inspection Optiminization



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-255) keyword SEGMENT should be used instead of LOAD In data management dml because LOAD is not supported now

2016-09-17 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-255:
--

 Summary: keyword SEGMENT should be used instead of LOAD  In data 
management dml because LOAD is not supported now
 Key: CARBONDATA-255
 URL: https://issues.apache.org/jira/browse/CARBONDATA-255
 Project: CarbonData
  Issue Type: Bug
Affects Versions: 0.1.0-incubating
Reporter: zhangshunyu
 Fix For: 0.2.0-incubating


keyword SEGMENT should be used instead of LOAD  In data management dml because 
LOAD is not supported now



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-254) Code Inspection Optiminization

2016-09-17 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-254:
--

 Summary: Code Inspection Optiminization
 Key: CARBONDATA-254
 URL: https://issues.apache.org/jira/browse/CARBONDATA-254
 Project: CarbonData
  Issue Type: Improvement
Reporter: zhangshunyu


Code Inspection Optiminization



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-231) Rename repeared table names in same test file and add drop tables.

2016-09-08 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-231:
--

 Summary: Rename repeared table names in same test file and add 
drop tables.
 Key: CARBONDATA-231
 URL: https://issues.apache.org/jira/browse/CARBONDATA-231
 Project: CarbonData
  Issue Type: Improvement
Reporter: zhangshunyu






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (CARBONDATA-199) when subquery with sort and filter the result is empty

2016-09-01 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-199:
--

 Summary: when subquery with sort and filter the result is empty
 Key: CARBONDATA-199
 URL: https://issues.apache.org/jira/browse/CARBONDATA-199
 Project: CarbonData
  Issue Type: Bug
Reporter: zhangshunyu


When the query has subquery with sort and filter, it can not return resullt



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)