[GitHub] incubator-carbondata pull request #70: [CARBONDATA-154] Fix the bug of block...

2016-08-09 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/70 [CARBONDATA-154] Fix the bug of block prune that query result is wrong. ## Why raise this pr: During block prune, endkey is always only decided by the last filter

[GitHub] incubator-carbondata pull request #24: Correct the log info

2016-07-05 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/24 Correct the log info You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata info Alternatively you

[GitHub] incubator-carbondata pull request #94: Fix bug that table not exist when exe...

2016-08-24 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/94 Fix bug that table not exist when execute show segments using spark-sql and beeline the same time. ## Why raise this pr: 1 When using beeline and sparksql the same time

[GitHub] incubator-carbondata pull request #129: Remove not needed parameters

2016-09-06 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/129 Remove not needed parameters There are many parameters in CarbonCommonConstants we not use now, should remove them. You can merge this pull request into a Git repository

[GitHub] incubator-carbondata pull request #117: [WIP]Fix the bug that when subquery ...

2016-09-01 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/117 [WIP]Fix the bug that when subquery with sort and filter the result is empty. ## Why raise this pr? Fix this bug: When the query has subquery with sort and filter, it can

[GitHub] incubator-carbondata pull request #142: [WIP][CARBONDATA-221] Fix the bug of...

2016-09-08 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/142 [WIP][CARBONDATA-221] Fix the bug of inverted index that store inverted index in metadata. ## Why raise this pr? Inverted index in ddl info was not stored into store, and when

[GitHub] incubator-carbondata pull request #129: Remove not needed parameters

2016-09-07 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/129 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #110: [CARBONDATA-193]Fix the bug that neg...

2016-08-31 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/110#discussion_r76929947 --- Diff: core/src/main/java/org/apache/carbondata/core/util/ValueCompressionUtil.java --- @@ -78,26 +78,26 @@ private ValueCompressionUtil

[GitHub] incubator-carbondata pull request #110: [wip][CARBONDATA-193]Fix the bug tha...

2016-08-30 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/110 [wip][CARBONDATA-193]Fix the bug that negative data compress is not properly when datatype is Double ## Why raise this pr? **Fix bug: negative data compress is not properly

[GitHub] incubator-carbondata pull request #52: [CARBONDATA-104] Support varchar data...

2016-09-16 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/52 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #204: [CARBONDATA-280]Fix the bug that whe...

2016-10-07 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/204 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #222: [CARBONDATA-221] Fix the bug of inve...

2016-10-09 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/222 [CARBONDATA-221] Fix the bug of inverted index that store inverted index in metadata. ## Why raise this pr? 1. Problem: In current code, inverted index in ddl info

[GitHub] incubator-carbondata pull request #185: Add a new feature that support delet...

2016-09-21 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/185 Add a new feature that support delete all carbon tables under one database. Why rasie this pr? Add a new feature that support delete all carbon tables under one database

[GitHub] incubator-carbondata pull request #171: [WIP] Code Inspection Optiminization

2016-09-17 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/171 [WIP] Code Inspection Optiminization You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata

[GitHub] incubator-carbondata pull request #178: [WIP] Fix NULL values issue

2016-09-20 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/178 [WIP] Fix NULL values issue You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata null

[GitHub] incubator-carbondata pull request #178: [WIP] Fix NULL values issue

2016-09-20 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/178 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #195: FIX CI

2016-09-23 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/195 FIX CI You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata FIXCI Alternatively you can review

[GitHub] incubator-carbondata pull request #188: [WIP] Add table_block_size on table ...

2016-09-22 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/188 [WIP] Add table_block_size on table level. You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata

[GitHub] incubator-carbondata pull request #188: [WIP] Add table_block_size on table ...

2016-09-22 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/188 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #189: [CARBONDATA-267] Set block_size for ...

2016-09-22 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/189 [CARBONDATA-267] Set block_size for table on table level ## Why raised this pr? To configure block file size for each table on column level. ## How to solve? Add a new

[GitHub] incubator-carbondata pull request #191: [WIP] Change delete segments parser

2016-09-22 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/191 [WIP] Change delete segments parser You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata

[GitHub] incubator-carbondata pull request #81: [CARBONDATA-132] Fix the bug that the...

2016-08-27 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/81 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #81: [CARBONDATA-132] Fix the bug that the...

2016-08-27 Thread Zhangshunyu
GitHub user Zhangshunyu reopened a pull request: https://github.com/apache/incubator-carbondata/pull/81 [CARBONDATA-132] Fix the bug that the CSV file header exception can not be shown to user using beeline. ## Why raise this pr: **For bug fix: The exception that 'CSV File

[GitHub] incubator-carbondata pull request #81: [CARBONDATA-132] Parse some Spark exc...

2016-08-23 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/81#discussion_r75984291 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -775,6 +777,13 @@ object

[GitHub] incubator-carbondata pull request #81: [CARBONDATA-132] Parse some Spark exc...

2016-08-23 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/81#discussion_r75984276 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -775,6 +777,13 @@ object

[GitHub] incubator-carbondata pull request #89: Fix the problem of hdfs lock and move...

2016-08-24 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/89 Fix the problem of hdfs lock and move the lock file inside the table folder. ## Why raise this pr 1. The hdfs lock file for one table should be put inside this table's store

[GitHub] incubator-carbondata pull request #103: Fix the bug that when using Decimal ...

2016-08-29 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/103 Fix the bug that when using Decimal type as dictionary gen surrogate key will mismatch for the same values during increment load. ## Why raise this pr? **Fix bug: when using

[GitHub] incubator-carbondata pull request #104: [CARBONDATA-188] Compress CSV file b...

2016-08-29 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/104#discussion_r76580960 --- Diff: processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/UnivocityCsvParser.java --- @@ -112,25 +116,29

[GitHub] incubator-carbondata pull request #84: [CARBONDATA-167]Fix that 'UndeclaredT...

2016-08-23 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/84 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

Re: 回复:[Discuss]Set block_size for table on table level

2016-09-27 Thread Zhangshunyu
I have verified that it would not affect the older tables. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Discuss-Set-block-size-for-table-on-table-level-tp1472p1531.html Sent from the Apache CarbonData Mailing List archive mailing list

[GitHub] incubator-carbondata pull request #204: [CARBONDATA-280]Fix the bug that whe...

2016-09-27 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/204 [CARBONDATA-280]Fix the bug that when table properties is repeated it only set the last one ## Why raise this pr? When table properties is repeated it only set the last one

Re: [Discuss]Set block_size for table on table level

2016-09-28 Thread Zhangshunyu
For each table, we can set block size consider the data.size, this is because that when execute query, each task will get one block to process one time, when the blocks num < parallelism, set a reasonable block size would get most suitable block num, to make the best of parallelism. -- View

[GitHub] incubator-carbondata pull request #52: [WIP] Support varchar datatype as SPA...

2016-09-28 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/52 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

Re: [jira] [Created] (CARBONDATA-275) org.apache.thrift.TBaseHelper.hashCode(int) can't find this function

2016-09-27 Thread Zhangshunyu
Use thrift 0.93 can solve this problem. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/jira-Created-CARBONDATA-275-org-apache-thrift-TBaseHelper-hashCode-int-can-t-find-this-function-tp1488p1530.html Sent from the Apache CarbonData Mailing

[GitHub] incubator-carbondata pull request #204: [CARBONDATA-280]Fix the bug that whe...

2016-10-09 Thread Zhangshunyu
GitHub user Zhangshunyu reopened a pull request: https://github.com/apache/incubator-carbondata/pull/204 [CARBONDATA-280]Fix the bug that when table properties is repeated it only set the last one ## Why raise this pr? When table properties is repeated it only set the last one

[GitHub] incubator-carbondata pull request #225: [CARBONDATA-295]Abstract Compressor ...

2016-10-10 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/225 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #309: [CARBONDATA-402] support CreateAsSel...

2016-11-11 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/309#discussion_r87588006 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -1375,6 +1376,24

[GitHub] incubator-carbondata pull request #222: [CARBONDATA-221] Fix the bug of inve...

2016-10-23 Thread Zhangshunyu
GitHub user Zhangshunyu reopened a pull request: https://github.com/apache/incubator-carbondata/pull/222 [CARBONDATA-221] Fix the bug of inverted index that store inverted index in metadata by using Encoding.INVERTED_INDEX. ## Why raise this pr? 1. Problem: In current code

[GitHub] incubator-carbondata pull request #222: [CARBONDATA-221] Fix the bug of inve...

2016-10-23 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #319: [CARBONDATA-411] Test

2016-11-15 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/319 [CARBONDATA-411] Test test You can merge this pull request into a Git repository by running: $ git pull https://github.com/Zhangshunyu/incubator-carbondata a Alternatively

[GitHub] incubator-carbondata pull request #259: Fix constants and method names

2016-10-26 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/259 Fix constants and method names ## Why raise this pr? To rename some constants and method names, for example: It is hard to get clear about what the parameter is used

[GitHub] incubator-carbondata pull request #224: [CARBONDATA-239]Add scan_blocklet_nu...

2016-10-12 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/224#discussion_r82958230 --- Diff: core/src/main/java/org/apache/carbondata/scan/processor/AbstractDataBlockIterator.java --- @@ -127,11 +133,15 @@ protected

[GitHub] incubator-carbondata pull request #230: [CARBONDATA-306]Add block size info ...

2016-10-12 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/230#discussion_r83027603 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java --- @@ -252,6 +252,9

[GitHub] incubator-carbondata pull request #231: [CARBONDATA-311]Log the data size of...

2016-10-12 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/231 [CARBONDATA-311]Log the data size of blocklet during data load. ## Why raise this pr? The blocklet size is an important parameter for analyzing data load and query, this info

[GitHub] incubator-carbondata pull request #230: [CARBONDATA-306]Add block size info ...

2016-10-12 Thread Zhangshunyu
Github user Zhangshunyu commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/230#discussion_r83139950 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/writer/AbstractFactDataWriter.java --- @@ -252,6 +252,9

[jira] [Created] (CARBONDATA-104) To support varchar datatype

2016-07-25 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-104: -- Summary: To support varchar datatype Key: CARBONDATA-104 URL: https://issues.apache.org/jira/browse/CARBONDATA-104 Project: CarbonData Issue Type: New

[jira] [Created] (CARBONDATA-123) Stored by 'carbondata' or 'org.apache.carbondata.format' shoulb be not case senstive

2016-07-28 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-123: -- Summary: Stored by 'carbondata' or 'org.apache.carbondata.format' shoulb be not case senstive Key: CARBONDATA-123 URL: https://issues.apache.org/jira/browse/CARBONDATA-123

[jira] [Created] (CARBONDATA-154) Block prune can not get the right blocks and query result is wrong

2016-08-09 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-154: -- Summary: Block prune can not get the right blocks and query result is wrong Key: CARBONDATA-154 URL: https://issues.apache.org/jira/browse/CARBONDATA-154 Project

[jira] [Created] (CARBONDATA-676) Code clean

2017-01-21 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-676: -- Summary: Code clean Key: CARBONDATA-676 URL: https://issues.apache.org/jira/browse/CARBONDATA-676 Project: CarbonData Issue Type: Improvement

[jira] [Created] (CARBONDATA-166) create table contains shared dictionary,and the shared dictionary keywords is not complete,create table can success and load failed

2016-08-22 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-166: -- Summary: create table contains shared dictionary,and the shared dictionary keywords is not complete,create table can success and load failed Key: CARBONDATA-166 URL: https

[jira] [Created] (CARBONDATA-178) table not exist when execute show segments using spark-sql and beeline the same time

2016-08-24 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-178: -- Summary: table not exist when execute show segments using spark-sql and beeline the same time Key: CARBONDATA-178 URL: https://issues.apache.org/jira/browse/CARBONDATA-178

[jira] [Created] (CARBONDATA-193) Data is not loading properly when double data type is having negative values

2016-08-30 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-193: -- Summary: Data is not loading properly when double data type is having negative values Key: CARBONDATA-193 URL: https://issues.apache.org/jira/browse/CARBONDATA-193

[jira] [Created] (CARBONDATA-231) Rename repeared table names in same test file and add drop tables.

2016-09-08 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-231: -- Summary: Rename repeared table names in same test file and add drop tables. Key: CARBONDATA-231 URL: https://issues.apache.org/jira/browse/CARBONDATA-231 Project

[jira] [Created] (CARBONDATA-289) Support MB/M for table block size and update the doc about this new feature.

2016-10-08 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-289: -- Summary: Support MB/M for table block size and update the doc about this new feature. Key: CARBONDATA-289 URL: https://issues.apache.org/jira/browse/CARBONDATA-289

[jira] [Created] (CARBONDATA-254) Code Inspection Optiminization

2016-09-17 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-254: -- Summary: Code Inspection Optiminization Key: CARBONDATA-254 URL: https://issues.apache.org/jira/browse/CARBONDATA-254 Project: CarbonData Issue Type

[jira] [Created] (CARBONDATA-267) Set block_size for table on table level

2016-09-22 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-267: -- Summary: Set block_size for table on table level Key: CARBONDATA-267 URL: https://issues.apache.org/jira/browse/CARBONDATA-267 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-280) when table properties is repeated it only set the last one

2016-09-27 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-280: -- Summary: when table properties is repeated it only set the last one Key: CARBONDATA-280 URL: https://issues.apache.org/jira/browse/CARBONDATA-280 Project

[jira] [Created] (CARBONDATA-293) Add scan_blocklet_num for query statistics

2016-10-09 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-293: -- Summary: Add scan_blocklet_num for query statistics Key: CARBONDATA-293 URL: https://issues.apache.org/jira/browse/CARBONDATA-293 Project: CarbonData

[jira] [Created] (CARBONDATA-451) Can not run query on windows now

2016-11-26 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-451: -- Summary: Can not run query on windows now Key: CARBONDATA-451 URL: https://issues.apache.org/jira/browse/CARBONDATA-451 Project: CarbonData Issue Type

[jira] [Created] (CARBONDATA-411) test

2016-11-15 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-411: -- Summary: test Key: CARBONDATA-411 URL: https://issues.apache.org/jira/browse/CARBONDATA-411 Project: CarbonData Issue Type: Improvement

[jira] [Created] (CARBONDATA-295) Abstract Snappy interface and seperate it from Compressor interface

2016-10-10 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-295: -- Summary: Abstract Snappy interface and seperate it from Compressor interface Key: CARBONDATA-295 URL: https://issues.apache.org/jira/browse/CARBONDATA-295

[jira] [Created] (CARBONDATA-311) Log the data size of blocklet during data load.

2016-10-12 Thread zhangshunyu (JIRA)
zhangshunyu created CARBONDATA-311: -- Summary: Log the data size of blocklet during data load. Key: CARBONDATA-311 URL: https://issues.apache.org/jira/browse/CARBONDATA-311 Project: CarbonData