Re: Open discussion and Vote: What kind of JIRA issue events need send mail to dev@carbondata.incubator.apache.org

2016-08-18 Thread chenliang613
Hi I agree Henry's proposal. Issue Created, send mails to dev@mailing list Issue Created and all other JIRA events send mails to new mailing list at issues@mailing list. Regards Liang -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Open-d

Re: Open discussion and Vote: What kind of JIRA issue events need send mail to dev@carbondata.incubator.apache.org

2016-08-19 Thread chenliang613
Agree for modified Option2 which be proposed by Henry. We will implement it as per the solution. Thanks for all of you participated in discussion and vote. Regards Liang -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Open-discussion-and-Vo

Re: [VOTE] Apache CarbonData 0.1.0-incubating release

2016-08-19 Thread chenliang613
+1 (binding) -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/VOTE-Apache-CarbonData-0-1-0-incubating-release-tp353p357.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.

[GitHub] incubator-carbondata pull request #147: Add cluster deployment guide

2016-09-09 Thread chenliang613
GitHub user chenliang613 opened a pull request: https://github.com/apache/incubator-carbondata/pull/147 Add cluster deployment guide add cluster deployment guide You can merge this pull request into a Git repository by running: $ git pull https://github.com/chenliang613

[GitHub] incubator-carbondata pull request #179: [CARBONDATA-214]Remove binary file a...

2016-09-21 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/179#discussion_r79872943 --- Diff: processing/src/test/java/org/apache/carbondata/test/util/StoreCreator.java --- @@ -0,0 +1,565 @@ +/* + * Licensed to the

Re: carbondata and idempotence

2016-09-23 Thread chenliang613
Hi Vincent Happy to hear you are interested in Apache CarbonData. Write to CarbonData file from Spark, please refer to the example : DataFrameAPIExample. Can you explain more about this requirement:A strong requirement is to avoid a Spark worker crash to write duplicated entries in Carbon... ? R

Re: Open discussion and Vote: What kind of JIRA issue events need send mail to dev@carbondata.incubator.apache.org

2016-09-26 Thread chenliang613
Hi all Propose to move "pull request information from github" to iss...@carbondata.incubator.apache.org also. For leveraging dev@carbondata.incubator.apache.org to focus on more solution/implementation/design discussion. Please provide your opinion also. Regards Liang chenliang613 w

RE: [Discuss]Set block_size for table on table level

2016-09-26 Thread chenliang613
+1, agree with Jihong's comment : make it as optional, usually the default block size will be used if user don't specially define it. Regards Liang Jihong Ma wrote > +1, To avoid potential compatibility issue, we could introduce this param > as an optional field, as long as it is not a required

Re: [jira] [Created] (CARBONDATA-275) org.apache.thrift.TBaseHelper.hashCode(int) can't find this function

2016-09-27 Thread chenliang613
Hi Have you installed Apache Thrift 0.9.3(https://thrift.apache.org/download)? and make sure thrift is added to system path. Regards Liang JIRA j...@apache.org wrote > zjw11763 created CARBONDATA-275: > --- > > Summary: org.apache.thrift.TBaseHelper

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-29 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r81246241 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -462,3 +478,133 @@ class

Re: Discussion about using multi local directorys to improve dataloading perfomance

2016-10-09 Thread chenliang613
+1 for the solution. Regards Liang QiangCai wrote > Hi All, > For each dataloading, we write the sorted temp files into only one > different local directory. I think this is a bottle neck of dataloading. > It is neccessary to use multi local directorys in multi disks for each > dataloading to

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-20 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r84415112 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0

[GitHub] incubator-carbondata pull request #255: CARBONDATA-336 Align the the name de...

2016-10-22 Thread chenliang613
GitHub user chenliang613 opened a pull request: https://github.com/apache/incubator-carbondata/pull/255 CARBONDATA-336 Align the the name description Align the the name description for databaseNameOp and tableName. You can merge this pull request into a Git repository by running

[GitHub] incubator-carbondata pull request #255: CARBONDATA-336 Align the the name de...

2016-10-22 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/255#discussion_r84578556 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonSqlParser.scala --- @@ -926,14 +926,14 @@ class CarbonSqlParser

[GitHub] incubator-carbondata pull request #255: CARBONDATA-336 Align the the name de...

2016-10-24 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/255#discussion_r84699713 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonSqlParser.scala --- @@ -926,14 +926,14 @@ class CarbonSqlParser

[GitHub] incubator-carbondata pull request #287: [CARBONDATA-367]Add support alluxio(...

2016-11-03 Thread chenliang613
GitHub user chenliang613 opened a pull request: https://github.com/apache/incubator-carbondata/pull/287 [CARBONDATA-367]Add support alluxio(tachyon) file system For supporting alluxio users to use higher performance file format(CarbonData), and enhance Apache CarbonData

[GitHub] incubator-carbondata pull request #298: [CARBONDATA-383]Optimize hdfsStoreLo...

2016-11-05 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/298#discussion_r86676467 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -166,7 +166,7 @@ class

[GitHub] incubator-carbondata pull request #306: Update readme as per IPMC comments

2016-11-08 Thread chenliang613
GitHub user chenliang613 opened a pull request: https://github.com/apache/incubator-carbondata/pull/306 Update readme as per IPMC comments Update readme as per IPMC comments You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] incubator-carbondata pull request #311: [CARBONDATA-403] Add example for dat...

2016-11-12 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/311#discussion_r87704849 --- Diff: examples/src/main/scala/org/apache/carbondata/examples/CarbonExample.scala --- @@ -32,24 +32,34 @@ object CarbonExample

[GitHub] incubator-carbondata issue #312: [CARBONDATA-404] Fixing dataframe save when...

2016-11-13 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata/pull/312 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] incubator-carbondata-site issue #1: Updated website for release

2016-12-17 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/1 @PallaviSingh1992 can you explain the detail about the PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] incubator-carbondata-site issue #5: Document Changes and Optimization

2017-01-02 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/5 please rebase and solve the conflict. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] incubator-carbondata-site issue #8: Feature/new features updated for release...

2017-01-29 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/8 please squash into one commit. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] incubator-carbondata-site issue #8: Feature/new features updated for release...

2017-01-30 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/8 1. Why added "content/images/format/Orders.gif"? 2.It is difficult to review for one PR which including too much files updated. --- If your project is set up f

[GitHub] incubator-carbondata-site issue #15: Added Search,Security and Faqs

2017-02-14 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/15 @PallaviSingh1992 Thank you worked on this issue. Please add the below link to : Community/Contributing To CarbonData https://github.com/apache/incubator

[GitHub] incubator-carbondata-site issue #15: Added Search,Security and Faqs

2017-02-15 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/15 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] incubator-carbondata-site issue #17: Updated the meetup page,links, ddl file...

2017-02-20 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/17 please rebase it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] incubator-carbondata-site issue #18: Removed Redundant and unused files and ...

2017-03-02 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/18 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] incubator-carbondata-site issue #19: Updated the pom file for html generatio...

2017-03-03 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/19 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] incubator-carbondata-site pull request #21: Updated the Meetup Page

2017-03-19 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/incubator-carbondata-site/pull/21#discussion_r106799987 --- Diff: content/meetup.html --- @@ -76,8 +76,8 @@ target="_blank">Co

[GitHub] incubator-carbondata-site issue #23: Meetup Page link updated

2017-03-20 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/23 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] incubator-carbondata-site issue #21: Updated the Meetup Page

2017-03-20 Thread chenliang613
Github user chenliang613 commented on the issue: https://github.com/apache/incubator-carbondata-site/pull/21 please close this PR --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

Re: Discussing to add carbondata-tools module

2016-08-05 Thread chenliang613
Thanks for you started the discussion, these tools look good. I am trying to understand why need these tools : Can you provide some scenarios info, these tools could help users to solve what issues? Regards Liang -- View this message in context: http://apache-carbondata-mailing-list-archive.

Re: [PROPOSAL] How to merge a pull request

2016-08-06 Thread chenliang613
+1 -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/PROPOSAL-How-to-merge-a-pull-request-tp18p22.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.

Re: Reg, Running CarbonData on Windows

2016-08-08 Thread chenliang613
Hi Currently, CarbonData deploy along with Spark, not supporting windows. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Reg-Running-CarbonData-on-Windows-tp44p45.html Sent from the Apache CarbonData Mailing List archive mailing list archiv

Open Discussion:Apache CarbonData Roadmap

2016-08-08 Thread chenliang613
HiI would like to start one discussion thread for Apache CarbonData Roadmap.Your any input and comments would be very appreciated! Apache CarbonData 0.1.0-incubating Support integration with Apache Spark1.5.2,1.6.1,1.6.2Support integration with Apache Hadoop 2.2 later versionColumnar data storeFull

Re: Open Discussion:Apache CarbonData Roadmap

2016-08-08 Thread chenliang613
Hi Jb Thanks for your comments. Remove kettle for preparing to integrate with Apache Beam/Apache Flink for supporting real-time data load. I would like to propose integration with Apache Beam etc. in Apache CarbonData 0.3.0. Regards Liang -- View this message in context: http://apache-carbon

Re: Towards 0.1.0-incubating release

2016-08-08 Thread chenliang613
Sure, Ravi and me will together with you to finish some PRs for preparing 0.1.0 relaeaes. Regards Liang (CarbonData dev mailing list web forum : http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com) -- View this message in context: http://apache-carbondata-mailing-list-archive.1

Re: Open Discussion:Apache CarbonData Roadmap

2016-08-09 Thread chenliang613
Hi William Thanks for your input. Most of your points would be considered in 0.2.0 : remove kettle, add create table properties for simplifying data load,especially for high cardinality columns setting, support 2.0 Regards Liang -- View this message in context: http://apache-carbondata-mailin

Re: [jira] [Created] (CARBONDATA-156) We are hoping to support the same table parallel load data

2016-08-11 Thread chenliang613
HiAs i understood, should support parallel load dataļ¼ˆbuild MDK index and sort for each data block processingļ¼‰, only to sort and join all data blocks into carbondata files, use one thread to handle. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble

Re: load data fail

2016-08-12 Thread chenliang613
HiAs we discussed, the error of "Table is locked for updation. Please try after some time " has been solved through setting directory rights.The below is new error, please Ravindra check and provide helps :WARN 12-08 16:29:51,871 - Lost task 1.1 in stage 2.0 (TID 6, had