Discussion : Propose to optimize some features which are very less be used.

2024-04-06 Thread Liang Chen
Dear community I have one proposal , suggest optimizing some features which are very less be used please vote the below modules, whether can be optimized/removed : index/secondary-index index/bloom index/lucene geo Regards Liang

Re: C++ implementation requirement

2024-04-06 Thread Liang Chen
Dear For supporting C++ implementation, will be a big work, who can start this task , we can first discuss design ideas? Regards Liang On 2023/10/23 06:09:39 Liang Chen wrote: > Dear Jacky > > Thanks for bring this discussion to community. > good idea , +1 from my side, C++ im

Re: DISCUSSION : Need to optimize the supported version of Spark

2024-03-31 Thread Liang Chen
+1, agree. To David : can you please take this task ? Regards Liang 蔡强 于2024年3月29日周五 13:19写道: > +1 > > I suggest to integrate with 3.5.1, and no need to support old versions > > On Sun, 17 Mar 2024 at 21:49, Liang Chen wrote: > > > Dear community > > > >

DISCUSSION : Need to optimize the supported version of Spark

2024-03-17 Thread Liang Chen
Dear community Apache CarbonDate integrates multi version Spark engine, it is time to upgrade version and optimize the old versions which don't need to be supported. Please input your comments. Regards Liang

Re: Personal question related to the current board report

2024-03-12 Thread Liang Chen
Dear Chris Thank you for contacting the community. In the past 6 months, around 5-6 contributors committed source code to the project. It is true, the community need to further encourage more contributors, we will push it , thanks again. Regard Liang Christofer Dutz 于 2024年1月14日周日 14:12写道:

Re: C++ implementation requirement

2024-01-05 Thread Liang Chen
Dear Jacky Good idea, then will improve query performance significantly. we need to discuss further, how to start. may be you can first prepare a proposal document , and send to dev mailing for discussion. Regards Liang Jacky Li 于2023年10月23日周一 04:47写道: > Hi community, > > > I have been

[ANNOUNCE] Apache CarbonData 2.3.1 Released

2023-11-25 Thread Liang Chen
Hi All, The Apache CarbonData PMC team is happy to announce the release of Apache CarbonData version 2.3.1 This release improved the below issues: - Fixed performance issues by changing index id - Fixed Secondary Index till segment level with SI as datamap, make Secondary Index as

[RESULT] Re: [VOTE] Apache CarbonData 2.3.1-rc1 release

2023-11-25 Thread Liang Chen
Hi all PMC vote has passed for Apache Carbondata 2.3.1 release, the result as below: +1(binding) : 6(Liang Chen, Jacky , Akash, Kunal, Indhumathi M, Bo Xu) Thanks all for your vote. Regards Liang Liang Chen 于2023年11月25日周六 09:49写道: > +1 > > Regards > Liang > > Indhumathi

Re: [VOTE] Apache CarbonData 2.3.1-rc1 release

2023-11-25 Thread Liang Chen
+1 Regards Liang Indhumathi M 于2023年11月21日周二 19:11写道: > +1 > > Regards, > Indhumathi M > > > On Tue, 21 Nov 2023 at 1:07 AM, Liang Chen > wrote: > > > Hi > > > > > > > > I submit the Apache CarbonData 2.3.1 (RC1) to your vote. > &g

Discussion : The community plans to clear up the old invalid PRs and some PRs are under WIP for a long time.

2023-11-05 Thread Liang Chen
Dear The community plans to clear up the old invalid PRs and some PRs are under WIP for a long time. Please input your comment, and check the RP list under your name. Regards

Re: C++ implementation requirement

2023-10-23 Thread Liang Chen
Dear Jacky Thanks for bring this discussion to community. good idea , +1 from my side, C++ implementation cloud get much more performance improvement. Regards Liang Jacky Li 于2023年10月23日周一 04:47写道: > Hi community, > > > I have been using Apache CarbonData with Apache Spark to > process

Dear community

2023-10-19 Thread Liang Chen
As you know, Carbondata as datastore and dataformat already be quite good and mature. I want to create the thread via mailing list to open discuss what are the next milestones of carbondata project? One proposal from my side: we should consider how to integrate with AI computing engine? Regards

Invite Bo Xu as new release manager . Re: [ANNOUNCE] Bo Xu as new PMC for Apache CarbonData

2023-10-18 Thread Liang Chen
Dear community I would like to propose Bo xu as new PMC to take charge of next new release. Regards Liang Liang Chen 于2023年4月24日周一 20:57写道: > *Hi * > > > *We are pleased to announce that Bo Xu as new PMC for Apache CarbonData.* > > > *Congrats to **Bo Xu**!* > > > *Apache CarbonData PMC* >

[ANNOUNCE] Bo Xu as new PMC for Apache CarbonData

2023-04-24 Thread Liang Chen
*Hi * *We are pleased to announce that Bo Xu as new PMC for Apache CarbonData.* *Congrats to **Bo Xu**!* *Apache CarbonData PMC*

Re: Newbie Question: Challenges with Getting Started

2023-04-06 Thread Liang Chen
Hi Should be ok, please try it again. Regards Sandeep N 于2022年4月18日周一 19:47写道: > Hi all, > > I ran into carbondata and started trying it out. I am following this page > https://carbondata.apache.org/quick-start-guide.html. > > So far I have downloaded >

Re: Error while creating table

2023-04-06 Thread Liang Chen
The user group is u...@carbondata.apache.org Regards Xinyu Zeng 于2022年4月25日周一 11:13写道: > Hi, > > Since there is no user group, I am using this email list to ask > questions. Please let me know if there are other platforms for users > to discuss. > > I am new to CarbonData and am following the

Discussion : the Jenkins CI of ASF is not working well , any suggestion ? we need to change a new free CI

2023-04-06 Thread Liang Chen
Dear The Jenkins CI of ASF is not working well , any suggestion ? we need to change a new free CI

How a DBS Data Platform Drives Real-time Insights & Analytics using Apache CarbonData:

2023-02-12 Thread Liang Chen
Dear How a DBS Data Platform Drives Real-time Insights & Analytics using Apache CarbonData: Please find the link : https://www.youtube.com/watch?v=cDYkmwMoCEA=1779s Regards Liang

Re: CI/CD and Carbondata build

2022-12-03 Thread Liang Chen
Dear JB Great!Thanks for your contribution. Regards Liang Jean-Baptiste Onofré 于2022年12月3日周六 07:59写道: > Thanks guys. > > I will resume my work on this. > > I will keep you posted asap. > > Regards > JB > > On Fri, Dec 2, 2022 at 7:11 AM Akash r wrote: > > > > +1 > > > > Regards, > > Akash R

Re: CI/CD and Carbondata build

2022-12-01 Thread Liang Chen
+1 Thanks for JB. Regards Liang Jean-Baptiste Onofré 于2022年11月25日周五 05:50写道: > Hi guys > > No objections ? > > I will then move forward with proposed plan. > > Regards > JB > > Le ven. 18 nov. 2022 à 07:46, Jean-Baptiste Onofré a > écrit : > > > Hi guys > > I started to work on the build and

[ANNOUNCE] Brijoo as new PMC for Apache CarbonData

2022-09-24 Thread Liang Chen
Hi We are pleased to announce that Brijoo as new PMC for Apache CarbonData. Congrats to Brijool! Apache CarbonData PMC

Re: Correct way to ramp up on Carbondata

2022-05-12 Thread Liang Chen
Hi First, i suggest that you can install one IntelliJ IDEA to run these examples : https://github.com/apache/carbondata/tree/master/examples/spark/src/main/scala/org/apache/carbondata/benchmark Second : the below is my test script , please take it as reference: carbon_jar=./carbonlib/$(ls -1

Re: Performance Engineering Track CFP for ApacheCon NA New Orleans

2022-04-10 Thread Liang Chen
Hi sharan Thanks for kindly sharing this information, we will check it. Regards Liang sharanf 于2022年4月7日周四 18:00写道: > Hi All > > I hope that you have already heard that ApacheCon NA is back as a live > event in New Orleans later this year. You can find out more details > here:

[ANNOUNCE] Indhumathi M as new PMC for Apache CarbonData

2022-02-15 Thread Liang Chen
Hi We are pleased to announce that Indhumathi M as new PMC for Apache CarbonData. Congrats to Indhumathi M! Apache CarbonData PMC

[ANNOUNCE] Vikram Ahuja as new Apache CarbonData committer

2022-02-11 Thread Liang Chen
We are pleased to announce that the PMC has invited Vikram Ahuja as new Apache CarbonData committer, and the invite has been accepted! Congrats to Vikram Ahuja and welcome aboard. Regards Apache CarbonData PMC

Re: [DISCUSSION] Log4j2 Vulnerability (CVE-2021-44228, CVE-2021-45046,CVE-2021-45105) Analysis

2022-01-09 Thread Liang Chen
Thanks, Indhumathi. These analysis info would be very helpful for us. Regards Liang On 2021/12/30 12:31:12 Indhumathi M wrote: > Hello all, this discussion is related to a Log4j2 vulnerability. > > As you may be aware, there has been a critical vulnerability in Log4j2, the > Java Logging

Re: [VOTE] Apache CarbonData 2.3.0(RC1) release

2021-12-20 Thread Liang Chen
-1 from my side. We need to consider these PR : 4240,4241,4242,4243 Regards Liang Kunal Kapoor 于2021年12月20日周一 下午9:39写道: > Hi All, > > I submit the Apache CarbonData 2.3.0(RC1) for your vote. > > > *1.Release Notes:* > >

Apache carbondata topics at APACHECON ASIA 2021

2021-08-26 Thread Liang Chen
1. How a DBS Data Platform Drives Real-time Insights & Analytics using Apache CarbonData: https://www.youtube.com/watch?v=cDYkmwMoCEA 2.Faster Bigdata Analytics By Maneuvering Apache Carbondata’S Indexes: https://www.youtube.com/watch?v=aXSsN1eITs0

Re: [VOTE] Apache CarbonData 2.2.0(RC2) release

2021-08-04 Thread Liang Chen
+1 Regards Liang Ajantha Bhat 于2021年8月3日周二 下午1:07写道: > +1 > > Regards, > Ajantha > > On Mon, Aug 2, 2021 at 9:03 PM Venkata Gollamudi > wrote: > > > +1 > > > > Regards, > > Venkata Ramana > > > > On Mon, 2 Aug, 2021, 20:18 Kunal Kapoor, > wrote: > > > > > +1 > > > > > > Regards > > > Kunal

Re: [VOTE] Apache CarbonData 2.2.0(RC1) release

2021-07-07 Thread Liang Chen
-1, there are some open issues need be considered. Regards Liang Kumar Vishal 于2021年7月6日周二 下午6:14写道: > -1 > Pls consider pr 4148 > Regards > Kumar Vishal > > On Tue, 6 Jul 2021 at 12:45 PM, Akash Nilugal > wrote: > > > Hi All, > > > > I submit the *Apache CarbonData 2.2.0(RC1) *for your vote.

[ANNOUNCE] Akash R Nilugal as new PMC for Apache CarbonData

2021-04-11 Thread Liang Chen
Hi We are pleased to announce that Akash R Nilugal as new PMC for Apache CarbonData. Congrats to Akash R Nilugal! Apache CarbonData PMC

Re: Looking to contribute to carbondata

2021-04-05 Thread Liang Chen
Hi Pratyaksh Welcome to Apache CarbonData community, we will discuss with you and help you quickly to be familiar with CarbonData. one suggestion : please first join in dev mailing list and check the quick start document. Regards Liang Pratyaksh Sharma wrote > Hi everyone, > > I am looking to

Re: [VOTE] Apache CarbonData 2.1.1(RC2) release

2021-03-29 Thread Liang Chen
+1(binding) Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: Apply to open 'Issues' tab in Apache CarbonData github

2021-03-28 Thread Liang Chen
Hi All The issues of github table has been enabled. Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: Apply to open 'Issues' tab in Apache CarbonData github

2021-03-18 Thread Liang Chen
I will apply Issues table via INFRA Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: DISCUSSION: propose to activate "Issues" of https://github.com/apache/carbondata

2021-03-18 Thread Liang Chen
ce issues then can directly > discuss in slack for quick support. > > Thanks, > Ajantha > > On Thu, 18 Mar, 2021, 5:29 pm Liang Chen, > chenliang613@ > wrote: > >> Hi >> >> As you know, for better managing community, i propose to put "Issues, >

DISCUSSION: propose to activate "Issues" of https://github.com/apache/carbondata

2021-03-18 Thread Liang Chen
Hi As you know, for better managing community, i propose to put "Issues, Pull Request, Code" together and request Apache INFRA to activate "Issues" of github. Open discussion, please input your comments. Regards Liang

Re: [VOTE] Apache CarbonData 2.1.1(RC1) release

2021-03-18 Thread Liang Chen
-1, need to fix some major defects Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[ANNOUNCE] Ajantha as new PMC for Apache CarbonData

2020-11-19 Thread Liang Chen
Hi We are pleased to announce that Ajantha as new PMC for Apache CarbonData. Congrats to Ajantha! The Apache CarbonData PMC

Re: [VOTE] Apache CarbonData 2.1.0(RC2) release

2020-11-05 Thread Liang Chen
+1(binding) Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[ANN] Indhumathi as new Apache CarbonData committer

2020-10-06 Thread Liang Chen
Hi We are pleased to announce that the PMC has invited Indhumathi as new Apache CarbonData committer, and the invite has been accepted! Congrats to Indhumathi and welcome aboard. Regards The Apache CarbonData PMC

Re: [VOTE] Apache CarbonData 2.1.0(RC1) release

2020-10-06 Thread Liang Chen
Hi -1 from my side, there are some open PRs need to be considered. Regards Liang kunalkapoor wrote > Hi All, > > I submit the Apache CarbonData 2.1.0(RC1) for your vote. > > > *1.Release Notes:* >

Re: Regarding Carbondata Benchmarking & Feature presentation

2020-09-22 Thread Liang Chen
Hi Great. Happy to see more and more companies use Apache CarbonData. Regards Liang Vimal Das Kammath wrote > Hi Carbondata Team, > > I am working on proposing Carbondata to the Data Analytics team in Uber. > It > will be great if any of you can share the latest benchmarking and >

Re: [discuss]CarbonData update operation enhance

2020-09-22 Thread Liang Chen
Hi Thank you started this discussion. This proposal is for improving data updation performance, right ? Regards Liang Linwood wrote > *[Background]* > Update operation will clean up delta files before update( see > cleanUpDeltaFiles(carbonTable, false)), It's loop traversal metadata path > and

Re: Apache CarbonData 2.0 release webinar(3rd June, 19:30-21:00 China time)

2020-06-03 Thread Liang Chen
-- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [VOTE] Apache CarbonData 2.0.1(RC1) release

2020-06-01 Thread Liang Chen
+1(binding) Regards Liang kunalkapoor wrote > Hi All, > > I submit the Apache CarbonData 2.0.1(RC1) for your vote. > > > *1.Release Notes:* > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12347870 > > *2. The tag to be voted upon* : > apache-carbondata-2.0.1-rc1

Apache CarbonData 2.0 release webinar(3rd June, 19:30-21:00 China time)

2020-05-29 Thread Liang Chen
Hi All Apache CarbonData 2.0 release webinar(3rd June, 19:30-21:00 China time) at : https://www.slidestalk.com/m/191 2.0 Release notes : https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+CarbonData+2.0.0+Release Please sign up and join us for discussion. Regards Liang

Re: [VOTE] Apache CarbonData 2.0.0(RC3) release

2020-05-18 Thread Liang Chen
+1(binding) from myside. Regards Liang kunalkapoor wrote > Hi All, > > I submit the Apache CarbonData 2.0.0(RC3) for your vote. > > > *1.Release Notes:* > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12346046=Html=12320220 > > *Some key features and improvements in this

Re: Carbon over-use cluster resources

2020-04-14 Thread Liang Chen
OK, thank you feedbacked this issue, let us look into it. Regards Liang Manhua Jiang wrote > Hi All, > Recently, I found carbon over-use cluster resources. Generally the design > of carbon work flow does not act as common spark task which only do one > small work in one thread, but the task has

Re: [VOTE] Apache CarbonData 2.0.0(RC1) release

2020-04-02 Thread Liang Chen
Hi Thanks for preparing 2.0.0. For rc1, my comment is : -1 (binding) The following of open issues should be considerred in 2.0.0: https://github.com/apache/carbondata/pull/3675 https://github.com/apache/carbondata/pull/3687 https://github.com/apache/carbondata/pull/3682

[ANNOUNCE] Kunal Kapoor as new PMC for Apache CarbonData

2020-03-29 Thread Liang Chen
Hi We are pleased to announce that Kunal Kapoor as new PMC for Apache CarbonData. Congrats to Kunal Kapoor! Apache CarbonData PMC

[ANNOUNCE] Tao Li as new Apache CarbonData committer

2020-03-06 Thread Liang Chen
Hi We are pleased to announce that the PMC has invited Tao Li as new Apache CarbonData committer and the invite has been accepted! Congrats to Tao Li and welcome aboard. Regards On behalf of Apache CarbonData PMC

[ANNOUNCE] Zhi Liu as new Apache CarbonData committer

2020-03-06 Thread Liang Chen
Hi We are pleased to announce that the PMC has invited Zhi Liu as new Apache CarbonData committer and the invite has been accepted! Congrats to Zhi Liu and welcome aboard. Regards On behalf of Apache CarbonData PMC

Re: Apply to open 'Issues' tab in Apache CarbonData github

2019-12-22 Thread Liang Chen
Hi +1 from my side. One question : what issues should be raised to Apache JIRA? what issues will be raised to github's issue ? It is better to give the clear definition. Regards Liang xm_zzc wrote > Hi community: > I suggest community to open 'Issues' tab in carbondata github page, we > can

Re: DISCUSSION: removing support for Spark 2.1 and 2.2 in CarbonData 2.0

2019-12-22 Thread Liang Chen
OK from my side, +1 Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [VOTE] Apache CarbonData 1.6.1(RC1) release

2019-10-14 Thread Liang Chen
+1 Please update the release notes accordingly. Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[ANNOUNCE] Ajantha as new Apache CarbonData committer

2019-10-03 Thread Liang Chen
Hi We are pleased to announce that the PMC has invited Ajantha as new Apache CarbonData committer and the invite has been accepted! Congrats to Ajantha and welcome aboard. Regards Apache CarbonData PMC

[ANNOUNCE] Zhichao Zhang as new PMC for Apache CarbonData

2019-08-28 Thread Liang Chen
Hi We are pleased to announce that Zhichao Zhang as new PMC for Apache CarbonData. Congrats to Zhichao Zhang. Regards Apache CarbonData PMC

[ANNOUNCE] Manhua Jiang as new Apache CarbonData committer

2019-08-28 Thread Liang Chen
Hi We are pleased to announce that the PMC has invited Manhua Jiang as new Apache CarbonData committer and the invite has been accepted! Congrats to Manhua Jiang and welcome aboard. Regards Apache CarbonData PMC

Re: [VOTE] Apache CarbonData 1.6.0(RC3) release

2019-08-18 Thread Liang Chen
+1 from my side regards Liang 在 2019年8月13日星期二,Raghunandan S 写道: > Hi > > > I submit the Apache CarbonData 1.6.0 (RC3) for your vote. > > > 1.Release Notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12320220=12344965 > > > Some key features and improvements in

test , check if the mailing is working ?

2019-07-16 Thread Liang Chen

Re: there are plans to support the spark 2.4?

2019-07-08 Thread Liang Chen
Yes, the carbondata community will consider all stable spark versions for ecosystem integration. Regards Liang 李斌松 于2019年7月8日周一 下午2:43写道: > there are plans to support the spark 2.4? >

Re: [VOTE] Apache CarbonData 1.5.4(RC1) release

2019-05-29 Thread Liang Chen
+1 Regards Liang manishgupta88 wrote > +1 > > Regards > Manish Gupta > > On Mon, May 27, 2019 at 11:34 AM kanaka > kanakakumaravvaru@ > wrote: > >> +1 >> >> >> >> -- >> Sent from: >> http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ >> -- Sent from:

[ANNOUNCE] Akash as new Apache CarbonData committer

2019-04-25 Thread Liang Chen
Hi all We are pleased to announce that the PMC has invited Akash as new Apache CarbonData committer, and the invite has been accepted! Congrats to Akash and welcome aboard. Regards Apache CarbonData PMC -- Regards Liang

Re: [VOTE] Apache CarbonData 1.5.3(RC1) release

2019-04-08 Thread Liang Chen
+1 Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: Support for spark 2.1.1 (HDP spark versions)

2019-02-28 Thread Liang Chen
Hi Did you successfully compile with "mvn -DskipTests -Pspark-2.1 -Dspark.version=2.1.1 clean package" ? I used the community spark 2.1.1, it is working fine. Regards Liang satish.sidnakoppa wrote > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/file/t389/versions.png;

Re: [Discussion]read latest schema in case of external table and file format

2019-02-04 Thread Liang Chen
Hi Can you explain which scenario will generate two carbondata files with different schema? Regards Liang akashrn5 wrote > Hi dev, > > Currently we have a validation that if there are two carbondata files in a > location with different schema, then we fail the query. I think there is > no >

Re: [VOTE] Apache CarbonData 1.5.2(RC2) release

2019-02-04 Thread Liang Chen
Hi +1 Regards Liang sraghunandan wrote > Hi > > > I submit the Apache CarbonData 1.5.2 (RC2) for your vote. > > > 1.Release Notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12344321 > > > Some key features and improvements in this release: > > >

Re: New git: https://gitbox.apache.org/repos/asf?p=carbondata.git

2019-01-12 Thread Liang Chen
Hi Please use the below script : git remote set-url apache https://gitbox.apache.org/repos/asf/carbondata Regards Liang Liang Chen wrote > Hi > > The below is my steps, please take it as reference : > > ChenLiangs-MAC:mergepr apple$ git remote -v > apache

Re: New git: https://gitbox.apache.org/repos/asf?p=carbondata.git

2019-01-12 Thread Liang Chen
://gitbox.apache.org/repos/asf?p=carbondata.git (push) github https://github.com/apache/carbondata (fetch) github https://github.com/apache/carbondata (push) Liang Chen-2 wrote > Hi all > > Please update your local git with the new address( > https://gitbox.apache.org/repos/asf?p=carbondata.git), ot

New git: https://gitbox.apache.org/repos/asf?p=carbondata.git

2019-01-12 Thread Liang Chen
Hi all Please update your local git with the new address( https://gitbox.apache.org/repos/asf?p=carbondata.git), otherwise, you can't push new PR. Regards Liang

Re: [DISCUSS] Move to gitbox as per ASF infra team mail

2019-01-11 Thread Liang Chen
Hi all Thank all of your votes. @JB, thanks for your kind help, I will create one INFRA ticket, and request the migration time this weekend Regards Liang Liang Chen wrote > Hi all, > > Background : > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/NOTI

[DISCUSS] Move to gitbox as per ASF infra team mail

2019-01-04 Thread Liang Chen
Hi all, Background : http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/NOTICE-Mandatory-migration-of-git-repositories-to-gitbox-apache-org-td72614.html Apache Hadoop git repository is in git-wip-us server and it will be decommissioned, ASF infra is proposing to move to

[ANNOUNCE] Chuanyin Xu as new PMC for Apache CarbonData

2019-01-01 Thread Liang Chen
Hi We are pleased to announce that Chuanyin Xu as new PMC for Apache CarbonData . Congrats to Chuanyin Xu! Apache CarbonData PMC

Re: [DISCUSSION] Optimize the properties documentation or comments

2018-12-15 Thread Liang Chen
+1 Regards Liang xubo245 wrote > Optimize the properties documentation or comments: > Some properties have not documentation or comments, which will not easy to > understand for user. > We should add properties documentation or comments. > > Unify documentation: > Some properties have not

Re: [Discussion] Make 'no_sort' as default sort_scope and keep sort_columns as 'empty' by default

2018-12-15 Thread Liang Chen
Hi First, let me understand your propoal,you mean : 1, If user defines the "sort_columns=columns" : all behaviors are same as the current, no any change.(most of users will set this key option during create carbondata table) 2, If user doesn't define the "sort_columns" : current default

Re: [DISCUSS] Support transactional table in SDK

2018-12-07 Thread Liang Chen
Hi Good idea, thank you started this discussion. Agree with Ravi comments, we need to double-check some limitations after introducing the feature. Flink and Kafka integration can be discussed later. For using SDK to write new data to the existing carbondata table , some questions: 1.How to

[ANNOUNCE] Bo Xu as new Apache CarbonData committer

2018-12-07 Thread Liang Chen
Hi all We are pleased to announce that the PMC has invited Bo Xu as new Apache CarbonData committer, and the invite has been accepted! Congrats to Bo Xu and welcome aboard. Regards Apache CarbonData PMC

Re: [VOTE] Apache CarbonData 1.5.1(RC2) release

2018-12-03 Thread Liang Chen
Hi +1 Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: [Discuss] Removing search mode

2018-11-06 Thread Liang Chen
Hi +1, but one suggestion, in the future we can first try these alpha features in the separate branch . once it is confirmed, then merge into master. Regards Liang akashrn5 wrote > +1 > yes, after search mode implementation we didnt get much advantage as > expected and simply code will be

Re: [VOTE] Apache CarbonData 1.5.0(RC2) release

2018-10-10 Thread Liang Chen
+1 Regards Liang Ravindra Pesala 于2018年10月10日周三 上午3:15写道: > Hi > > I submit the Apache CarbonData 1.5.0 (RC2) for your vote. > > 1.Release Notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12341006 > > Some key features and improvements in this release: >

[ANNOUNCE] Raghunandan as new committer of Apache CarbonData

2018-09-26 Thread Liang Chen
Hi all We are pleased to announce that the PMC has invited Raghunandan as new committer of Apache CarbonData, and the invite has been accepted! Congrats to Raghunandan and welcome aboard. Regards Apache CarbonData PMC

Re: [VOTE] Apache CarbonData 1.5.0(RC1) release

2018-09-26 Thread Liang Chen
Hi I would like to see these PRs be merged(2761, 2759) . Regards Liang ravipesala wrote > Hi > > I submit the Apache CarbonData 1.5.0 (RC1) for your vote. > > 1.Release Notes: > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12341006 > > Some key features and

Re: CarbonData Performance Optimization

2018-09-24 Thread Liang Chen
Hi +1, great proposal, very expect to see your pull request. Regards Liang ravipesala wrote > Hi, > > In case of querying data using Spark or Presto, carbondata is not well > optimized for reading data and fill the vector. The major issues are as > follows. > 1. CarbonData has long method

Re: [DISCUSSION] Updates to CarbonData documentation and structure

2018-09-04 Thread Liang Chen
Hi Raghu +1, all these optimizations are very good. Regards Liang sraghunandan wrote > Dear All, > > I wanted to propose some updates and changes to our current > documentation,Please let me know your inputs and comments. > > > 1.Split Our carbondata command into DDL and DML > > 2.Add

Re: error occur when I load data to s3

2018-09-03 Thread Liang Chen
Hi kunal Can you list all S3 issues PR, we may need to give 1.4.2 patch release. Because aaron plan to use carbondata in production this month. To arron : First please you try master, see if can solve your problems. Regards Liang kunalkapoor wrote > Hi aaron, > Many issues like this have been

Re: [DISCUSSION] Implement file-level Min/Max index for streaming segment

2018-08-26 Thread Liang Chen
Hi +1 for this proposal. Regards Liang David CaiQiang wrote > Hi All, > Currently, the filter queries on the streaming table always scan all > streaming files, even though there are no data in streaming files that > meet > the filter conditions. > So I try to support file-level min/max

Re: [DISCUSSION] Support Standard Spark's FileFormat interface in Carbondata

2018-08-23 Thread Liang Chen
HI +1, agree to support standard spark file format interface in carbondata, it will be significantly helpful for broadening apache carbondata's ecosystem. Regards Liang ravipesala wrote > Hi, > > Current Carbondata has deep integration with Spark to provide > optimizations > in performance

Re: Change the 'comment' content for column when execute command 'desc formatted table_name'

2018-08-21 Thread Liang Chen
Hi 1. Agree with likun's comments(4 points) : 2. About 'select sql' for CTAS , you can leave it. we can consider it later. Regards Liang Jacky Li wrote > Hi ZZC, > > I have checked the doc in CARBONDATA-2595. I have following comments: > 1. In the Table Basic Information section, it is

Re: How to look up date segment details in carbon without partition.

2018-08-13 Thread Liang Chen
Hi In Carbondata system, the segment concept may be different with other system. One data load is one segment for carbondata. Actually, carbondata currently support partition with global sort also, you can use date as partition column to check data size for under each partition folder. Regards

Re: [VOTE] Apache CarbonData 1.4.1(RC2) release

2018-08-13 Thread Liang Chen
Hi +1. many good improvements and bug fixs. Regards Liang ravipesala wrote > Hi > > > I submit the Apache CarbonData 1.4.1 (RC2) for your vote. > > > 1.Release Notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12343148 > > Some key features and

Re: [Discussion] Propose to upgrade the version of integration/presto from 0.187 to 0.206

2018-08-13 Thread Liang Chen
now > using the dictionary_aggregation feature for optimization. The other bug > fixes are also important for carbondata integration. > However, they have changed the connector interface as well, so we might > need to change our interface accordingly. > > Thanks and regards > Bhavya > >

Re: [VOTE] Apache CarbonData 1.4.1(RC1) release

2018-07-31 Thread Liang Chen
Hi These PR, it is better to merge in 1.4.1 also https://github.com/apache/carbondata/pull/2588 https://github.com/apache/carbondata/pull/2565 Regards Liang ravipesala wrote > Hi > > > I submit the Apache CarbonData 1.4.1 (RC1) for your vote. > > > 1.Release Notes: > >

Re: [VOTE] Apache CarbonData 1.4.1(RC1) release

2018-07-31 Thread Liang Chen
ravipesala wrote > Hi > > > I submit the Apache CarbonData 1.4.1 (RC1) for your vote. > > > 1.Release Notes: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320220=12343148 > > Some key features and improvements in this release: > >1. Supported Local

Re: New-bie JIRAs for new contributors

2018-07-31 Thread Liang Chen
vikashtalanki wrote > Hi Vikash > > Welcome to Apache CarbonData community. > 1. Firstly, please let me know your apache jira account(email id), i will > add you as contributor. > 2. Secondly,You can run the simple example as per : >

[Discussion] Propose to upgrade the version of integration/presto from 0.187 to 0.206

2018-07-24 Thread Liang Chen
Hi Dev The presto community already released 0.206 last week (refer the detail at https://prestodb.io/docs/current/release/release-0.206.html), this release fixed many issues, so propose Apache CarbonData community to upgrade to the latest presto version for carbondata integration. please

Re: Index file cache will not work when the table has invalid segment.

2018-07-12 Thread Liang Chen
Hi Currently, CarbonData doesn't support map data type Regards Liang carbondata-newuser wrote > Carbon version is 1.4 rc2. > create table( > col1 string, > col2 int, > col2 string, > date string > ) > > *First step:* > insert into table carbonTest select col1,col2,col3,"20180707" from >

Re: Carbondata集成Presto的问题请教

2018-06-14 Thread Liang Chen
Hi Please send your questions to mailing list.(cc to mailing list) Currently, "presto read streaming carbondata table" is not supporting. Can you share with the community , why need to support this feature, what are your exact requirements? Regards Liang kevintop 于2018年6月13日周三 上午9:48写道: > 陈总

Updated release notes . Re: [ANNOUNCE] Apache CarbonData 1.4.0 release

2018-06-05 Thread Liang Chen
Hi Please find the updated 1.4.0 release notes: https://cwiki.apache.org/confluence/display/CARBONDATA/Apache+CarbonData+1.4.0+Release Regards Liang -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

Re: Support updating/deleting data for stream table

2018-06-03 Thread Liang Chen
data for one year, > he > need to delete one year ago of data everyday. On the other hand, solution > 2 > is more complicated than solution 1, we need to consider the implement of > solution 2 in depth. > Based on the above reasons, Liang Chen, Jacky, David and I prefered to >

  1   2   >