Re: [ANNOUNCE] Kunal Kapoor as new PMC for Apache CarbonData

2020-03-29 Thread Bhavya Aggarwal
pleased to announce that Kunal Kapoor as new PMC for Apache > > CarbonData. > > > > > > Congrats to Kunal Kapoor! > > > > > > Apache CarbonData PMC > > > -- *Bhavya Aggarwal* CTO & Partner Knoldus Inc. <http://www.knoldus.com/> +91-9910483

Re: [DISCUSS] Move to gitbox as per ASF infra team mail

2019-01-06 Thread Bhavya Aggarwal
+1 On Mon, Jan 7, 2019 at 8:08 AM David CaiQiang wrote: > +1 > > > > - > Best Regards > David Cai > -- > Sent from: > http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/ > -- *Bhavya Aggarwal* CTO & Partner Knoldus Inc. <http:/

Re: [Discussion] Propose to upgrade the version of integration/presto from 0.187 to 0.206

2018-07-24 Thread Bhavya Aggarwal
ed many issues, so propose Apache CarbonData community to upgrade to the > latest presto version for carbondata integration. > > please provide your opinion. > > Regards > Liang > -- *Bhavya Aggarwal* CTO & Partner Knoldus Inc. <http://www.knoldus.com/> +91-9

Re: query carbondata by presto got error : tableCacheModel.carbonTable should not be null

2018-06-22 Thread Bhavya Aggarwal
gt; any idea for this issue? > > > chenxingyu -- *Bhavya Aggarwal* Sr. Director Knoldus Inc. <http://www.knoldus.com/> +91-9910483067 Canada - USA - India - Singapore <https://in.linkedin.com/company/knoldus> <https://twitter.com/Knolspeak> <https:/

Re: [Discussion] Carbon Local Dictionary Support

2018-06-07 Thread Bhavya Aggarwal
che-carbondata-dev-mailing-list-archive.1130556. > n5.nabble.com/ > -- *Bhavya Aggarwal* Sr. Director Knoldus Inc. <http://www.knoldus.com/> +91-9910483067 Canada - USA - India - Singapore <https://in.linkedin.com/company/knoldus> <https://twitter.com/Knolspeak> <https://www.facebook.com/KnoldusSoftware/> <https://blog.knoldus.com/>

Re: [ANNOUNCE] Zhichao Zhang as new Apache CarbonData committer

2018-05-02 Thread Bhavya Aggarwal
Congrats Zhichao! Regards Bhavya On Wed, May 2, 2018 at 8:37 AM, Lionel CL wrote: > Congrats Zhichao! > > Best Regards, > CaoLu > > 发件人: Liang Chen > > 答复:

Re: [ANNOUNCE] Kumar Vishal as new PMC for Apache CarbonData

2018-01-10 Thread Bhavya Aggarwal
Congratulations Vishal.. Regards Bhavya On 10-Jan-2018 2:47 PM, "xm_zzc" <441586...@qq.com> wrote: > Congratulations Vishal ! > > > > -- > Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556. > n5.nabble.com/ >

Re: [ANNOUNCE] Kunal Kapoor as new Apache CarbonData committer

2018-01-08 Thread Bhavya Aggarwal
Congrats Kunal !! Thanks Bhavya On Tue, Jan 9, 2018 at 12:49 PM, Simarpreet Kaur Monga < simarpr...@knoldus.in> wrote: > Congratulations Kunal !! > > On Tue, Jan 9, 2018 at 10:45 AM, Shivangi Gupta > > wrote: > > > Congratulations Kunal  > > > > On Mon, Jan 8, 2018

Re: carbondata with presto unsupported Complex Types

2017-12-11 Thread Bhavya Aggarwal
Hi Dylan, Yes we have plans to support the complex type in Presto Integration in near future, will update you once it is done. Regards Bhavya On Mon, Dec 11, 2017 at 1:36 PM, dylan wrote: > hi anubhavtarar: > thanks for you reply > Do you have plans to support

Re: sparksql query result is not same as persto on same sql

2017-12-01 Thread Bhavya Aggarwal
Thanks Dylan, We are looking into the problem. Regards Bhavya On Fri, Dec 1, 2017 at 2:25 PM, dylan wrote: > hello all: > i am use carbondata version is 1.2.0 and spark version is 1.6.0. > in my test case >1.Creating a Table > cc.sql("create table IF NOT

Blog on how to use Carbondata with Presto

2017-11-22 Thread Bhavya Aggarwal
Hi All, Please look at the blog to see how we can use CarbonData with Presto. https://blog.knoldus.com/2017/11/20/integrating-presto-with-carbondata/ Thanks and regards Bhavya

Re: Error while creating table in carbondata

2017-11-06 Thread Bhavya Aggarwal
kage > The pom file was changed as which provided in former email. > > > > 在 2017/11/6 下午7:47,“Bhavya Aggarwal”<bha...@knoldus.com> 写入: > > >Hi, > > > >Can you please let me know how are you building the Carbondata assembly > >jar, or which command you are

Re: Error while creating table in carbondata

2017-11-06 Thread Bhavya Aggarwal
a/parcels/SPARK2/ > lib/spark2/jars/ > > spark-catalyst_2.11-2.1.0.cloudera1.jar > > > > > > > > 在 2017/11/6 下午4:12,“Bhavya Aggarwal”<bha...@knoldus.com> 写入: > > >Hi, > > > >Can you please check if you have spark-catalyst jar in $SPARK_HOME/j

Version upgrade for Presto Integration to 0.186

2017-11-02 Thread Bhavya Aggarwal
Hi All, Presto 0.186 version has as lot of improvements that will increase the performance and improve the reliability. Some of the major issues and improvements are listed below. - Fix excessive GC overhead caused by map to map cast. - Fix issue that may cause queries containing

Re: [Discussion] Support pre-aggregate table to improve OLAP performance

2017-10-17 Thread Bhavya Aggarwal
Hi Dev, For the Pre Aggregate tables how will we handle subsequent loads, will we be running the query on the whole table and calculating the aggregations again and then deleting the existing segment and creating the new segments for whole data. With the above approach as the data increases in

Re: [DISCUSSION] Support only spark 2 in carbon 1.3.0

2017-10-10 Thread Bhavya Aggarwal
+1 Regards Bhavya On Tue, Oct 10, 2017 at 7:15 PM, jarray wrote: > +1 > > > > > > > On 10/10/2017 14:13, gururajshetty wrote: > + 1 > > Regards, > Gururaj > > > > > -- > Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556. > n5.nabble.com/ >

Re: [VOTE] Apache CarbonData 1.2.0(RC3) release

2017-09-22 Thread Bhavya Aggarwal
+1 Thanks and regards Bhavya On Fri, Sep 22, 2017 at 5:51 PM, Ravindra Pesala wrote: > Hi > > I submit the Apache CarbonData 1.2.0 (RC3) to your vote. > > 1.Release Notes: > *https://issues.apache.org/jira/secure/ReleaseNote.jspa? > projectId=12320220=12340260 >

Re: [ANNOUNCE] Lu Cao as new Apache CarbonData committer

2017-09-13 Thread Bhavya Aggarwal
Congrats Lu Cao .. Thanks and regards Bhavya On Wed, Sep 13, 2017 at 7:30 PM, Raghunandan S < carbondatacontributi...@gmail.com> wrote: > Congrats lu cao. > On Wed, 13 Sep 2017 at 7:18 PM, Liang Chen > wrote: > > > Hi all > > > > We are pleased to announce that the

Re: [ANNOUNCE] Manish Gupta as new Apache CarbonData

2017-08-27 Thread Bhavya Aggarwal
Congrats Manish. Regards Bhavya On 28-Aug-2017 8:31 am, "xm_zzc" <441586...@qq.com> wrote: > Congratulations Manish!!! > > > > -- > View this message in context: http://apache-carbondata-dev- > mailing-list-archive.1130556.n5.nabble.com/ANNOUNCE-Manish- >

Re: Presto+CarbonData optimization work discussion

2017-07-25 Thread Bhavya Aggarwal
I have created a pull request 1190 for Presto Optimization where we have done following changes to improve the performance 1. Removed unnecessary loops from the integration code to make it more efficient. 2. Implemented Lazy Blocks as is being used in case of ORC. 3. Improved dictionary decoding

[Discussion] Using Lazy Dictionary Decode for Presto Integration

2017-07-18 Thread Bhavya Aggarwal
We were trying the Presto with carbon data and in the code currently Carbondata is decoding the dictionary values into actual values as soon as the data is read from Carbondata. I think if we do a lazy decode of dictionary values after aggregation it will make the queries faster. Please let me

Re: [DISCUSSION] CarbonData Integration with Presto

2017-07-10 Thread Bhavya Aggarwal
nt -XX:+HeapDumpOnOutOfMemoryError -XX:OnOutOfMemoryError=kill -9 %p -XX:ReservedCodeCacheSize=1G Regards Bhavya On Mon, Jul 3, 2017 at 11:45 AM, Bhavya Aggarwal <bha...@knoldus.com> wrote: > Thanks Linquer, > > I will try with the above option and we tried it with ORC as well , here > ar

Re: Fwd: [DISCUSSION] CarbonData Integration with Presto

2017-07-05 Thread Bhavya Aggarwal
I am currently loading 500 GB data once that is completed will try with your settings today itself. Regards Bhavya On 06-Jul-2017 8:39 am, "linqer" <26304...@qq.com> wrote: > hi, did you test orc vs carbondata with configuration as I suggested? > > > > -- > View this message in context:

Re: [DISCUSSION] Propose to move notification of "jira Created" to issues@mailing list from dev

2017-07-04 Thread Bhavya Aggarwal
+1 Agreed these should be two seperate mailing lists. Thanks and Regards Bhavya On Tue, Jul 4, 2017 at 5:20 PM, Venkata Gollamudi wrote: > +1 > It is better to be moved > > Regards, > Venkata Ramana G > > On Tue, Jul 4, 2017 at 4:40 PM, Kumar Vishal

Re: [DISCUSSION] CarbonData Integration with Presto

2017-07-03 Thread Bhavya Aggarwal
Thanks Linquer, I will try with the above option and we tried it with ORC as well , here are the comparison results for same query with 50 GB of data and same configuration that I mentioned earlier. [image: Inline image 1] Thanks and regards Bhavya On Mon, Jul 3, 2017 at 9:39 AM, linqer

Re: [DISCUSSION] CarbonData Integration with Presto

2017-07-03 Thread Bhavya Aggarwal
pose to support presto version with 0.166. > Is there any performance difference between 0.179 and 0.166? > > Regards > Liang > > > 2017-07-01 13:12 GMT+08:00 Bhavya Aggarwal <bha...@knoldus.com>: > > > Hi, > > > > Please find the configuration set

[DISCUSSION] Whether Carbondata should work with Presto in the next release version(1.2.0)

2017-06-11 Thread Bhavya Aggarwal
Hi All, We can add the Presto integration as one of the items for 1.2.0 release, we can add support for Presto to read from Carbondata as Presto is used by many people for query execution. Please vot and discuss on Presto integration in this mail thread. Thanks and regards Bhavya

[DISCUSSION] Whether Carbondata should support Hive in the next release version(1.2.0)

2017-06-11 Thread Bhavya Aggarwal
Hi Guys, Should we add Hive Integration with CarbonData in release 1.2.0, it will be good if we can come up with features that needs to be supported in the Hive Integration. Please vote and give your comments for the same in this discussion. Thanks and regards Bhavya

Re: [ANNOUNCE] Ravindra as new Apache CarbonData PMC

2017-05-19 Thread Bhavya Aggarwal
Congrats Ravindra, Regards Bhavya On Fri, May 19, 2017 at 4:56 PM, Liang Chen wrote: > Hi all > > We are pleased to announce that the PMC has invited Ravindra as new Apache > CarbonData PMC member, and the invite has been accepted ! > > Congrats to Ravindra and welcome

Re: [ANNOUNCE] Cai Qiang as new Apache CarbonData committer

2017-05-17 Thread Bhavya Aggarwal
Congrats David... Regards Bhavya On Wed, May 17, 2017 at 9:50 PM, Naresh P R wrote: > Congrats David !!! > > Regards, > Naresh P R > > On May 17, 2017 7:05 PM, "Liang Chen" wrote: > > Hi all > > We are pleased to announce that the PMC

Re: [VOTE] Apache CarbonData 1.1.0 (RC3) release

2017-05-12 Thread Bhavya Aggarwal
+1 On Sat, May 13, 2017 at 12:23 AM, Jihong Ma wrote: > +1 > > Jihong > > -Original Message- > From: Liang Chen [mailto:chenliang6...@gmail.com] > Sent: Friday, May 12, 2017 12:20 AM > To: dev@carbondata.apache.org > Subject: Re: [VOTE] Apache CarbonData 1.1.0

Re: Use dev@carbondata.apache.org to test new mailing list without incubator

2017-05-03 Thread Bhavya Aggarwal
ACK Regards Bhavya On Wed, May 3, 2017 at 12:31 PM, Pallavi Singh wrote: > ACK > > 2017-05-02 11:20 GMT+05:30 Mohammad Shahid Khan < > mohdshahidkhan1...@gmail.com>: > > > ACK > > > > On Wed, Apr 26, 2017 at 11:47 PM, Vimal Das Kammath < > >