subscribe to mailer list

2016-07-14 Thread manish gupta

Re: Error while loading - Table is locked for updation. Please try after some time ( Spark 1.6.2 )

2017-02-06 Thread manish gupta
some invalid path for carbon.properties and ensure none of the properties is getting printed while creating CarbonContext. 2. If the 1st point does not work out then set the below property in carbon.properties file and try loading the data. carbon.lock.type=HDFSLOCK Regards Manish Gupta

Re: Error while loading - Table is locked for updation. Please try after some time ( Spark 1.6.2 )

2017-02-06 Thread manish gupta
printed in the thrift server logs. Also please provide the complete logs for failure. Regards Manish Gupta On Mon, Feb 6, 2017 at 2:18 PM, Sanoj M George <sanoj.geo...@gmail.com> wrote: > Not yet resolved, still getting same error. > > On Mon, Feb 6, 2017 at 12:41 P

Re: Exception throws when I load data using carbondata-1.0.0

2017-02-14 Thread manish gupta
org.apache.carbondata.spark.rdd.CarbonBlockDistinctValuesCombineRDD is present or not. If you are using only the assembly jar then decompile and check in assembly jar. Regards Manish Gupta On Tue, Feb 14, 2017 at 11:19 AM, Xiaoqiao He <xq.he2...@gmail.com> wrote: > hi, dev, > > The latest release version apache-carbondata-1.0.0-incubating-rc

Re: Failed to APPEND_FILE, hadoop.hdfs.protocol.AlreadyBeingCreatedException

2017-01-19 Thread manish gupta
-append-file-occur-alreadybeingcreatedexception Regards Manish Gupta On Fri, Jan 20, 2017 at 8:10 AM, ffpeng90 <ffp900...@126.com> wrote: > I have met the same problem. > I load data for three times and this exception always throws at the third > time. > I use the branch-1.

Re: Re: Failed to APPEND_FILE, hadoop.hdfs.protocol.AlreadyBeingCreatedException

2017-01-20 Thread manish gupta
Can you try compiling with hadoop-2.7.2 version and use it and let us know if the issue still persists. "mvn package -DskipTests -Pspark-1.5.2 -Phadoop-2.7.2 -DskipTests" Regards Manish Gupta On Fri, Jan 20, 2017 at 1:30 PM, 彭 <ffp900...@126.com> wrote: > I build the jar wi

Re: [DISCUSS] Graduation to a TLP (Top Level Project)

2017-03-01 Thread manish gupta
+1 Thanks JB. Regards Manish Gupta On Wed, Mar 1, 2017 at 9:20 PM, QiangCai <qiang...@qq.com> wrote: > +1 > > Great, Thanks JB. > > > > -- > View this message in context: http://apache-carbondata- > mailing-list-archive.1130556.n5.nabble.com/DISCUSS- > G

Re: [Feature ]Design Document for Update/Delete support in CarbonData

2016-11-23 Thread manish gupta
Manish Gupta On Wed, Nov 23, 2016 at 10:47 AM, Vimal Das Kammath < vimaldas.kamm...@gmail.com> wrote: > Hi Aniket, > > The design looks sound and the documentation is great. > I have few suggestions. > > 1) Measure update vs dimension update : In case of dimension update.

Re: CarbonData propose major version number increment for next version (to 1.0.0)

2016-11-24 Thread manish gupta
+1 Regards Manish Gupta On Thu, Nov 24, 2016 at 7:30 PM, Kumar Vishal <kumarvishal1...@gmail.com> wrote: > +1 > > -Regards > Kumar Vishal > > On Thu, Nov 24, 2016 at 2:41 PM, Raghunandan S < > carbondatacontributi...@gmail.com> wrote: > > > +1 >

Re: Int accepting range of BigInt

2016-11-04 Thread manish gupta
Hi Pallavi, This is a bug in the system. We store Int as bigInt but value beyond the integer range should not be allowed for storage in integer datatype column. >From my opinion you can raise a Jira issue for this. Regards Manish Gupta On Thu, Nov 3, 2016 at 11:06 PM, Kumar Vishal <kumarv

Re: B-Tree LRU cache (New Feature)

2016-12-04 Thread manish gupta
. In these cases we cannot ensure that invalid objects from cache are cleared from all the executors. Removal only from driver can be ensured. To handle these cases each executor should have a mechanism to decide for the invalid segments/block/dictionary cache. Regards Manish Gupta On Sun, Dec 4

[Discussion] Parsing values during data load should adopt a strict check or lenient check mechanism

2016-12-06 Thread manish gupta
should be the parsing behavior. Carbon should adopt a strict check mechanism or lenient check mechanism considering that the behavior should be same for both dimensions and measures as both are finally table columns. Regards Manish Gupta

Re: [Discussion] Parsing values during data load should adopt a strict check or lenient check mechanism

2016-12-18 Thread manish gupta
Hi All, As per suggestions I have raised a jira to track this issue. https://issues.apache.org/jira/browse/CARBONDATA-542 Regards Manish Gupta

Re: 回复: etl.DataLoadingException: The input file does not exist

2016-12-22 Thread manish gupta
d by QiangCai. *carbon.ddl.base.hdfs.url=hdfs://:* example *carbon.ddl.base.hdfs.url=hdfs://9.82.101.42:54310 <http://9.82.101.42:54310>* Regards Manish Gupta On Fri, Dec 23, 2016 at 10:09 AM, QiangCai <qiang...@qq.com> wrote: > Please find the following item in carbon.properties file, give a prop

Re: [DISCUSSION] Initiating Apache CarbonData-1.1.0 incubating Release

2017-03-27 Thread manish gupta
+1 Regards Manish Gupta On Mon, Mar 27, 2017 at 2:41 PM, Kumar Vishal <kumarvishal1...@gmail.com> wrote: > +1 > -Regards > Kumar Vishal > > On Mar 27, 2017 09:31, "xm_zzc" <441586...@qq.com> wrote: > > > Hi, Liang: > > Thanks for your reply.

Re: [New Feature] Alter table support in carbondata

2017-03-09 Thread manish gupta
Hi QiangCai, Syntax for change data type is kept similar to hive alter table change data type syntax. Please let me know your point of reference. I will look at it and modify if required. Regards Manish Gupta On Fri, Mar 10, 2017 at 7:26 AM, QiangCai <qiang...@qq.com> wrote: >

Re: [New Feature] Alter table support in carbondata

2017-03-09 Thread manish gupta
to support reordering of columns to change the MDKEY order. Regards Manish Gupta On Fri, Mar 10, 2017 at 5:20 AM, Liang Chen <chenliang6...@gmail.com> wrote: > Hi > > Thanks for you started this discussion for alter table feature. > > A couple of comments: > 1.For "change of

[New Feature] Alter table support in carbondata

2017-03-09 Thread manish gupta
system. Please refer the design document at below location and share your suggestions. https://drive.google.com/file/d/0B1DnrpMgGOu9dGxYMzVJUXEyZG8/view?usp=sharing Regards Manish Gupta

Re: [New Feature] Alter table support in carbondata

2017-03-13 Thread manish gupta
Ok. Regards Manish Gupta On Mon, Mar 13, 2017 at 3:51 PM, Venkata Gollamudi <g.ramana...@gmail.com> wrote: > Hi Manish, > > Thanks for working on this. Please raise Jira to track this. > > Regards, > Ramana > > On Fri, Mar 10, 2017 at 12:21 PM, Kumar Vishal <k

Re: column auto mapping when loading data from csv file

2017-03-12 Thread manish gupta
and we cannot be sure that this is exactly how user wanted to load the data. So from my opinion we should let user decide this behavior. Regards Manish Gupta On Mon, Mar 13, 2017 at 7:48 AM, Yinwei Li <251469...@qq.com> wrote: > Hi all, > > > when loading data from a csv file t

Re: Removing of kettle code from Carbondata

2017-03-12 Thread manish gupta
+1 Maintaining 2 flows is a cumbersome process. Better to remove. Regards Manish Gupta On Mon, Mar 13, 2017 at 9:42 AM, QiangCai <qiang...@qq.com> wrote: > +1 > > To avoid redundancy code, better to do it after testing the new flow > fully. > > Regards > David

Re: [New Feature] Alter table support in carbondata

2017-03-14 Thread manish gupta
Hi Guru, Yes you can raise a jira for document updation. Regards Manish Gupta On Tue, Mar 14, 2017 at 1:41 PM, Gururaj Shetty <sgururajshe...@gmail.com> wrote: > Hi Manish, > > We need to document in details the usage scenario and the sytax for the > same. We can als

[jira] [Created] (CARBONDATA-124) Exception thrown while executing drop table command in spark-sql cli

2016-07-28 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-124: --- Summary: Exception thrown while executing drop table command in spark-sql cli Key: CARBONDATA-124 URL: https://issues.apache.org/jira/browse/CARBONDATA-124

[jira] [Updated] (CARBONDATA-125) Remove usage of currentRestructureNumber from the code

2016-08-01 Thread Manish Gupta (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Gupta updated CARBONDATA-125: Issue Type: Improvement (was: Bug) > Remove usage of currentRestructureNumber f

[jira] [Created] (CARBONDATA-56) Exception thrown when aggregation on dimension which has decimal datatype

2016-07-14 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-56: -- Summary: Exception thrown when aggregation on dimension which has decimal datatype Key: CARBONDATA-56 URL: https://issues.apache.org/jira/browse/CARBONDATA-56

[jira] [Assigned] (CARBONDATA-56) Exception thrown when aggregation on dimension which has decimal datatype

2016-07-14 Thread Manish Gupta (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manish Gupta reassigned CARBONDATA-56: -- Assignee: Manish Gupta > Exception thrown when aggregation on dimension which

[jira] [Created] (CARBONDATA-80) Dictionary values should be equally distributed in buckets while loading in memory

2016-07-19 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-80: -- Summary: Dictionary values should be equally distributed in buckets while loading in memory Key: CARBONDATA-80 URL: https://issues.apache.org/jira/browse/CARBONDATA-80

[jira] [Created] (CARBONDATA-86) Value displayed as Null after increase in precision for decimal datatype after aggregation

2016-07-20 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-86: -- Summary: Value displayed as Null after increase in precision for decimal datatype after aggregation Key: CARBONDATA-86 URL: https://issues.apache.org/jira/browse/CARBONDATA

[jira] [Created] (CARBONDATA-65) Data load fails if there is space in the header names provided in FILEHEADER option in load command

2016-07-18 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-65: -- Summary: Data load fails if there is space in the header names provided in FILEHEADER option in load command Key: CARBONDATA-65 URL: https://issues.apache.org/jira/browse

[jira] [Created] (CARBONDATA-229) Array Index of bound exception thrown from dictionary look up while writing sort index file

2016-09-08 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-229: --- Summary: Array Index of bound exception thrown from dictionary look up while writing sort index file Key: CARBONDATA-229 URL: https://issues.apache.org/jira/browse

[jira] [Created] (CARBONDATA-194) ArrayIndexOfBoundException thrown when number of columns in row more than the max number of columns in univocity parser settings

2016-08-31 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-194: --- Summary: ArrayIndexOfBoundException thrown when number of columns in row more than the max number of columns in univocity parser settings Key: CARBONDATA-194 URL: https

[jira] [Created] (CARBONDATA-459) Block distribution is wrong in case of dynamic allocation=true

2016-11-28 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-459: --- Summary: Block distribution is wrong in case of dynamic allocation=true Key: CARBONDATA-459 URL: https://issues.apache.org/jira/browse/CARBONDATA-459 Project

[jira] [Created] (CARBONDATA-381) Unnecessary catalog metadata refresh and array index of bound exception in drop table

2016-11-04 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-381: --- Summary: Unnecessary catalog metadata refresh and array index of bound exception in drop table Key: CARBONDATA-381 URL: https://issues.apache.org/jira/browse/CARBONDATA-381

[jira] [Created] (CARBONDATA-315) Data loading fails if parsing a double value returns infinity

2016-10-13 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-315: --- Summary: Data loading fails if parsing a double value returns infinity Key: CARBONDATA-315 URL: https://issues.apache.org/jira/browse/CARBONDATA-315 Project

[jira] [Created] (CARBONDATA-629) Issue with database name case sensitivity

2017-01-12 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-629: --- Summary: Issue with database name case sensitivity Key: CARBONDATA-629 URL: https://issues.apache.org/jira/browse/CARBONDATA-629 Project: CarbonData

[jira] [Created] (CARBONDATA-542) Parsing values for measures and dimensions during data load should adopt a strict check

2016-12-18 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-542: --- Summary: Parsing values for measures and dimensions during data load should adopt a strict check Key: CARBONDATA-542 URL: https://issues.apache.org/jira/browse/CARBONDATA

[jira] [Created] (CARBONDATA-803) Incorrect results returned by not equal to filter on dictionary column with numeric data type

2017-03-21 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-803: --- Summary: Incorrect results returned by not equal to filter on dictionary column with numeric data type Key: CARBONDATA-803 URL: https://issues.apache.org/jira/browse

[jira] [Created] (CARBONDATA-780) Alter table support for compaction through sort step

2017-03-15 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-780: --- Summary: Alter table support for compaction through sort step Key: CARBONDATA-780 URL: https://issues.apache.org/jira/browse/CARBONDATA-780 Project: CarbonData

[jira] [Created] (CARBONDATA-779) Alter table support for column group

2017-03-15 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-779: --- Summary: Alter table support for column group Key: CARBONDATA-779 URL: https://issues.apache.org/jira/browse/CARBONDATA-779 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-776) Alter table support for spark 1.6

2017-03-15 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-776: --- Summary: Alter table support for spark 1.6 Key: CARBONDATA-776 URL: https://issues.apache.org/jira/browse/CARBONDATA-776 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-797) Data loss for BigInt datatype if data contains long max and min values

2017-03-20 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-797: --- Summary: Data loss for BigInt datatype if data contains long max and min values Key: CARBONDATA-797 URL: https://issues.apache.org/jira/browse/CARBONDATA-797

[jira] [Created] (CARBONDATA-777) Alter table support for spark 2.1

2017-03-15 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-777: --- Summary: Alter table support for spark 2.1 Key: CARBONDATA-777 URL: https://issues.apache.org/jira/browse/CARBONDATA-777 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-914) Clear BTree and Dictionary instances from LRU cache on table drop

2017-04-12 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-914: --- Summary: Clear BTree and Dictionary instances from LRU cache on table drop Key: CARBONDATA-914 URL: https://issues.apache.org/jira/browse/CARBONDATA-914

[jira] [Created] (CARBONDATA-870) Folders and files not getting cleaned up created locally during data load operation

2017-04-05 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-870: --- Summary: Folders and files not getting cleaned up created locally during data load operation Key: CARBONDATA-870 URL: https://issues.apache.org/jira/browse/CARBONDATA-870

[jira] [Created] (CARBONDATA-900) Is null query on a newly added measure column is not returning proper results

2017-04-11 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-900: --- Summary: Is null query on a newly added measure column is not returning proper results Key: CARBONDATA-900 URL: https://issues.apache.org/jira/browse/CARBONDATA-900

[jira] [Created] (CARBONDATA-924) Drop of all cache should happen in refresh flow, should not be directly deleted in command execution

2017-04-13 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-924: --- Summary: Drop of all cache should happen in refresh flow, should not be directly deleted in command execution Key: CARBONDATA-924 URL: https://issues.apache.org/jira/browse

[jira] [Created] (CARBONDATA-767) Alter table support for carbondata

2017-03-13 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-767: --- Summary: Alter table support for carbondata Key: CARBONDATA-767 URL: https://issues.apache.org/jira/browse/CARBONDATA-767 Project: CarbonData Issue

[jira] [Created] (CARBONDATA-863) Support creation and deletion of dictionary files through RDD during alter add and drop

2017-04-05 Thread Manish Gupta (JIRA)
Manish Gupta created CARBONDATA-863: --- Summary: Support creation and deletion of dictionary files through RDD during alter add and drop Key: CARBONDATA-863 URL: https://issues.apache.org/jira/browse/CARBONDATA