pyspark????????carbondata

2017-05-26 Thread ????????
pysparkcarbondata??

pyspark????carbondata

2017-05-26 Thread ????????
pysparkcarbondata??

Re: when plan to implemnt merge operation

2017-05-26 Thread Mic Sun
merge example like this: small: id updatatime 1 9:00 2 8:00 6 9:00 big: id updatetime 1 10:00 2 7:00 3 9:00 4 9:00 5 9:00 as for record in small: id=1,small.updatebigdate.update,update big; id=6,big doesn't have that record,insert big; for our solut

[jira] [Created] (CARBONDATA-1098) change statistics to use exact type instead of Object

2017-05-26 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-1098: Summary: change statistics to use exact type instead of Object Key: CARBONDATA-1098 URL: https://issues.apache.org/jira/browse/CARBONDATA-1098 Project: CarbonData

[DISCUSSION] Interfaces for index frame work

2017-05-26 Thread Ravindra Pesala
New interfaces for index framework has been added in PR https://github.com/apache/carbondata/pull/958 Interfaces for Index storage and retrieval implementations. 1.IndexStore class which maintains all index tables existed in carbondata.So it can be worked as independent service as well. 2.IndexTab

Re: Logging problem

2017-05-26 Thread Rana Faisal
Hi Liang, I made changes in log4j.properties file of Spark. I changed INFO with ERROR to stop this issue. Thank you Regards Faisal On 26/05/2017 17:51, Liang Chen wrote: Hi Rana Please let us know if your issue be solved? Regards Liang 2017-05-25 20:38 GMT+08:00 Liang Chen : Hi Ran

Re: Implementing Streaming Ingestion Support in CarbonData

2017-05-26 Thread Liang Chen
Hi Aniket and Prabhat Thanks for you guys started streaming ingestion feature. I have created one branch with name "streaming_ingest". Suggest creating an independent module under integration/streaming. Regards Liang 2017-05-22 15:54 GMT+08:00 prabhatkashyap : > Hi Aniket, > > We have started

Re: Delete ERROR

2017-05-26 Thread Liang Chen
Hi sunerhan I tested at my local machine, can delete more than 1000 rows at one batch. Need to reproduce the error : ERROR deleteExecution$: main Delete data operation is failed due to failure in creating delete delta file for segment : null block : null Regards Liang 2017-05-23 11:52 GMT+08

Re: Compilation error on presto Branch

2017-05-26 Thread Liang Chen
Hi Thanks for your good contributions! Please rebase your PR to master branch. The presto branch code has been rebased to master :) Regards Liang 2017-05-24 19:16 GMT+08:00 Geetika Gupta : > Hi, > > I have updated the core version for presto branch to fix the compilation > issue and build fai

Re: Logging problem

2017-05-26 Thread Liang Chen
Hi Rana Please let us know if your issue be solved? Regards Liang 2017-05-25 20:38 GMT+08:00 Liang Chen : > Hi Rana > > Your this query is in Spark-shell ? > Please try the below script: > > import org.apache.log4j.Logger > import org.apache.log4j.Level > Logger.getLogger("org").setLevel(Level.

Re: when plan to implemnt merge operation

2017-05-26 Thread Liang Chen
Hi 1. Can you give a specific example, let us first understand your requirement exactly. Like below, to provide some fact data. ID date name age 1 2017-05-1carbon 21 2 2017-05-23 spark 30 .. 2. I would like to kindly invite your team guys to participate

[INFORM]Hive and Presto branch have been merged into master ,please rebase your related PRs.

2017-05-26 Thread Liang Chen
Hi dev Hive and Presto branch have been merged into master ,please rebase your related PRs. Regards Liang

[jira] [Created] (CARBONDATA-1097) describe formatted query should display no_inverted_index column

2017-05-26 Thread Rahul Kumar (JIRA)
Rahul Kumar created CARBONDATA-1097: --- Summary: describe formatted query should display no_inverted_index column Key: CARBONDATA-1097 URL: https://issues.apache.org/jira/browse/CARBONDATA-1097 Projec

[jira] [Created] (CARBONDATA-1096) wrong data show in quering carbontable with timestamp data type from hive

2017-05-26 Thread anubhav tarar (JIRA)
anubhav tarar created CARBONDATA-1096: - Summary: wrong data show in quering carbontable with timestamp data type from hive Key: CARBONDATA-1096 URL: https://issues.apache.org/jira/browse/CARBONDATA-1096

[jira] [Created] (CARBONDATA-1095) Fix rebase issues of presto and hive integration

2017-05-26 Thread Liang Chen (JIRA)
Liang Chen created CARBONDATA-1095: -- Summary: Fix rebase issues of presto and hive integration Key: CARBONDATA-1095 URL: https://issues.apache.org/jira/browse/CARBONDATA-1095 Project: CarbonData