[jira] [Created] (CARBONDATA-933) performance benchmarking of carbon data on hive and orc on hive using compare test

anubhav tarar created CARBONDATA-933: Summary: performance benchmarking of carbon data on hive and orc on hive using compare test Key: CARBONDATA-933 URL: https://issues.apache.org/jira/browse/CARBONDATA-933

[jira] [Created] (CARBONDATA-826) Create carbondata-connector of presto for supporting presto query carbon data

Liang Chen created CARBONDATA-826: - Summary: Create carbondata-connector of presto for supporting presto query carbon data Key: CARBONDATA-826 URL: https://issues.apache.org/jira/browse/CARBONDATA-826

[jira] [Created] (CARBONDATA-695) Create DataFrame example in example/spark2, read carbon data to dataframe

Liang Chen created CARBONDATA-695: - Summary: Create DataFrame example in example/spark2, read carbon data to dataframe Key: CARBONDATA-695 URL: https://issues.apache.org/jira/browse/CARBONDATA-695

[jira] (CARBONDATA-690) Carbon data load fails with default option for USE_KETTLE(False)

Ramakrishna created CARBONDATA-690: -- Summary: Carbon data load fails with default option for USE_KETTLE(False) Key: CARBONDATA-690 URL: https://issues.apache.org/jira/browse/CARBONDATA-690 Project

Support of Float Data Type in Carbon Data

Hi, Carbon Data is not supporting Float Data type. Do we need to fix this Jira issue [CARBONDATA-390] <https://issues.apache.org/jira/browse/CARBONDATA-390>? I think float data type should have its own range. So do we need to support range for Float data type? Proposed Solution : W

Re: [Discussion] Please vote and comment for carbon data file format change

d improve IO >> >> For this I am planing to change the carbondata thrift format >> >> *Old format* >> >> >> >> *New format* >> >> >> >> *​* >> >> Please vote and comment for this new format change >> >&g

Re: [Discussion] Please vote and comment for carbon data file format change

+1 , currrent dataformat have first time query slow issue , should be fixed. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Discussion-Please-vote-and-comment-for-carbon-data-file-format-change-tp2491p4018.html Sent from the Apache

Re: [Discussion] Please vote and comment for carbon data file format change

; >> Thanks! >> >> Jihong >> >> -Original Message- >> From: Jacky Li [mailto:jacky.li...@qq.com] >> Sent: Thursday, November 03, 2016 7:54 AM >> To: dev@carbondata.incubator.apache.org >> Subject: Re: [Discussion] Please vote and c

Re: [Discussion] Please vote and comment for carbon data file format change

> Thanks! > > Jihong > > -Original Message- > From: Jacky Li [mailto:jacky.li...@qq.com] > Sent: Thursday, November 03, 2016 7:54 AM > To: dev@carbondata.incubator.apache.org > Subject: Re: [Discussion] Please vote and comment for carbon data file > form

Re: carbon data

Try Code like this: ``` if (cc.tableNames().filter(f => f == _cfg.get("tableName").get).size == 0) { df.sqlContext.sql(s"DROP TABLE IF EXISTS ${_cfg.get("tableName").get}") writer.options(_cfg).mode(SaveMode.Overwrite).format(_format).save() } else {

Re: carbon data

Thank you for the response Liang. I think I have followed the example but it still returns error: Data loading failed. table not found: default.carbontest attached my code below: I read data from a hive table with HiveContext and convert it to CarbonContext then generate the df and save to

Re: carbon data

Hi Lionel Don't need to create table first, please find the example code in ExampleUtils.scala df.write .format("carbondata") .option("tableName", tableName) .option("compress", "true") .option("useKettle", "false") .mode(mode) .save() Preparing API docs is in progress.

carbon data

Hi team, I'm trying to save spark dataframe to carbondata file. I see the example in your wiki option("tableName", "carbontable"). Does that mean I have to create a carbondata table first and then save data into the table? Can I save it directly without creating the carbondata table? the code is

[jira] [Created] (CARBONDATA-430) Carbon data tpch benchmark

suo tong created CARBONDATA-430: --- Summary: Carbon data tpch benchmark Key: CARBONDATA-430 URL: https://issues.apache.org/jira/browse/CARBONDATA-430 Project: CarbonData Issue Type: Task

Re: [Feature] proposal for update and delete support in Carbon data

nData has builtin support for index, any idea what is the > impaction to the B tree index already in driver and executor memory? > > Regards, > Jacky > > > 在 2016年11月15日，下午12:25，Vinod KC <vinod.kc...@gmail.com> 写道： > > > > Hi All > > I would like to

[Feature] proposal for update and delete support in Carbon data

Hi All I would like to propose following new features in Carbon data 1) Update statement to support modifying existing records in carbon data table 2) Delete statement to remove records from carbon data table A) Update operation: 'Update' features can be added to CarbonData using intermediate

RE: [Discussion] Please vote and comment for carbon data file format change

@carbondata.incubator.apache.org Subject: Re: [Discussion] Please vote and comment for carbon data file format change The proposed change is reasonable, +1. But is there a plan to make the reader backward compatible with the old format? So the impact to the current deployment is minimum. Regards, Jacky > 在 2016年11月2日，上

Re: [Discussion] Please vote and comment for carbon data file format change

Dear Jacky, Yes I am planning to support both data format reader(new and old) + writer(new and old), default new writer will be enabled, but if user wants to write in older format for that i will expose one configuration. Please let me know if you have any other suggestion. -Regards

Re: [Discussion] Please vote and comment for carbon data file format change

* Hi Xiaoqiao He*, Please find the *attachment.* *-Regards* *Kumar Vishal* On Tue, Nov 1, 2016 at 9:27 PM, Xiaoqiao He wrote: > Hi Kumar Vishal, > > I couldn't get Fig. of the file format, could you re-upload them? > Thanks. > > Best Regards > > On Tue, Nov 1, 2016 at

Re: [Discussion] Please vote and comment for carbon data file format change

Hi Kumar Vishal, I couldn't get Fig. of the file format, could you re-upload them? Thanks. Best Regards On Tue, Nov 1, 2016 at 7:12 PM, Kumar Vishal wrote: > > ​Hello All, > > Improving carbon first time query performance > > Reason: > 1. As file system cache is

[Discussion] Please vote and comment for carbon data file format change

​Hello All, Improving carbon first time query performance Reason: 1. As file system cache is cleared file reading will make it slower to read and cache 2. In first time query carbon will have to read the footer from file data file to form the btree 3. Carbon reading more footer data than its

Re: Discussion(New feature) Support Complex Data Type: Map in Carbon Data

The key in the map can be only primitive data types. At present, Carbon Data supports following primitive data types Integer, String, Timestamp, Double and Decimal. If in future CarbonData adds supports more primitive data types, the same can be used as key in the Map. The reason for restricting

Re: Discussion(New feature) Support Complex Data Type: Map in Carbon Data

RBONDATA/CarbonData+Home > > Regards > Liang > > > Vimal Das Kammath wrote > > Hi All, > > > > This discussion is regarding support for Map Data type in Carbon Data. > > > > Carbon Data supports complex and nested data types such as Arrays and > > S

Re: Discussion(New feature) Support Complex Data Type: Map in Carbon Data

it to cwiki:https://cwiki.apache.org/confluence/display/CARBONDATA/CarbonData+Home Regards Liang Vimal Das Kammath wrote > Hi All, > > This discussion is regarding support for Map Data type in Carbon Data. > > Carbon Data supports complex and nested data types such as Arrays and &g

Discussion(New feature) Support Complex Data Type: Map in Carbon Data

Hi All, This discussion is regarding support for Map Data type in Carbon Data. Carbon Data supports complex and nested data types such as Arrays and Struts. However, Carbon Data does not support other complex data types such as Maps and Union which are generally supported by popular opensource

[jira] [Resolved] (CARBONDATA-12) Carbon data load bad record log file not renamed form inprogress to normal .log

[ https://issues.apache.org/jira/browse/CARBONDATA-12?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-12. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Carbon data load

[jira] [Resolved] (CARBONDATA-9) Carbon data load bad record is not written into the bad record log file

[ https://issues.apache.org/jira/browse/CARBONDATA-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-9. -- Resolution: Fixed Fix Version/s: 0.1.0-incubating > Carbon data load