[jira] [Created] (CARBONDATA-331) Support no compression option while loading

Jacky Li created CARBONDATA-331: --- Summary: Support no compression option while loading Key: CARBONDATA-331 URL: https://issues.apache.org/jira/browse/CARBONDATA-331 Project: CarbonData Issue

Drop Database cascade hive command not supported.

Hey team, I am creating a database and that database contains tables. I want to drop the database and clean the table in one command using cascade, but carbon data gave us an error. If i am using hive, hive allow me for dropping database with cascade. Below are the details: In *CarbonData*: 0:

[GitHub] incubator-carbondata pull request #252: [CARBONDATA-331] Modify Compressor i...

GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/252 [CARBONDATA-331] Modify Compressor interface and add no compression option Modification in this PR: 1. Modify the compressor inteface to make it easier to add new compressors.

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84245645 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/sort/SortProcessorStepImpl.java --- @@ -0,0 +1,237 @@

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84242215 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0 +1,63

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r84247597 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0 +1,374

describe formatted table command does not show block size

Hey team, carbon data creating a table block size with 1GB default value. But when i am trying to show the block size value using desc formatted , the detail is show, but block size doest not appear. I suggest in tables details the block size must be visible. Even we manually define the table

Unable to perform compaction,

Hello, There is some issue with compaction. Auto and force compaction are not working. In spark logs I got this error: -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Unable-to-perform-compaction-tp2099.html Sent from the Apache

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84238092 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/RowEncoder.java --- @@ -0,0 +1,32 @@ +/* + *

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84229694 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/constants/DataLoadProcessorConstants.java --- @@ -33,4 +33,8 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84231719 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84237159 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84228406 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/GenericParser.java --- @@ -0,0 +1,22 @@ +package

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84234651 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84230036 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84233387 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84227656 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/CarbonParserFactory.java --- @@ -0,0 +1,40 @@ +package

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84227253 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/complexobjects/ArrayObject.java --- @@ -0,0 +1,18 @@ +package

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84243728 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0 +1,63

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84233734 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84236755 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84234179 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84232050 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84236268 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84233633 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84229327 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/complexobjects/StructObject.java --- @@ -0,0 +1,19 @@ +package

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84240216 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowEncoderImpl.java --- @@ -0,0 +1,132 @@ +/*

table schema is not matched "create table" command

hi, i deployed carbon on yarn and tried to convert json data into carbondata using carbon-spark-sql. when i run following create table command: create table q3_carbon (cookie string, freq int, key bigint) STORED BY 'carbondata'; it return succ. then , i run : show create table q3_carbon; it

Re: load data error

try hdfs://name001:9000/carbondata/sample.csv Instead of hdfs:///name001:9000/carbondata/sample.csv 发自我的 iPhone > 在 2016年10月20日，上午10:52，仲景武 写道： > > > when run command (thrift sever): > > jdbc:hive2://taonongyuan.com:10099/default> load >

Re: describe formatted table command does not show block size

Yes, better show all table properties in desc command. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/describe-formatted-table-command-does-not-show-block-size-tp2098p2103.html Sent from the Apache CarbonData Mailing List archive mailing

Re: describe formatted table command does not show block size

Hey Ravi, can we raise the issue in jira ? -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/describe-formatted-table-command-does-not-show-block-size-tp2098p2104.html Sent from the Apache CarbonData Mailing List archive mailing list archive

[GitHub] incubator-carbondata pull request #249: [CARBONDATA-329] constant final clas...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/249#discussion_r84315712 --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java --- @@ -19,866 +19,859 @@ package

[jira] [Created] (CARBONDATA-332) Create successfully Database, tables and columns using carbon reserve keywords

Harmeet Singh created CARBONDATA-332: Summary: Create successfully Database, tables and columns using carbon reserve keywords Key: CARBONDATA-332 URL: https://issues.apache.org/jira/browse/CARBONDATA-332

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84243237 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/NonDictionaryFieldEncoderImpl.java --- @@ -0,0 +1,54

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84400885 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -439,42 +436,42 @@ class

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404173 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -1043,32 +1050,32 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404263 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -1114,36 +1121,36 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404340 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonGlobalDictionaryRDD.scala --- @@ -385,22 +385,22 @@ class

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404111 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -505,129 +512,129 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84405181 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -839,10 +841,10 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404806 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/CommonUtil.scala --- @@ -49,7 +49,7 @@ object CommonUtil {

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404204 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -1114,36 +1121,36 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404900 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -267,10 +267,10 @@ object

Re: describe formatted table command does not show block size

hi, Harmeet there is already pr#230 for this problem. pls check. thanks -- Original -- From: "Harmeet Singh";; Date: Thu, Oct 20, 2016 09:11 PM To: "dev"; Subject: Re: describe formatted table

??????[jira] [Created] (CARBONDATA-332) Create successfully Database,tables and columns using carbon reserve keywords

hi, Harmeet i will raise a pr to solve this. thanks Jay -- -- ??: "Harmeet Singh (JIRA)";; : 2016??10??20??(??) 6:36 ??: "dev"; : [jira] [Created]

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84401276 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -189,15 +195,15 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84400739 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -439,42 +436,42 @@ class

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84400407 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -196,30 +196,29 @@ class

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84400353 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/CarbonFilters.scala --- @@ -259,29 +259,29 @@ object CarbonFilters {

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84401103 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -175,8 +177,12 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84400383 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/CarbonFilters.scala --- @@ -259,29 +259,29 @@ object CarbonFilters {

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84401697 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -505,129 +512,129 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84401743 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -505,129 +512,129 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84401600 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -505,129 +512,129 @@ object

[GitHub] incubator-carbondata pull request #248: [CARBONDATA-328] Improve Code and Fi...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/248#discussion_r84404075 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -505,129 +512,129 @@ object

Re: describe formatted table command does not show block size

Hey 杰 , Yes I am checking the PR, so I suppose there is no need for raise the bug on jira. But still the PR is not merge, Is there some specific reasons? . -- View this message in context:

load data from local file system using beeline

Hey team, I am using Thriftserver and Beeline client for executing carbon data queries. I want to load the data from csv into carbon data table. The CSV file is exist at out local system. When i am trying to execute the query, i got an exception, invalid path. Below is the example; 0:

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84226906 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/AbstractDataLoadProcessorStep.java --- @@ -114,11 +114,15 @@