Re: questions about carbondata

2016-10-21 Thread weijie tong
tks for the reply, for 3,I still want to know that whether all the blocklets of all the blocks store sequence according to the sorted mdk key? if so , the global sequence mdk key of the carbon table would behave like what hbase rowkey does . or the sequence is block local ,the block index file ma

[GitHub] incubator-carbondata pull request #249: [CARBONDATA-329] constant final clas...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/249#discussion_r84567557 --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java --- @@ -19,866 +19,859 @@ package org.a

[GitHub] incubator-carbondata pull request #253: trivial fix in documentation

2016-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/253 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] incubator-carbondata pull request #254: [CARBONDATA-326] Creates wrong table...

2016-10-21 Thread Zhangshunyu
GitHub user Zhangshunyu opened a pull request: https://github.com/apache/incubator-carbondata/pull/254 [CARBONDATA-326] Creates wrong table on 'create table like' ## Why raise this pr? For fix this problem on jira: ``` I'm trying to create a table like my old table but it

[GitHub] incubator-carbondata pull request #253: trivial fix in documentation

2016-10-21 Thread phalodi
GitHub user phalodi opened a pull request: https://github.com/apache/incubator-carbondata/pull/253 trivial fix in documentation ## What changes were proposed in this pull request? This is too trivial so i didn't create JIRA task. In Quick Start Guide there is u

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r84519762 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0 +1,374

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84518688 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,69 @@

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84518288 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84517789 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/RemoveDictionaryUtil.java --- @@ -123,6 +123,60 @@ private static i

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84515278 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/CarbonSorter.java --- @@ -0,0 +1,56 @@ +/* + * License

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84513482 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,69 @@ +/

[GitHub] incubator-carbondata pull request #230: [CARBONDATA-306]Add block size info ...

2016-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/230 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] incubator-carbondata pull request #230: [CARBONDATA-306]Add block size info ...

2016-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/230 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84513301 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84513452 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84512153 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/*

Re: load data error

2016-10-21 Thread 仲景武
sorry, it can’t run…. 0: jdbc:hive2://taonongyuan.com:10099/default> load data inpath 'hdfs:///name001:9000/carbondata/sample.csv' into table test_table3; Error: java.lang.IllegalArgumentException: Pathname /name001:9000/carbondata/sample.csv from hdfs:/name001:9000/car

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510901 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/RemoveDictionaryUtil.java --- @@ -123,6 +123,60 @@ private static i

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510667 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -334,24 +151,24 @@ publ

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510612 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -334,24 +151,24 @@ publ

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510589 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/SortProcessorStepImpl.java --- @@ -0,0 +1,79 @@ +/*

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510340 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/impl/CarbonParallelReadMergeSorterImpl.java --- @@ -0,0 +1,

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510002 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/CarbonSorter.java --- @@ -0,0 +1,56 @@ +/* + * Lice

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84508061 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84508220 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59 @@

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84508170 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59 @@

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84504071 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/

Re: load data from local file system using beeline

2016-10-21 Thread Zhangshunyu
Hi Harmeet, Actually,local is not supported yet,you can put the files on hdfs,and then load them. And i think this is a good suggestion to support load data from local file. Regards Sunday - My English name is Sunday -- View this message in context: http://apache-carbondata-mailing-list-

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84495043 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/RemoveDictionaryUtil.java --- @@ -123,6 +123,60 @@ private static int

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84494016 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/RemoveDictionaryUtil.java --- @@ -123,6 +123,60 @@ private static int

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84492901 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -334,24 +151,24 @@ public

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84491588 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/SortProcessorStepImpl.java --- @@ -0,0 +1,79 @@ +/* +

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84491864 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -334,24 +151,24 @@ public

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84490086 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/impl/CarbonParallelReadMergeSorterImpl.java --- @@ -0,0 +1,223

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84489680 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/impl/CarbonParallelReadMergeSorterImpl.java --- @@ -0,0 +1,223

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/240 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84485160 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/constants/DataLoadProcessorConstants.java --- @@ -33,4 +33,8 @@

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84484170 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84484027 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59 @@ +/

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84484710 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59 @@ +/

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84484251 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84482988 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84483207 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84482571 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59 @@ +/*

[GitHub] incubator-carbondata pull request #231: [CARBONDATA-311]Log the data size of...

2016-10-21 Thread Zhangshunyu
Github user Zhangshunyu closed the pull request at: https://github.com/apache/incubator-carbondata/pull/231 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84476461 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84476407 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84476341 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84476023 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475851 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/constants/DataLoadProcessorConstants.java --- @@ -33,4 +33,8 @@

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475781 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/complexobjects/StructObject.java --- @@ -0,0 +1,19 @@ +packa

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475566 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/GenericParser.java --- @@ -0,0 +1,22 @@ +package org.

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475433 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/CarbonParserFactory.java --- @@ -0,0 +1,40 @@ +packag

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475299 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/AbstractDataLoadProcessorStep.java --- @@ -114,11 +114,15 @@ pro

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84474223 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84474110 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84473500 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowEncoderImpl.java --- @@ -0,0 +1,132 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84472920 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/RowEncoder.java --- @@ -0,0 +1,32 @@ +/* + * Li

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84473138 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0 +1,63

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84472949 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0 +1,63

[GitHub] incubator-carbondata pull request #238: [CARBONDATA-334] Correct Some Spelli...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/238#discussion_r84463724 --- Diff: hadoop/src/test/java/org/apache/carbondata/hadoop/test/util/StoreCreator.java --- @@ -346,26 +346,26 @@ public static void executeGra

Re: Unable to perform compaction,

2016-10-21 Thread Liang Chen
Hi Can you provide the detail test steps and error logs Regards Liang 2016-10-20 19:35 GMT+08:00 prabhatkashyap : > Hello, > There is some issue with compaction. Auto and force compaction are not > working. > In spark logs I got this error: > > > > > > > > > > -- > View this message in context

[jira] [Created] (CARBONDATA-335) Load data command options 'QUOTECHAR' perform unexpected behavior.

2016-10-21 Thread Harmeet Singh (JIRA)
Harmeet Singh created CARBONDATA-335: Summary: Load data command options 'QUOTECHAR' perform unexpected behavior. Key: CARBONDATA-335 URL: https://issues.apache.org/jira/browse/CARBONDATA-335 Pro

Re: Load data command Quote character unexpected behavior.

2016-10-21 Thread Harmeet
Okay Lion, I will Raise this issue on Jira. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Load-data-command-Quote-character-unexpected-behavior-tp2145p2166.html Sent from the Apache CarbonData Mailing List archive mailing list archive at

Re: Load data command Quote character unexpected behavior.

2016-10-21 Thread Lion.X
OK, get it. I will handler it. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Load-data-command-Quote-character-unexpected-behavior-tp2145p2165.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.

??????questions about carbondata

2016-10-21 Thread ??
hi, 1. correct. one carbon file is same as one block, one block has many blocklets as well as one file footer which has metadata(btree index) of blocklets. one load makes one segment,in one segment has many blocks. 2. carbon will sort dim column data in one blocklet, then the row sequenc

Re: Unable to load CSV using differenent delimiter like "|"(Pipe)and";" (Semicolon) etc

2016-10-21 Thread Harmeet
Hey Jay, I am getting still same error. My code is up to date. I am creating new database and new table for testing. Following are details: *>> Create database * 0: jdbc:hive2://127.0.0.1:1> create database needb; +-+--+ | result | +-+--+ +-+--+ No rows selected (6.2

[GitHub] incubator-carbondata pull request #224: [CARBONDATA-239]Add scan_blocklet_nu...

2016-10-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-carbondata/pull/224 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the f

Re: Load data command Quote character unexpected behavior.

2016-10-21 Thread Harmeet
Hey Lion, My code is up to date and i am still getting same error. I am verifying this on multiple machines. *Actual Output >>> * ---+---+---+--+ | tammy | $my name$ | NULL | 90.0 | 22| ---

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r8023 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84443937 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r8189 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84443403 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84443155 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84443496 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/DataConverterProcessorStepImpl.java --- @@ -0,0 +1,61 @@

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84443007 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94 @@ +/*

Re: Unable to load CSV using differenent delimiter like "|"(Pipe)and";" (Semicolon) etc

2016-10-21 Thread ??
hi, Harmeet not reproduce. pls provide more details. reagrds Jay -- Original -- From: "Harmeet";; Date: Fri, Oct 21, 2016 02:51 PM To: "dev"; Subject: Re: Unable to load CSV using differenent delimiter like "|"(Pipe)and";" (Semicolon) etc Hey Jay, T

Re: Load data command Quote character unexpected behavior.

2016-10-21 Thread 向志强
hi, Harmeet By your descriptions above, I can not reproduce the problem which you described. It returned the right result in my env. Pls use the lasted version and check again, and give more details. Lionx 2016-10-21 15:07 GMT+08:00 Harmeet : > Hey Team, > > I am using load data command with spec

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84435567 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/ComplexParser.java --- @@ -0,0 +1,13 @@ +package org.apa

questions about carbondata

2016-10-21 Thread weijie tong
1,what's the relation ship between these term? carbondata file ,block, blocklet ,carbondata file footer ? once we have a batch job to load data into a carbondata table, does that mean the table file will be composed by different blocks ,and each block is a carbondata file which is composed by man

[GitHub] incubator-carbondata pull request #246: [CARBONDATA-321] If user changes the...

2016-10-21 Thread sujith71955
Github user sujith71955 closed the pull request at: https://github.com/apache/incubator-carbondata/pull/246 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[jira] [Created] (CARBONDATA-334) Correct Some Spelling Mistakes

2016-10-21 Thread Lionx (JIRA)
Lionx created CARBONDATA-334: Summary: Correct Some Spelling Mistakes Key: CARBONDATA-334 URL: https://issues.apache.org/jira/browse/CARBONDATA-334 Project: CarbonData Issue Type: Bug

Beijing Apache CarbonData meetup:https://www.meetup.com/Apache-Carbondata-Meetup/events/235013117/

2016-10-21 Thread Liang Chen
Hi all Saturday, October 29, 2016 1:30 PM to 5:30 PM You can apply through this link : https://www.meetup.com/Apache-Carbondata-Meetup/events/235013117/ Regards Liang

Load data command Quote character unexpected behavior.

2016-10-21 Thread Harmeet
Hey Team, I am using load data command with specific Quote character. But after loading the data, the behavior of quote character is not working. Below is my example: *create table one (name string, description string, salary double, age int, dob timestamp) stored by 'carbondata';* csf File >>