[GitHub] incubator-carbondata pull request #318: [WIP] Dictionary server implementati...

2016-11-15 Thread ravipesala
Github user ravipesala closed the pull request at: https://github.com/apache/incubator-carbondata/pull/318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #318: [WIP] Dictionary server implementati...

2016-11-15 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/318 [WIP] Dictionary server implementation for single pass data load It is work under progress, we can review the design of this PR You can merge this pull request into a Git

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87713382 --- Diff: integration/spark/src/main/scala/org/apache/spark/mapreduce/CarbonHadoopMapReduceUtil.scala --- @@ -0,0 +1,25

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87712886 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -224,42 +221,29 @@ private void addSegmentsIfEmpty

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87712366 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -130,41 +130,27 @@ public static CarbonTable

[GitHub] incubator-carbondata pull request #313: [CARBONDATA-405]Fixed Data load fail...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/313#discussion_r8753 --- Diff: integration/spark/src/test/scala/org/apache/carbondata/spark/testsuite/dataframe/DataFrameTestCase.scala --- @@ -0,0 +1,57

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540775 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/mdkey/NumberCompressorUnitTest.java --- @@ -0,0 +1,132

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540550 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/mdkey/BitsUnitTest.java --- @@ -0,0 +1,98 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540505 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/mdkey/BitsUnitTest.java --- @@ -0,0 +1,98 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #305: [CARBONDATA-393] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/305#discussion_r87540197 --- Diff: core/src/test/java/org/apache/carbondata/core/keygenerator/columnar/impl/MultiDimKeyVarLengthVariableSplitGeneratorUnitTest.java

[GitHub] incubator-carbondata pull request #303: [CARBONDATA-386] Unit test case for ...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/303#discussion_r87531522 --- Diff: core/src/test/java/org/apache/carbondata/core/util/CarbonMetadataUtilTest.java --- @@ -0,0 +1,60 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #295: [Carbondata-379] Scan package's unit...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/295#discussion_r87529444 --- Diff: core/src/test/java/org/apache/carbondata/scan/result/impl/NonFilterQueryScannedResultTest.java --- @@ -0,0 +1,53

[GitHub] incubator-carbondata pull request #295: [Carbondata-379] Scan package's unit...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/295#discussion_r87527367 --- Diff: core/src/main/java/org/apache/carbondata/scan/complextypes/PrimitiveQueryType.java --- @@ -166,6 +166,7 @@ public

[GitHub] incubator-carbondata pull request #277: [CARBONDATA-357] Add unit test for V...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/277#discussion_r87527053 --- Diff: core/src/test/java/org/apache/carbondata/core/util/ValueCompressionUtilTest.java --- @@ -0,0 +1,546 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #277: [CARBONDATA-357] Add unit test for V...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/277#discussion_r87526104 --- Diff: core/src/test/java/org/apache/carbondata/core/util/ValueCompressionUtilTest.java --- @@ -0,0 +1,546 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #270: [CARBONDATA-346] Add unit test for C...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/270#discussion_r87453971 --- Diff: core/src/test/java/org/apache/carbondata/core/util/CarbonUtilTest.java --- @@ -18,18 +18,746 @@ */ package

[GitHub] incubator-carbondata pull request #269: [CARBONDATA-345] improve code-covera...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/269#discussion_r87446559 --- Diff: processing/src/test/java/org/apache/carbondata/lcm/locks/ZooKeeperLockingTest.java --- @@ -41,103 +41,103 @@ */ public

[GitHub] incubator-carbondata pull request #269: [CARBONDATA-345] improve code-covera...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/269#discussion_r87446084 --- Diff: pom.xml --- @@ -6,9 +6,7 @@ The ASF licenses this file to You under the Apache License, Version 2.0 (the "Li

[GitHub] incubator-carbondata pull request #269: [CARBONDATA-345] improve code-covera...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/269#discussion_r87444589 --- Diff: core/src/test/java/org/apache/carbondata/core/cache/dictionary/DictionaryByteArrayWrapperTest.java --- @@ -0,0 +1,58

[GitHub] incubator-carbondata pull request #267: [CARBONDATA-340] implement test case...

2016-11-10 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/267#discussion_r87442533 --- Diff: core/src/main/java/org/apache/carbondata/core/load/LoadMetadataDetails.java --- @@ -150,7 +150,7 @@ public String getLoadStartTime

[GitHub] incubator-carbondata pull request #313: [CARBONDATA-405]Fixed Data load fail...

2016-11-10 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/313 [CARBONDATA-405]Fixed Data load fail if dataframe is created with LONG datatype column If the dataframe schema has long datatype then carbon table creation is failing because

[GitHub] incubator-carbondata pull request #312: [CARBONDATA-404] Fixing dataframe sa...

2016-11-10 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/312 [CARBONDATA-404] Fixing dataframe save when loading in cluster mode. Currently dataframe save writes temp csv in local folder so it fails in cluster mode. This PR changes the temp

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171862 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -43,35 +45,58

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171167 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/SortProcessorStepImpl.java --- @@ -50,6 +50,7 @@ public

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171144 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/IntermediateFileMerger.java --- @@ -110,7

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87171187 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/DataConverterProcessorStepImpl.java --- @@ -47,20 +58,109

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170923 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortParameters.java --- @@ -122,6 +116,11

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170942 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -264,6 +277,72

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170892 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortTempFileChunkHolder.java --- @@ -136,6

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170805 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java --- @@ -396,4 +407,223 @@ private

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87170688 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -215,6 +227,105 @@ public static

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-07 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86929386 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataRDDFactory.scala --- @@ -761,6 +761,11 @@ object

[GitHub] incubator-carbondata pull request #300: [CARBONDATA-359]is null & not null f...

2016-11-06 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/300 [CARBONDATA-359]is null & not null functions are not working when data fetching from sub query https://issues.apache.org/jira/browse/CARBONDATA-359 You can merge this

[GitHub] incubator-carbondata pull request #284: [CARBONDATA-366]Throw error when str...

2016-11-06 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/284#discussion_r86706791 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonUtil.java --- @@ -117,18 +117,27 @@ public static void closeStreams

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-06 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86684268 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-06 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86683747 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #297: [CARBONDATA-284]Fixed compilation an...

2016-11-04 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/297 [CARBONDATA-284]Fixed compilation and checkstyle issues of PR 208 You can merge this pull request into a Git repository by running: $ git pull https://github.com/ravipesala

[GitHub] incubator-carbondata pull request #293: [CARBONDATA-374] Support smallint ty...

2016-11-04 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/293#discussion_r86498453 --- Diff: integration/spark/src/test/scala/org/apache/spark/sql/TestCreateTable.scala --- @@ -0,0 +1,30 @@ +/* --- End diff

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-02 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r86214621 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -953,66 +959,6 @@ public static

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-02 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r86211496 --- Diff: core/src/main/java/org/apache/carbondata/scan/filter/FilterExpressionProcessor.java --- @@ -352,4 +354,18 @@ private

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2][WIP] Data load integr...

2016-11-01 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r85923089 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -213,6 +224,64 @@ public static

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284] Abstracting index a...

2016-10-27 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r85470691 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java --- @@ -0,0 +1,169 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284] Abstracting index a...

2016-10-27 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r85346673 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/internal/segment/impl/IndexedSegment.java --- @@ -0,0 +1,73

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284] Abstracting index a...

2016-10-27 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r85340545 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/internal/index/impl/InMemoryBTreeIndex.java --- @@ -0,0 +1,215

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284] Abstracting index a...

2016-10-27 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r85339106 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/internal/CarbonFormat.java --- @@ -0,0 +1,24 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284] Abstracting index a...

2016-10-27 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r85337928 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonTableInputFormat.java --- @@ -0,0 +1,169 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2][WIP] Data load integr...

2016-10-27 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/263 [CARBONDATA-2][WIP] Data load integration of all steps for removing kettle This PR integrates all data load steps to the main flow. Still DataWriterStep need

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-26 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r85270229 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java --- @@ -304,4 +311,92 @@ public

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-26 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r85267495 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-26 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r85267443 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactHandlerFactory.java --- @@ -0,0 +1,48

Re: In load data, CSV row contains special char at start and end of value but insert as a NULL

2016-10-25 Thread ravipesala
Here age is int data type so it cannot insert special characters. Please try with string type and verify. -- View this message in context:

[GitHub] incubator-carbondata pull request #256: [CARBONDATA-213] Remove thrift compl...

2016-10-24 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/256 [CARBONDATA-213] Remove thrift complier dependency from default build. By default `mvn install` does not include carbon-format, it downloads dependency from repository. User

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84518288 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84517789 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/RemoveDictionaryUtil.java --- @@ -123,6 +123,60 @@ private static

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510612 --- Diff: processing/src/main/java/org/apache/carbondata/processing/sortandgroupby/sortdata/SortDataRows.java --- @@ -334,24 +151,24

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510589 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/SortProcessorStepImpl.java --- @@ -0,0 +1,79

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510340 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/impl/CarbonParallelReadMergeSorterImpl.java --- @@ -0,0

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84510002 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/sort/CarbonSorter.java --- @@ -0,0 +1,56

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84508220 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84508170 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/FieldEncoderFactory.java --- @@ -0,0 +1,59

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84504071 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -0,0 +1,99

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84476341 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475851 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/constants/DataLoadProcessorConstants.java --- @@ -33,4 +33,8

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475566 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/GenericParser.java --- @@ -0,0 +1,22 @@ +package

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84475299 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/AbstractDataLoadProcessorStep.java --- @@ -114,11 +114,15

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84474110 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowConverterImpl.java --- @@ -0,0 +1,94

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84472920 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/RowEncoder.java --- @@ -0,0 +1,32

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-21 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84473138 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0

Re: describe formatted table command does not show block size

2016-10-20 Thread ravipesala
Yes, better show all table properties in desc command. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/describe-formatted-table-command-does-not-show-block-size-tp2098p2103.html Sent from the Apache CarbonData Mailing List archive mailing

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-19 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/251 [CARBONDATA-302]Added Writer processor step for dataloading. Add DataWriterProcessorStep which reads the data from sort processor step and apply mdk generator on key and creates

Re: Create table like old table.

2016-10-19 Thread ravipesala
Carbon did not implement 'create table like' feature. But it should not create wrong table if we use 'like' command, either it should throw error saying it does not support or it should create right table. Its an issue, please raise a jira. -- View this message in context:

Re: Create table with columns contains spaces in name.

2016-10-19 Thread ravipesala
Probably it is a bug. -- View this message in context: http://apache-carbondata-mailing-list-archive.1130556.n5.nabble.com/Create-table-with-columns-contains-spaces-in-name-tp2030p2034.html Sent from the Apache CarbonData Mailing List archive mailing list archive at Nabble.com.

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-16 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/244 [CARBONDATA-300] Added Encoder processor for dataloading. Added interface implementation for encode data load processor. You can merge this pull request into a Git

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-14 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/240 [CARBONDATA-298]Added InputProcessorStep to read data from csv reader iterator. Add InputProcessorStep which should iterate recordreader of csv input and parse the data as per

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-14 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83373827 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/AbstractDataLoadProcessorStep.java --- @@ -73,15 +72,15

[GitHub] incubator-carbondata pull request #236: [CARBONDATA-299] Add dictionary inte...

2016-10-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/236#discussion_r83359748 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/dictionary/InMemBiDictionary.java --- @@ -0,0 +1,85

[GitHub] incubator-carbondata pull request #236: [CARBONDATA-299] Add dictionary inte...

2016-10-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/236#discussion_r83359504 --- Diff: core/src/main/java/org/apache/carbondata/core/devapi/BiDictionary.java --- @@ -0,0 +1,53 @@ +/* + * Licensed to the Apache

[GitHub] incubator-carbondata pull request #212: [CARBONDATA-285] Use path parameter ...

2016-10-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/212#discussion_r83350489 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonDatasourceRelation.scala --- @@ -55,18 +55,11 @@ class CarbonSource

[GitHub] incubator-carbondata pull request #212: [CARBONDATA-285] Use path parameter ...

2016-10-13 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/212#discussion_r83350430 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -861,9 +861,11 @@ private

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83147351 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/iterators/RecordReaderIterator.java --- @@ -0,0 +1,40

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83147018 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/DataLoadProcessorStep.java --- @@ -0,0 +1,40 @@ +package

[GitHub] incubator-carbondata pull request #212: [CARBONDATA-285] Use path parameter ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/212#discussion_r83146927 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonDatasourceRelation.scala --- @@ -55,18 +55,11 @@ class CarbonSource

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83130319 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/DataLoadProcessorStep.java --- @@ -0,0 +1,40 @@ +package

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83130123 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/DataLoadProcessorStep.java --- @@ -0,0 +1,40 @@ +package

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83129418 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/CarbonDataLoadConfiguration.java --- @@ -0,0 +1,185

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r83129008 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/CarbonDataLoadConfiguration.java --- @@ -0,0 +1,185

[GitHub] incubator-carbondata pull request #229: [CARBONDATA-297]Added interface for ...

2016-10-11 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/229#discussion_r82830846 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/DataLoadProcessorStep.java --- @@ -0,0 +1,40 @@ +package

[GitHub] incubator-carbondata pull request #215: [WIP][CARBONDATA-2] Remove kettle fr...

2016-10-10 Thread ravipesala
Github user ravipesala closed the pull request at: https://github.com/apache/incubator-carbondata/pull/215 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284][WIP] Abstracting in...

2016-10-07 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r82446169 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/api/row/CarbonRowInputFormat.java --- @@ -0,0 +1,40 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #215: [WIP][CARBONDATA-2] Remove kettle fr...

2016-10-07 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/215 [WIP][CARBONDATA-2] Remove kettle from carbodata New flow is added in processing module to load data with out kettle. New code is added to the package

[GitHub] incubator-carbondata pull request #148: [CARBONDATA-233] bad record logger s...

2016-10-07 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/148#discussion_r82348806 --- Diff: processing/src/main/java/org/apache/carbondata/processing/surrogatekeysgenerator/csvbased/CarbonCSVBasedSeqGenStep.java

[GitHub] incubator-carbondata pull request #148: [CARBONDATA-233] bad record logger s...

2016-10-07 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/148#discussion_r82341356 --- Diff: processing/src/main/java/org/apache/carbondata/processing/surrogatekeysgenerator/csvbased/BadRecordslogger.java --- @@ -89,41

[GitHub] incubator-carbondata pull request #179: [CARBONDATA-214]Remove binary file a...

2016-09-21 Thread ravipesala
Github user ravipesala closed the pull request at: https://github.com/apache/incubator-carbondata/pull/179 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-carbondata pull request #186: [CARBONDATA-215][CARBONDATA-216] Cor...

2016-09-21 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/186 [CARBONDATA-215][CARBONDATA-216] Corrected file headers and removed unnecessary open csv files Corrected file headers and removed unnecessary open csv files. You can merge

[GitHub] incubator-carbondata pull request #179: [CARBONDATA-214]Remove binary file a...

2016-09-20 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/179 [CARBONDATA-214]Remove binary file and generate the binary file on fly while running the test case Remove binary file and generate the binary file on fly while running the test

[GitHub] incubator-carbondata pull request #106: [CARBONDATA-160]Data mismatch issue ...

2016-08-30 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/106#discussion_r76784836 --- Diff: core/src/main/java/org/apache/carbondata/scan/filter/FilterUtil.java --- @@ -623,9 +655,11 @@ public static DimColumnFilterInfo

[GitHub] incubator-carbondata pull request #72: Fixed wrong result and random query f...

2016-08-12 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/72 Fixed wrong result and random query fails. Query iteration has some problem and it reads wrong data when the data is huge. And also this PR fixes the join queries with tables

[GitHub] incubator-carbondata pull request #70: [CARBONDATA-154] Fix the bug of block...

2016-08-12 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/70#discussion_r74554497 --- Diff: core/src/main/java/org/carbondata/scan/filter/FilterUtil.java --- @@ -669,27 +669,14 @@ public static DimColumnFilterInfo

[GitHub] incubator-carbondata pull request #56: blocklets distribution for query perf...

2016-08-09 Thread ravipesala
Github user ravipesala commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/56#discussion_r74122285 --- Diff: core/src/main/java/org/carbondata/core/carbon/datastore/block/TableBlockInfo.java --- @@ -185,6 +207,16 @@ public long

[GitHub] incubator-carbondata pull request #68: Fixed casesensitive column issue in s...

2016-08-08 Thread ravipesala
GitHub user ravipesala opened a pull request: https://github.com/apache/incubator-carbondata/pull/68 Fixed casesensitive column issue in self join queries Queries are failing when the case sensitive columns are used in self join queries like below `select b.IMEI from table1

  1   2   >