[GitHub] incubator-carbondata pull request #126: [CARBONDATA-212] Use SQLContext to r...

2016-09-05 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/126 [CARBONDATA-212] Use SQLContext to read CarbonData files In this PR, user can use SQLContext instead of CarbonContext to read CarbonData files. See DatasourceExample.scala You

[GitHub] incubator-carbondata pull request #125: [CARBONDATA-209] add DROP TABLE in a...

2016-09-04 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/125 [CARBONDATA-209] add DROP TABLE in all test cases In this PR, DROP TABLE is added in all test cases. You can merge this pull request into a Git repository by running: $ git pull

[GitHub] incubator-carbondata pull request #151: [CARBONDATA-210] Support BZIP2 compr...

2016-09-13 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/151 [CARBONDATA-210] Support BZIP2 compressed CSV file for data load 2 test cases are added: 1) test loading data with BZIP2 compressed CSV file 2) test loading data with CSV file

[GitHub] incubator-carbondata pull request #157: [CARBONDATA-240] Use SQLContext to q...

2016-09-14 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/157 [CARBONDATA-240] Use SQLContext to query CarbonData directly without creating table When using Spark 1.6, user can use SQLContext to query CarbonData files directly without creating

[GitHub] incubator-carbondata pull request #149: [CARBONDATA-234]wrong message gettin...

2016-09-14 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/149#discussion_r78782607 --- Diff: integration/spark/src/main/java/org/apache/carbondata/integration/spark/merger/CarbonCompactionUtil.java --- @@ -210,10 +211,14

[GitHub] incubator-carbondata pull request #149: [CARBONDATA-234]wrong message gettin...

2016-09-14 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/149#discussion_r78782633 --- Diff: integration/spark/src/main/java/org/apache/carbondata/integration/spark/merger/CarbonCompactionUtil.java --- @@ -246,6 +251,9

[GitHub] incubator-carbondata pull request #214: [WIP] Add a tool to print out schema...

2016-10-06 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/214 [WIP] Add a tool to print out schema of CarbonData Add a tool to print out schema information, taking carbondata table folder as input parameter usage: carbon-ls path

[GitHub] incubator-carbondata pull request #212: Use path parameter in Spark datasour...

2016-10-04 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/212 Use path parameter in Spark datasource API Currently, when using carbon with spark datasource API, it need to give database name and table name as parameter, it is not the normal way

[GitHub] incubator-carbondata pull request #209: Fix scalastyle in ExampleUtils.scala

2016-10-04 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/209 Fix scalastyle in ExampleUtils.scala Modify function discription to meet java doc convention You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] incubator-carbondata pull request #211: [CARBONDATA-282] Add segment managem...

2016-10-04 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/211 [CARBONDATA-282] Add segment management in CarbonExample A new example for data management is added. It will help user to understand how following syntax is used: - DELETE

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-10-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r82387284 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -742,7 +742,8 @@ object

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284][WIP] Abstracting in...

2016-10-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r82505613 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/api/CarbonInputFormatBase.java --- @@ -0,0 +1,69 @@ +/* --- End diff

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284][WIP] Abstracting in...

2016-10-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r82505442 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/api/row/CarbonRowInputFormat.java --- @@ -0,0 +1,40 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284][WIP] Abstracting in...

2016-10-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r82505582 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/internal/segment/StreamingSegment.java --- @@ -0,0 +1,45

[GitHub] incubator-carbondata pull request #216: Update DOC about table level blocksi...

2016-10-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/216#discussion_r82504992 --- Diff: docs/DDL-Operations-on-Carbon.md --- @@ -67,6 +67,14 @@ Here, DICTIONARY_EXCLUDE will exclude dictionary creation. This is applicable

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284][WIP] Abstracting in...

2016-10-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r82505527 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/internal/segment/IndexedSegment.java --- @@ -0,0 +1,70 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-10-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r82370864 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -462,3 +478,155 @@ class

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-10-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r82369947 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -72,8 +76,91 @@ class

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-10-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r82367638 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/CarbonOption.scala --- @@ -17,6 +17,8 @@ package

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-10-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r82363963 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/CarbonOption.scala --- @@ -36,6 +38,8 @@ class CarbonOption(options

[GitHub] incubator-carbondata pull request #213: Support Append mode when writing Dat...

2016-10-04 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/213 Support Append mode when writing Dataframe to CarbonData Support df.write using Append as save mode, it will become a new segment in CarbonData This PR add append implementation

[GitHub] incubator-carbondata pull request #216: [CARBONDATA-289]Support MB/M for tab...

2016-10-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/216#discussion_r82523320 --- Diff: docs/DDL-Operations-on-Carbon.md --- @@ -67,6 +67,14 @@ Here, DICTIONARY_EXCLUDE will exclude dictionary creation. This is applicable

[GitHub] incubator-carbondata pull request #216: [CARBONDATA-289]Support MB/M for tab...

2016-10-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/216#discussion_r82523040 --- Diff: docs/DDL-Operations-on-Carbon.md --- @@ -67,6 +67,14 @@ Here, DICTIONARY_EXCLUDE will exclude dictionary creation. This is applicable

[GitHub] incubator-carbondata pull request #215: [WIP][CARBONDATA-2] Remove kettle fr...

2016-10-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/215#discussion_r82504432 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/csvinput/CustomArrayWritable.java --- @@ -0,0 +1,51 @@ +package

[GitHub] incubator-carbondata pull request #174: [CARBONDATA-257] Make CarbonData rea...

2016-09-18 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/174 [CARBONDATA-257] Make CarbonData readable through Spark/MapReduce program User should be able to use SparkContext.newAPIHadoopFile to read CarbonData files For example

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r79549321 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -52,11 +58,18 @@ public static

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r79549615 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -461,8 +459,15 @@ private Object getFilterPredicates

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r79554930 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -52,12 +56,27 @@ public static

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r79555228 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -461,8 +460,7 @@ private Object getFilterPredicates

[GitHub] incubator-carbondata pull request #189: [CARBONDATA-267] Set block_size for ...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/189#discussion_r80176593 --- Diff: format/src/main/thrift/schema.thrift --- @@ -124,6 +124,7 @@ struct TableSchema{ 1: required string table_id; // ID used

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80179516 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -17,13 +17,14 @@ package

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80179757 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -461,8 +460,8 @@ private Object getFilterPredicates

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80179688 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -17,13 +17,14 @@ package

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80179616 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -52,12 +56,27 @@ public static

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80179589 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -17,13 +17,14 @@ package

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80179086 --- Diff: core/src/main/java/org/apache/carbondata/core/carbon/querystatistics/QueryStatisticsRecorderImpl.java --- @@ -0,0 +1,172

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80922605 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -462,3 +478,133 @@ class

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80921202 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -462,3 +478,133 @@ class

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80912853 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -72,6 +76,89 @@ class

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80915025 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/CarbonDataLoadRDD.scala --- @@ -145,92 +232,28 @@ class

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80929523 --- Diff: processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/CsvInput.java --- @@ -343,41 +349,57 @@ public boolean

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80903639 --- Diff: processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/CsvInput.java --- @@ -343,41 +349,57 @@ public boolean

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80927972 --- Diff: processing/src/main/java/org/apache/carbondata/processing/csvreaderstep/CsvInput.java --- @@ -85,6 +87,8 @@ private

[GitHub] incubator-carbondata pull request #203: [CARBONDATA-279]Load RDD to carbonda...

2016-09-28 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/203#discussion_r80932289 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/util/GlobalDictionaryUtil.scala --- @@ -742,7 +742,8 @@ object

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284][WIP] Abstracting in...

2016-10-03 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/208 [CARBONDATA-284][WIP] Abstracting index and segment interface This PR adds new User API and Dev API for carbon-hadoop module: ### User API - `CarbonColumnarInputFormat

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-25 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80410923 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -17,13 +17,14 @@ package

[GitHub] incubator-carbondata pull request #176: [CARBONDATA-208] Add configuration e...

2016-09-25 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/176#discussion_r80411022 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonTimeStatisticsFactory.java --- @@ -52,12 +56,27 @@ public static

[GitHub] incubator-carbondata pull request #206: [CARBONDATA-282] Add segment managem...

2016-10-01 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/206 [CARBONDATA-282] Add segment management in CarbonExample Add segment delete using segment id and date example in CarbonExample This PR will help user to understand how `DELETE

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r85159483 --- Diff: processing/src/main/java/org/apache/carbondata/processing/util/CarbonDataProcessorUtil.java --- @@ -304,4 +311,92 @@ public static

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r85159146 --- Diff: processing/src/main/java/org/apache/carbondata/processing/store/CarbonFactHandlerFactory.java --- @@ -0,0 +1,48

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-26 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r85157225 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0 +1,360

[GitHub] incubator-carbondata pull request #208: [CARBONDATA-284] Abstracting index a...

2016-10-27 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/208#discussion_r85457738 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/internal/segment/impl/IndexedSegment.java --- @@ -0,0 +1,73

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87125387 --- Diff: integration/spark/src/main/java/org/apache/carbondata/spark/load/CarbonLoaderUtil.java --- @@ -215,6 +227,105 @@ public static void

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87123336 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/DataConverterProcessorStepImpl.java --- @@ -47,20 +58,109

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87123603 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/DataConverterProcessorStepImpl.java --- @@ -47,20 +58,109

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87120631 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -1112,24 +1085,27 @@ case

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87122331 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/converter/impl/RowConverterImpl.java --- @@ -43,35 +45,58

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-08 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87122653 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/impl/RowParserImpl.java --- @@ -18,22 +18,80

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86664431 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/DataLoadProcessExecutor.java --- @@ -0,0 +1,28 @@ +package

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86664395 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86664148 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86665514 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r8739 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/execution/command/carbonTableSchema.scala --- @@ -1198,10 +1172,16 @@ case

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r86665773 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87218055 --- Diff: examples/src/main/scala/org/apache/carbondata/examples/CarbonExample1.scala --- @@ -0,0 +1,340 @@ +/* + * Licensed

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-09 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r87217857 --- Diff: conf/ss.txt --- @@ -0,0 +1,122 @@ + +Release Notes - CarbonData - Version 0.1.0-incubating --- End diff -- why

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r86786637 --- Diff: core/src/main/java/org/apache/carbondata/core/carbon/datastore/block/Distributable.java --- @@ -16,10 +16,12

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-07 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r86786673 --- Diff: hadoop/src/main/java/org/apache/carbondata/hadoop/CarbonInputFormat.java --- @@ -311,80 +278,6 @@ private void addSegmentsIfEmpty

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87540816 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -177,6 +178,13 @@ public

[GitHub] incubator-carbondata pull request #262: [CARBONDATA-308] Use CarbonInputForm...

2016-11-10 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/262#discussion_r87540836 --- Diff: processing/src/main/java/org/apache/carbondata/lcm/status/SegmentStatusManager.java --- @@ -177,6 +178,13 @@ public

[GitHub] incubator-carbondata pull request #311: add example for data load without us...

2016-11-10 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/311 add example for data load without using kettle In this PR, example SQL and dataframe usage is added for loading data without kettle You can merge this pull request into a Git

[GitHub] incubator-carbondata pull request #263: [CARBONDATA-2] Data load integration...

2016-11-05 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/263#discussion_r8652 --- Diff: integration/spark/src/main/scala/org/apache/carbondata/spark/rdd/NewCarbonDataLoadRDD.scala --- @@ -0,0 +1,281

[GitHub] incubator-carbondata pull request #252: [CARBONDATA-331] Modify Compressor i...

2016-10-20 Thread jackylk
GitHub user jackylk opened a pull request: https://github.com/apache/incubator-carbondata/pull/252 [CARBONDATA-331] Modify Compressor interface and add no compression option Modification in this PR: 1. Modify the compressor inteface to make it easier to add new compressors

[GitHub] incubator-carbondata pull request #247: [CARBONDATA-301] Added Sort processo...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/247#discussion_r84245645 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/sort/SortProcessorStepImpl.java --- @@ -0,0 +1,237

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84242215 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0 +1,63

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r84247597 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0 +1,374

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84238092 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/RowEncoder.java --- @@ -0,0 +1,32

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84229694 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/constants/DataLoadProcessorConstants.java --- @@ -33,4 +33,8

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84231719 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84237159 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84228406 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/GenericParser.java --- @@ -0,0 +1,22 @@ +package

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84234651 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84230036 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84233387 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84227656 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/parser/CarbonParserFactory.java --- @@ -0,0 +1,40 @@ +package

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84227253 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/complexobjects/ArrayObject.java --- @@ -0,0 +1,18 @@ +package

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84243728 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/encodestep/EncoderProcessorStepImpl.java --- @@ -0,0 +1,63

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84233734 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84236755 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84234179 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84232050 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84236268 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84233633 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r84229327 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/complexobjects/StructObject.java --- @@ -0,0 +1,19 @@ +package

[GitHub] incubator-carbondata pull request #244: [CARBONDATA-300] Added Encoder proce...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/244#discussion_r84240216 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/encoding/impl/RowEncoderImpl.java --- @@ -0,0 +1,132

[GitHub] incubator-carbondata pull request #240: [CARBONDATA-298]Added InputProcessor...

2016-10-14 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/240#discussion_r83506371 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/input/InputProcessorStepImpl.java --- @@ -0,0 +1,171

[GitHub] incubator-carbondata pull request #249: [CARBONDATA-329] constant final clas...

2016-10-20 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/249#discussion_r84315712 --- Diff: core/src/main/java/org/apache/carbondata/core/constants/CarbonCommonConstants.java --- @@ -19,866 +19,859 @@ package

[GitHub] incubator-carbondata pull request #255: CARBONDATA-336 Align the the name de...

2016-10-22 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/255#discussion_r84578283 --- Diff: integration/spark/src/main/scala/org/apache/spark/sql/CarbonSqlParser.scala --- @@ -926,14 +926,14 @@ class CarbonSqlParser

[GitHub] incubator-carbondata pull request #251: [CARBONDATA-302]Added Writer process...

2016-10-25 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/251#discussion_r84843684 --- Diff: processing/src/main/java/org/apache/carbondata/processing/newflow/steps/writer/DataWriterProcessorStepImpl.java --- @@ -0,0 +1,360

[GitHub] incubator-carbondata pull request #184: [CARBONDATA-264]Fixed limit query sc...

2016-10-25 Thread jackylk
Github user jackylk commented on a diff in the pull request: https://github.com/apache/incubator-carbondata/pull/184#discussion_r84940497 --- Diff: core/src/main/java/org/apache/carbondata/scan/executor/impl/QueryExecutorProperties.java --- @@ -91,5 +89,10 @@ * list

  1   2   >