[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-12 Thread manishgupta88
Github user manishgupta88 commented on the issue: https://github.com/apache/carbondata/pull/2730 @ravipesala ...Please add code comments wherever applicable...especially for new classes and to explain major flow or logic...it will make the code more readable and easy to understand

[GitHub] carbondata pull request #2730: [WIP] Performance improvements for Fileformat...

2018-10-12 Thread manishgupta88
Github user manishgupta88 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2730#discussion_r224746003 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/vector/impl/directread/ColumnarVectorWrapperDirectWithDeleteDelta.java ---

[GitHub] carbondata pull request #2730: [WIP] Performance improvements for Fileformat...

2018-10-12 Thread manishgupta88
Github user manishgupta88 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2730#discussion_r224738600 --- Diff:

[GitHub] carbondata pull request #2730: [WIP] Performance improvements for Fileformat...

2018-10-12 Thread manishgupta88
Github user manishgupta88 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2730#discussion_r224776123 --- Diff: core/src/main/java/org/apache/carbondata/core/metadata/datatype/DecimalConverterFactory.java --- @@ -95,6 +100,51 @@ public int

[GitHub] carbondata issue #2808: [WIP] Refactor ColumnPageWrapper

2018-10-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2808 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/981/ ---

[jira] [Created] (CARBONDATA-3005) Proposing Gzip Compression support

2018-10-12 Thread Shardul Singh (JIRA)
Shardul Singh created CARBONDATA-3005: - Summary: Proposing Gzip Compression support Key: CARBONDATA-3005 URL: https://issues.apache.org/jira/browse/CARBONDATA-3005 Project: CarbonData

[GitHub] carbondata issue #2808: [WIP] Refactor ColumnPageWrapper

2018-10-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2808 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9049/ ---

[GitHub] carbondata issue #2812: [CARBONDATA-3004][32k] Fix bugs in writing dataframe...

2018-10-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2812 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/980/ ---

[GitHub] carbondata issue #2812: [CARBONDATA-3004][32k] Fix bugs in writing dataframe...

2018-10-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2812 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9048/ ---

[GitHub] carbondata issue #2808: [WIP] Refactor ColumnPageWrapper

2018-10-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2808 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/784/ ---

[jira] [Closed] (CARBONDATA-2988) use unsafe for query model based on system property

2018-10-12 Thread xuchuanyin (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuchuanyin closed CARBONDATA-2988. -- Resolution: Not A Problem > use unsafe for query model based on system property >

[GitHub] carbondata issue #2812: [CARBONDATA-3004][32k] Fix bugs in writing dataframe...

2018-10-12 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2812 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/783/ ---

[jira] [Updated] (CARBONDATA-3004) Fix bug in writing dataframe to carbon table while the field order is different

2018-10-12 Thread xuchuanyin (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuchuanyin updated CARBONDATA-3004: --- Issue Type: Sub-task (was: Bug) Parent: CARBONDATA-2420 > Fix bug in writing

[GitHub] carbondata pull request #2812: [CARBONDATA-3004][32k] Fix bugs in writing da...

2018-10-12 Thread xuchuanyin
GitHub user xuchuanyin opened a pull request: https://github.com/apache/carbondata/pull/2812 [CARBONDATA-3004][32k] Fix bugs in writing dataframe to carbon with longstring Currently while writing dataframe to carbon table, we need to parse the rows in dataframe. For string

[jira] [Created] (CARBONDATA-3004) Fix bug in writing dataframe to carbon table while the field order is different

2018-10-12 Thread xuchuanyin (JIRA)
xuchuanyin created CARBONDATA-3004: -- Summary: Fix bug in writing dataframe to carbon table while the field order is different Key: CARBONDATA-3004 URL: https://issues.apache.org/jira/browse/CARBONDATA-3004

[GitHub] carbondata issue #2730: [WIP] Performance improvements for Fileformat and Pr...

2018-10-12 Thread QiangCai
Github user QiangCai commented on the issue: https://github.com/apache/carbondata/pull/2730 @ravipesala can you describe the modification? ---

[GitHub] carbondata issue #2729: [WIP]Store optimization

2018-10-12 Thread QiangCai
Github user QiangCai commented on the issue: https://github.com/apache/carbondata/pull/2729 @kumarvishal09 can you describe the modification? ---

[jira] [Updated] (CARBONDATA-2596) Support updating/deleting data on stream table

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2596: Fix Version/s: (was: 1.5.0) > Support updating/deleting data on stream

[jira] [Updated] (CARBONDATA-3003) Suppor read batch row in CSDK

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-3003: Fix Version/s: (was: 1.5.0) > Suppor read batch row in CSDK >

[jira] [Updated] (CARBONDATA-3000) Provide C++ interface for writing carbon data

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-3000: Fix Version/s: (was: 1.5.0) > Provide C++ interface for writing carbon

[jira] [Updated] (CARBONDATA-2997) Support read schema from index file and data file in CSDK

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2997: Fix Version/s: (was: 1.5.0) > Support read schema from index file and

[jira] [Updated] (CARBONDATA-3002) Fix some spell error and remove the data after test case finished running

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-3002: Fix Version/s: (was: 1.5.0) > Fix some spell error and remove the data

[jira] [Updated] (CARBONDATA-2999) support read schema from S3

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2999: Fix Version/s: (was: 1.5.0) > support read schema from S3 >

[jira] [Updated] (CARBONDATA-2996) readSchemaInIndexFile can't read schema by folder path

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2996: Fix Version/s: (was: 1.5.0) > readSchemaInIndexFile can't read schema by

[jira] [Updated] (CARBONDATA-2981) Support read primitive data type in CSDK

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2981: Fix Version/s: (was: 1.5.0) NONE > Support read

[jira] [Updated] (CARBONDATA-2939) New interface can' t compatibility with old SDK version

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2939: Fix Version/s: (was: 1.5.0) > New interface can' t compatibility with old

[jira] [Resolved] (CARBONDATA-2903) Fix compiler warnings

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2903. - Resolution: Fixed Fix Version/s: (was: 1.4.2) > Fix compiler

[jira] [Updated] (CARBONDATA-2934) Compaction from NO_SORT to other sort scope

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2934: Fix Version/s: (was: 1.5.0) > Compaction from NO_SORT to other sort scope

[jira] [Resolved] (CARBONDATA-2711) carbonFileList is not initalized when updatetablelist call

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2711. - Resolution: Fixed > carbonFileList is not initalized when updatetablelist

[jira] [Updated] (CARBONDATA-2951) CSDK: Provide C++ interface for SDK

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2951: Fix Version/s: (was: 1.5.0) NONE > CSDK: Provide C++

[jira] [Resolved] (CARBONDATA-2945) Support JSON record in StreamSQL

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2945. - Resolution: Fixed > Support JSON record in StreamSQL >

[jira] [Resolved] (CARBONDATA-2919) StreamSQL support ingest from Kafka

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala resolved CARBONDATA-2919. - Resolution: Fixed > StreamSQL support ingest from Kafka >

[jira] [Updated] (CARBONDATA-2919) StreamSQL support ingest from Kafka

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2919: Fix Version/s: 1.5.0 > StreamSQL support ingest from Kafka >

[jira] [Updated] (CARBONDATA-2688) CarbonStore Java API and REST API

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2688: Fix Version/s: (was: 1.5.0) > CarbonStore Java API and REST API >

[jira] [Updated] (CARBONDATA-2752) Carbon provide Zeppelin support

2018-10-12 Thread Ravindra Pesala (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravindra Pesala updated CARBONDATA-2752: Fix Version/s: (was: 1.5.0) > Carbon provide Zeppelin support >