[jira] [Updated] (CARBONDATA-2) Remove kettle for loading data

2016-11-02 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-2: --- Labels: features (was: ) Component/s: data-load > Remove kettle for loading data > ---

[jira] [Updated] (CARBONDATA-430) Carbon data tpch benchmark

2016-11-21 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-430: - Issue Type: Improvement (was: Task) > Carbon data tpch benchmark > --

[jira] [Commented] (CARBONDATA-458) Improving carbon first time query performance

2016-11-28 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15703060#comment-15703060 ] Jihong MA commented on CARBONDATA-458: -- this work will contain materializing all

[jira] [Updated] (CARBONDATA-535) Enable Date and Char datatype support for Carbondata

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-535: - Description: Add Date and Char datatype support for Carbondata (was: carbondata should suppor

[jira] [Updated] (CARBONDATA-322) Integration with spark 2.x

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-322: - Description: Since spark 2.0 released. there are many nice features such as more efficient pa

[jira] [Updated] (CARBONDATA-322) Integration with spark 2.x

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-322: - Issue Type: New Feature (was: Improvement) > Integration with spark 2.x > -

[jira] [Updated] (CARBONDATA-536) Initialize GlobalDictionaryUtil.updateTableMetadataFunc for Spark 2.x

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-536: - Description: GlobalDictionaryUtil.updateTableMetadataFunc needs to be initialized. (was: For

[jira] [Updated] (CARBONDATA-531) Eliminate spark dependency in carbon core

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-531: - Description: Clean up the interface and take out Spark dependency on Carbon-core module. (was

[jira] [Updated] (CARBONDATA-527) Greater than/less-than/Like filters optimization for dictionary encoded columns

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-527: - Issue Type: New Feature (was: Improvement) Summary: Greater than/less-than/Like filters

[jira] [Updated] (CARBONDATA-522) New data loading flowcauses testcase failures like big decimal etc

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-522: - Description: Pls check http://136.243.101.176:8080/job/ApacheCarbonPRBuilder/105/. new data f

[jira] [Updated] (CARBONDATA-519) Enable vector reader in Carbon-Spark 2.0 integration and Carbon layer

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-519: - Description: Spark 2.0 supports vectorized reader and uses whole codegen to improve performanc

[jira] [Updated] (CARBONDATA-516) [SPARK2]update union issue in CarbonLateDecoderRule for Spark 2.x integration

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-516: - Description: In spark2, Union class is no longer sub-class of BinaryNode. (was: In spark2, U

[jira] [Updated] (CARBONDATA-495) Unify compressor interface

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-495: - Description: Use compressor factory to unify the interface and eliminate small objects (was:

[jira] [Updated] (CARBONDATA-493) Insert into select from a empty table cause exception

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-493: - Summary: Insert into select from a empty table cause exception (was: Insertinto sql can not s

[jira] [Updated] (CARBONDATA-484) Implement LRU cache for B-Tree

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-484: - Description: LRU Cache for B-Tree is proposed to ensure to avoid out memory, when too many n

[jira] [Updated] (CARBONDATA-478) Separate SparkRowReadSupportImpl implementation for integrating with Spark1.x vs. Spark 2.x

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-478: - Issue Type: New Feature (was: Bug) Summary: Separate SparkRowReadSupportImpl implementa

[jira] [Updated] (CARBONDATA-469) Leveraging Carbondata's bucketing info for optimized Join operation

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-469: - Description: Optimize join in spark using bucketing information to avoid shuffling when possib

[jira] [Updated] (CARBONDATA-467) CREATE TABLE extension to support bucket table.

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-467: - Description: 1. CREATE TABLE Statement extension. {code} CREATE TABLE test(user_id BIGINT, fir

[jira] [Updated] (CARBONDATA-464) Big GC occurs frequently when Carbon's blocklet size is enlarged from the default

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-464: - Description: parquet might fetch from i/o 1 million(a row group) at one time, its data is div

[jira] [Updated] (CARBONDATA-443) Enable non-sort data loading

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-443: - Description: Improving data ingestion rate for fast ingestion for special use cases with pote

[jira] [Updated] (CARBONDATA-442) Query result mismatching with Hive

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-442: - Summary: Query result mismatching with Hive (was: SELECT querry result mismatched with hive r

[jira] [Updated] (CARBONDATA-430) Optimizations for TPC-H benchmark

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-430: - Summary: Optimizations for TPC-H benchmark (was: Carbon data tpch benchmark) > Optimizations

[jira] [Updated] (CARBONDATA-431) Improve compression ratio for numeric datatype

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-431: - Description: Carbon has better compression ratio for String type, but worst for numeric data

[jira] [Updated] (CARBONDATA-429) Eliminate unnecessary file name check in dictionary cache

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-429: - Description: 1.there are currently many file name check for each column's dictionary cache, w

[jira] [Updated] (CARBONDATA-432) Feed Carbon task‘s input size to Spark

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-432: - Description: Currently, the input size of task/stage couldn't be displayed properly in the spa

[jira] [Updated] (CARBONDATA-433) Respect to blocklet size setting when scanning Carbondata files

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-433: - Description: Currently, the blocklet size is configed through carbon.blocklet.size in carbon.

[jira] [Updated] (CARBONDATA-436) Make blocklet size configuration respect to the actual size (in terms of byte) of the blocklet

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-436: - Description: Currently, the blocklet size is based on the row counts within the blocklet. The

[jira] [Updated] (CARBONDATA-437) Optimizing collectData in ScannedResultCollector

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-437: - Description: row assembly speed is slow compared to other columnar file format after file scan

[jira] [Updated] (CARBONDATA-464) Frequent GC incurs when Carbon's blocklet size is enlarged from the default

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-464: - Description: other columnar file format fetch 1 million(a row group) at a time, its data is d

[jira] [Updated] (CARBONDATA-516) [SPARK2]update union class in CarbonLateDecoderRule for Spark 2.x integration

2016-12-15 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-516: - Summary: [SPARK2]update union class in CarbonLateDecoderRule for Spark 2.x integration (was:

[jira] [Created] (CARBONDATA-548) Miscellaneous code improvements

2016-12-21 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-548: Summary: Miscellaneous code improvements Key: CARBONDATA-548 URL: https://issues.apache.org/jira/browse/CARBONDATA-548 Project: CarbonData Issue Type: Improv

[jira] [Created] (CARBONDATA-549) code improvement for bigint compression

2016-12-21 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-549: Summary: code improvement for bigint compression Key: CARBONDATA-549 URL: https://issues.apache.org/jira/browse/CARBONDATA-549 Project: CarbonData Issue Type

[jira] [Created] (CARBONDATA-550) Add unit test cases for Bigint, Big decimal value compression

2016-12-21 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-550: Summary: Add unit test cases for Bigint, Big decimal value compression Key: CARBONDATA-550 URL: https://issues.apache.org/jira/browse/CARBONDATA-550 Project: CarbonDa

[jira] [Created] (CARBONDATA-588) cleanup WriterCompressModel

2017-01-03 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-588: Summary: cleanup WriterCompressModel Key: CARBONDATA-588 URL: https://issues.apache.org/jira/browse/CARBONDATA-588 Project: CarbonData Issue Type: Improvemen

[jira] [Updated] (CARBONDATA-588) cleanup WriterCompressModel

2017-01-03 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-588: - Issue Type: Sub-task (was: Improvement) Parent: CARBONDATA-548 > cleanup WriterCompre

[jira] [Updated] (CARBONDATA-607) Cleanup ValueCompressionHolder class and all sub-classes

2017-01-07 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-607: - Issue Type: Sub-task (was: Improvement) Parent: CARBONDATA-548 > Cleanup ValueCompres

[jira] [Created] (CARBONDATA-607) Cleanup ValueCompressionHolder class and all sub-classes

2017-01-07 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-607: Summary: Cleanup ValueCompressionHolder class and all sub-classes Key: CARBONDATA-607 URL: https://issues.apache.org/jira/browse/CARBONDATA-607 Project: CarbonData

[jira] [Updated] (CARBONDATA-607) Cleanup ValueCompressionHolder class and all sub-classes

2017-01-07 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-607: - Description: Rewrite ValueCompressionHolder class as a base class for compressing or uncompre

[jira] [Created] (CARBONDATA-661) misc cleanup in carbon core

2017-01-18 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-661: Summary: misc cleanup in carbon core Key: CARBONDATA-661 URL: https://issues.apache.org/jira/browse/CARBONDATA-661 Project: CarbonData Issue Type: Improvemen

[jira] [Updated] (CARBONDATA-661) misc cleanup in carbon core

2017-01-18 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-661: - Issue Type: Sub-task (was: Improvement) Parent: CARBONDATA-548 > misc cleanup in carb

[jira] [Assigned] (CARBONDATA-661) misc cleanup in carbon core

2017-01-18 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA reassigned CARBONDATA-661: Assignee: Jihong MA > misc cleanup in carbon core > --- > >

[jira] [Created] (CARBONDATA-681) CSVReader related code improvement

2017-01-25 Thread Jihong MA (JIRA)
Jihong MA created CARBONDATA-681: Summary: CSVReader related code improvement Key: CARBONDATA-681 URL: https://issues.apache.org/jira/browse/CARBONDATA-681 Project: CarbonData Issue Type: Imp

[jira] [Updated] (CARBONDATA-681) CSVReader related code improvement

2017-01-25 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-681: - Issue Type: Sub-task (was: Improvement) Parent: CARBONDATA-548 > CSVReader related co

[jira] [Updated] (CARBONDATA-681) CSVReader related code improvement

2017-01-25 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated CARBONDATA-681: - Description: refactoring csv reader support during data loading, as well as replacing relevant