[GitHub] carbondata pull request #2906: [CARBONDATA-3088][Compaction] support prefetc...

2018-11-07 Thread Sssan520
Github user Sssan520 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2906#discussion_r231738236 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/iterator/RawResultIterator.java --- @@ -40,103 +49,150 @@ */

[GitHub] carbondata pull request #2906: [CARBONDATA-3088][Compaction] support prefetc...

2018-11-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2906#discussion_r231755219 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/iterator/RawResultIterator.java --- @@ -40,103 +49,150 @@ */

[GitHub] carbondata pull request #2907: [CARBONDATA-3031] refining usage of numberofc...

2018-11-07 Thread Sssan520
GitHub user Sssan520 opened a pull request: https://github.com/apache/carbondata/pull/2907 [CARBONDATA-3031] refining usage of numberofcores in CarbonProperties **1**. many places use the function 'getNumOfCores' of CarbonProperties which returns **the loading cores.** **2**.

[GitHub] carbondata issue #2907: [CARBONDATA-3031] refining usage of numberofcores in...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2907 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1327/ ---

[GitHub] carbondata issue #2907: [CARBONDATA-3031] refining usage of numberofcores in...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2907 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1538/ ---

[GitHub] carbondata issue #2907: [CARBONDATA-3031] refining usage of numberofcores in...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2907 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9586/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1328/ ---

[GitHub] carbondata pull request #2907: [CARBONDATA-3031] refining usage of numberofc...

2018-11-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2907#discussion_r231778046 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java --- @@ -951,27 +951,46 @@ public void print() { return

[GitHub] carbondata pull request #2907: [CARBONDATA-3031] refining usage of numberofc...

2018-11-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2907#discussion_r231777987 --- Diff: core/src/main/java/org/apache/carbondata/core/util/CarbonProperties.java --- @@ -951,27 +951,46 @@ public void print() { return

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1539/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9587/ ---

[jira] [Created] (CARBONDATA-3088) enhance compaction performance by using prefetch

2018-11-07 Thread xuchuanyin (JIRA)
xuchuanyin created CARBONDATA-3088: -- Summary: enhance compaction performance by using prefetch Key: CARBONDATA-3088 URL: https://issues.apache.org/jira/browse/CARBONDATA-3088 Project: CarbonData

[GitHub] carbondata pull request #2906: [CARBONDATA-3088][Compaction] support prefetc...

2018-11-07 Thread xuchuanyin
GitHub user xuchuanyin opened a pull request: https://github.com/apache/carbondata/pull/2906 [CARBONDATA-3088][Compaction] support prefetch for compaction Current compaction performance is low. By adding logs to observe the compaction procedure, we found that in

[jira] [Updated] (CARBONDATA-3088) enhance compaction performance by using prefetch

2018-11-07 Thread xuchuanyin (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuchuanyin updated CARBONDATA-3088: --- Issue Type: Improvement (was: Bug) > enhance compaction performance by using prefetch

[jira] [Created] (CARBONDATA-3087) Prettify DESC FORMATTED output

2018-11-07 Thread Jacky Li (JIRA)
Jacky Li created CARBONDATA-3087: Summary: Prettify DESC FORMATTED output Key: CARBONDATA-3087 URL: https://issues.apache.org/jira/browse/CARBONDATA-3087 Project: CarbonData Issue Type:

[GitHub] carbondata issue #2885: [CARBONDATA-3064] Support separate audit log

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2885 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9583/ ---

[GitHub] carbondata issue #2885: [CARBONDATA-3064] Support separate audit log

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2885 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1535/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Failed with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1536/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread xuchuanyin
Github user xuchuanyin commented on the issue: https://github.com/apache/carbondata/pull/2906 Please note that this PR is nearly the modification from PR #2133 plus that we meld the `convertRow` step to the backup buffer procedure. ---

[GitHub] carbondata pull request #2906: [CARBONDATA-3088][Compaction] support prefetc...

2018-11-07 Thread xuchuanyin
Github user xuchuanyin commented on a diff in the pull request: https://github.com/apache/carbondata/pull/2906#discussion_r231492037 --- Diff: core/src/main/java/org/apache/carbondata/core/scan/result/iterator/RawResultIterator.java --- @@ -40,103 +49,150 @@ */

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1325/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Failed with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9584/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.2.1, Please check CI http://95.216.28.178:8080/job/ApacheCarbonPRBuilder1/1537/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.3.1, Please check CI http://136.243.101.176:8080/job/carbondataprbuilder2.3/9585/ ---

[GitHub] carbondata issue #2906: [CARBONDATA-3088][Compaction] support prefetch for c...

2018-11-07 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/2906 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder2.1/1326/ ---