[GitHub] carbondata issue #1841: [CARBONDATA-2062] Configure the temp directory to be...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1841 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3027/ ---

[GitHub] carbondata pull request #1842: [CARBONDATA-1945] updated bad records handlin...

2018-01-21 Thread vandana7
GitHub user vandana7 opened a pull request: https://github.com/apache/carbondata/pull/1842 [CARBONDATA-1945] updated bad records handling for its default value You can merge this pull request into a Git repository by running: $ git pull

[GitHub] carbondata issue #1793: [CARBONDATA-2021]fix clean up issue when update oper...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1793 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3025/ ---

[GitHub] carbondata issue #1838: [CARBONDATA-2060]fix insert overwrite on partition t...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1838 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1795/ ---

[GitHub] carbondata issue #1838: [CARBONDATA-2060]fix insert overwrite on partition t...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1838 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3026/ ---

[GitHub] carbondata issue #1793: [CARBONDATA-2021]fix clean up issue when update oper...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1793 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1794/ ---

[GitHub] carbondata issue #1793: [CARBONDATA-2021]fix clean up issue when update oper...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1793 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3025/ ---

[GitHub] carbondata pull request #1841: [CARBONDATA-2062] Configure the temp director...

2018-01-21 Thread sraghunandan
GitHub user sraghunandan opened a pull request: https://github.com/apache/carbondata/pull/1841 [CARBONDATA-2062] Configure the temp directory to be used for streaming handoff Be sure to do all of the following checklist to help us incorporate your contribution quickly and

[jira] [Updated] (CARBONDATA-2062) Streaming is not setting the temp location to be used during handoff

2018-01-21 Thread Raghunandan (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-2062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghunandan updated CARBONDATA-2062: Attachment: store.png > Streaming is not setting the temp location to be used during

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1840 @QiangCai @jackylk @chenliang613 please review again, thanks. ---

[jira] [Created] (CARBONDATA-2062) Streaming is not setting the temp location to be used during handoff

2018-01-21 Thread Raghunandan (JIRA)
Raghunandan created CARBONDATA-2062: --- Summary: Streaming is not setting the temp location to be used during handoff Key: CARBONDATA-2062 URL: https://issues.apache.org/jira/browse/CARBONDATA-2062

[jira] [Resolved] (CARBONDATA-1962) Support alter table add columns/drop columns on S3 table

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeeta Gulia resolved CARBONDATA-1962. Resolution: Implemented > Support alter table add columns/drop columns on S3

[jira] [Resolved] (CARBONDATA-1963) Support S3 table with dictionary

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeeta Gulia resolved CARBONDATA-1963. Resolution: Implemented > Support S3 table with dictionary >

[jira] [Resolved] (CARBONDATA-1960) Add example for creating a local table and load CSV data which is stored in S3.

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeeta Gulia resolved CARBONDATA-1960. Resolution: Implemented Fix Version/s: 1.4.0 > Add example for creating

[jira] [Resolved] (CARBONDATA-1961) Support data update/delete on S3 table

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeeta Gulia resolved CARBONDATA-1961. Resolution: Implemented Fix Version/s: 1.4.0 > Support data

[jira] [Resolved] (CARBONDATA-1959) Support compaction on S3 table

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeeta Gulia resolved CARBONDATA-1959. Resolution: Fixed Fix Version/s: 1.4.0 > Support compaction on S3 table

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1840 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3024/ ---

[jira] [Resolved] (CARBONDATA-1827) Add Support to provide S3 Functionality in Carbondata

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangeeta Gulia resolved CARBONDATA-1827. Resolution: Fixed Fix Version/s: 1.4.0 > Add Support to provide S3

[jira] [Commented] (CARBONDATA-1827) Add Support to provide S3 Functionality in Carbondata

2018-01-21 Thread Sangeeta Gulia (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333924#comment-16333924 ] Sangeeta Gulia commented on CARBONDATA-1827: Github PR 1805 completes all the listed

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3024/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1793/ ---

[GitHub] carbondata issue #1793: [CARBONDATA-2021]fix clean up issue when update oper...

2018-01-21 Thread akashrn5
Github user akashrn5 commented on the issue: https://github.com/apache/carbondata/pull/1793 retest sdv please ---

[GitHub] carbondata issue #1793: [CARBONDATA-2021]fix clean up issue when update oper...

2018-01-21 Thread akashrn5
Github user akashrn5 commented on the issue: https://github.com/apache/carbondata/pull/1793 retest this please ---

[jira] [Commented] (CARBONDATA-1989) Drop partition is dropping table data

2018-01-21 Thread Geetika Gupta (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16333915#comment-16333915 ] Geetika Gupta commented on CARBONDATA-1989: --- The behaviour is same as hive as DROP

[jira] [Closed] (CARBONDATA-1989) Drop partition is dropping table data

2018-01-21 Thread Geetika Gupta (JIRA)
[ https://issues.apache.org/jira/browse/CARBONDATA-1989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geetika Gupta closed CARBONDATA-1989. - Resolution: Fixed > Drop partition is dropping table data >

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1840 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3023/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1840 retest this please ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1792/ ---

[jira] [Created] (CARBONDATA-2061) Check for only valid IN_PROGRESS segments

2018-01-21 Thread dhatchayani (JIRA)
dhatchayani created CARBONDATA-2061: --- Summary: Check for only valid IN_PROGRESS segments Key: CARBONDATA-2061 URL: https://issues.apache.org/jira/browse/CARBONDATA-2061 Project: CarbonData

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
Github user zzcclp commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162852531 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
Github user zzcclp commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162851674 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
Github user zzcclp commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162851688 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
Github user zzcclp commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162851669 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
Github user zzcclp commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162841758 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162841010 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162840232 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162840147 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
Github user zzcclp commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162839907 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread chenliang613
Github user chenliang613 commented on a diff in the pull request: https://github.com/apache/carbondata/pull/1840#discussion_r162838020 --- Diff: examples/spark2/src/main/scala/org/apache/carbondata/examples/DStreamWithBatchTableExample.scala --- @@ -0,0 +1,228 @@ +/* + *

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1790/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3021/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1840 retest this please ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3020/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1789/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1840 retest this please. ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1788/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3019/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1840 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3022/ ---

[GitHub] carbondata issue #1806: modify default config: change the default of tempCSV...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1806 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3021/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1787/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3018/ ---

[GitHub] carbondata issue #1838: [CARBONDATA-2060]fix insert overwrite on partition t...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1838 Build Success with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3017/ ---

[GitHub] carbondata issue #1838: [CARBONDATA-2060]fix insert overwrite on partition t...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1838 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1786/ ---

[GitHub] carbondata issue #1838: [CARBONDATA-2060]fix insert overwrite on partition t...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1838 SDV Build Success , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3020/ ---

[GitHub] carbondata issue #1806: modify default config: change the default of tempCSV...

2018-01-21 Thread jackylk
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/1806 retest sdv please ---

[GitHub] carbondata issue #1806: modify default config: change the default of tempCSV...

2018-01-21 Thread jackylk
Github user jackylk commented on the issue: https://github.com/apache/carbondata/pull/1806 LGTM ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1840 retest this please ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Success with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1785/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3016/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1840 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3019/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1784/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1840 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3018/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.1.0, Please check CI http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/3014/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread CarbonDataQA
Github user CarbonDataQA commented on the issue: https://github.com/apache/carbondata/pull/1840 Build Failed with Spark 2.2.1, Please check CI http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/1783/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread ravipesala
Github user ravipesala commented on the issue: https://github.com/apache/carbondata/pull/1840 SDV Build Fail , Please check CI http://144.76.159.231:8080/job/ApacheSDVTests/3017/ ---

[GitHub] carbondata issue #1840: [CARBONDATA-2054]Add an example: how to use CarbonDa...

2018-01-21 Thread zzcclp
Github user zzcclp commented on the issue: https://github.com/apache/carbondata/pull/1840 @QiangCai @jackylk @chenliang613 please review, thanks. ---

[GitHub] carbondata pull request #1840: [CARBONDATA-2054]Add an example: how to use C...

2018-01-21 Thread zzcclp
GitHub user zzcclp opened a pull request: https://github.com/apache/carbondata/pull/1840 [CARBONDATA-2054]Add an example: how to use CarbonData batch load to integrate with Spark Streaming. This example introduces how to use CarbonData batch load to integrate with Spark Streaming: