[GitHub] carbondata issue #1639: [CARBONDATA-1881] Insert overwrite value for pre-agg...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1639
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1862/



---

[GitHub] carbondata issue #1639: [CARBONDATA-1881] Insert overwrite value for pre-agg...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1639
  
Build Success with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/633/



---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1861/



---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
Build Failed with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/632/



---

[GitHub] carbondata issue #1639: [CARBONDATA-1881] Insert overwrite value for pre-agg...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1639
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1860/



---

[GitHub] carbondata issue #1639: [CARBONDATA-1881] Insert overwrite value for pre-agg...

[kunal642]

Github user kunal642 commented on the issue:

https://github.com/apache/carbondata/pull/1639
  
Retest this please


---

[GitHub] carbondata issue #1639: [CARBONDATA-1881] Insert overwrite value for pre-agg...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1639
  
Build Failed with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/631/



---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1859/



---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
Build Success with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/630/



---

[GitHub] carbondata pull request #1639: [CARBONDATA-1881] Insert overwrite value for ...

[kunal642]

GitHub user kunal642 opened a pull request:

https://github.com/apache/carbondata/pull/1639

[CARBONDATA-1881] Insert overwrite value for pre-aggregate load was 
incorrect

Analysis: while loading the value for insert overwrite was set to false.

Solution: Consider the value of insert overwrite set for maintable for 
pre-aggregate table loading.

Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [X] Any interfaces changed?
 no
 - [X] Any backward compatibility impacted?
 no
 - [X] Document update required?
no
 - [X] Testing done
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance 
test report.
- Any additional information to help reviewers in testing this 
change.
   
 - [X] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kunal642/carbondata insert_overwrite_fix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1639.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1639


commit dc077a7b611dad09de2ea8bbb3efcfd8efba6348
Author: kunal642 
Date:   2017-12-11T05:50:43Z

insert overwrite value for pre-aggregate load was incorrect




---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[rahulforallp]

Github user rahulforallp commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
retest this please


---

[GitHub] carbondata issue #1630: [CARBONDATA-1826] Carbon 1.3.0 - Spark 2.2: Describe...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1630
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1858/



---

[jira] [Created] (CARBONDATA-1881) insert overwrite not working properly for pre-aggregate tables

[Kunal Kapoor (JIRA)]

Kunal Kapoor created CARBONDATA-1881:


 Summary: insert overwrite not working properly for pre-aggregate 
tables
 Key: CARBONDATA-1881
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1881
 Project: CarbonData
  Issue Type: Bug
Reporter: Kunal Kapoor
Assignee: Kunal Kapoor
Priority: Minor


when insert overwrite if fired on the main table then the pre-aggregate tables 
are not overwritten with the new values instead the values are appended to the 
table like a normal insert



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1630: [CARBONDATA-1826] Carbon 1.3.0 - Spark 2.2: Describe...

[dhatchayani]

Github user dhatchayani commented on the issue:

https://github.com/apache/carbondata/pull/1630
  
retest this please


---

[GitHub] carbondata issue #1630: [CARBONDATA-1826] Carbon 1.3.0 - Spark 2.2: Describe...

[dhatchayani]

Github user dhatchayani commented on the issue:

https://github.com/apache/carbondata/pull/1630
  
retest this please


---

[GitHub] carbondata pull request #1616: [CARBONDATA-1851] Code refactored for better ...

[rahulforallp]

GitHub user rahulforallp reopened a pull request:

https://github.com/apache/carbondata/pull/1616

[CARBONDATA-1851] Code refactored for better usablity to external system

Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [X] Any interfaces changed? **user interface is not changed.**
 
 - [X] Any backward compatibility impacted? **No**
 
 - [X] Document update required? **No**

 - [X] Testing done
This PR contains **refactored code**  . So no new test-case 
required.
   Only UT, FT and SDV test success report required from CI is 
sufficient.

 - [X] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 




You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rahulforallp/incubator-carbondata 
code_refactor

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1616.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1616


commit 98256151b1dae6071332007ee5c60f51702accf2
Author: rahulforallp 
Date:   2017-12-05T14:18:38Z

Code refactored




---

[GitHub] carbondata pull request #1616: [CARBONDATA-1851] Code refactored for better ...

[rahulforallp]

Github user rahulforallp closed the pull request at:

https://github.com/apache/carbondata/pull/1616


---

[GitHub] carbondata issue #1631: [CARBONDATA-1872][API] Clean up unused constant in C...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1631
  
Build Success with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/628/



---

[GitHub] carbondata issue #1631: [CARBONDATA-1872][API] Clean up unused constant in C...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1631
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1856/



---

[GitHub] carbondata issue #1631: [CARBONDATA-1872][API] Clean up unused constant in C...

[QiangCai]

Github user QiangCai commented on the issue:

https://github.com/apache/carbondata/pull/1631
  
retest this please


---

[jira] [Created] (CARBONDATA-1880) Global Sort maybe generates many small files

[QiangCai (JIRA)]

QiangCai created CARBONDATA-1880:


 Summary: Global Sort maybe generates many small files
 Key: CARBONDATA-1880
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1880
 Project: CarbonData
  Issue Type: Improvement
Reporter: QiangCai
Priority: Minor


Global Sort maybe generates many small files without option 
"carbon.load.global.sort.partitions", 
It makes the select query be slower, 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1637: [CARBONDATA-1876]clean all the InProgress segments f...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1637
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1855/



---

[GitHub] carbondata issue #1637: [CARBONDATA-1876]clean all the InProgress segments f...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1637
  
Build Success with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/627/



---

[GitHub] carbondata issue #1638: [CARBONDATA-1879] Support alter table to change the ...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1638
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1854/



---

[GitHub] carbondata issue #1638: [CARBONDATA-1879] Support alter table to change the ...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1638
  
Build Success with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/626/



---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1853/



---

[GitHub] carbondata issue #1616: [CARBONDATA-1851] Code refactored for better usablit...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1616
  
Build Failed with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/625/



---

[GitHub] carbondata issue #1627: [CARBONDATA-1759]make visibility of segments as fals...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1627
  
Build Success with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1852/



---

[GitHub] carbondata issue #1627: [CARBONDATA-1759]make visibility of segments as fals...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1627
  
Build Success with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/624/



---

[GitHub] carbondata issue #1637: [CARBONDATA-1876]clean all the InProgress segments f...

[akashrn5]

Github user akashrn5 commented on the issue:

https://github.com/apache/carbondata/pull/1637
  
retest this please


---

[GitHub] carbondata issue #1637: [CARBONDATA-1876]clean all the InProgress segments f...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1637
  
Build Failed  with Spark 2.1.0, Please check CI 
http://136.243.101.176:8080/job/ApacheCarbonPRBuilder1/1851/



---

[GitHub] carbondata issue #1637: [CARBONDATA-1876]clean all the InProgress segments f...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1637
  
Build Failed with Spark 2.2.0, Please check CI 
http://88.99.58.216:8080/job/ApacheCarbonPRBuilder/623/



---

[GitHub] carbondata pull request #1638: [CARBONDATA-1879] Support alter table to chan...

[QiangCai]

GitHub user QiangCai opened a pull request:

https://github.com/apache/carbondata/pull/1638

[CARBONDATA-1879] Support alter table to change the status of the streaming 
segment

Support new SQL command to change the status of the segment from 
"streaming" to "streaming finish":
Alter table  finish streaming

1. If streaming is running, the command will throw an exception.
2. If there isn't streaming segment, do nothing.

 - [x] Any interfaces changed?
 add new sql command:
  Alter table  finish streaming
 - [x] Any backward compatibility impacted?
  no
 - [x] Document update required?
  required
 - [x] Testing done
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
   added
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance 
test report.
- Any additional information to help reviewers in testing this 
change.
   
 - [x] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
  NA


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/QiangCai/carbondata finish_streaming

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1638.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1638


commit fc5318348dea70f57e967a9a38a8cd25c139b7f9
Author: QiangCai 
Date:   2017-12-10T13:01:56Z

alter table finish streaming




---

[GitHub] carbondata issue #1627: [CARBONDATA-1759]make visibility of segments as fals...

[akashrn5]

Github user akashrn5 commented on the issue:

https://github.com/apache/carbondata/pull/1627
  
retest this please


---

[GitHub] carbondata pull request #1637: [CARBONDATA-1876]clean all the InProgress seg...

[akashrn5]

GitHub user akashrn5 opened a pull request:

https://github.com/apache/carbondata/pull/1637

[CARBONDATA-1876]clean all the InProgress segments for all databases during 
session initialization

clean all the InProgress segments for all databases during session 
initialization

clean all the InProgress segments for all databases during session 
initialization. when carbon session initialize , clean all the in progress 
segments for all the databases created by user.


Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [X] Any interfaces changed?
 NA
 - [X] Any backward compatibility impacted?
 NA
 - [X] Document update required?
NA
 - [X] Testing done
local testing is done
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance 
test report.
- Any additional information to help reviewers in testing this 
change.
   
 - [X] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
NA


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/akashrn5/incubator-carbondata clean_progress

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1637.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1637


commit db891b8638fe56e8bfec4162d19a8d5b045d265f
Author: akashrn5 
Date:   2017-12-07T23:06:55Z

clean all the InProgress segments for all databases during session 
initialization




---

[jira] [Assigned] (CARBONDATA-1879) Support alter table to change the status of the streaming segment

[QiangCai (JIRA)]

 [ 
https://issues.apache.org/jira/browse/CARBONDATA-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

QiangCai reassigned CARBONDATA-1879:


Assignee: QiangCai

> Support alter table to change the status of the streaming segment
> -
>
> Key: CARBONDATA-1879
> URL: https://issues.apache.org/jira/browse/CARBONDATA-1879
> Project: CarbonData
>  Issue Type: Sub-task
>Reporter: QiangCai
>Assignee: QiangCai
>Priority: Minor
>
> Support alter table finish streaming:
> Alter table   finish streaming
> This command will try to change the status of the segment from "streaming" to 
> "streaming finish"



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (CARBONDATA-1879) Support alter table to change the status of the streaming segment

[QiangCai (JIRA)]

QiangCai created CARBONDATA-1879:


 Summary: Support alter table to change the status of the streaming 
segment
 Key: CARBONDATA-1879
 URL: https://issues.apache.org/jira/browse/CARBONDATA-1879
 Project: CarbonData
  Issue Type: Sub-task
Reporter: QiangCai
Priority: Minor


Support alter table finish streaming:
Alter table   finish streaming

This command will try to change the status of the segment from "streaming" to 
"streaming finish"




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] carbondata issue #1636: [CARBONDATA-1801] Remove unnecessary mdk computation...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1636
  
Can one of the admins verify this patch?


---

[GitHub] carbondata issue #1636: [CARBONDATA-1801] Remove unnecessary mdk computation...

[CarbonDataQA]

Github user CarbonDataQA commented on the issue:

https://github.com/apache/carbondata/pull/1636
  
Can one of the admins verify this patch?


---

[GitHub] carbondata pull request #1636: [CARBONDATA-1801] Remove unnecessary mdk comp...

[kevinjmh]

GitHub user kevinjmh opened a pull request:

https://github.com/apache/carbondata/pull/1636

[CARBONDATA-1801] Remove unnecessary mdk computation code

Be sure to do all of the following checklist to help us incorporate 
your contribution quickly and easily:

 - [No] Any interfaces changed?
 
 - [No ] Any backward compatibility impacted?
 
 - [ No] Document update required?

 - [ ] Testing done
Please provide details on 
- Whether new unit test cases have been added or why no new tests 
are required?
- How it is tested? Please attach test report.
- Is it a performance related change? Please attach the performance 
test report.
- Any additional information to help reviewers in testing this 
change.
   
 - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kevinjmh/carbondata master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/carbondata/pull/1636.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1636


commit e4e14d069590d116685b02aceaf3c2839ac3e66e
Author: Manhua 
Date:   2017-12-10T10:46:53Z

[CARBONDATA-1801] Remove unnecessary mdk computation code




---