Re: [Discussion]support user specified segments in major compation

2017-11-20 Thread Liang Chen
Hi Jin Zhou OK, Thanks for your proposal. can you raise one PRs to support the two features? Regards Liang Jin Zhou wrote > @Liang Chen, thank you for your reply. > > > After seriously thinking about your suggestion, I also think the two > problems should be considered separately. > For

Re: [Discussion]support user specified segments in major compation

2017-10-30 Thread Jin Zhou
@Liang Chen, thank you for your reply. After seriously thinking about your suggestion, I also think the two problems should be considered separately. For problem 2, User specified compaction segments is not a good solution indeed. I am glad to do some work for this. For problem 1, I agree with

Re: [Discussion]support user specified segments in major compation

2017-10-26 Thread Liang Chen
Hi Jin Zhou Thanks for starting this discussion. 1. For your first proposal : Currently , segment is the system internal concept, not expose to outside. Can you provide what exact problems do you encounter? we can find the alternative solution for your problems.

Re: [Discussion]support user specified segments in major compation

2017-10-23 Thread xm_zzc
+1, sounds good about this feature. -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/

[Discussion]support user specified segments in major compation

2017-10-23 Thread Jin Zhou
Hi community, Carbondata currently support two types of compaction: Minor and Major compaction. CarbonData will do major compaction according to the user defined segment size. But which segments to be merged are transparent to users. We plan to extend major compaction to support user specified