Re: [discuss]CarbonData update operation enhance

2020-09-22 Thread David CaiQiang
hi Linwood, 1. better to implement "Update feature enhancement" at first, it will create a new segment to store new files. http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Discussion-Update-feature-enhancement-td99769.html 2. clean deletedelta files now carbon need

Re: Regarding Carbondata Benchmarking & Feature presentation

2020-09-22 Thread Liang Chen
Hi Great. Happy to see more and more companies use Apache CarbonData. Regards Liang Vimal Das Kammath wrote > Hi Carbondata Team, > > I am working on proposing Carbondata to the Data Analytics team in Uber. > It > will be great if any of you can share the latest benchmarking and > feature/des

Re: [discuss]CarbonData update operation enhance

2020-09-22 Thread Liang Chen
Hi Thank you started this discussion. This proposal is for improving data updation performance, right ? Regards Liang Linwood wrote > *[Background]* > Update operation will clean up delta files before update( see > cleanUpDeltaFiles(carbonTable, false)), It's loop traversal metadata path > and