************************************************************************** a) First can you disable local dictionary and try the same scenario? I would test in other time
Good idea, and I think this works, when I use global dictionary, query can return right result. But the question is, global dictionary also introduce a bug in spark 2.3, which I described in another issue. http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/Issue-Dictionary-and-S3-td63106.html ************************************************************************** b) Can drop datamp and try the same scenario? -- If data is coming from data map (can see this in explain command) I have confirmed this, datamap is not the reason for this. because this can reproduce without datamap. ************************************************************************** c) Avoid compaction and try the same scenario. I've confirmed, if no compaction, query works well. ************************************************************************** d) If you can share, give me test data and complete steps. (Because compaction and other steps are not there in your previous mail) The data is kind of huge, the table holds on about 7T csv raw data. I have no good idea to give you test data:) -- Sent from: http://apache-carbondata-dev-mailing-list-archive.1130556.n5.nabble.com/
