[jira] [Created] (CARBONDATA-4066) data mismatch observed with SI and without SI when SI global sort and SI segment merge is true

[Mahesh Raju Somalaraju (Jira)]

Mahesh Raju Somalaraju created CARBONDATA-4066:
--------------------------------------------------

             Summary: data mismatch observed with SI and without SI when SI 
global sort and SI segment merge is true
                 Key: CARBONDATA-4066
                 URL: https://issues.apache.org/jira/browse/CARBONDATA-4066
             Project: CarbonData
          Issue Type: Bug
            Reporter: Mahesh Raju Somalaraju


data mismatch observed with SI and without SI when SI global sort and SI 
segment merge is true

 

test case for reproduce the issue:

CarbonProperties.getInstance()
 .addProperty(CarbonCommonConstants.CARBON_SI_SEGMENT_MERGE, "true")
sql("create table complextable2 (id int, name string, country array<string>) 
stored as " +
 "carbondata tblproperties('sort_scope'='global_sort','sort_columns'='name')")
sql(
 s"load data inpath '$resourcesPath/secindex/array.csv' into table 
complextable2 options('delimiter'=','," +
 
"'quotechar'='\"','fileheader'='id,name,country','complex_delimiter_level_1'='$',"
 +
 "'global_sort_partitions'='10')")
val result = sql(" select * from complextable2 where 
array_contains(country,'china')")
sql("create index index_2 on table complextable2(country) as 'carbondata' 
properties" +
 "('sort_scope'='global_sort')")
checkAnswer(sql("select count(*) from complextable2 where 
array_contains(country,'china')"),
 sql("select count(*) from complextable2 where 
ni(array_contains(country,'china'))"))



--
This message was sent by Atlassian Jira
(v8.3.4#803005)