Github user gvramana commented on the issue:
https://github.com/apache/carbondata/pull/1321
Unification for simplicity is ok. Ex: SORT_SCOPE provided in create table
is default SORT_SCOPE for that table.
However we have scenarios where SORT_SCOPE needs to be overridden in load
command for data load speed/streaming cases. So that compaction will bring back
the scope to table level default value.
Option 1:
We can decide if delete load time SORT_SCOPE and bring it back later when
it is fully supported.
Option 2:
Keep the syntax in data load as optional parameter and currently validate
to allow only Valid values.
like Data load level BATCH_SORT when table level BATCH_SORT or LOCAL_SORT
is valid, as current compaction can support this.
currently all other cases dataload level SORT_SCOPE should be same as table
level SORT_SCOPE.
---
