nsivabalan edited a comment on issue #3499:
URL: https://github.com/apache/hudi/issues/3499#issuecomment-930269121
@codejoyan : whats the key generator you are using? Can you confirm you are
setting those params (key gen, record key, partition path) while setting these
clustering configs as well.
because, from stack trace this is what I see.
Since you don't set any value for
"hoodie.clustering.plan.strategy.sort.columns", we resot to using built in
BulkInsertSort mode. by default we do global sorting here depending on
(partition path, record key) pair.
We can try out one thing here. We can try to set no sorting mode and see
what happens.
"hoodie.bulkinsert.sort.mode" = "NONE"
Alternatively, can you give it a shot by setting
"hoodie.clustering.plan.strategy.sort.columns" to record key field may be. We
can also see how that pans out.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
