bvaradar commented on issue #1823:
URL: https://github.com/apache/hudi/issues/1823#issuecomment-657958175
@RajasekarSribalan : Compactions should be able to be triggered and
executed from CLI if there are delta files and configured correctly. Can you
post the logs from "compaction schedule" after you disabled inline compaction
and delta files got added. The only constraint is that when scheduling
compactions, ingestion should not be running.
If you are running structured streaming job, please try out the PR
suggested by @bhasudha which will execute compaction asynchronously. In batch
mode, You can also enable inline compaction and setting a proper value for
hoodie.compact.inline.max.delta.commits depending on how frequent you want to
run compactions.
Regarding (2) Compaction is only relevant for MOR tables. Compaction is the
process of taking the delta-files and creating columnar files. CopyOnWrite
tables are implicitly compacted.
Regarding the error related to kryoException, Are you still seeing the error
?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
