kpurella commented on issue #2240:
URL: https://github.com/apache/hudi/issues/2240#issuecomment-729805782
1) I don't see much improvement by enabling hoodie. clean.async=true
2) Here is the hoodie partition :s3://mybucket/myapp/ouput/hudi-raw/default/
3) list of files under .hoodie
PRE .aux/
PRE .temp/
2020-11-10 22:33:34 0 .aux_$folder$
2020-11-10 22:33:34 0 .temp_$folder$
2020-11-10 22:45:43 4926823 20201110223331.deltacommit
2020-11-10 22:42:25 984 20201110223331.deltacommit.inflight
2020-11-10 22:35:24 0 20201110223331.deltacommit.requested
2020-11-10 23:17:20 5274215 20201110230257.deltacommit
2020-11-10 23:13:37 3916496 20201110230257.deltacommit.inflight
2020-11-10 23:04:45 0 20201110230257.deltacommit.requested
2020-11-10 23:22:47 5097604 20201110231726.commit
2020-11-10 23:17:34 0 20201110231726.compaction.inflight
2020-11-10 23:17:33 2218785 20201110231726.compaction.requested
2020-11-11 00:10:21 1786853 20201110233218.clean
2020-11-10 23:49:47 1659524 20201110233218.clean.inflight
2020-11-10 23:49:46 1659524 20201110233218.clean.requested
2020-11-10 23:46:54 5274215 20201110233218.deltacommit
2020-11-10 23:43:12 3916496 20201110233218.deltacommit.inflight
2020-11-10 23:33:50 0 20201110233218.deltacommit.requested
2020-11-10 23:49:36 5097604 20201110234700.commit
2020-11-10 23:47:10 0 20201110234700.compaction.inflight
2020-11-10 23:47:10 2224673 20201110234700.compaction.requested
2020-11-13 07:09:04 1798629 20201113063046.clean
2020-11-13 06:49:04 1665412 20201113063046.clean.inflight
2020-11-13 06:49:04 1665412 20201113063046.clean.requested
2020-11-13 06:46:19 5274215 20201113063046.deltacommit
2020-11-13 06:42:40 3916496 20201113063046.deltacommit.inflight
2020-11-13 06:32:14 0 20201113063046.deltacommit.requested
2020-11-13 06:48:56 5097604 20201113064625.commit
2020-11-13 06:46:35 0 20201113064625.compaction.inflight
2020-11-13 06:46:35 2224673 20201113064625.compaction.requested
2020-11-13 07:44:42 1798629 20201113071234.clean
2020-11-13 07:25:45 1665412 20201113071234.clean.inflight
2020-11-13 07:25:45 1665412 20201113071234.clean.requested
2020-11-13 07:23:04 5274215 20201113071234.deltacommit
2020-11-13 07:19:55 3916496 20201113071234.deltacommit.inflight
2020-11-13 07:14:16 0 20201113071234.deltacommit.requested
2020-11-13 07:25:37 5097604 20201113072312.commit
2020-11-13 07:23:22 0 20201113072312.compaction.inflight
2020-11-13 07:23:21 2224673 20201113072312.compaction.requested
2020-11-13 17:56:44 5274215 20201113174201.deltacommit
2020-11-13 17:52:57 3916496 20201113174201.deltacommit.inflight
2020-11-13 17:44:37 0 20201113174201.deltacommit.requested
2020-11-13 17:59:22 5097604 20201113175651.commit
2020-11-13 17:57:00 0 20201113175651.compaction.inflight
2020-11-13 17:56:59 2224673 20201113175651.compaction.requested
2020-11-13 18:35:38 1798629 20201113180714.clean
2020-11-13 18:09:46 1665412 20201113180714.clean.inflight
2020-11-13 18:09:45 1665412 20201113180714.clean.requested
2020-11-13 18:21:58 5274215 20201113180714.deltacommit
2020-11-13 18:17:48 3916496 20201113180714.deltacommit.inflight
2020-11-13 18:08:42 0 20201113180714.deltacommit.requested
2020-11-13 18:24:40 5097604 20201113182206.commit
2020-11-13 18:22:18 0 20201113182206.compaction.inflight
2020-11-13 18:22:17 2224673 20201113182206.compaction.requested
2020-11-17 16:49:44 1798629 20201117162434.clean
2020-11-17 16:26:53 1665412 20201117162434.clean.inflight
2020-11-17 16:26:52 1665412 20201117162434.clean.requested
2020-11-17 16:34:02 5274215 20201117162434.deltacommit
2020-11-17 16:30:26 3916496 20201117162434.deltacommit.inflight
2020-11-17 16:26:00 0 20201117162434.deltacommit.requested
2020-11-17 16:36:41 5097604 20201117163409.commit
2020-11-17 16:34:21 0 20201117163409.compaction.inflight
2020-11-17 16:34:20 2224673 20201117163409.compaction.requested
2020-11-10 22:33:34 0 archived_$folder$
2020-11-10 22:33:36 325 hoodie.properties
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
