jai20242 commented on issue #11249:
URL: https://github.com/apache/hudi/issues/11249#issuecomment-2116857839
I tried it but it doesn't work:
**1) Connect**
hudi->connect --path /tmp/dep_hudi2
2024-05-17 08:34:09.024 INFO 3288 --- [ main]
o.a.h.c.t.HoodieTableMetaClient : Loading HoodieTableMetaClient from
/tmp/dep_hudi2
2024-05-17 08:34:09.212 WARN 3288 --- [ main]
o.a.h.u.NativeCodeLoader : Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
2024-05-17 08:34:09.626 WARN 3288 --- [ main] o.a.h.f.FileSystem
: Cannot load filesystem:
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider
com.google.cloud.hadoop.fs.gcs.GoogleHadoopFileSystem could not be instantiated
2024-05-17 08:34:09.626 WARN 3288 --- [ main] o.a.h.f.FileSystem
: java.lang.NoSuchMethodError:
com.google.common.base.Preconditions.checkState(ZLjava/lang/String;J)V
2024-05-17 08:34:09.938 INFO 3288 --- [ main]
o.a.h.c.t.HoodieTableConfig : Loading table properties from
/tmp/dep_hudi2/.hoodie/hoodie.properties
2024-05-17 08:34:09.949 INFO 3288 --- [ main]
o.a.h.c.t.HoodieTableMetaClient : Finished Loading Table of type
MERGE_ON_READ(version=1, baseFileFormat=PARQUET) from /tmp/dep_hudi2
Metadata for table prueba loaded
**2) Show commits**
hudi:prueba->commits show --sortBy "Total Bytes Written" --desc true --limit
10
2024-05-17 08:34:19.987 INFO 3288 --- [ main]
o.a.h.c.t.t.HoodieActiveTimeline : Loaded instants upto :
Option{val=[20240517082810322__deltacommit__COMPLETED__20240517083132000]}
╔═══════════════════╤═════════════════════╤═══════════════════╤═════════════════════╤══════════════════════════╤═══════════════════════╤══════════════════════════════╤══════════════╗
║ CommitTime │ Total Bytes Written │ Total Files Added │ Total Files
Updated │ Total Partitions Written │ Total Records Written │ Total Update
Records Written │ Total Errors ║
╠═══════════════════╪═════════════════════╪═══════════════════╪═════════════════════╪══════════════════════════╪═══════════════════════╪══════════════════════════════╪══════════════╣
║ 20240517082810322 │ 752,5 MB │ 0 │ 14
│ 7 │ 1435323 │ 1435323
│ 0 ║
╟───────────────────┼─────────────────────┼───────────────────┼─────────────────────┼──────────────────────────┼───────────────────────┼──────────────────────────────┼──────────────╢
║ 20240517082347494 │ 41,7 MB │ 14 │ 0
│ 7 │ 1435323 │ 0
│ 0 ║
╚═══════════════════╧═════════════════════╧═══════════════════╧═════════════════════╧══════════════════════════╧═══════════════════════╧══════════════════════════════╧══════════════╝
**3) Run compaction**
hudi:prueba->compaction run --tableName prueba
2024-05-17 08:34:24.542 INFO 3288 --- [ main]
o.a.h.c.t.t.HoodieActiveTimeline : Loaded instants upto :
Option{val=[20240517082810322__deltacommit__COMPLETED__20240517083132000]}
NO PENDING COMPACTION TO RUN
**4) Schedule compaction**
hudi:prueba->compaction schedule
Attempted to schedule compaction for 20240517083427496
**5) Run compaction again**
hudi:prueba->compaction run --tableName prueba
2024-05-17 08:34:34.152 INFO 3288 --- [ main]
o.a.h.c.t.t.HoodieActiveTimeline : Loaded instants upto :
Option{val=[20240517082810322__deltacommit__COMPLETED__20240517083132000]}
NO PENDING COMPACTION TO RUN
And the hudi path is:
**1).hoodie folder**
.
..
.20240517082347494.deltacommit.crc
.20240517082347494.deltacommit.inflight.crc
.20240517082347494.deltacommit.requested.crc
.20240517082810322.deltacommit.crc
.20240517082810322.deltacommit.inflight.crc
.20240517082810322.deltacommit.requested.crc
.aux
.hoodie.properties.crc
.schema
.temp
20240517082347494.deltacommit
20240517082347494.deltacommit.inflight
20240517082347494.deltacommit.requested
20240517082810322.deltacommit
20240517082810322.deltacommit.inflight
20240517082810322.deltacommit.requested
archived
hoodie.properties
**2) The files in a partition**
.
..
..280a7ceb-a1ee-4cd7-ba8c-9ec870164ec9-0_20240517082347494.log.1_1-60-254.crc
..ee36904f-023d-46aa-bdb2-947de4be3fd1-0_20240517082347494.log.1_0-60-253.crc
..hoodie_partition_metadata.crc
.280a7ceb-a1ee-4cd7-ba8c-9ec870164ec9-0_0-26-105_20240517082347494.parquet.crc
.280a7ceb-a1ee-4cd7-ba8c-9ec870164ec9-0_20240517082347494.log.1_1-60-254
.ee36904f-023d-46aa-bdb2-947de4be3fd1-0_1-26-106_20240517082347494.parquet.crc
.ee36904f-023d-46aa-bdb2-947de4be3fd1-0_20240517082347494.log.1_0-60-253
.hoodie_partition_metadata
280a7ceb-a1ee-4cd7-ba8c-9ec870164ec9-0_0-26-105_20240517082347494.parquet
ee36904f-023d-46aa-bdb2-947de4be3fd1-0_1-26-106_20240517082347494.parquet
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
