This is an automated email from the ASF dual-hosted git repository.
yihua pushed a change to branch branch-0.x
in repository https://gitbox.apache.org/repos/asf/hudi.git
omit 687bf6b0451 [HUDI-7532] Include only compaction instants for
lastCompaction in getDeltaCommitsSinceLatestCompaction (#10915)
omit f8bb642b766 [HUDI-7759] Remove Hadoop dependencies in hudi-common
module (#11220)
omit 2fbb1fc95ec [HUDI-7429] Fixing average record size estimation for
delta commits (#10763)
omit 68fd850ec97 [HUDI-7752] Abstract serializeRecords for log writing
(#11210)
omit ffaf143b44e [HUDI-7624] Fixing index tagging duration (#11035)
omit ba94e96dbf1 [HUDI-7712] Fixing RLI initialization to account for file
slices instead of just base files while initializing (#11153)
omit 2099e4269ed [HUDI-7749] Bump Spark version 3.3.1 to 3.3.4 (#11198)
omit 11132dbff18 [HUDI-7535] Add metrics for sourceParallelism and Refresh
profile in S3/GCS (#10918)
omit 457d345f445 [HUDI-7617] Fix issues for bulk insert user defined
partitioner in StreamSync (#11014)
omit 9940305e721 [HUDI-7549] Reverting spurious log block deduction with
LogRecordReader (#10922)
omit e8f9c1f1cef [HUDI-7589] Add API to create HoodieStorage in
HoodieIOFactory (#11208)
omit 81094e699ee remove a few classes from hudi-common (#11209)
omit fde841f0999 [HUDI-7750] Move HoodieLogFormatWriter class to
hoodie-hadoop-common module (#11207)
omit 2cf7f882213 [HUDI-7744] Introduce IOFactory and a config to set the
factory (#11192)
omit 6a9b1d98c6b [HUDI-7743] Improve StoragePath usages (#11189)
omit db7136f5bc3 [HUDI-7523] Add HOODIE_SPARK_DATASOURCE_OPTIONS to be used
in HoodieIncrSource (#10900)
omit 0b75508a22e [HUDI-7501] Use source profile for S3 and GCS sources
(#10861)
omit cb921e9704e [HUDI-4732] Add support for confluent schema registry with
proto (#11070)
omit 1536d50870a [HUDI-7745] Move Hadoop-dependent util methods to
hudi-hadoop-common (#11193)
omit 460d90e50fa [HUDI-7508] Avoid collecting records in
HoodieStreamerUtils.createHoodieRecords and JsonKafkaSource mapPartitions
(#10872)
omit 21874a3f5ad [HUDI-7739] Shudown asyncDetectorExecutor in
AsyncTimelineServerBasedDetectionStrategy (#11182)
omit aacbdc7da5b [HUDI-7731] Fix usage of new Configuration() in production
code (#11191)
omit ed0462b49ad [HUDI-7673] Fixing false positive validation failure for
RLI with MDT validation tool (#11098)
omit e987c8a8512 [HUDI-7742] Move Hadoop-dependent reader util classes to
hudi-hadoop-common module (#11190)
omit 09baac5e133 [HUDI-7726] Restructure TableSchemaResolver to separate
Hadoop logic and use BaseFileUtils (#11185)
omit 6d35691b6a8 [HUDI-7654] Optimizing BQ sync for MDT (#11061)
omit 83ee6cf493d [HUDI-7738] Set FileStreamReader Charset as UTF-8 (#11181)
omit 223588c7071 [HUDI-7729] Move ParquetUtils to hudi-hadoop-common module
(#11186)
omit 91e76854ab4 [HUDI-7725] Restructure HFileBootstrapIndex to separate
Hadoop-dependent logic (#11171)
omit 9e35710f3be [HUDI-7350] Make Hudi reader and writer factory APIs
Hadoop-independent (#11163)
omit c56fed9620d [HUDI-7587] Make hudi-hadoop-common module dependent on
hudi-common module (#11131)
omit edd7cfbff92 [HUDI-7737] Bump Spark 3.4 version to Spark 3.4.3 (#11180)
omit 9b3c9793042 [MINOR] Cosmetic changes for names and log msgs (#11179)
omit de5548809b8 [HUDI-7735] Remove usage of SerializableConfiguration
(#11177)
omit 8cb1d2e3e60 [HUDI-7734] Remove unused FSPermissionDTO (#11176)
omit 9867fda9692 [HUDI-7699] Support STS external ids and configurable
session names in the AWS StsAssumeRoleCredentialsProvider (#11134)
omit cd54076c090 [HUDI-7728] Use StorageConfiguration in LockProvider
constructors (#11173)
omit eb3a242fc9a [HUDI-7727] Avoid constructAbsolutePathInHadoopPath in
hudi-common module (#11172)
omit e4d286b09da [MINOR] Use parent as the glob path when full file path
specified (#11150)
omit c203dd6b387 [MINOR] Remove duplicate settings (#11167)
omit e84a3a55b1e [MINOR] Do not force setting spark conf in UtilHelpers
(#11166)
omit f7ec3878cc8 [HUDI-7720] Fix HoodieTableFileSystemView NPE in
fetchAllStoredFileGroups (#11161)
omit 3b02464a712 [HUDI-7721] Fix broken build on master (#11164)
omit ea2c6492804 [HUDI-7710] Use compaction.requested during conflict
resolution (#11151)
omit 60a0183a791 Fixing deltastreamer tests for auto record key gen (#11099)
omit 0762a70680e [HUDI-7641] Adding metadata enablement metrics and index
type metrics (#11053)
omit d22a4f34c37 [HUDI-7703] Clean plan to exclude partitions with no
deleting file (#11136)
omit 83139893d38 [HUDI-7710] Remove compaction.inflight from conflict
resolution (#11148)
omit efcac143c78 [HUDI-7576] Improve efficiency of
getRelativePartitionPath, reduce computation of partitionPath in
AbstractTableFileSystemView (#11001)
omit f90d906134b [HUDI-7686] Add tests on the util methods for type cast of
configuration instances (#11121)
omit a268cd2a3f4 [MINOR] remove unnecessary lines from java test (#11139)
omit 7c6ecbb9e4c [HUDI-7688] Stop retry inflate if encounter
InterruptedIOException (#11125)
omit 1d6ff6bb7bf [HUDI-6296] Add Scala 2.13 support for Spark 3.5
integration (#11130)
omit 127aabde61e [HUDI-7702] Remove unused method in ReflectUtil (#11135)
omit 7834d0d0bfc [HUDI-7694] Unify bijection-avro dependency version
(#11132)
omit bb5b285cb7c [HUDI-7588] Replace hadoop Configuration with
StorageConfiguration in meta client (#11071)
omit 971d0b89247 [HUDI-7684] Sort the records for Flink metadata table
bulk_insert (#11116)
omit 2c5af864cd5 [HUDI-7667] Created util method to get offset range for
fetching new data (#11092)
omit af9eb516dd9 [MINOR] Remove the redundant log in HFileBootstrapIndex
(#11115)
omit 055df60db80 [HUDI-7682] Remove the files copy in Azure CI tests report
(#11110)
omit 70155da8ff5 [HUDI-7683] Make HoodieMetadataMetrics log level debug ro
reduce noise (#11114)
omit 46b666a7d83 [HUDI-7681] Remove Hadoop Path usage in a few classes in
hudi-common module (#11108)
omit 3a0be9cafe9 [HUDI-7674] Fix Hudi CLI Command "metadata validate-files"
to use file listing to validate (#11100)
omit 40f2c765d0d [HUDI-7675] Don't set default value for primary key when
get schema from hms (#11101)
omit 878d0d92c05 [HUDI-7668] Add and rename APIs in StorageConfiguration
(#11102)
omit f4ba12c10e7 [HUDI-7670] Return StorageConfiguration from getConf() in
HoodieStorage (#11096)
omit 0bda958007f [MINOR] Streamer test setup performance (#10806)
omit c32beae1443 [HUDI-7664] Remove Hadoop dependency from hudi-io module
(#11089)
omit 3ef0b7a5d95 [HUDI-7676] Fix serialization in Spark DAG in
HoodieBackedTableMetadataWriter (#11103)
omit 90c429eb9dc [HUDI-7575] Avoid repeated fetching of pending replace
instants (#10976)
omit ed5e8a64e56 [HUDI-7672] Fix the Hive server scratch dir for tests in
hudi-utilities (#11097)
omit 63a3e2fe28e [HUDI-7511] Fixing offset range calculation for kafka
(#10875)
omit 8eb7518711d [HUDI-7658] Add time to meta sync failure log (#11080)
omit c95ebfb47ab [MINOR] Make KafkaSource abstraction public and more
flexible (#11093)
omit e8494df5704 [HUDI-7666] Fix serializable implementation of
StorageConfiguration class (#11091)
omit 5ee71fd7f34 [HUDI-7645] Optimize BQ sync tool for MDT (#11065)
omit 6a84e7cca10 [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental
Source (#10336)
omit 2a66bc3fb0f [HUDI-7660] Fix excessive object creation in RowDataKeyGen
(#11084)
omit 84a98695ea6 [MINOR] Remove unused util methods in LogReaderUtils
(#11086)
omit b99e87db0d0 [HUDI-7650] Remove FileSystem argument in TestHelpers
methods (#11072)
omit 226c2c7f895 [HUDI-7632] Remove FileSystem usage in
HoodieLogFormatWriter (#11082)
omit 586898b9256 [HUDI-7651] Add util methods for creating meta client
(#11081)
omit 55598858969 [MINOR] Fix LoggerName for JDBCExecutor (#11063)
omit 0a556cb3dcd [HUDI-6386] Enable testArchivalWithMultiWriters back as
they are passing (#9085)
omit 94a67e420a5 [HUDI-7647] READ_UTC_TIMEZONE doesn't affect log files for
MOR tables (#11066)
omit 63ec2431743 [MINOR] Fixe naming of methods in HoodieMetadataConfig
(#11076)
omit d14b6401d2e [MINOR] Fix incorrect catch of ClassCastException using
HoodieSparkKeyGeneratorFactory (#11062)
omit 4669a4cad5d [HUDI-7608] Fix Flink table creation configuration not
taking effect when writing to Spark (#11005)
omit 7cadc96b049 [MINOR] Reuse MetadataPartitionType enum to get all
partition paths (#11068)
omit beb20386e03 [HUDI-7655] Minor fix to rli validation with MDT validator
(#11060)
omit 273c7332648 [HUDI-7623] Refactoring of RemoteHoodieTableFileSystemView
and RequestHandler (#11032)
omit 4180f7827fb [HUDI-7631] Clean up usage of CachingPath outside
hudi-common module (#11059)
omit 541b4dcf244 [HUDI-7628] Rename FSUtils.getPartitionPath to
constructAbsolutePath (#11054)
omit 82f7485e4f9 [MINOR] Added configurations of Hudi table, file-based SQL
source, Hudi error table, and timestamp key generator to configuration listing
(#11057)
omit deb90df6409 [HUDI-7515] Fix partition metadata write failure (#10886)
omit 5020b2a9e18 [HUDI-7643] Fix test by using the right StreamSync
constructor (#11056)
omit 5582cde47b7 [HUDI-7618] Add ability to ignore checkpoints in delta
streamer (#11018)
omit 50f367dbe1f [HUDI-7640] Uses UUID as temporary file suffix for
HoodieStorage.createImmutableFileInPath (#11052)
omit 2137b2928fc [HUDI-6497] Replace FileSystem, Path, and FileStatus usage
in hudi-common module (#10591)
omit 8bc56c52d6c [HUDI-7637] Make StoragePathInfo Comparable (#11050)
omit c8c52e252fb [HUDI-7635] Add default block size and openSeekable APIs
to HoodieStorage (#11048)
omit 667f93b1fff [HUDI-7636] Make StoragePath Serializable (#11049)
omit 925f2be736a [MINOR] Remove redundant TestStringUtils in hudi-common
(#11046)
omit 5d118c06b91 [HUDI-7633] Use try with resources for AutoCloseable
(#11045)
omit 9bb09d7b78d [HUDI-4228] Clean up literal usage in Hudi CLI argument
check (#11042)
omit 585078471fe [HUDI-7626] Propagate UserGroupInformation from the main
thread to the new thread of timeline service threadpool (#11039)
omit a233bbecb3a [HUDI-7625] Avoid unnecessary rewrite for metadata table
(#11038)
omit f1f6f93fe0f [HUDI-7578] Avoid unnecessary rewriting to improve
performance (#11028)
omit 9a0349828e6 [MINOR] Rename location to path in `makeQualified` (#11037)
omit d34ba818f75 [MINOR] Remove redundant lines in StreamSync and
TestStreamSyncUnitTests (#11027)
omit 9c5feffa593 [HUDI-6762] Removed usages of
MetadataRecordsGenerationParams (#10962)
omit 23637b7a076 [HUDI-7619] Removed code duplicates in
HoodieTableMetadataUtil (#11022)
omit 2d84c5c5b1f [HUDI-7584] Always read log block lazily and remove
readBlockLazily argument (#11015)
omit 0c06b3ce011 [HUDI-7615] Mark a few write configs with the correct
sinceVersion (#11012)
omit 1b6e36140cb [HUDI-7606] Unpersist RDDs after table services, mainly
compaction and clustering (#11000)
omit 5e0a7cd5552 [HUDI-7616] Avoid multiple cleaner plans and deprecate
hoodie.clean.allow.multiple (#11013)
omit 13beb355176 [HUDI-7378] Fix Spark SQL DML with custom key generator
(#10615)
new a92613a8969 [HUDI-7378] Fix Spark SQL DML with custom key generator
(#10615)
new 09dae35771c [HUDI-7616] Avoid multiple cleaner plans and deprecate
hoodie.clean.allow.multiple (#11013)
new 73a84d7b573 [HUDI-7606] Unpersist RDDs after table services, mainly
compaction and clustering (#11000)
new 1117db69d59 [HUDI-7615] Mark a few write configs with the correct
sinceVersion (#11012)
new ab0e2cdd579 [HUDI-7584] Always read log block lazily and remove
readBlockLazily argument (#11015)
new ecb33e338e3 [HUDI-7619] Removed code duplicates in
HoodieTableMetadataUtil (#11022)
new cd6870696e6 [HUDI-6762] Removed usages of
MetadataRecordsGenerationParams (#10962)
new 7fe6acf8e1b [MINOR] Remove redundant lines in StreamSync and
TestStreamSyncUnitTests (#11027)
new 87659d47de8 [MINOR] Rename location to path in `makeQualified` (#11037)
new 34a158463c9 [HUDI-7578] Avoid unnecessary rewriting to improve
performance (#11028)
new 82bdc9c03db [HUDI-7625] Avoid unnecessary rewrite for metadata table
(#11038)
new e3ac75ccab3 [HUDI-7626] Propagate UserGroupInformation from the main
thread to the new thread of timeline service threadpool (#11039)
new 29b4a040507 [HUDI-4228] Clean up literal usage in Hudi CLI argument
check (#11042)
new a0a2c9786af [HUDI-7633] Use try with resources for AutoCloseable
(#11045)
new 290f50520e6 [MINOR] Remove redundant TestStringUtils in hudi-common
(#11046)
new c9c1f7569bf [HUDI-7636] Make StoragePath Serializable (#11049)
new 517f7d0a5fd [HUDI-7635] Add default block size and openSeekable APIs
to HoodieStorage (#11048)
new 8fff9400971 [HUDI-7637] Make StoragePathInfo Comparable (#11050)
new bce71996eac [HUDI-6497] Replace FileSystem, Path, and FileStatus usage
in hudi-common module (#10591)
new 349e083e490 [HUDI-7640] Uses UUID as temporary file suffix for
HoodieStorage.createImmutableFileInPath (#11052)
new 82c3209f64d [HUDI-7618] Add ability to ignore checkpoints in delta
streamer (#11018)
new 2dd563f19b4 [HUDI-7643] Fix test by using the right StreamSync
constructor (#11056)
new 071b26d26ed [HUDI-7515] Fix partition metadata write failure (#10886)
new 36cf9bd5b10 [MINOR] Added configurations of Hudi table, file-based SQL
source, Hudi error table, and timestamp key generator to configuration listing
(#11057)
new 66208b07ecd [HUDI-7628] Rename FSUtils.getPartitionPath to
constructAbsolutePath (#11054)
new 4f3952e8195 [HUDI-7631] Clean up usage of CachingPath outside
hudi-common module (#11059)
new e7e77e58968 [HUDI-7623] Refactoring of RemoteHoodieTableFileSystemView
and RequestHandler (#11032)
new aebf1ee4ae8 [HUDI-7655] Minor fix to rli validation with MDT validator
(#11060)
new 44f8897d5d4 [MINOR] Reuse MetadataPartitionType enum to get all
partition paths (#11068)
new 02142e87cbb [HUDI-7608] Fix Flink table creation configuration not
taking effect when writing to Spark (#11005)
new cea3e43866e [MINOR] Fix incorrect catch of ClassCastException using
HoodieSparkKeyGeneratorFactory (#11062)
new 514251d3011 [MINOR] Fixe naming of methods in HoodieMetadataConfig
(#11076)
new d61673ec70e [HUDI-7647] READ_UTC_TIMEZONE doesn't affect log files for
MOR tables (#11066)
new 5a79c260699 [HUDI-6386] Enable testArchivalWithMultiWriters back as
they are passing (#9085)
new 79df1834088 [MINOR] Fix LoggerName for JDBCExecutor (#11063)
new 01e52405991 [HUDI-7651] Add util methods for creating meta client
(#11081)
new 663ba26b8df [HUDI-7632] Remove FileSystem usage in
HoodieLogFormatWriter (#11082)
new f66310ac4f3 [HUDI-7650] Remove FileSystem argument in TestHelpers
methods (#11072)
new 371fc73a5b7 [MINOR] Remove unused util methods in LogReaderUtils
(#11086)
new d4ef0b6dad8 [HUDI-7660] Fix excessive object creation in RowDataKeyGen
(#11084)
new d42f399d5a5 [HUDI-7235] Fix checkpoint bug for S3/GCS Incremental
Source (#10336)
new 500723148ad [HUDI-7645] Optimize BQ sync tool for MDT (#11065)
new b71e27979ec [HUDI-7666] Fix serializable implementation of
StorageConfiguration class (#11091)
new 03e21d03eca [MINOR] Make KafkaSource abstraction public and more
flexible (#11093)
new 1d38ae5faf2 [HUDI-7658] Add time to meta sync failure log (#11080)
new 45426de9e85 [HUDI-7511] Fixing offset range calculation for kafka
(#10875)
new 6ffdc5fabce [HUDI-7672] Fix the Hive server scratch dir for tests in
hudi-utilities (#11097)
new 348b6bb68f7 [HUDI-7575] Avoid repeated fetching of pending replace
instants (#10976)
new 305bd7e8321 [HUDI-7676] Fix serialization in Spark DAG in
HoodieBackedTableMetadataWriter (#11103)
new 2960094dcc7 [HUDI-7664] Remove Hadoop dependency from hudi-io module
(#11089)
new 2b73ab44c6e [MINOR] Streamer test setup performance (#10806)
new e8368f2f5da [HUDI-7670] Return StorageConfiguration from getConf() in
HoodieStorage (#11096)
new 1ba41a210d9 [HUDI-7668] Add and rename APIs in StorageConfiguration
(#11102)
new ee974ec1170 [HUDI-7675] Don't set default value for primary key when
get schema from hms (#11101)
new 3754c8ac2c3 [HUDI-7674] Fix Hudi CLI Command "metadata validate-files"
to use file listing to validate (#11100)
new 13ae15c60c4 [HUDI-7681] Remove Hadoop Path usage in a few classes in
hudi-common module (#11108)
new dd7e59705b6 [HUDI-7683] Make HoodieMetadataMetrics log level debug ro
reduce noise (#11114)
new f7937d305ac [HUDI-7682] Remove the files copy in Azure CI tests report
(#11110)
new 2bfe068148b [MINOR] Remove the redundant log in HFileBootstrapIndex
(#11115)
new e828a6d0a3b [HUDI-7667] Created util method to get offset range for
fetching new data (#11092)
new 6e3b22e8c4a [HUDI-7684] Sort the records for Flink metadata table
bulk_insert (#11116)
new 4ddd99b3dc7 [HUDI-7588] Replace hadoop Configuration with
StorageConfiguration in meta client (#11071)
new fa9e4895967 [HUDI-7694] Unify bijection-avro dependency version
(#11132)
new e99a2ee9b13 [HUDI-7702] Remove unused method in ReflectUtil (#11135)
new 47c57f89fe1 [HUDI-6296] Add Scala 2.13 support for Spark 3.5
integration (#11130)
new 581b8818272 [HUDI-7688] Stop retry inflate if encounter
InterruptedIOException (#11125)
new 23bb9a0c2d6 [MINOR] remove unnecessary lines from java test (#11139)
new b331120daad [HUDI-7686] Add tests on the util methods for type cast of
configuration instances (#11121)
new a05bfdc5d68 [HUDI-7576] Improve efficiency of
getRelativePartitionPath, reduce computation of partitionPath in
AbstractTableFileSystemView (#11001)
new c31eab1a859 [HUDI-7710] Remove compaction.inflight from conflict
resolution (#11148)
new da0eb16ea06 [HUDI-7703] Clean plan to exclude partitions with no
deleting file (#11136)
new 357137045bf [HUDI-7641] Adding metadata enablement metrics and index
type metrics (#11053)
new c38e9527eea Fixing deltastreamer tests for auto record key gen (#11099)
new 9e9e2184cdd [HUDI-7710] Use compaction.requested during conflict
resolution (#11151)
new 53d1c1fbaba [HUDI-7721] Fix broken build on master (#11164)
new fc91460a6f3 [HUDI-7720] Fix HoodieTableFileSystemView NPE in
fetchAllStoredFileGroups (#11161)
new 0eda139327a [MINOR] Do not force setting spark conf in UtilHelpers
(#11166)
new fb4ac8d0916 [MINOR] Remove duplicate settings (#11167)
new faf953a0162 [MINOR] Use parent as the glob path when full file path
specified (#11150)
new 63e8cd90f3e [HUDI-7727] Avoid constructAbsolutePathInHadoopPath in
hudi-common module (#11172)
new 1b2f05f0ec9 [HUDI-7728] Use StorageConfiguration in LockProvider
constructors (#11173)
new e03b5287465 [HUDI-7699] Support STS external ids and configurable
session names in the AWS StsAssumeRoleCredentialsProvider (#11134)
new b98bf58f444 [HUDI-7734] Remove unused FSPermissionDTO (#11176)
new 7b923ece7b8 [HUDI-7735] Remove usage of SerializableConfiguration
(#11177)
new 13fd77c38b2 [MINOR] Cosmetic changes for names and log msgs (#11179)
new 99ea8b6c73a [HUDI-7737] Bump Spark 3.4 version to Spark 3.4.3 (#11180)
new 8fb7f85ee7a [HUDI-7587] Make hudi-hadoop-common module dependent on
hudi-common module (#11131)
new a5656a1a823 [HUDI-7350] Make Hudi reader and writer factory APIs
Hadoop-independent (#11163)
new 7f117394f76 [HUDI-7725] Restructure HFileBootstrapIndex to separate
Hadoop-dependent logic (#11171)
new d49bd439b6e [HUDI-7729] Move ParquetUtils to hudi-hadoop-common module
(#11186)
new caec900f7e3 [HUDI-7738] Set FileStreamReader Charset as UTF-8 (#11181)
new 68e35144475 [HUDI-7654] Optimizing BQ sync for MDT (#11061)
new f44c1c0c787 [HUDI-7726] Restructure TableSchemaResolver to separate
Hadoop logic and use BaseFileUtils (#11185)
new 733728cd2ef [HUDI-7742] Move Hadoop-dependent reader util classes to
hudi-hadoop-common module (#11190)
new e530f388dca [HUDI-7673] Fixing false positive validation failure for
RLI with MDT validation tool (#11098)
new 4f243efb0db [HUDI-7731] Fix usage of new Configuration() in production
code (#11191)
new c28e00913fa [HUDI-7739] Shudown asyncDetectorExecutor in
AsyncTimelineServerBasedDetectionStrategy (#11182)
new d6cc2c00933 [HUDI-7508] Avoid collecting records in
HoodieStreamerUtils.createHoodieRecords and JsonKafkaSource mapPartitions
(#10872)
new c21e4202eac [HUDI-7745] Move Hadoop-dependent util methods to
hudi-hadoop-common (#11193)
new 2b2bba9feac [HUDI-4732] Add support for confluent schema registry with
proto (#11070)
new 8beaf31e84c [HUDI-7501] Use source profile for S3 and GCS sources
(#10861)
new 7907b999738 [HUDI-7523] Add HOODIE_SPARK_DATASOURCE_OPTIONS to be used
in HoodieIncrSource (#10900)
new 04c275d2db2 [HUDI-7743] Improve StoragePath usages (#11189)
new aeb49aad2b7 [HUDI-7744] Introduce IOFactory and a config to set the
factory (#11192)
new 5150d1beee8 [HUDI-7750] Move HoodieLogFormatWriter class to
hoodie-hadoop-common module (#11207)
new 8f2dba35949 remove a few classes from hudi-common (#11209)
new 6e129de5d90 [HUDI-7589] Add API to create HoodieStorage in
HoodieIOFactory (#11208)
new 580bb1c260e [HUDI-7549] Reverting spurious log block deduction with
LogRecordReader (#10922)
new 25da2b0b1b0 [HUDI-7617] Fix issues for bulk insert user defined
partitioner in StreamSync (#11014)
new 90b0b5b7114 [HUDI-7535] Add metrics for sourceParallelism and Refresh
profile in S3/GCS (#10918)
new 0e5d6f9b7cc [HUDI-7749] Bump Spark version 3.3.1 to 3.3.4 (#11198)
new 3c00124b3ec [HUDI-7712] Fixing RLI initialization to account for file
slices instead of just base files while initializing (#11153)
new 56d9fbe0552 [HUDI-7624] Fixing index tagging duration (#11035)
new c047600f3b3 [HUDI-7752] Abstract serializeRecords for log writing
(#11210)
new f74671283c7 [HUDI-7429] Fixing average record size estimation for
delta commits (#10763)
new 4db72fd2f5c [HUDI-7759] Remove Hadoop dependencies in hudi-common
module (#11220)
new cc64cd82747 [HUDI-7532] Include only compaction instants for
lastCompaction in getDeltaCommitsSinceLatestCompaction (#10915)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (687bf6b0451)
\
N -- N -- N refs/heads/branch-0.x (cc64cd82747)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 117 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../hudi/functional/TestSparkSqlWithCustomKeyGenerator.scala | 10 +++++-----
1 file changed, 5 insertions(+), 5 deletions(-)
