This is an automated email from the ASF dual-hosted git repository.
yuzhaojing pushed a change to branch release-0.12.1-rc1
in repository https://gitbox.apache.org/repos/asf/hudi.git
at 2c1560c4e3 Create release branch for version 0.12.1.
This branch includes the following new commits:
new 4f67551d5c [HUDI-4581] Claim RFC-58 for data skipping integration with
query engines (#6346)
new 504f31b31b [HUDI-4577] Adding test coverage for `DELETE FROM`, Spark
Quickstart guide (#6318)
new d47e6808ee [HUDI-4556] Improve functional test coverage of column
stats index (#6319)
new ce8bf956d8 [HUDI-4558] lost 'hoodie.table.keygenerator.class' in
hoodie.properties (#6320)
new 3e1a8db89a [HUDI-4543] Support natural order when table schema
contains a field named 'ts' (#6246)
new 83bb38a227 [HUDI-4569][RFC-58] Claim RFC-58 for adding a new feature
named 'Multiple event_time Fields Latest Verification in a Single Table' for
Hudi (#6328)
new 59fe24dc46 [HUDI-3503] Support more feature to call procedure
CleanCommand (#6353)
new 791eafc495 [MINOR] fix potential npe in spark writer (#6363)
new 49fd4110b4 fix bug in cli show fsview all (#6314)
new 4b6696f04f [HUDI-4488] Improve S3EventsHoodieIncrSource efficiency
(#6228)
new 1c804a8243 [HUDI-4611] Fix the duplicate creation of config in
HoodieFlinkStreamer (#6369)
new ab24655663 [HUDI-3189] Fallback to full table scan with incremental
query when files are cleaned up or achived for MOR table (#6141)
new b2b2aad2a4 [MINOR] fix progress field calculate logic in
HoodieLogRecordReader (#6291)
new 52390b6bf8 [HUDI-4608] Fix upgrade command in Hudi CLI (#6374)
new c6bce6bf68 [HUDI-4609] Improve usability of upgrade/downgrade commands
in Hudi CLI (#6377)
new a43cfec9b2 [HUDI-4574] Fixed timeline based marker thread safety issue
(#6383)
new 3f32adc214 [HUDI-4621] Add validation that bucket index fields should
be subset of primary keys (#6396)
new 48083d8674 [HUDI-4354] Add --force-empty-sync flag to deltastreamer
(#6027)
new 40c693b7c9 [HUDI-4601] Read error from MOR table after compaction with
timestamp partitioning (#6365)
new 87272a1ffe [MINOR] Update DOAP with 0.12.0 Release (#6413)
new 7e5c43c922 [HUDI-4529] Tweak some default config options for flink
(#6287)
new 0103022727 [HUDI-4632] Remove the force active property for flink1.14
profile (#6415)
new b12faa230c [HUDI-4551] Tweak the default parallelism of flink pipeline
to execution env parallelism (#6312)
new 5e274066fb [MINOR] Improve code style of CLI Command classes (#6427)
new 39312d139e [HUDI-3625] Claim RFC-60 for Federated Storage Layer (#6440)
new 78b4a99685 [HUDI-3579] Add timeline commands in hudi-cli (#5139)
new 49ed03fc8c [HUDI-4638] Rename payload clazz and preCombine field
options for flink sql (#6434)
new 0b7a500503 Revert "[HUDI-4632] Remove the force active property for
flink1.14 profile (#6415)" (#6449)
new 093eea11c3 [HUDI-4643] MergeInto syntax WHEN MATCHED is optional but
must be set (#6443)
new 25150011fb [HUDI-4644] Change default flink profile to 1.15.x (#6445)
new e15718c295 [HUDI-4678] Claim RFC-61 for Snapshot view management
(#6461)
new 982713b24a [HUDI-4676] infer cleaner policy when write concurrency
mode is OCC (#6459)
new 592bf903c0 [HUDI-4683] Use enum class value for default value in flink
options (#6453)
new e87569a665 [HUDI-4686] Flip option 'write.ignore.failed' to default
false (#6467)
new a5242ba3e9 [HUDI-4515] Fix savepoints will be cleaned in keeping
latest versions policy (#6267)
new 0f6851e1ff [HUDI-4637] Release thread in RateLimiter doesn't been
terminated (#6433)
new 0786488e12 [HUDI-4698] Rename the package
'org.apache.flink.table.data' to avoid conflicts with flink table core (#6481)
new 7303ece273 HUDI-4687 add show_invalid_parquet procedure (#6480)
new 68b1f1444d [HUDI-4584] Fixing `SQLConf` not being propagated to
executor (#6352)
new 686b9c8a75 [HUDI-4441] Log4j2 configuration fixes and removal of
log4j1 dependencies (#6170)
new 989f1bba5c [HUDI-4665] Flipping default for "ignore failed batch"
config in streaming sink to false (#6450)
new 739ddc7cdd [HUDI-4713] Fix flaky
ITTestHoodieDataSource#testAppendWrite (#6490)
new a07441a794 [HUDI-4696] Fix flaky TestHoodieCombineHiveInputFormat
(#6494)
new 8ef49838f4 Revert "[HUDI-3669] Add a remote request retry mechanism
for 'Remotehoodietablefiles… (#5884)" (#6501)
new 2cfada92f6 [Stacked on 6386] Fixing `DebeziumSource` to properly
commit offsets; (#6416)
new c7c5a8ae16 [HUDI-4399][RFC-57] Protobuf support in DeltaStreamer
(#6111)
new 19a088800d [HUDI-4703] use the historical schema to response time
travel query (#6499)
new b20cfb3430 [HUDI-4549] Remove avro from hudi-hive-sync-bundle and
hudi-aws-bundle (#6472)
new e14c6f0b16 [HUDI-4482] remove guava and use caffeine instead for cache
(#6240)
new 90092cf823 [HUDI-4483] Fix checkstyle in integ-test module (#6523)
new 0894b26511 [HUDI-4340] fix not parsable text DateTimeParseException by
addng a method parseDateFromInstantTimeSafely for parsing timestamp when output
metrics (#6000)
new 824abbf448 [DOCS] Add docs about
javax.security.auth.login.LoginException when starting Hudi Sink Connector
(#6255)
new 6c38663972 [HUDI-4327] Fixing flaky deltastreamer test
(testCleanerDeleteReplacedDataWithArchive) (#6533)
new f808ddd0d3 [HUDI-4730] Fix batch job cannot clean old commits files
(#6515)
new cd88d1234d [HUDI-4740] Add metadata fields for hive catalog
#createTable (#6541)
new 72e059c2e2 [HUDI-4695] Fixing flaky
TestInlineCompaction#testCompactionRetryOnFailureBasedOnTime (#6534)
new f5bb934587 [HUDI-4193] change protoc version to unblock hudi
compilation on m1 mac (#6535)
new aa939206cb [HUDI-4438] Fix flaky
TestCopyOnWriteActionExecutor#testPartitionMetafileFormat (#6546)
new 7ce610f6d7 [MINOR] Fix typo in HoodieArchivalConfig (#6542)
new 6917c47e98 [HUDI-4582] Support batch synchronization of partition to
HMS to avoid timeout (#6347)
new 97aa633764 [HUDI-4742] Fix AWS Glue partition's location is wrong when
updatePartition (#6545)
new 94be4a8504 [HUDI-4642] Adding support to hudi-cli to repair deprecated
partition (#6438)
new fba75642da [HUDI-4751] Fix owner instants for transaction manager api
callers (#6549)
new f7c578bbef [HUDI-4739] Wrong value returned when key's length equals 1
(#6539)
new 1337565fc6 [HUDI-4528] Add diff tool to compare commit metadata (#6485)
new 6335662fb3 [HUDI-4648] Support rename partition through CLI (#6569)
new 161c623979 [HUDI-4775] Fixing incremental source for MOR table (#6587)
new 6c732325bb [HUDI-4694] Print testcase running time for CI jobs (#6586)
new 6a020354f4 [RFC] Claim RFC-62 for Diagnostic Reporter (#6599)
new b421aa6ebe [minor] following HUDI-4739, fix the extraction for simple
record keys (#6594)
new c597eb5d20 [HUDI-4619] Add a remote request retry mechanism for
'Remotehoodietablefilesystemview'. (#6393)
new 586f8bef3c [HUDI-4720] Fix HoodieInternalRow return wrong num of
fields when source not contains meta fields (#6500)
new 671745123b [HUDI-4389] Make HoodieStreamingSink idempotent (#6098)
new cec4fc6e0e [MINOR] Remove redundant braces (#6604)
new 76336bf05e [HUDI-4618] Separate log word for CommitUitls class (#6392)
new c2c5eea12f [HUDI-4776] Fix merge into use unresolved assignment (#6589)
new b17095afa0 [HUDI-4795] Fix KryoException when bulk insert into a not
bucket index hudi table
new 0e7ce1b3dc [HUDI-4615] Return checkpoint as null for empty data from
events queue. (#6387)
new 60895bbb35 [HUDI-4782] Support TIMESTAMP_LTZ type for flink (#6607)
new 996e1382df [HUDI-4731] Shutdown CloudWatch reporter when query
completes (#6468)
new bdebf4d2ba [HUDI-4793] Fixing ScalaTest tests to properly respect
Log4j2 configs (#6617)
new 8757ec6609 [HUDI-4766] Strengthen flink clustering job (#6566)
new 63b001797b [HUDI-4797] fix merge into table for source table with
different column order (#6620)
new afc82858bc [MINOR] Typo fix for kryo in flink-bundle (#6639)
new 9661ec1804 [HUDI-4811] Fix the checkstyle of hudi flink (#6633)
new be528cdc03 [HUDI-4465] Optimizing file-listing sequence of Metadata
Table (#6016)
new f0d85e50c8 [HUDI-4807] Use base table instant for metadata
initialization (#6629)
new 6bbb4325b0 [HUDI-3453] Fix HoodieBackedTableMetadata concurrent
reading issue (#5091)
new 64ce7676bb [HUDI-4518] Add unit test for reentrant lock in diff
lockProvider (#6624)
new fc1685e7d3 [HUDI-4810] Fixing Hudi bundles requiring log4j2 on the
classpath (#6631)
new 6005022ba6 [HUDI-4826] Update RemoteHoodieTableFileSystemView to allow
base path in UTF-8 (#6544)
new c0d79f5e30 [HUDI-4763] Allow hoodie read client to choose index (#6506)
new 8151fa42a8 [DOCS] Fix Slack invite link in README.md (#6648)
new b848f51cd5 [MINOR] Add dev setup and spark 3.3 profile to readme
(#6656)
new 467e382ea1 [HUDI-4831] Fix
AWSDmsAvroPayload#getInsertValue,combineAndGetUpdateValue to invoke correct api
(#6637)
new a298bd7d39 [HUDI-4806] Use Avro version from the root pom for Flink
bundle (#6628)
new 9ea134c02a [HUDI-4833] Add Postgres Schema Name to Postgres Debezium
Source (#6616)
new 541e114f9a [HUDI-4825] Remove redundant fields in serialized commit
metadata in JSON (#6646)
new 9c225f65b5 [MINOR] Insert should call validateInsertSchema in
HoodieFlinkWriteClient (#5919)
new f9b2b910a6 [HUDI-3879] Suppress exceptions that are not fatal in
HoodieMetadataTableValidator (#5344)
new 3bd9130f5c [HUDI-3998] Fix getCommitsSinceLastCleaning failed when
async cleaning (#5478)
new 1d8d279012 [HUDI-3994] - Added support for initializing DeltaStreamer
without a defined Spark Master (#5630)
new 6d37d06fb7 [HUDI-4628] Hudi-flink support
GLOBAL_BLOOM，GLOBAL_SIMPLE，BUCKET index type (#6406)
new f13ec2544f [HUDI-4814] Schedules new clustering plan based on latest
clustering instant (#6574)
new 16328a87c0 [HUDI-4817] Delete markers after full-record bootstrap
operation (#6667)
new e16d63b4cf [HUDI-4691] Cleaning up duplicated classes in Spark 3.3
module (#6550)
new 95ac58e503 [HUDI-4752] Add dedup support for MOR table in cli (#6608)
new 0afc5819dd [HUDI-4837] Stop sleeping where it is not necessary after
the success (#6270)
new d614242f21 [HUDI-4843] Delete the useless timer in
BaseRollbackActionExecutor (#6671)
new 34c6ce909c [HUDI-4780] hoodie.logfile.max.size It does not take
effect, causing the log file to be too large (#6602)
new 394ebb3c6b [HUDI-4844] Skip partition value resolving when the field
does not exists for MergeOnReadInputFormat#getReader (#6678)
new 59c85a4f5c [MINOR] Fix the Spark job status description for
metadata-only bootstrap operation (#6666)
new 17a23daa8e [HUDI-3403] Ensure keygen props are set for bootstrap
(#6645)
new 73d8758123 [HUDI-4193] Upgrade Protobuf to 3.21.5 (#5784)
new ebdb9f41a2 [HUDI-4785] Fix partition discovery in bootstrap operation
(#6673)
new ec628848a5 [HUDI-4706] Fix InternalSchemaChangeApplier#applyAddChange
error to add nest type (#6486)
new b7687d939a [HUDI-4851] Fixing CSI not handling `InSet` operator
properly (#6685)
new c758a96a3c [HUDI-4796] MetricsReporter stop bug (#6619)
new 8e3c36553a [HUDI-3861] update tblp 'path' when rename table (#5320)
new be67657536 [HUDI-4853] Get field by name for
OverwriteNonDefaultsWithLatestAvroPayload to avoid schema mismatch (#6689)
new ba7774867a [HUDI-4813] Fix infer keygen not work in sparksql side
issue (#6634)
new f7a6637622 [HUDI-4856] Missing option for HoodieCatalogFactory (#6693)
new 702e40c71b [HUDI-4864] Fix AWSDmsAvroPayload#combineAndGetUpdateValue
when using MOR snapshot query after delete operations with test (#6688)
new 9b886d1f72 [HUDI-4841] Fix sort idempotency issue (#6669)
new 6572693eb5 [HUDI-4865] Optimize HoodieAvroUtils#isMetadataField to use
O(1) complexity (#6702)
new 7db20e9601 [HUDI-4736] Fix inflight clean action preventing clean
service to continue when multiple cleans are not allowed (#6536)
new 8b21bb7128 [HUDI-4842] Support compaction strategy based on delta log
file num (#6670)
new a084dd6a93 [HUDI-4282] Repair IOException in CHDFS when check block
corrupted in HoodieLogFileReader (#6031)
new c11537b082 [HUDI-4757] Create pyspark examples (#6672)
new fd0a953df6 [HUDI-3959] Rename class name for spark rdd reader (#5409)
new 3db232ee7d [HUDI-4828] Fix the extraction of record keys which may be
cut out (#6650)
new 094ed24185 [HUDI-4873] Report number of messages to be processed via
metrics (#6271)
new 93e94eb709 [HUDI-4424] Add new compactoin trigger stratgy:
NUM_COMMITS_AFTER_REQ… (#6144)
new 7bc70aa62a Fix errors from cherry-picking
new 2c1560c4e3 Create release branch for version 0.12.1.
The 135 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
