This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a change to branch branch-0.x
in repository https://gitbox.apache.org/repos/asf/hudi.git
at 0908f648152 [HUDI-6999] Adding row writer support to HoodieStreamer
(#9913)
This branch includes the following new commits:
new 226a46d4841 [HUDI-6846] Fix a bug of consistent bucket index
clustering (#9679)
new 69225bc9bf6 [HUDI-6823] instantiate writeTimer in
StreamWriteOperatorCoordinator (#9637)
new a30c904608a [HUDI-6853] ArchiveCommitsProcedure should throw an
exception when the archive operation executes failed (#9703)
new 4afc077f56b [MINOR] Fix hbase index config improper use (#9582)
new e870ef66653 [HUDI-6630] Automatic release connection for hoodie
metaserver client (#9340)
new 20c5ef50bdf [HUDI-6862] Replace directory connector markers in
TestSqlStatement (#9458)
new 9e647b17ea1 [HUDI-6847] Improve the incremental clean fallback logic
(#9681)
new 903933f607b [HUDI-6848] Fix non-unique uid for hudi operators (#9680)
new 68ea64f7e24 [MINOR] Close record readers in TestHoodieReaderWriterBase
after use during tests (#9504)
new ea0c7fa7e29 [HUDI-6870] Pass project ID to BigQuery job (#9730)
new e0b2fb67816 [HUDI-6865] Fix InternalSchema schemaId when column is
dropped (#9724)
new fa04fb901f1 [MINOR] Enhancing validate staged bundles script (#8591)
new 4c288b35053 [HUDI-6871] BigQuery sync improvements (#9741)
new 2bd4d3618aa [HUDI-6708] Support record level indexing with async
indexer (#9517)
new b786ce7b491 [MINOR] Close resources in tests (#9685)
new 7ee50a13f4a [MINOR] Fix default config values if not specified (#9625)
new aea93b3b71c [HUDI-6882] Differentiate between replacecommits in
cluster planning (#9755)
new e4f53c5334f [MINOR] Set connection settings for maven to avoid build
flakiness (#9772)
new d7d0b0e5d09 [MINOR] Mark a few new configs advanced and tag since
version of 0.14.0 (#9771)
new b32be910dbb [HUDI-6881] Hudi configured
spark.scheduler.allocation.file should include scheme since Spark3.2 (#9754)
new 0ab1beb4e18 [HUDI-6011] Fix cli show archived commits breaks for
replacecommit (#8345)
new b688181616c [HUDI-5924] Fixing cli clean command to trim down a subset
based on start and end (#8169)
new 073b36a2da5 [MINOR] Fix the check for connector identity in
HoodieHiveCatalog (#9770)
new 936ece380ec [HUDI-6062] Fix irregular enum config (#8564)
new 0dd2e0aa055 [HUDI-6893] Copy the trino bundle to override the one in
the image (#9781)
new a6aec4719cd [HUDI-6827] Fix task failure when insert into empty
dataset (#9797)
new b535919ab7d [HUDI-6892] ExternalSpillableMap may cause data
duplication when flink compaction (#9778)
new c935303ce51 fixing build/compilation issue. Fixed missing import in
HoodieTableMetadataUtil
new b9980984f2e [HUDI-6922] Fix inconsistency between base file format and
catalog input format (#9830)
new 757b0a529ab [HUDI-6828] Fix wrong partitionToReplaceIds when
insertOverwrite empty data into partitions (#9811)
new c88d6ffcbd5 [MINOR] Disable falky integration test temporarily (#9823)
new bab7a1ed44a [HUDI-6916] Improve performance of Custom Key Generators
(#9821)
new a66cf28be04 [HUDI-6913] Set default database name correctly (#9816)
new c925d98c170 [HUDI-5911]
SimpleTransactionDirectMarkerBasedDetectionStrategy can't work with
none-partitioned table (#8143)
new 05867751b3b [HUDI-6926] Disable DROP_PARTITION_COLUMNS when upsert MOR
table (#9840)
new fcb7c89fe75 [HUDI-6873] fix clustering mor (#9774)
new 42f09b3d4ff [HUDI-6927] CDC file clean not work (#9841)
new 25db3575fe5 [HUDI-6917] Fix docker integ tests (#9843)
new 8c616c1fc74 Fixing build failures with InsertIntoHoodieTableCommand
new 9665ef44928 [HUDI-6937] CopyOnWriteInsertHandler#consume cause
clustering performance degradation (#9851)
new b8186d11303 Follow up HUDI-6937, fix the RealtimeCompactedRecordReader
props instantiation (#9853)
new 63d513ef543 [HUDI-6894] ReflectionUtils is not thread safe (#9786)
new 14e89fd7866 [HUDI-6941] Fix partition pruning for multiple partition
fields (#9863)
new 93d6a66b577 [HUDI-6944] Fix flink boostrap concurrency issue (#9867)
new 3e33ecde8ba [HUDI-6945] Fix HoodieRowDataParquetWriter cast issue
(#9868)
new bca004c3a09 [HUDI-6924] Fix hoodie table config not wok in table
properties (#9836)
new e60690a52cd [HUDI-6950] Query should process listed partitions to
avoid driver oom due to large number files in table first partition (#9875)
new 7121c9826b0 [MINOR] HFileBootstrapIndex: use try-with-resources in two
places (#9813)
new 871f8b7e6e1 [HUDI-6369] Fix spacial curve with sample strategy fails
when 0 or 1 rows only is incoming (#9053)
new bee5e5c5da9 [HUDI-5031] Fix MERGE INTO creates empty partition files
when source table has partitions but target table does not (#6983)
new ffae06b14ae [HUDI-5220] fix hive snapshot query add non hoodie paths
file status (#7206)
new 53adb3fa4d0 Fix race condition in HoodieSparkSqlWriter (#9749)
new 8e5b520f112 When invalidate the table in the spark sql query cache,
verify if the hive-async database exists (#9425)
new 48f5d46b63a [HUDI-6932] Updated batch size for delete partitions for
Glue sync tool (#9842)
new b4fe76cf584 [HUDI-6898] Medatawriter closing in tests, update logging
(#9768)
new 9c279a48f10 [MINOR] Add tests on combine parallelism (#9731)
new 2998fbccea5 [HUDI-6977] Upgrade hadoop version from 2.10.1 to 2.10.2
(#9914)
new 0a5f2315519 [HUDI-6923] Fixing bug with sanitization for rowSource
(#9834)
new 61dbed3aa59 [HUDI-6896] HoodieAvroHFileReader.RecordIterator iteration
never terminates (#9789)
new 80c21779ef6 [HUDI-7000] Fix
HoodieActiveTimeline::deleteInstantFileIfExists not show the file path when
occur delete not success (#9935)
new 3da45374f52 [HUDI-6998] Fix drop table failure when load table as
spark v2 table whose path is delete (#9932)
new 901b3a047d4 [HUDI-6946] Data Duplicates with range pruning while using
hoodie.bloom.index.use.metadata (#9886)
new 64a571d51ed [HUDI-6991] Fix hoodie.parquet.max.file.size conf reset
error (#9924)
new ad5367f8025 [HUDI-7013] Drop table command cannot delete dir when
purge is enable (#9960)
new b449bd4334e [HUDI-7002] Fixing initializing RLI MDT partition for
non-partitioned dataset (#9938)
new 15fe64dce3d [HUDI-7005] Fix hudi-aws-bundle relocation issue with avro
(#9946)
new 7aa2552129e [HUDI-7009] Filtering out null values from avro kafka
source (#9955)
new 0908f648152 [HUDI-6999] Adding row writer support to HoodieStreamer
(#9913)
The 68 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
