[hudi] branch master updated: [MINOR] Update DOAP with 0.12.0 Release (#6413)

2022-08-16 Thread codope
This is an automated email from the ASF dual-hosted git repository. codope pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 042241fa2c [MINOR] Update DOAP with 0.12.0

[GitHub] [hudi] codope merged pull request #6413: [MINOR] Update DOAP with 0.12.0 Release

2022-08-16 Thread GitBox
codope merged PR #6413: URL: https://github.com/apache/hudi/pull/6413 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] codope commented on pull request #6413: [MINOR] Update DOAP with 0.12.0 Release

2022-08-16 Thread GitBox
codope commented on PR #6413: URL: https://github.com/apache/hudi/pull/6413#issuecomment-1217493647 CI failure is not caused by this patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] codope opened a new pull request, #6417: [HUDI-4565] Release note for version 0.12.0

2022-08-16 Thread GitBox
codope opened a new pull request, #6417: URL: https://github.com/apache/hudi/pull/6417 ### Change Logs - Release highlights in `website/releases/release-0.12.0.md` - Updated `website/releases/download.md` - Updated `docusaurus.config.js`

[GitHub] [hudi] shubham-bungee commented on issue #6389: [SUPPORT] HELP :: Using TWO FIELDS to precombine :: 'hoodie.datasource.write.precombine.field': "column1,column2"

2022-08-16 Thread GitBox
shubham-bungee commented on issue #6389: URL: https://github.com/apache/hudi/issues/6389#issuecomment-1217486370 > Unfortunately, there is no out of the box solution to use two fields as preCombine for now. Thanks a lot for reply. We are a startup, planning to move to hudi, you

[GitHub] [hudi] hudi-bot commented on pull request #6413: [MINOR] Update DOAP with 0.12.0 Release

2022-08-16 Thread GitBox
hudi-bot commented on PR #6413: URL: https://github.com/apache/hudi/pull/6413#issuecomment-1217469882 ## CI report: * 98d233b95b8653fa681b2c24aa900c7a86adddf3 Azure:

[jira] [Updated] (HUDI-3407) Make sure Restore operation is Not Concurrent w/ Writes in Multi-Writer scenario

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3407: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Make sure Restore operation is Not

[jira] [Updated] (HUDI-3585) Docs for (consistent) hashing index

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3585: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Docs for (consistent) hashing index >

[jira] [Updated] (HUDI-10) Auto tune bulk insert parallelism #555

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-10?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-10: Fix Version/s: 0.12.1 (was: 0.12.0) > Auto tune bulk insert parallelism #555 >

[jira] [Updated] (HUDI-686) Implement BloomIndexV2 that does not depend on memory caching

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-686: - Fix Version/s: 0.12.1 (was: 0.12.0) > Implement BloomIndexV2 that does not depend

[jira] [Updated] (HUDI-3965) Spark sql dml w/ spark2 and scala12 fails w/ ClassNotFoundException for SparkSQLCLIDriver

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3965: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Spark sql dml w/ spark2 and scala12 fails

[jira] [Updated] (HUDI-1053) Make ComplexKeyGenerator also support non partitioned Hudi dataset

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1053: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Make ComplexKeyGenerator also support non

[jira] [Updated] (HUDI-13) Clarify whether the hoodie-hadoop-mr jars need to be rolled out across Hive cluster #553

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-13?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-13: Fix Version/s: 0.12.1 (was: 0.12.0) > Clarify whether the hoodie-hadoop-mr jars need

[jira] [Updated] (HUDI-736) Simplify ReflectionUtils#getTopLevelClasses

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-736: - Fix Version/s: 0.12.1 (was: 0.12.0) > Simplify ReflectionUtils#getTopLevelClasses

[jira] [Updated] (HUDI-1061) Hudi CLI savepoint command fail because of spark conf loading issue

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1061: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Hudi CLI savepoint command fail because of

[jira] [Updated] (HUDI-1101) Decouple Hive dependencies from hudi-spark

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1101: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Decouple Hive dependencies from hudi-spark

[jira] [Updated] (HUDI-1117) Add tdunning json library to spark and utilities bundle

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1117: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add tdunning json library to spark and

[jira] [Updated] (HUDI-1145) Debug if Insert operation calls upsert in case of small file handling path.

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1145: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Debug if Insert operation calls upsert in

[jira] [Updated] (HUDI-1245) Make debugging Integ tests easier

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1245: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Make debugging Integ tests easier >

[jira] [Updated] (HUDI-3961) Encounter NoClassDefFoundError when using Spark 3.1 bundle and utilities slim bundle

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3961: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Encounter NoClassDefFoundError when using

[jira] [Updated] (HUDI-992) For hive-style partitioned source data, partition columns synced with Hive will always have String type

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-992: - Fix Version/s: 0.12.1 (was: 0.12.0) > For hive-style partitioned source data,

[jira] [Updated] (HUDI-488) Refactor Source classes in hudi-utilities

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-488: - Fix Version/s: 0.12.1 (was: 0.12.0) > Refactor Source classes in hudi-utilities >

[jira] [Updated] (HUDI-1036) HoodieCombineHiveInputFormat not picking up HoodieRealtimeFileSplit

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1036: -- Fix Version/s: 0.12.1 (was: 0.12.0) > HoodieCombineHiveInputFormat not picking

[jira] [Updated] (HUDI-1590) Support async clustering w/ test suite job

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1590: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Support async clustering w/ test suite job

[jira] [Updated] (HUDI-3864) Avoid fetching all files for all partitions on the read/query path for flink

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3864: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Avoid fetching all files for all

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1885: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Support Delete/Update Non-Pk Table >

[jira] [Updated] (HUDI-747) Implement Rollback like API in HoodieWriteClient which can revert all actions

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-747: - Fix Version/s: 0.12.1 (was: 0.12.0) > Implement Rollback like API in

[jira] [Updated] (HUDI-2157) Spark write the bucket index table

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2157: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Spark write the bucket index table >

[jira] [Updated] (HUDI-1179) Add Row tests to all key generator test classes

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1179: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add Row tests to all key generator test

[jira] [Updated] (HUDI-1207) Add kafka implementation of write commit callback to Spark datasources

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1207: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add kafka implementation of write commit

[jira] [Updated] (HUDI-2003) Auto Compute Compression ratio for input data to output parquet/orc file size

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2003: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Auto Compute Compression ratio for input

[jira] [Updated] (HUDI-1645) Add unit test to verify clean and rollback instants are archived correctly

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1645: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add unit test to verify clean and rollback

[jira] [Updated] (HUDI-1748) Read operation will possibility fail on mor table rt view when a write operations is concurrency running

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1748: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Read operation will possibility fail on

[jira] [Updated] (HUDI-1574) Trim existing unit tests to finish in much shorter amount of time

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1574: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Trim existing unit tests to finish in much

[jira] [Updated] (HUDI-1275) Incremental TImeline Syncing causes compaction to fail with FileNotFound exception

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1275: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Incremental TImeline Syncing causes

[jira] [Updated] (HUDI-1247) Add jmh based benchmarking to hudi

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1247: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add jmh based benchmarking to hudi >

[jira] [Updated] (HUDI-1616) Abstract out one off operations within dag

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1616: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Abstract out one off operations within dag

[jira] [Updated] (HUDI-1329) Support async compaction in spark DF write()

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1329: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Support async compaction in spark DF

[jira] [Updated] (HUDI-1380) Async cleaning does not work with Timeline Server

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1380: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Async cleaning does not work with Timeline

[jira] [Updated] (HUDI-1212) GDPR: Support deletions of records on all versions of Hudi dataset

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1212: -- Fix Version/s: 0.12.1 (was: 0.12.0) > GDPR: Support deletions of records on all

[jira] [Updated] (HUDI-2154) Add index key field into HoodieKey

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2154: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add index key field into HoodieKey >

[jira] [Updated] (HUDI-1823) Hive/Presto Integration with ORC

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1823: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Hive/Presto Integration with ORC >

[jira] [Updated] (HUDI-2612) No need to define primary key for flink insert operation

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2612: -- Fix Version/s: 0.12.1 (was: 0.12.0) > No need to define primary key for flink

[jira] [Updated] (HUDI-2156) Cluster the table with bucket index

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2156: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Cluster the table with bucket index >

[jira] [Updated] (HUDI-1556) Add App Id and App name to HoodieDeltaStreamerMetrics

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1556: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add App Id and App name to

[jira] [Updated] (HUDI-1271) Add utility scripts to perform Restores

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1271: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add utility scripts to perform Restores >

[jira] [Updated] (HUDI-1698) Multiwriting for Flink / Java

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1698: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Multiwriting for Flink / Java >

[jira] [Updated] (HUDI-1779) Fail to bootstrap/upsert a table which contains timestamp column

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1779: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Fail to bootstrap/upsert a table which

[jira] [Updated] (HUDI-1440) Allow option to override schema when doing spark.write

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-1440: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Allow option to override schema when doing

[jira] [Updated] (HUDI-2188) Improve test for the insert_overwrite and insert_overwrite_table in hoodieDeltaStreamer

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2188: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Improve test for the insert_overwrite and

[jira] [Updated] (HUDI-2946) Upgrade maven plugin to make Hudi be compatible with higher Java versions

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2946: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Upgrade maven plugin to make Hudi be

[jira] [Updated] (HUDI-2657) Make inlining configurable based on diff use-case.

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2657: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Make inlining configurable based on diff

[jira] [Updated] (HUDI-2260) Fix hardcoding of SimpleKeyGen for default KeyGenProp for virtual key configs

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2260: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Fix hardcoding of SimpleKeyGen for default

[jira] [Updated] (HUDI-3000) [UMBRELLA] Consistent Hashing Index

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3000: -- Fix Version/s: 0.12.1 (was: 0.12.0) > [UMBRELLA] Consistent Hashing Index >

[jira] [Updated] (HUDI-2884) Allow loading external configs while querying Hudi tables with Spark

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2884: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Allow loading external configs while

[jira] [Updated] (HUDI-2638) Rewrite tests around Hudi index

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2638: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Rewrite tests around Hudi index >

[jira] [Updated] (HUDI-2928) Evaluate rebasing Hudi's default compression from Gzip to Zstd

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2928: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Evaluate rebasing Hudi's default

[jira] [Updated] (HUDI-2762) Ensure hive can query insert only logs in MOR

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2762: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Ensure hive can query insert only logs in

[jira] [Updated] (HUDI-2932) Debug CI failure for TestHoodieBackedMetadata#testCleaningArchivingAndCompaction

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2932: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Debug CI failure for >

[jira] [Updated] (HUDI-2954) Code cleanup: HFileDataBock - using integer keys is never used

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2954: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Code cleanup: HFileDataBock - using

[jira] [Updated] (HUDI-2237) Add virtual key support for ORC file format

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2237: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add virtual key support for ORC file

[jira] [Updated] (HUDI-2754) Performance improvement for IncrementalRelation

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2754: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Performance improvement for

[jira] [Updated] (HUDI-2504) Add configuration to make HoodieBootstrap support ignoring file suffix

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2504: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add configuration to make HoodieBootstrap

[jira] [Updated] (HUDI-2991) Add rename partition for spark sql

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2991: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add rename partition for spark sql >

[jira] [Updated] (HUDI-2988) Add Event time configuration: latency adjustment

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2988: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Add Event time configuration: latency

[jira] [Updated] (HUDI-3049) Use flink table name as default synced hive table name

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3049: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Use flink table name as default synced

[jira] [Updated] (HUDI-2860) Make timeline server work with concurrent/async table service

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2860: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Make timeline server work with

[jira] [Updated] (HUDI-2808) Supports deduplication for streaming write

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2808: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Supports deduplication for streaming write

[jira] [Updated] (HUDI-2940) Support sync database and table created by Flink catalog to hive

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2940: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Support sync database and table created by

[jira] [Updated] (HUDI-2786) Failed to connect to namenode in Docker Demo on Apple M1 chip

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2786: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Failed to connect to namenode in Docker

[jira] [Updated] (HUDI-3017) Infer FlinkStreamer options like table source

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3017: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Infer FlinkStreamer options like table

[jira] [Updated] (HUDI-3304) support partial update on mor table

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3304: -- Fix Version/s: 0.12.1 (was: 0.12.0) > support partial update on mor table >

[jira] [Updated] (HUDI-2867) Make HoodiePartitionPath optional

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2867: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Make HoodiePartitionPath optional >

[jira] [Updated] (HUDI-3335) Loading Hudi table fails with NullPointerException

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3335: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Loading Hudi table fails with

[jira] [Updated] (HUDI-3121) Spark datasource with bucket index unit test reuse

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3121: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Spark datasource with bucket index unit

[jira] [Updated] (HUDI-2544) Use standard builder pattern to refactor ConfigProperty

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2544: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Use standard builder pattern to refactor

[jira] [Updated] (HUDI-3381) Rebase `HoodieMergeHandle` to operate on `HoodieRecord`

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3381: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Rebase `HoodieMergeHandle` to operate on

[jira] [Updated] (HUDI-2768) Enable async timeline server by default

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-2768: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Enable async timeline server by default >

[jira] [Updated] (HUDI-3309) Integrate quickstart examples into integration tests

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3309: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Integrate quickstart examples into

[jira] [Updated] (HUDI-3351) Rebase Record combining semantic into `HoodieRecordCombiningEngine`

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3351: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Rebase Record combining semantic into

[jira] [Updated] (HUDI-3385) Implement Spark-specific `FileReader`s

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3385: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Implement Spark-specific `FileReader`s >

[jira] [Updated] (HUDI-3265) Implement a custom serializer for the WriteStatus

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3265: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Implement a custom serializer for the

[jira] [Updated] (HUDI-3410) Revisit Record-reading Abstractions

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3410: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Revisit Record-reading Abstractions >

[jira] [Updated] (HUDI-3317) Partition specific pointed lookup/reading strategy for metadata table

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3317: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Partition specific pointed lookup/reading

[jira] [Updated] (HUDI-3167) Update RFC27 with the design for the new HoodieIndex type based on metadata indices

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3167: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Update RFC27 with the design for the new

[jira] [Updated] (HUDI-3189) Fallback to full table scan with incremental query when files are cleaned up or achived for MOR table

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3189: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Fallback to full table scan with

[jira] [Updated] (HUDI-3342) MOR Delta Block Rollbacks not applied if Lazy Block reading is disabled

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3342: -- Fix Version/s: 0.12.1 (was: 0.12.0) > MOR Delta Block Rollbacks not applied if

[jira] [Updated] (HUDI-3249) Performance Improvements

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3249: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Performance Improvements >

[jira] [Updated] (HUDI-3241) Support Analyze table in Spark SQL

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3241: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Support Analyze table in Spark SQL >

[jira] [Updated] (HUDI-3067) "Table already exists" error with multiple writers and dynamodb

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3067: -- Fix Version/s: 0.12.1 (was: 0.12.0) > "Table already exists" error with multiple

[jira] [Updated] (HUDI-3259) Code Refactor: Common prep records commit util for Spark and Flink

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3259: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Code Refactor: Common prep records commit

[jira] [Updated] (HUDI-3155) java.lang.NoSuchFieldError for logical timestamp types when run hive sync tool

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3155: -- Fix Version/s: 0.12.1 (was: 0.12.0) > java.lang.NoSuchFieldError for logical

[jira] [Updated] (HUDI-3391) presto and hive beeline fails to read MOR table w/ 2 or more array fields

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3391: -- Fix Version/s: 0.12.1 (was: 0.12.0) > presto and hive beeline fails to read MOR

[jira] [Updated] (HUDI-3214) Optimize auto partition in spark

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3214: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Optimize auto partition in spark >

[jira] [Updated] (HUDI-3533) Refactor FileSystemBackedTableMetadata and related classes to support getBloomFilters directly

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3533: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Refactor FileSystemBackedTableMetadata and

[jira] [Updated] (HUDI-3314) support merge into with no-pk condition

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3314: -- Fix Version/s: 0.12.1 (was: 0.12.0) > support merge into with no-pk condition >

[jira] [Updated] (HUDI-3487) The global index is enabled regardless of changlog

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3487: -- Fix Version/s: 0.12.1 (was: 0.12.0) > The global index is enabled regardless of

[jira] [Updated] (HUDI-3210) [UMBRELLA] A new Presto connector for Hudi

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3210: -- Fix Version/s: 0.12.1 (was: 0.12.0) > [UMBRELLA] A new Presto connector for Hudi

[jira] [Updated] (HUDI-3354) Rebase `HoodieRealtimeRecordReader` to return `HoodieRecord`

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3354: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Rebase `HoodieRealtimeRecordReader` to

[jira] [Updated] (HUDI-3717) Avoid double-listing w/in BaseHoodieTableFileIndex

2022-08-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3717: -- Fix Version/s: 0.12.1 (was: 0.12.0) > Avoid double-listing w/in

  1   2   3   4   5   >