[jira] [Resolved] (HUDI-2008) Add an annotation to suppress the compiler warnings

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2008. - Fix Version/s: 0.9.0 Assignee: Wei Resolution: Fixed > Add an annotation to

[jira] [Resolved] (HUDI-2043) HoodieDefaultTimeline$filterPendingCompactionTImeline() method have wrong filter condition

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2043. - Assignee: Zheng yunhong Resolution: Fixed >

[jira] [Updated] (HUDI-2043) HoodieDefaultTimeline$filterPendingCompactionTImeline() method have wrong filter condition

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2043: Status: In Progress (was: Open) > HoodieDefaultTimeline$filterPendingCompactionTImeline() method

[jira] [Updated] (HUDI-1988) FinalizeWrite() been executed twice in AbstractHoodieWriteClient$commitstats

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1988: Status: In Progress (was: Open) > FinalizeWrite() been executed twice in

[jira] [Resolved] (HUDI-1988) FinalizeWrite() been executed twice in AbstractHoodieWriteClient$commitstats

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-1988. - Assignee: Zheng yunhong Resolution: Fixed > FinalizeWrite() been executed twice in

[jira] [Resolved] (HUDI-2097) Fix unable to read commit metadata error

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2097. - Assignee: Zheng yunhong Resolution: Fixed > Fix unable to read commit metadata error >

[jira] [Updated] (HUDI-2028) Implement RockDbBasedMap as an alternate to DiskBasedMap in SpillableMap

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2028: Fix Version/s: 0.9.0 > Implement RockDbBasedMap as an alternate to DiskBasedMap in SpillableMap >

[jira] [Comment Edited] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390817#comment-17390817 ] sivabalan narayanan edited comment on HUDI-1842 at 7/30/21, 11:48 PM: --

[GitHub] [hudi] nsivabalan commented on a change in pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-30 Thread GitBox
nsivabalan commented on a change in pull request #3328: URL: https://github.com/apache/hudi/pull/3328#discussion_r680212711 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/InsertIntoHoodieTableCommand.scala ## @@ -209,19 +209,32

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-30 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * c3bdfdd1e47790f46f4263a7fb5242c01dd02188 UNKNOWN * 40cbb91efb34e6360849a42056de6343cc1251d6 UNKNOWN *

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390679#comment-17390679 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #3315: URL:

[GitHub] [hudi] zhedoubushishi commented on a change in pull request #3373: [HUDI-2255] Refactor Datasource options

2021-07-30 Thread GitBox
zhedoubushishi commented on a change in pull request #3373: URL: https://github.com/apache/hudi/pull/3373#discussion_r680105067 ## File path: docker/demo/sparksql-incremental.commands ## @@ -27,8 +27,8 @@ import org.apache.hadoop.fs.FileSystem; val fs =

[jira] [Commented] (HUDI-2255) Refactor DataSourceOptions

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390689#comment-17390689 ] ASF GitHub Bot commented on HUDI-2255: -- zhedoubushishi commented on a change in pull request #3373:

[jira] [Updated] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1842: -- Summary: [SQL] Spark Sql Support For The Exists Hoodie Table (was: Spark Sql Support

[jira] [Updated] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2208: -- Labels: pull-request-available release-blocker (was: pull-request-available) >

[jira] [Updated] (HUDI-2221) [SQL] Functionality testing with Spark 2

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2221: -- Summary: [SQL] Functionality testing with Spark 2 (was: Functionality testing with

[jira] [Updated] (HUDI-2208) Support Bulk Insert For Spark Sql

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2208: -- Priority: Blocker (was: Major) > Support Bulk Insert For Spark Sql >

[jira] [Updated] (HUDI-2063) [SQL] Add Doc For Spark Sql Integrates With Hudi

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2063: -- Labels: pull-request-available release-blocker (was: pull-request-available) > [SQL]

[jira] [Updated] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2208: -- Summary: [SQL] Support Bulk Insert For Spark Sql (was: Support Bulk Insert For Spark

[jira] [Resolved] (HUDI-2094) Supports hive style partitioning for flink writer

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2094. - Resolution: Fixed > Supports hive style partitioning for flink writer >

[jira] [Updated] (HUDI-2097) Fix unable to read commit metadata error

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2097: Status: In Progress (was: Open) > Fix unable to read commit metadata error >

[jira] [Updated] (HUDI-2094) Supports hive style partitioning for flink writer

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2094: Status: In Progress (was: Open) > Supports hive style partitioning for flink writer >

[jira] [Resolved] (HUDI-2081) Move TestHiveSyncTool to functional

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2081. - Fix Version/s: 0.9.0 Resolution: Fixed > Move TestHiveSyncTool to functional >

[jira] [Updated] (HUDI-2058) support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2058: Status: In Progress (was: Open) > support incremental query for

[jira] [Resolved] (HUDI-2058) support incremental query for insert_overwrite_table/insert_overwrite operation on cow table

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2058. - Resolution: Fixed > support incremental query for insert_overwrite_table/insert_overwrite >

[jira] [Resolved] (HUDI-2116) sync 10w partitions to hive by using HiveSyncTool lead to the oom of hive MetaStore

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2116. - Fix Version/s: (was: 0.10.0) 0.9.0 Resolution: Fixed > sync 10w

[jira] [Resolved] (HUDI-2127) `maxMemorySizeInBytes` in log scanner is not initialized

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2127. - Fix Version/s: 0.9.0 Resolution: Fixed > `maxMemorySizeInBytes` in log scanner is not

[jira] [Updated] (HUDI-2127) `maxMemorySizeInBytes` in log scanner is not initialized

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2127: Status: In Progress (was: Open) > `maxMemorySizeInBytes` in log scanner is not initialized >

[jira] [Updated] (HUDI-2115) FileSlices in the filegroup is not descending by timestamp

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2115: Status: In Progress (was: Open) > FileSlices in the filegroup is not descending by timestamp >

[jira] [Resolved] (HUDI-2115) FileSlices in the filegroup is not descending by timestamp

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2115. - Fix Version/s: 0.9.0 Resolution: Fixed > FileSlices in the filegroup is not descending by

[jira] [Updated] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2107: Status: In Progress (was: Open) > Support Read Log Only MOR Table For Spark >

[jira] [Resolved] (HUDI-2107) Support Read Log Only MOR Table For Spark

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2107. - Resolution: Fixed > Support Read Log Only MOR Table For Spark >

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390711#comment-17390711 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #3315: URL:

[jira] [Commented] (HUDI-2255) Refactor DataSourceOptions

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390712#comment-17390712 ] ASF GitHub Bot commented on HUDI-2255: -- vinothchandar commented on a change in pull request #3373:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3373: [HUDI-2255] Refactor Datasource options

2021-07-30 Thread GitBox
vinothchandar commented on a change in pull request #3373: URL: https://github.com/apache/hudi/pull/3373#discussion_r680116010 ## File path: docker/demo/sparksql-incremental.commands ## @@ -27,8 +27,8 @@ import org.apache.hadoop.fs.FileSystem; val fs =

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-30 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * c3bdfdd1e47790f46f4263a7fb5242c01dd02188 UNKNOWN * 40cbb91efb34e6360849a42056de6343cc1251d6 UNKNOWN *

[GitHub] [hudi] vinothchandar commented on a change in pull request #3373: [HUDI-2255] Refactor Datasource options

2021-07-30 Thread GitBox
vinothchandar commented on a change in pull request #3373: URL: https://github.com/apache/hudi/pull/3373#discussion_r680116010 ## File path: docker/demo/sparksql-incremental.commands ## @@ -27,8 +27,8 @@ import org.apache.hadoop.fs.FileSystem; val fs =

[jira] [Updated] (HUDI-2249) Changing index type fails

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2249: -- Labels: release-blocker (was: ) > Changing index type fails >

[jira] [Updated] (HUDI-2249) [SQL] Changing index type fails

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2249: -- Summary: [SQL] Changing index type fails (was: Changing index type fails) > [SQL]

[jira] [Updated] (HUDI-2250) [SQL] Bulk insert support for tables w/ primary key

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2250: -- Labels: release-blocker (was: ) > [SQL] Bulk insert support for tables w/ primary key

[jira] [Updated] (HUDI-2250) [SQL] Bulk insert support for tables w/ primary key

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2250: -- Summary: [SQL] Bulk insert support for tables w/ primary key (was: Bulk insert support

[jira] [Updated] (HUDI-2249) Changing index type fails

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2249: -- Priority: Blocker (was: Major) > Changing index type fails > -

[jira] [Updated] (HUDI-2251) [SQL] Fix Exception Cause By Table Name Case Sensitivity For Append Mode Write

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2251: -- Summary: [SQL] Fix Exception Cause By Table Name Case Sensitivity For Append Mode Write

[jira] [Updated] (HUDI-2251) [SQL] Fix Exception Cause By Table Name Case Sensitivity For Append Mode Write

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2251: -- Status: In Progress (was: Open) > [SQL] Fix Exception Cause By Table Name Case

[jira] [Resolved] (HUDI-2251) [SQL] Fix Exception Cause By Table Name Case Sensitivity For Append Mode Write

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-2251. --- Resolution: Fixed > [SQL] Fix Exception Cause By Table Name Case Sensitivity For

[GitHub] [hudi] nsivabalan commented on a change in pull request #3328: [HUDI-2208] Support Bulk Insert For Spark Sql

2021-07-30 Thread GitBox
nsivabalan commented on a change in pull request #3328: URL: https://github.com/apache/hudi/pull/3328#discussion_r680186620 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -248,6 +248,14 @@ object

[jira] [Commented] (HUDI-2208) [SQL] Support Bulk Insert For Spark Sql

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390783#comment-17390783 ] ASF GitHub Bot commented on HUDI-2208: -- nsivabalan commented on a change in pull request #3328: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-30 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * c3bdfdd1e47790f46f4263a7fb5242c01dd02188 UNKNOWN * 40cbb91efb34e6360849a42056de6343cc1251d6 UNKNOWN *

[jira] [Resolved] (HUDI-2031) JVM occasionally crashes during compaction when spark speculative execution is enabled

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2031. - Fix Version/s: 0.9.0 Resolution: Fixed > JVM occasionally crashes during compaction when

[jira] [Updated] (HUDI-2031) JVM occasionally crashes during compaction when spark speculative execution is enabled

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2031: Status: In Progress (was: Open) > JVM occasionally crashes during compaction when spark

[jira] [Resolved] (HUDI-2053) Insert Static Partition With DateType Return Incorrect Partition Value

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2053. - Resolution: Fixed > Insert Static Partition With DateType Return Incorrect Partition Value >

[jira] [Updated] (HUDI-2053) Insert Static Partition With DateType Return Incorrect Partition Value

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2053: Status: In Progress (was: Open) > Insert Static Partition With DateType Return Incorrect Partition

[jira] [Updated] (HUDI-1944) Support Hudi to read from Kafka Consumer Group Offset

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1944: Fix Version/s: 0.9.0 > Support Hudi to read from Kafka Consumer Group Offset >

[jira] [Updated] (HUDI-2057) CTAS Generate An External Table When Create Managed Table

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2057: Status: In Progress (was: Open) > CTAS Generate An External Table When Create Managed Table >

[jira] [Resolved] (HUDI-2057) CTAS Generate An External Table When Create Managed Table

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2057. - Fix Version/s: 0.9.0 Resolution: Fixed > CTAS Generate An External Table When Create

[jira] [Updated] (HUDI-2116) sync 10w partitions to hive by using HiveSyncTool lead to the oom of hive MetaStore

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2116: Status: In Progress (was: Open) > sync 10w partitions to hive by using HiveSyncTool lead to the

[jira] [Resolved] (HUDI-2046) Loaded too many classes when use kryo of spark to hudi

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2046. - Fix Version/s: 0.9.0 Resolution: Fixed > Loaded too many classes when use kryo of spark to

[jira] [Updated] (HUDI-2046) Loaded too many classes when use kryo of spark to hudi

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2046: Status: In Progress (was: Open) > Loaded too many classes when use kryo of spark to hudi >

[jira] [Comment Edited] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390817#comment-17390817 ] sivabalan narayanan edited comment on HUDI-1842 at 7/30/21, 11:52 PM: --

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390832#comment-17390832 ] ASF GitHub Bot commented on HUDI-1771: -- swuferhong opened a new pull request #3285: URL:

[jira] [Commented] (HUDI-1771) Propagate CDC format for hoodie

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390831#comment-17390831 ] ASF GitHub Bot commented on HUDI-1771: -- swuferhong closed pull request #3285: URL:

[GitHub] [hudi] swuferhong closed pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-07-30 Thread GitBox
swuferhong closed pull request #3285: URL: https://github.com/apache/hudi/pull/3285 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] swuferhong opened a new pull request #3285: [HUDI-1771] Propagate CDC format for hoodie

2021-07-30 Thread GitBox
swuferhong opened a new pull request #3285: URL: https://github.com/apache/hudi/pull/3285 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Updated] (HUDI-2063) [SQL] Add Doc For Spark Sql Integrates With Hudi

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2063: -- Summary: [SQL] Add Doc For Spark Sql Integrates With Hudi (was: Add Doc For Spark Sql

[jira] [Updated] (HUDI-2222) Test catalog integration

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-: -- Labels: release-blocker (was: ) > Test catalog integration >

[jira] [Updated] (HUDI-2063) [SQL] Add Doc For Spark Sql Integrates With Hudi

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2063: -- Priority: Blocker (was: Major) > [SQL] Add Doc For Spark Sql Integrates With Hudi >

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390770#comment-17390770 ] ASF GitHub Bot commented on HUDI-2257: -- nsivabalan edited a comment on pull request #3375: URL:

[GitHub] [hudi] nsivabalan edited a comment on pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-07-30 Thread GitBox
nsivabalan edited a comment on pull request #3375: URL: https://github.com/apache/hudi/pull/3375#issuecomment-890125142 here is the right file that you might want to update docs/_posts/2020-01-15-delete-support-in-hudi.md Also you can add a note to our quick start page as well

[jira] [Comment Edited] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390817#comment-17390817 ] sivabalan narayanan edited comment on HUDI-1842 at 7/30/21, 11:14 PM: --

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390817#comment-17390817 ] sivabalan narayanan commented on HUDI-1842: --- I was just playing around. Just dumping my findings

[jira] [Updated] (HUDI-1996) When using SchemaRegistryProvider.java cant pass basic auth creds in url

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1996: Status: In Progress (was: Open) > When using SchemaRegistryProvider.java cant pass basic auth

[jira] [Resolved] (HUDI-1996) When using SchemaRegistryProvider.java cant pass basic auth creds in url

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-1996. - Fix Version/s: (was: 0.10.0) 0.9.0 Resolution: Fixed > When using

[jira] [Commented] (HUDI-2221) Functionality testing with Spark 2

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390759#comment-17390759 ] sivabalan narayanan commented on HUDI-2221: --- [~codope]: do we have any update on this?  >

[jira] [Updated] (HUDI-2221) Functionality testing with Spark 2

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2221: -- Labels: release-blocker (was: ) > Functionality testing with Spark 2 >

[jira] [Updated] (HUDI-2221) Functionality testing with Spark 2

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2221: -- Priority: Blocker (was: Major) > Functionality testing with Spark 2 >

[jira] [Updated] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1248: Fix Version/s: (was: 0.9.0) 0.10.0 > [UMBRELLA] Tests cleanup and fixes >

[jira] [Updated] (HUDI-1248) [UMBRELLA] Tests cleanup and fixes

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1248: Status: In Progress (was: Open) > [UMBRELLA] Tests cleanup and fixes >

[jira] [Resolved] (HUDI-2038) Support rollback inflight compaction instances for CompactionPlanOperator

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2038. - Fix Version/s: 0.9.0 Resolution: Fixed > Support rollback inflight compaction instances

[jira] [Updated] (HUDI-2038) Support rollback inflight compaction instances for CompactionPlanOperator

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2038: Status: In Progress (was: Open) > Support rollback inflight compaction instances for

[jira] [Updated] (HUDI-2064) Fix TestHoodieBackedMetadata#testOnlyValidPartitionsAdded

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2064: Status: In Progress (was: Open) > Fix TestHoodieBackedMetadata#testOnlyValidPartitionsAdded >

[jira] [Resolved] (HUDI-2064) Fix TestHoodieBackedMetadata#testOnlyValidPartitionsAdded

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2064. - Fix Version/s: 0.9.0 Resolution: Fixed > Fix

[jira] [Resolved] (HUDI-2123) Exception When Merge With Null-Value Field

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2123. - Resolution: Fixed > Exception When Merge With Null-Value Field >

[jira] [Updated] (HUDI-2123) Exception When Merge With Null-Value Field

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2123: Status: In Progress (was: Open) > Exception When Merge With Null-Value Field >

[jira] [Updated] (HUDI-2113) Fix integration testing failure caused by sql results out of order

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2113: Status: In Progress (was: Open) > Fix integration testing failure caused by sql results out of

[jira] [Updated] (HUDI-2093) Fix empty avro schema path caused by duplicate parameters

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2093: Fix Version/s: 0.9.0 > Fix empty avro schema path caused by duplicate parameters >

[jira] [Resolved] (HUDI-2113) Fix integration testing failure caused by sql results out of order

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2113. - Fix Version/s: 0.9.0 Resolution: Fixed > Fix integration testing failure caused by sql

[jira] [Updated] (HUDI-2099) hive lock which state is WATING should be released, otherwise this hive lock will be locked forever

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2099: Status: In Progress (was: Open) > hive lock which state is WATING should be released, otherwise

[jira] [Updated] (HUDI-1828) Ensure All Tests Pass with ORC format

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1828: Status: In Progress (was: Open) > Ensure All Tests Pass with ORC format >

[jira] [Updated] (HUDI-2180) Fix Compile Error For Spark3

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2180: Fix Version/s: 0.9.0 > Fix Compile Error For Spark3 > > >

[jira] [Resolved] (HUDI-1828) Ensure All Tests Pass with ORC format

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-1828. - Fix Version/s: 0.9.0 Assignee: Teresa Kang Resolution: Fixed > Ensure All Tests

[GitHub] [hudi] vingov commented on pull request #3366: [HUDI-1985] Migrate the hudi site to docusaurus platform (website complete re-design)

2021-07-30 Thread GitBox
vingov commented on pull request #3366: URL: https://github.com/apache/hudi/pull/3366#issuecomment-890272138 @nsivabalan - Can you please review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HUDI-2232) [SQL] MERGE INTO fails with table having nested struct and partioned by

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2232: -- Summary: [SQL] MERGE INTO fails with table having nested struct and partioned by (was:

[jira] [Updated] (HUDI-2233) [SQL] Hive sync is not working

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2233: -- Fix Version/s: 0.9.0 > [SQL] Hive sync is not working > --

[jira] [Updated] (HUDI-2232) [SQL] MERGE INTO fails with table having nested struct and partioned by

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2232: -- Labels: release-blocker (was: ) > [SQL] MERGE INTO fails with table having nested

[jira] [Updated] (HUDI-2222) [SQL] Test catalog integration

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-: -- Summary: [SQL] Test catalog integration (was: Test catalog integration) > [SQL] Test

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390762#comment-17390762 ] sivabalan narayanan commented on HUDI-1842: --- [~pzw2018]: Am trying to understand how this flow

[jira] [Updated] (HUDI-2233) [SQL] Hive sync is not working

2021-07-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2233: -- Summary: [SQL] Hive sync is not working (was: Hive sync is not working) > [SQL] Hive

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390798#comment-17390798 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #3315: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-30 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * c3bdfdd1e47790f46f4263a7fb5242c01dd02188 UNKNOWN * 40cbb91efb34e6360849a42056de6343cc1251d6 UNKNOWN *

[jira] [Resolved] (HUDI-1984) Support independent flink hudi compaction function

2021-07-30 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-1984. - Assignee: Zheng yunhong Resolution: Fixed > Support independent flink hudi compaction

  1   2   3   4   5   >