[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392785#comment-17392785 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #3393: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392813#comment-17392813 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392812#comment-17392812 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * 5f5eb86f46e4bca94d0afaef7db2909d57c63d8c Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392822#comment-17392822 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-1842) [SQL] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392740#comment-17392740 ] ASF GitHub Bot commented on HUDI-1842: -- hudi-bot edited a comment on pull request #3393: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 53186a44289eb1740d15d0b35afc9d9f3c9f5904 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * 656226de7302806a140efdec95c42e5961e85650 Azure:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392760#comment-17392760 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392758#comment-17392758 ] ASF GitHub Bot commented on HUDI-2087: -- danny0405 commented on a change in pull request #3390: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * cc9a650f2cda42a587ed969de0d8fd3c5f391df7 Azure:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392769#comment-17392769 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 307a60591e5e250215e4224558273dae412e53ae Azure:

[jira] [Commented] (HUDI-2242) Add inference logic to few Hudi configs

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392776#comment-17392776 ] ASF GitHub Bot commented on HUDI-2242: -- hudi-bot edited a comment on pull request #3359: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-891812944 ## CI report: * 3aec37c6f238f4ed40672d20f7b7c6e6314a9519 Azure:

[GitHub] [hudi] yuzhaojing commented on a change in pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-04 Thread GitBox
yuzhaojing commented on a change in pull request #3390: URL: https://github.com/apache/hudi/pull/3390#discussion_r682351127 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -128,6 +129,11 @@ private void

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392804#comment-17392804 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392805#comment-17392805 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * cc9a650f2cda42a587ed969de0d8fd3c5f391df7 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[GitHub] [hudi] danny0405 commented on a change in pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-04 Thread GitBox
danny0405 commented on a change in pull request #3390: URL: https://github.com/apache/hudi/pull/3390#discussion_r682320425 ## File path: hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableFactory.java ## @@ -128,6 +129,11 @@ private void

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN *

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392759#comment-17392759 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[jira] [Commented] (HUDI-2242) Add inference logic to few Hudi configs

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392778#comment-17392778 ] ASF GitHub Bot commented on HUDI-2242: -- hudi-bot edited a comment on pull request #3359: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 307a60591e5e250215e4224558273dae412e53ae Azure:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392795#comment-17392795 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #3233: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392797#comment-17392797 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #3233: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392794#comment-17392794 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #3233: URL:

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r682348886 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,189 @@ +/* + * Licensed to the

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r682349212 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/marker/MarkerDirState.java ## @@ -0,0 +1,393 @@ +/* + * Licensed

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * cc9a650f2cda42a587ed969de0d8fd3c5f391df7 Azure:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392756#comment-17392756 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[jira] [Commented] (HUDI-2242) Add inference logic to few Hudi configs

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392774#comment-17392774 ] ASF GitHub Bot commented on HUDI-2242: -- hudi-bot edited a comment on pull request #3359: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3359: [HUDI-2242] Add configuration inference logic for few options

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3359: URL: https://github.com/apache/hudi/pull/3359#issuecomment-888073098 ## CI report: * 307a60591e5e250215e4224558273dae412e53ae Azure:

[GitHub] [hudi] karan867 commented on issue #3077: [SUPPORT] Large latencies in hudi writes using upsert mode.

2021-08-04 Thread GitBox
karan867 commented on issue #3077: URL: https://github.com/apache/hudi/issues/3077#issuecomment-892413100 @nsivabalan Thank you for the reply. Please find the answers to the above questions 1. I am using the default file size. I tried decreasing it to 60 MB but that increased

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392803#comment-17392803 ] ASF GitHub Bot commented on HUDI-1138: -- yihua commented on a change in pull request #3233: URL:

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r682352714 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,189 @@ +/* + * Licensed to the

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN *

[GitHub] [hudi] hudi-bot edited a comment on pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3233: URL: https://github.com/apache/hudi/pull/3233#issuecomment-875280958 ## CI report: * 2d22335c215ed620ce20018b1c83be189b7c70c6 UNKNOWN * 230205edfab190cfaf687d0323ae8d704f425e1d UNKNOWN *

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392746#comment-17392746 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on a change in pull request #3398: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
nsivabalan commented on a change in pull request #3398: URL: https://github.com/apache/hudi/pull/3398#discussion_r682313186 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/SparkClientFunctionalTestSuite.java ## @@ -0,0 +1,32 @@ +/*

[GitHub] [hudi] yihua commented on a change in pull request #3233: [HUDI-1138] Add timeline-server-based marker file strategy for improving marker-related latency

2021-08-04 Thread GitBox
yihua commented on a change in pull request #3233: URL: https://github.com/apache/hudi/pull/3233#discussion_r682348725 ## File path: hudi-timeline-service/src/main/java/org/apache/hudi/timeline/service/handlers/MarkerHandler.java ## @@ -0,0 +1,189 @@ +/* + * Licensed to the

[GitHub] [hudi] yuzhaojing closed pull request #3390: [HUDI-2087] Support Append only in Flink stream

2021-08-04 Thread GitBox
yuzhaojing closed pull request #3390: URL: https://github.com/apache/hudi/pull/3390 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392799#comment-17392799 ] ASF GitHub Bot commented on HUDI-2087: -- yuzhaojing commented on a change in pull request #3390: URL:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392801#comment-17392801 ] ASF GitHub Bot commented on HUDI-2087: -- yuzhaojing closed pull request #3390: URL:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392800#comment-17392800 ] ASF GitHub Bot commented on HUDI-2087: -- yuzhaojing opened a new pull request #3390: URL:

[jira] [Commented] (HUDI-1138) Re-implement marker files via timeline server

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392809#comment-17392809 ] ASF GitHub Bot commented on HUDI-1138: -- hudi-bot edited a comment on pull request #3233: URL:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392755#comment-17392755 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan edited a comment on pull request #3398: URL:

[jira] [Commented] (HUDI-2042) Compare the field object directly in OverwriteWithLatestAvroPayload

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392773#comment-17392773 ] ASF GitHub Bot commented on HUDI-2042: -- minihippo commented on pull request #3108: URL:

[GitHub] [hudi] minihippo commented on pull request #3108: [HUDI-2042] Compare the field object directly in OverwriteWithLatestA…

2021-08-04 Thread GitBox
minihippo commented on pull request #3108: URL: https://github.com/apache/hudi/pull/3108#issuecomment-892401926 Hi @nsivabalan , can we land this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392808#comment-17392808 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN *

[GitHub] [hudi] veenaypatil commented on pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox
veenaypatil commented on pull request #3375: URL: https://github.com/apache/hudi/pull/3375#issuecomment-892758248 Closing and creating a new PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] veenaypatil closed pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox
veenaypatil closed pull request #3375: URL: https://github.com/apache/hudi/pull/3375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393284#comment-17393284 ] ASF GitHub Bot commented on HUDI-2233: -- nsivabalan commented on a change in pull request #3387: URL:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
nsivabalan commented on a change in pull request #3387: URL: https://github.com/apache/hudi/pull/3387#discussion_r682736531 ## File path: hudi-sync/hudi-hive-sync/src/main/java/org/apache/hudi/hive/ddl/HiveSyncMode.java ## @@ -0,0 +1,29 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] nsivabalan commented on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
nsivabalan commented on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892780304 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] satishkotha commented on pull request #3211: [HUDI-1468] Support more flexible clustering strategies and preserve commit …

2021-08-04 Thread GitBox
satishkotha commented on pull request #3211: URL: https://github.com/apache/hudi/pull/3211#issuecomment-892786714 > @codope @satishkotha what's the next step here? > Could I help somehow to get this moving along @codope is working on adding additional tests for this PR. he

[GitHub] [hudi] vingov commented on pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox
vingov commented on pull request #3375: URL: https://github.com/apache/hudi/pull/3375#issuecomment-892796613 Thanks, @nsivabalan! I pushed multiple changes after the site was rebuilt, all the tests were passed. AFAIK, the asf-site build works as expected. -- This is an automated

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN * Unknown: [CANCELED](TBD) *

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393344#comment-17393344 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] vingov commented on pull request #3405: [HUDI-1985] Added algolia search to the site + fixed broken links on the blog

2021-08-04 Thread GitBox
vingov commented on pull request #3405: URL: https://github.com/apache/hudi/pull/3405#issuecomment-892832349 Search bar in my local: ![Screen Shot 2021-08-04 at 10 16 22 AM](https://user-images.githubusercontent.com/1142498/128225323-1710b662-d8c3-4482-b268-fd9b309986c1.png)

[GitHub] [hudi] vinothchandar opened a new pull request #3406: [DOCS] Continuous refinement of how we explain Hudi

2021-08-04 Thread GitBox
vinothchandar opened a new pull request #3406: URL: https://github.com/apache/hudi/pull/3406 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN *

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393274#comment-17393274 ] ASF GitHub Bot commented on HUDI-2257: -- veenaypatil commented on pull request #3375: URL:

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393275#comment-17393275 ] ASF GitHub Bot commented on HUDI-2257: -- veenaypatil closed pull request #3375: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393286#comment-17393286 ] ASF GitHub Bot commented on HUDI-2233: -- nsivabalan commented on pull request #3387: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
nsivabalan commented on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-892775157 my bad. I checked out the master. I did not realize we had sync mode even before this patch. Ignore my previous question. I see this code block. ``` if

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393295#comment-17393295 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3398: [HUDI-2273] Moving some long running tests to functional

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3398: URL: https://github.com/apache/hudi/pull/3398#issuecomment-892305785 ## CI report: * 0a32f4afcbf92b85e51b12de7af26b918d58a549 UNKNOWN * 805cfcf4e270703ccb03d0db17253308e66280c5 UNKNOWN * Unknown: [CANCELED](TBD) *

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393338#comment-17393338 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on pull request #3398: URL:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393348#comment-17393348 ] ASF GitHub Bot commented on HUDI-1985: -- vingov opened a new pull request #3405: URL:

[GitHub] [hudi] nsivabalan commented on pull request #3375: [HUDI-2257] Adding note to set Keygen class while deleting data

2021-08-04 Thread GitBox
nsivabalan commented on pull request #3375: URL: https://github.com/apache/hudi/pull/3375#issuecomment-892756968 nvm. guess some conflicts. UI did not show clearly, but logs showed some conflicts;. have asked vinay to fix it. -- This is an automated message from the Apache Git Service.

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393271#comment-17393271 ] ASF GitHub Bot commented on HUDI-2257: -- nsivabalan commented on pull request #3375: URL:

[GitHub] [hudi] codope commented on issue #3280: [SUPPORT] Use structedstreaming to consume kafka to write to hudi error

2021-08-04 Thread GitBox
codope commented on issue #3280: URL: https://github.com/apache/hudi/issues/3280#issuecomment-892762965 @liujinhui1994 I tried to reproduce this locally but for me the streaming ran fine. My setup is Spark 2.4.7, Hadoop 2.7.3 and Hive 2.3.7. I tried for both COW and MOR table ```

[GitHub] [hudi] codope commented on pull request #3393: [HUDI-1842] Spark Sql Support For The Exists Hoodie Table

2021-08-04 Thread GitBox
codope commented on pull request #3393: URL: https://github.com/apache/hudi/pull/3393#issuecomment-892777427 > > > Hey peng. I did a round of testing on this patch. Here are my findings. > > > Insert into is till prefixing col name to meta fields. (3rd col and 4th col) > > > ``` >

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393293#comment-17393293 ] ASF GitHub Bot commented on HUDI-2273: -- nsivabalan commented on pull request #3398: URL:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393340#comment-17393340 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393349#comment-17393349 ] ASF GitHub Bot commented on HUDI-1985: -- vingov commented on pull request #3405: URL:

[jira] [Commented] (HUDI-1985) Website re-design implementation

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393362#comment-17393362 ] ASF GitHub Bot commented on HUDI-1985: -- vinothchandar commented on pull request #3405: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392832#comment-17392832 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392845#comment-17392845 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3401: [HUDI-2170] Always choose the latest record for HoodieRecordPayload

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3401: URL: https://github.com/apache/hudi/pull/3401#issuecomment-892472052 ## CI report: * 7fe0db6bdda8a2f543d068efa1cbb60682b2ef95 UNKNOWN * eb5956b8463eafa8253732698fc26778b15b2829 UNKNOWN Bot commands @hudi-bot

[jira] [Commented] (HUDI-2233) [SQL] Hive sync is not working

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392909#comment-17392909 ] ASF GitHub Bot commented on HUDI-2233: -- hudi-bot edited a comment on pull request #3387: URL:

[jira] [Commented] (HUDI-2167) HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392908#comment-17392908 ] ASF GitHub Bot commented on HUDI-2167: -- hudi-bot commented on pull request #3402: URL:

[GitHub] [hudi] hudi-bot commented on pull request #3402: [HUDI-2167] HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-04 Thread GitBox
hudi-bot commented on pull request #3402: URL: https://github.com/apache/hudi/pull/3402#issuecomment-892505211 ## CI report: * 40aa4313a56c82473828865ddcef89b550499d1e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] hudi-bot edited a comment on pull request #3387: [HUDI-2233] Use HMS To Sync Hive Meta For Spark Sql

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3387: URL: https://github.com/apache/hudi/pull/3387#issuecomment-891570386 ## CI report: * dae0d69eade3ba95d39e37c1851a56534f80e007 UNKNOWN * e2e35cec3fb48b01bf0a19bf4f2913bd7cb45a2b Azure:

[jira] [Commented] (HUDI-2167) HoodieCompactionConfig get HoodieCleaningPolicy NullPointerException

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392930#comment-17392930 ] ASF GitHub Bot commented on HUDI-2167: -- danny0405 commented on a change in pull request #3402: URL:

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17392949#comment-17392949 ] ASF GitHub Bot commented on HUDI-2087: -- danny0405 merged pull request #3390: URL:

[hudi] branch master updated (b8b9d6d -> 5574e09)

2021-08-04 Thread zhiwei
This is an automated email from the ASF dual-hosted git repository. zhiwei pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from b8b9d6d [HUDI-2087] Support Append only in Flink stream (#3390) add 5574e09 [HUDI-2232] [SQL] MERGE INTO fails

[GitHub] [hudi] pengzhiwei2018 merged pull request #3379: [HUDI-2232] [SQL] MERGE INTO fails with table having nested struct type

2021-08-04 Thread GitBox
pengzhiwei2018 merged pull request #3379: URL: https://github.com/apache/hudi/pull/3379 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HUDI-2274) Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2274: - Labels: pull-request-available (was: ) > Allows INSERT duplicates for Flink MOR table >

[jira] [Commented] (HUDI-2274) Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393028#comment-17393028 ] ASF GitHub Bot commented on HUDI-2274: -- danny0405 opened a new pull request #3403: URL:

[GitHub] [hudi] danny0405 opened a new pull request #3403: [HUDI-2274] Allows INSERT duplicates for Flink MOR table

2021-08-04 Thread GitBox
danny0405 opened a new pull request #3403: URL: https://github.com/apache/hudi/pull/3403 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of the

[jira] [Commented] (HUDI-2243) Support Time Travel Query For Hoodie Table

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393041#comment-17393041 ] ASF GitHub Bot commented on HUDI-2243: -- hudi-bot edited a comment on pull request #3360: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3360: [HUDI-2243] Support Time Travel Query For Hoodie Table

2021-08-04 Thread GitBox
hudi-bot edited a comment on pull request #3360: URL: https://github.com/apache/hudi/pull/3360#issuecomment-888079450 ## CI report: * f421cd891e1813dcf38e62fbf9caecab8c7bcace Azure:

[jira] [Commented] (HUDI-2273) Bring down the total test run time with CI

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393268#comment-17393268 ] ASF GitHub Bot commented on HUDI-2273: -- hudi-bot edited a comment on pull request #3398: URL:

[jira] [Commented] (HUDI-2257) Add a note to set keygenerator class while deleting data

2021-08-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17393283#comment-17393283 ] ASF GitHub Bot commented on HUDI-2257: -- veenaypatil opened a new pull request #3404: URL:

  1   2   3   4   5   >