[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389277#comment-17389277 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #3315: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * c3bdfdd1e47790f46f4263a7fb5242c01dd02188 UNKNOWN * 40cbb91efb34e6360849a42056de6343cc1251d6 UNKNOWN *

[jira] [Commented] (HUDI-2177) Virtual keys support for Compaction

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389275#comment-17389275 ] ASF GitHub Bot commented on HUDI-2177: -- hudi-bot edited a comment on pull request #3315: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3315: [HUDI-2177][HUDI-2200] Adding virtual keys support for MOR

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3315: URL: https://github.com/apache/hudi/pull/3315#issuecomment-883851530 ## CI report: * c3bdfdd1e47790f46f4263a7fb5242c01dd02188 UNKNOWN * 40cbb91efb34e6360849a42056de6343cc1251d6 UNKNOWN *

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389267#comment-17389267 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo edited a comment on pull request #3173: URL:

[jira] [Commented] (HUDI-1951) Hash Index for HUDI

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389265#comment-17389265 ] ASF GitHub Bot commented on HUDI-1951: -- minihippo commented on pull request #3173: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3365: [MINOR] fix check style error

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3365: URL: https://github.com/apache/hudi/pull/3365#issuecomment-10919 ## CI report: * 1bada8a9658e430582ea2c8e3cf83508dbd803ed Azure:

[GitHub] [hudi] minihippo edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-07-28 Thread GitBox
minihippo edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-11913 Hi @leesf, i will fix the unresolved comments in these two days -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] minihippo commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-07-28 Thread GitBox
minihippo commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-11913 Hi @leesf, i wil fix the unresolved comments in these two days -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389262#comment-17389262 ] ASF GitHub Bot commented on HUDI-1425: -- pengzhiwei2018 commented on pull request #2296: URL:

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389263#comment-17389263 ] ASF GitHub Bot commented on HUDI-1425: -- pengzhiwei2018 edited a comment on pull request #2296: URL:

[GitHub] [hudi] pengzhiwei2018 edited a comment on pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread GitBox
pengzhiwei2018 edited a comment on pull request #2296: URL: https://github.com/apache/hudi/pull/2296#issuecomment-11199 Hi @vinothchandar After this PR has merged, building the project will fail as `TestCOWDataSource` has reached the max file length 800. I have submit a PR to solve

[GitHub] [hudi] pengzhiwei2018 commented on pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread GitBox
pengzhiwei2018 commented on pull request #2296: URL: https://github.com/apache/hudi/pull/2296#issuecomment-11199 Hi @vinothchandar After this PR has merged, building the project will failed as `TestCOWDataSource` has reached the max file length 800. I have submit a PR to solve this:

[GitHub] [hudi] hudi-bot commented on pull request #3365: [MINOR] fix check style error

2021-07-28 Thread GitBox
hudi-bot commented on pull request #3365: URL: https://github.com/apache/hudi/pull/3365#issuecomment-10919 ## CI report: * 1bada8a9658e430582ea2c8e3cf83508dbd803ed UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[GitHub] [hudi] pengzhiwei2018 opened a new pull request #3365: [MINOR] fix check style error

2021-07-28 Thread GitBox
pengzhiwei2018 opened a new pull request #3365: URL: https://github.com/apache/hudi/pull/3365 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull request.* ## What is the purpose of

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389260#comment-17389260 ] ASF GitHub Bot commented on HUDI-1527: -- rmahindra123 commented on pull request #3353: URL:

[GitHub] [hudi] rmahindra123 commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-07-28 Thread GitBox
rmahindra123 commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-05871 > > That's pretty much the functionality, supporting reads of table without having to pass globs ("basePath/_/_/*") You can see the tests. > > Yes, I see. But the PR

[jira] [Created] (HUDI-2250) Bulk insert can work with tables w/o primary key

2021-07-28 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2250: - Summary: Bulk insert can work with tables w/o primary key Key: HUDI-2250 URL: https://issues.apache.org/jira/browse/HUDI-2250 Project: Apache Hudi

[jira] [Created] (HUDI-2249) Changing index type fails

2021-07-28 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-2249: - Summary: Changing index type fails Key: HUDI-2249 URL: https://issues.apache.org/jira/browse/HUDI-2249 Project: Apache Hudi Issue Type: Sub-task

[jira] [Commented] (HUDI-2231) Bump HIVE version to 2.3.9

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389252#comment-17389252 ] ASF GitHub Bot commented on HUDI-2231: -- vinothchandar commented on pull request #3355: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3355: [HUDI-2231] Bump HIVE version to 2.3.9

2021-07-28 Thread GitBox
vinothchandar commented on pull request #3355: URL: https://github.com/apache/hudi/pull/3355#issuecomment-888793501 @leoluan2009 can you please share why this is needed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389251#comment-17389251 ] ASF GitHub Bot commented on HUDI-1425: -- vinothchandar merged pull request #2296: URL:

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389250#comment-17389250 ] ASF GitHub Bot commented on HUDI-1425: -- vinothchandar commented on pull request #2296: URL:

[GitHub] [hudi] vinothchandar merged pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread GitBox
vinothchandar merged pull request #2296: URL: https://github.com/apache/hudi/pull/2296 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[hudi] branch master updated (efbbb67 -> bbadac7)

2021-07-28 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from efbbb67 [HUDI-2241] Explicit parallelism for flink bulk insert (#3357) add bbadac7 [HUDI-1425] Performance loss

[GitHub] [hudi] vinothchandar commented on pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread GitBox
vinothchandar commented on pull request #2296: URL: https://github.com/apache/hudi/pull/2296#issuecomment-888792744 https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=1235=results passed. landing. -- This is an automated message from the Apache Git Service.

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389247#comment-17389247 ] ASF GitHub Bot commented on HUDI-1425: -- hudi-bot edited a comment on pull request #2296: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #2296: URL: https://github.com/apache/hudi/pull/2296#issuecomment-874367360 ## CI report: * d4e3d89e0c02f1b9a704a61627f7aafec14e67e6 UNKNOWN * dc36883644cf88971ecf13dc3642d60e60a1e6ec UNKNOWN *

[jira] [Commented] (HUDI-2117) Unpersist the input rdd after the commit is completed

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389245#comment-17389245 ] ASF GitHub Bot commented on HUDI-2117: -- hudi-bot edited a comment on pull request #3207: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3207: [HUDI-2117] Unpersist the input rdd after the commit is completed to …

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3207: URL: https://github.com/apache/hudi/pull/3207#issuecomment-872128086 ## CI report: * 9dfadc7a259ac8a1552c4740455a575cbceb3264 UNKNOWN * 8f30f7d99d54758c35b839ea31c6d2b5ad101ba4 Azure:

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389242#comment-17389242 ] ASF GitHub Bot commented on HUDI-1527: -- pengzhiwei2018 commented on pull request #3353: URL:

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-07-28 Thread GitBox
pengzhiwei2018 commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-888779737 > That's pretty much the functionality, supporting reads of table without having to pass globs ("basePath/_/_/*") You can see the tests. Yes, I see. But the PR #2651

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389240#comment-17389240 ] ASF GitHub Bot commented on HUDI-1527: -- vinothchandar commented on pull request #3353: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-07-28 Thread GitBox
vinothchandar commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-888777601 That's pretty much the functionality, supporting reads of table without having to pass globs ("basePath/*/*/*") You can see the tests. -- This is an automated message

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389238#comment-17389238 ] ASF GitHub Bot commented on HUDI-1527: -- pengzhiwei2018 commented on pull request #3353: URL:

[GitHub] [hudi] pengzhiwei2018 commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-07-28 Thread GitBox
pengzhiwei2018 commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-888776637 Hi @rmahindra123 , the PR https://github.com/apache/hudi/pull/2651 has already support query by the table path. So I am not very understand what is the PR do, can you

[jira] [Commented] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389237#comment-17389237 ] ASF GitHub Bot commented on HUDI-2218: -- hudi-bot edited a comment on pull request #3341: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3341: [HUDI-2218] Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3341: URL: https://github.com/apache/hudi/pull/3341#issuecomment-886156722 ## CI report: * 9ac141d7fac4d35e1933adc48986de78f045ba95 Azure:

[jira] [Updated] (HUDI-922) [UMBRELLA] Transfer out of the Incubator

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-922: --- Fix Version/s: (was: 0.9.0) 0.10.0 > [UMBRELLA] Transfer out of the Incubator >

[jira] [Commented] (HUDI-922) [UMBRELLA] Transfer out of the Incubator

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389231#comment-17389231 ] Udit Mehrotra commented on HUDI-922: [~vinoth] moving this to 0.10.0. Not sure if this issue still

[jira] [Commented] (HUDI-956) Test MOR : Presto Realtime Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389229#comment-17389229 ] Udit Mehrotra commented on HUDI-956: >From Hudi's perspective the changes have already been merged

[jira] [Updated] (HUDI-956) Test MOR : Presto Realtime Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-956: --- Fix Version/s: (was: 0.9.0) 0.6.0 > Test MOR : Presto Realtime Query with

[jira] [Updated] (HUDI-956) Test MOR : Presto Realtime Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-956: --- Summary: Test MOR : Presto Realtime Query with metadata bootstrap (was: Test COW : Presto Realtime

[jira] [Updated] (HUDI-955) Test MOR : Presto Read Optimized Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-955: --- Fix Version/s: (was: 0.9.0) 0.6.0 > Test MOR : Presto Read Optimized Query with

[jira] [Commented] (HUDI-954) Test COW : Presto Read Optimized Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389227#comment-17389227 ] Udit Mehrotra commented on HUDI-954: >From Hudi's perspective the changes have already been merged

[jira] [Commented] (HUDI-955) Test MOR : Presto Read Optimized Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389228#comment-17389228 ] Udit Mehrotra commented on HUDI-955: >From Hudi's perspective the changes have already been merged

[jira] [Updated] (HUDI-954) Test COW : Presto Read Optimized Query with metadata bootstrap

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-954: --- Fix Version/s: (was: 0.9.0) 0.6.0 > Test COW : Presto Read Optimized Query with

[jira] [Updated] (HUDI-1180) Upgrade HBase to 2.3.3

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1180: Fix Version/s: (was: 0.9.0) 0.10.0 > Upgrade HBase to 2.3.3 >

[jira] [Updated] (HUDI-1869) Support Spark 3.1

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1869: Fix Version/s: (was: 0.9.0) 0.10.0 > Support Spark 3.1 > - >

[jira] [Updated] (HUDI-747) Implement Rollback like API in HoodieWriteClient which can revert all actions

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-747: --- Fix Version/s: (was: 0.9.0) 0.10.0 > Implement Rollback like API in

[jira] [Commented] (HUDI-304) Bring back spotless plugin

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389223#comment-17389223 ] Udit Mehrotra commented on HUDI-304: [~xushiyan] is this still being targeted for hudi 0.9.0 ? Else

[jira] [Updated] (HUDI-1112) Blog on Tracking Hudi Data along transaction time and buisness time

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1112: Fix Version/s: (was: 0.9.0) 0.10.0 > Blog on Tracking Hudi Data along

[jira] [Commented] (HUDI-1112) Blog on Tracking Hudi Data along transaction time and buisness time

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389222#comment-17389222 ] Udit Mehrotra commented on HUDI-1112: - Moving this to Hudi 0.10.0. > Blog on Tracking Hudi Data along

[jira] [Resolved] (HUDI-637) Investigate slower hudi queries in S3 vs HDFS

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-637. Resolution: Not A Problem > Investigate slower hudi queries in S3 vs HDFS >

[jira] [Commented] (HUDI-637) Investigate slower hudi queries in S3 vs HDFS

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389221#comment-17389221 ] Udit Mehrotra commented on HUDI-637: I do not deem this to be an issue any more. Resolving this. Please

[jira] [Commented] (HUDI-1425) Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389218#comment-17389218 ] ASF GitHub Bot commented on HUDI-1425: -- hudi-bot edited a comment on pull request #2296: URL:

[jira] [Commented] (HUDI-1371) Support file listing using metadata for Spark DataSource and Spark SQL queries

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389220#comment-17389220 ] ASF GitHub Bot commented on HUDI-1371: -- hudi-bot edited a comment on pull request #2893: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2893: [HUDI-1371] [HUDI-1893] Support metadata based listing for Spark DataSource and Spark SQL

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #2893: URL: https://github.com/apache/hudi/pull/2893#issuecomment-863021428 ## CI report: * 25302f80c8ff5fc109b3d51027f4443b31e868cf Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #2296: [HUDI-1425] Performance loss with the additional hoodieRecords.isEmpty() in HoodieSparkSqlWriter#write

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #2296: URL: https://github.com/apache/hudi/pull/2296#issuecomment-874367360 ## CI report: * d4e3d89e0c02f1b9a704a61627f7aafec14e67e6 UNKNOWN * dc36883644cf88971ecf13dc3642d60e60a1e6ec UNKNOWN *

[jira] [Updated] (HUDI-1974) Run pyspark and validate that it works correctly with all hudi versions

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1974: Fix Version/s: (was: 0.9.0) 0.10.0 > Run pyspark and validate that it works

[jira] [Commented] (HUDI-1974) Run pyspark and validate that it works correctly with all hudi versions

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389216#comment-17389216 ] Udit Mehrotra commented on HUDI-1974: - [~nishith29] moving this to hudi 0.10.0. Feel free to switch it

[jira] [Commented] (HUDI-1793) Refactor HoodieFlinkWriteClient#insertOverwrite and SparkRDDWriteClient#insertOverwrite

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389215#comment-17389215 ] Udit Mehrotra commented on HUDI-1793: - [~danny0405] moving this to be fixed in Hudi 0.10.0. >

[jira] [Updated] (HUDI-1793) Refactor HoodieFlinkWriteClient#insertOverwrite and SparkRDDWriteClient#insertOverwrite

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1793: Fix Version/s: (was: 0.9.0) 0.10.0 > Refactor

[jira] [Updated] (HUDI-2085) Support specify flink batch compaction paralleism and compaction target io

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-2085: Status: In Progress (was: Open) > Support specify flink batch compaction paralleism and compaction

[jira] [Resolved] (HUDI-2085) Support specify flink batch compaction paralleism and compaction target io

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-2085. - Resolution: Fixed > Support specify flink batch compaction paralleism and compaction target io >

[jira] [Commented] (HUDI-2087) Support Append only in Flink stream

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389212#comment-17389212 ] Udit Mehrotra commented on HUDI-2087: - [~yuzhaojing] [~danny0405] is this still being targeted any

[jira] [Commented] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389211#comment-17389211 ] ASF GitHub Bot commented on HUDI-2218: -- vinothchandar commented on pull request #3341: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3341: [HUDI-2218] Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread GitBox
vinothchandar commented on pull request #3341: URL: https://github.com/apache/hudi/pull/3341#issuecomment-888761826 nvm. this PR does not change any of that. ignore my comment above. if @xushiyan is happy, we can land this. -- This is an automated message from the Apache Git

[jira] [Commented] (HUDI-2117) Unpersist the input rdd after the commit is completed

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389209#comment-17389209 ] ASF GitHub Bot commented on HUDI-2117: -- hudi-bot edited a comment on pull request #3207: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3207: [HUDI-2117] Unpersist the input rdd after the commit is completed to …

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3207: URL: https://github.com/apache/hudi/pull/3207#issuecomment-872128086 ## CI report: * 673aa47c2278f2e4c254f1b0f9fa699b84e53a31 Azure:

[jira] [Updated] (HUDI-246) Apache Pulsar data source for Hudi DeltaStreamer

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-246: --- Fix Version/s: (was: 0.9.0) 0.10.0 > Apache Pulsar data source for Hudi

[jira] [Commented] (HUDI-2117) Unpersist the input rdd after the commit is completed

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389207#comment-17389207 ] ASF GitHub Bot commented on HUDI-2117: -- hudi-bot edited a comment on pull request #3207: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3207: [HUDI-2117] Unpersist the input rdd after the commit is completed to …

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3207: URL: https://github.com/apache/hudi/pull/3207#issuecomment-872128086 ## CI report: * 673aa47c2278f2e4c254f1b0f9fa699b84e53a31 Azure:

[jira] [Commented] (HUDI-2117) Unpersist the input rdd after the commit is completed

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389205#comment-17389205 ] ASF GitHub Bot commented on HUDI-2117: -- hudi-bot edited a comment on pull request #3207: URL:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3207: [HUDI-2117] Unpersist the input rdd after the commit is completed to …

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3207: URL: https://github.com/apache/hudi/pull/3207#issuecomment-872128086 ## CI report: * 673aa47c2278f2e4c254f1b0f9fa699b84e53a31 Azure:

[jira] [Commented] (HUDI-2117) Unpersist the input rdd after the commit is completed

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389202#comment-17389202 ] ASF GitHub Bot commented on HUDI-2117: -- vinothchandar commented on a change in pull request #3207:

[GitHub] [hudi] vinothchandar commented on a change in pull request #3207: [HUDI-2117] Unpersist the input rdd after the commit is completed to …

2021-07-28 Thread GitBox
vinothchandar commented on a change in pull request #3207: URL: https://github.com/apache/hudi/pull/3207#discussion_r678783220 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -1037,6 +1038,10 @@ protected

[jira] [Resolved] (HUDI-1551) Support Partition with BigDecimal/Integer field for TimestampBasedKeyGenerator

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-1551. - Resolution: Fixed > Support Partition with BigDecimal/Integer field for

[jira] [Commented] (HUDI-1241) Generate config docs automatically

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389197#comment-17389197 ] ASF GitHub Bot commented on HUDI-1241: -- vinothchandar closed pull request #3260: URL:

[jira] [Updated] (HUDI-1551) Support Partition with BigDecimal/Integer field for TimestampBasedKeyGenerator

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1551: Fix Version/s: 0.9.0 > Support Partition with BigDecimal/Integer field for

[jira] [Commented] (HUDI-1241) Generate config docs automatically

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389196#comment-17389196 ] ASF GitHub Bot commented on HUDI-1241: -- vinothchandar commented on pull request #3260: URL:

[jira] [Updated] (HUDI-1551) Support Partition with BigDecimal/Integer field for TimestampBasedKeyGenerator

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1551: Status: In Progress (was: Open) > Support Partition with BigDecimal/Integer field for

[GitHub] [hudi] vinothchandar closed pull request #3260: [HUDI-1241][WIP] Generate configuration doc automatically

2021-07-28 Thread GitBox
vinothchandar closed pull request #3260: URL: https://github.com/apache/hudi/pull/3260 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (HUDI-1551) Support Partition with BigDecimal/Integer field for TimestampBasedKeyGenerator

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1551: Summary: Support Partition with BigDecimal/Integer field for TimestampBasedKeyGenerator (was:

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389195#comment-17389195 ] ASF GitHub Bot commented on HUDI-1527: -- vinothchandar commented on pull request #3353: URL:

[GitHub] [hudi] vinothchandar commented on pull request #3260: [HUDI-1241][WIP] Generate configuration doc automatically

2021-07-28 Thread GitBox
vinothchandar commented on pull request #3260: URL: https://github.com/apache/hudi/pull/3260#issuecomment-888755802 Closing this in favor of #3302 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [hudi] vinothchandar commented on pull request #3353: [HUDI-1527] Automatically infer the full partition path when user only specifies the table path

2021-07-28 Thread GitBox
vinothchandar commented on pull request #3353: URL: https://github.com/apache/hudi/pull/3353#issuecomment-888755403 @pengzhiwei2018 are you able to take one pass at this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389192#comment-17389192 ] ASF GitHub Bot commented on HUDI-2218: -- garyli1019 commented on pull request #3341: URL:

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389193#comment-17389193 ] ASF GitHub Bot commented on HUDI-1527: -- vinothchandar commented on pull request #2475: URL:

[jira] [Resolved] (HUDI-1746) Added support for replace commits in hudi-cli

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra resolved HUDI-1746. - Resolution: Fixed > Added support for replace commits in hudi-cli >

[jira] [Commented] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389191#comment-17389191 ] ASF GitHub Bot commented on HUDI-2218: -- hudi-bot edited a comment on pull request #3341: URL:

[jira] [Commented] (HUDI-1527) Automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389194#comment-17389194 ] ASF GitHub Bot commented on HUDI-1527: -- vinothchandar closed pull request #2475: URL:

[GitHub] [hudi] vinothchandar closed pull request #2475: [HUDI-1527] automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread GitBox
vinothchandar closed pull request #2475: URL: https://github.com/apache/hudi/pull/2475 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on pull request #2475: [HUDI-1527] automatically infer the data directory, users only need to specify the table directory

2021-07-28 Thread GitBox
vinothchandar commented on pull request #2475: URL: https://github.com/apache/hudi/pull/2475#issuecomment-888755262 Closing in favor of #3353 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] garyli1019 commented on pull request #3341: [HUDI-2218] Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread GitBox
garyli1019 commented on pull request #3341: URL: https://github.com/apache/hudi/pull/3341#issuecomment-888755243 Hi @xushiyan , I extended the min-max event time feature you committed to a wider usage https://github.com/apache/hudi/commit/899ae70fdb70c1511c099a64230fd91b2fe8d4ee and

[jira] [Updated] (HUDI-1746) Added support for replace commits in hudi-cli

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1746: Fix Version/s: 0.9.0 > Added support for replace commits in hudi-cli >

[jira] [Updated] (HUDI-1746) Added support for replace commits in hudi-cli

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1746: Status: In Progress (was: Open) > Added support for replace commits in hudi-cli >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3341: [HUDI-2218] Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread GitBox
hudi-bot edited a comment on pull request #3341: URL: https://github.com/apache/hudi/pull/3341#issuecomment-886156722 ## CI report: * d3d42fd04828b0c73fae5a497b35aa3d1629388f Azure:

[jira] [Updated] (HUDI-1714) Improve code coverage of TestHoodieTimelineArchiveLog

2021-07-28 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-1714: Fix Version/s: 0.9.0 > Improve code coverage of TestHoodieTimelineArchiveLog >

[jira] [Commented] (HUDI-2218) Fix missing HoodieWriteStat in HoodieCreateHandle

2021-07-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17389187#comment-17389187 ] ASF GitHub Bot commented on HUDI-2218: -- hudi-bot edited a comment on pull request #3341: URL:

  1   2   3   4   >