[GitHub] [hudi] hudi-bot edited a comment on pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3823: URL: https://github.com/apache/hudi/pull/3823#issuecomment-946850790 ## CI report: * 704b6441521e368672d45893fa951fbd22257fa5 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3823: URL: https://github.com/apache/hudi/pull/3823#issuecomment-946850790 ## CI report: * 704b6441521e368672d45893fa951fbd22257fa5 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 2a3dab04e4119022e35debf2753fbabc89b3 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 2a3dab04e4119022e35debf2753fbabc89b3 Azure:

[GitHub] [hudi] yihua commented on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
yihua commented on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-952557838 @nsivabalan @vinothchandar I addressed all the comments. Could you take another pass? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Created] (HUDI-2632) Schema evolution for flink parquet reader

2021-10-26 Thread Danny Chen (Jira)
Danny Chen created HUDI-2632: Summary: Schema evolution for flink parquet reader Key: HUDI-2632 URL: https://issues.apache.org/jira/browse/HUDI-2632 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] hudi-bot edited a comment on pull request #3861: [WIP] Inspecting IT test failures

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3861: URL: https://github.com/apache/hudi/pull/3861#issuecomment-950966097 ## CI report: * bd90aabc79019127f0dbec591d3d3a9a7251dd5e Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-924523979 ## CI report: * 421892e22d1e2cfe194eebd818cf707be70f8156 Azure:

[GitHub] [hudi] nsivabalan commented on a change in pull request #3802: [HUDI-1500] Support replace commit in DeltaSync with commit metadata preserved

2021-10-26 Thread GitBox
nsivabalan commented on a change in pull request #3802: URL: https://github.com/apache/hudi/pull/3802#discussion_r737102067 ## File path: hudi-utilities/src/test/java/org/apache/hudi/utilities/functional/TestHoodieDeltaStreamer.java ## @@ -1137,8 +1144,9 @@ public void

[GitHub] [hudi] hudi-bot edited a comment on pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3823: URL: https://github.com/apache/hudi/pull/3823#issuecomment-946850790 ## CI report: * 704b6441521e368672d45893fa951fbd22257fa5 Azure:

[jira] [Created] (HUDI-2631) In CompactFunction, set up the write schema each time with the latest schema

2021-10-26 Thread Danny Chen (Jira)
Danny Chen created HUDI-2631: Summary: In CompactFunction, set up the write schema each time with the latest schema Key: HUDI-2631 URL: https://issues.apache.org/jira/browse/HUDI-2631 Project: Apache

[GitHub] [hudi] hudi-bot edited a comment on pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3823: URL: https://github.com/apache/hudi/pull/3823#issuecomment-946850790 ## CI report: * c491ffdeda525930fe01333daa7de0aa9c691df1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3823: URL: https://github.com/apache/hudi/pull/3823#issuecomment-946850790 ## CI report: * c491ffdeda525930fe01333daa7de0aa9c691df1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-914114290 ## CI report: * cb2d4c6bb353d978ff7e239536a42e8940605168 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3861: [WIP] Inspecting IT test failures

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3861: URL: https://github.com/apache/hudi/pull/3861#issuecomment-950966097 ## CI report: * 7746197bf4f39c28b2f98eefb2031b86f56e29a5 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3861: [WIP] Inspecting IT test failures

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3861: URL: https://github.com/apache/hudi/pull/3861#issuecomment-950966097 ## CI report: * 7746197bf4f39c28b2f98eefb2031b86f56e29a5 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-924523979 ## CI report: * 421892e22d1e2cfe194eebd818cf707be70f8156 Azure:

[GitHub] [hudi] dongkelun commented on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-26 Thread GitBox
dongkelun commented on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-952510218 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot edited a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-914114290 ## CI report: * 917d5ea4676141f19d078d2a561995e151221c54 Azure:

[GitHub] [hudi] liujinhui1994 removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
liujinhui1994 removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-951786854 [ERROR] Tests run: 5, Failures: 4, Errors: 0, Skipped: 1, Time elapsed: 60.788 s <<< FAILURE! - in org.apache.hudi.cli.integ.ITTestRepairsCommand [ERROR]

[GitHub] [hudi] hudi-bot edited a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-914114290 ## CI report: * 917d5ea4676141f19d078d2a561995e151221c54 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-914114290 ## CI report: * Unknown: [CANCELED](TBD) * 917d5ea4676141f19d078d2a561995e151221c54 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-914114290 ## CI report: * Unknown: [CANCELED](TBD) * 917d5ea4676141f19d078d2a561995e151221c54 UNKNOWN Bot commands @hudi-bot supports the following

[GitHub] [hudi] liujinhui1994 commented on pull request #3614: [HUDI-2370] Supports data encryption

2021-10-26 Thread GitBox
liujinhui1994 commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-952481648 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] dongkelun commented on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-26 Thread GitBox
dongkelun commented on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-952473543 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3330: [HUDI-2101][RFC-28]support z-order for hudi

2021-10-26 Thread GitBox
xiarixiaoyao commented on a change in pull request #3330: URL: https://github.com/apache/hudi/pull/3330#discussion_r737040967 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/execution/bulkinsert/RDDSpatialCurveOptimizationSortPartitioner.java ## @@

[GitHub] [hudi] laurieliyang commented on issue #3839: [Documentation] How can I translate the docs ?

2021-10-26 Thread GitBox
laurieliyang commented on issue #3839: URL: https://github.com/apache/hudi/issues/3839#issuecomment-952457793 > Hi @laurieliyang I just discovered that it looks like the Chinese localized docs only go up to v0.8.0. I am working to fix this so it also applies to current version.

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 2a3dab04e4119022e35debf2753fbabc89b3 Azure:

[GitHub] [hudi] kywe665 commented on pull request #3855: [HUDI-2607] Reorganize Hudi Docs

2021-10-26 Thread GitBox
kywe665 commented on pull request #3855: URL: https://github.com/apache/hudi/pull/3855#issuecomment-952402410 I found that the chinese docs were missing from v0.9.0. Looks like somehow they didn't get versioned at last release? I corrected the issue so that what was localized before

[GitHub] [hudi] yihua commented on a change in pull request #3746: [HUDI-2515] Add close when producing records failed

2021-10-26 Thread GitBox
yihua commented on a change in pull request #3746: URL: https://github.com/apache/hudi/pull/3746#discussion_r736983188 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetReaderIterator.java ## @@ -49,8 +49,9 @@ public boolean hasNext() {

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * bede6e6be4fda354793dc429de79e863f35c20ae Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * bede6e6be4fda354793dc429de79e863f35c20ae Azure:

[GitHub] [hudi] yihua commented on a change in pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
yihua commented on a change in pull request #3778: URL: https://github.com/apache/hudi/pull/3778#discussion_r736980261 ## File path: hudi-common/src/main/java/org/apache/hudi/common/data/HoodieMapPairData.java ## @@ -0,0 +1,157 @@ +/* + * Licensed to the Apache Software

[GitHub] [hudi] hudi-bot edited a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 8297063ac494454f142c3c0f92a9b4a3cb0b2f20 Azure:

[hudi] branch master updated: [HUDI-1475]: fixed java doc for precombine api (#3867)

2021-10-26 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new ae00079 [HUDI-1475]: fixed java doc for

[GitHub] [hudi] vinothchandar merged pull request #3867: [HUDI-1475]: fixed java doc for precombine api

2021-10-26 Thread GitBox
vinothchandar merged pull request #3867: URL: https://github.com/apache/hudi/pull/3867 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] vinothchandar commented on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-26 Thread GitBox
vinothchandar commented on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952367956 @yihua can you please do a first pass review here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [hudi] hudi-bot edited a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 8297063ac494454f142c3c0f92a9b4a3cb0b2f20 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 2f7738ef847d6a237d5d9800aab36769d4f8ab8d Azure:

[GitHub] [hudi] vinothchandar commented on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
vinothchandar commented on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-952355364 @minihippo yes. we can target this for 0.10.0 . Your take is that this should be ready for landing, after which we can do the follow ons? -- This is an automated message

[hudi] branch master updated (b1c4acf -> 643b1a4)

2021-10-26 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from b1c4acf [HUDI-2614] Remove duplicated hadoop-hdfs with tests classifier exists in bundles (#3864) add 643b1a4

[GitHub] [hudi] vinothchandar merged pull request #3858: [MINOR] Fix README for hudi-kafka-connect

2021-10-26 Thread GitBox
vinothchandar merged pull request #3858: URL: https://github.com/apache/hudi/pull/3858 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3871: [HUDI-2593] Enabling virtual keys for the metadata table

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3871: URL: https://github.com/apache/hudi/pull/3871#issuecomment-952298117 ## CI report: * ff9411c410ffbc5ce9b18b7ec97e226764062010 Azure:

[GitHub] [hudi] atharvai commented on issue #3870: [SUPPORT] Hudi v0.8.0 Savepoint rollback failure

2021-10-26 Thread GitBox
atharvai commented on issue #3870: URL: https://github.com/apache/hudi/issues/3870#issuecomment-952312361 Spark history server shows the app has no jobs or stages. seems odd that it looks like a no-op

[GitHub] [hudi] hudi-bot edited a comment on pull request #3871: [HUDI-2593] Disabling meta fields in the metadata table

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3871: URL: https://github.com/apache/hudi/pull/3871#issuecomment-952298117 ## CI report: * ff9411c410ffbc5ce9b18b7ec97e226764062010 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3871: [HUDI-2593] Disabling meta fields in the metadata table

2021-10-26 Thread GitBox
hudi-bot commented on pull request #3871: URL: https://github.com/apache/hudi/pull/3871#issuecomment-952298117 ## CI report: * ff9411c410ffbc5ce9b18b7ec97e226764062010 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

[jira] [Updated] (HUDI-2593) Enable virtual keys for metadata table

2021-10-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2593: - Labels: pull-request-available (was: ) > Enable virtual keys for metadata table >

[jira] [Updated] (HUDI-2593) Enable virtual keys for metadata table

2021-10-26 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2593: - Status: Patch Available (was: In Progress) > Enable virtual keys for metadata table >

[GitHub] [hudi] manojpec opened a new pull request #3871: [HUDI-2593] Disabling meta fields in the metadata table

2021-10-26 Thread GitBox
manojpec opened a new pull request #3871: URL: https://github.com/apache/hudi/pull/3871 ## What is the purpose of the pull request Meta fields like _hoodie_record_key, _hoodie_commit_time are not needed for the metadata table. Disabling it. ## Brief change log

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * bede6e6be4fda354793dc429de79e863f35c20ae Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 67c6e4a2fe83469fd99a821be21636867bf2ecb0 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3778: [HUDI-2502] Refactor index in hudi-client module

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3778: URL: https://github.com/apache/hudi/pull/3778#issuecomment-939762523 ## CI report: * 67c6e4a2fe83469fd99a821be21636867bf2ecb0 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 ## CI report: * 1209fe7ad83387b945d789346b068fac67aef759 Azure:

[jira] [Assigned] (HUDI-1436) Provide Option to run auto clean every nth commit.

2021-10-26 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma reassigned HUDI-1436: -- Assignee: Pratyaksh Sharma (was: Sreeram Ramji) > Provide Option to run auto clean

[jira] [Updated] (HUDI-1436) Provide Option to run auto clean every nth commit.

2021-10-26 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-1436: --- Status: In Progress (was: Open) > Provide Option to run auto clean every nth commit. >

[jira] [Closed] (HUDI-2496) Inserts are precombined even with dedup disabled

2021-10-26 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma closed HUDI-2496. -- > Inserts are precombined even with dedup disabled >

[jira] [Resolved] (HUDI-2496) Inserts are precombined even with dedup disabled

2021-10-26 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma resolved HUDI-2496. Resolution: Fixed > Inserts are precombined even with dedup disabled >

[jira] [Updated] (HUDI-1475) Fix documentation of preCombine to clarify when this API is used by Hudi

2021-10-26 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-1475: --- Status: In Progress (was: Open) > Fix documentation of preCombine to clarify when this API

[jira] [Updated] (HUDI-1475) Fix documentation of preCombine to clarify when this API is used by Hudi

2021-10-26 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-1475: --- Status: Patch Available (was: In Progress) > Fix documentation of preCombine to clarify when

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 ## CI report: * 7bb77d2a5fb574a9ff1b178a06088e5e508e6c9c Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3824: URL: https://github.com/apache/hudi/pull/3824#issuecomment-946872755 ## CI report: * 7bb77d2a5fb574a9ff1b178a06088e5e508e6c9c Azure:

[GitHub] [hudi] davehagman commented on a change in pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
davehagman commented on a change in pull request #3824: URL: https://github.com/apache/hudi/pull/3824#discussion_r736793931 ## File path: hudi-flink/src/main/java/org/apache/hudi/util/StreamerUtil.java ## @@ -423,8 +423,8 @@ public static String medianInstantTime(String

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * ee973637958fb9c1496cfb45f78346e2f01ffa02 UNKNOWN * 2ef9ac2280e54bccc1bf9b599a0be203008b04de Azure:

[GitHub] [hudi] davehagman commented on a change in pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
davehagman commented on a change in pull request #3824: URL: https://github.com/apache/hudi/pull/3824#discussion_r736770187 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java ## @@ -59,7 +59,7 @@ */ public class

[GitHub] [hudi] davehagman commented on a change in pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
davehagman commented on a change in pull request #3824: URL: https://github.com/apache/hudi/pull/3824#discussion_r736769346 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java ## @@ -59,7 +60,16 @@ */ public class

[GitHub] [hudi] davehagman commented on a change in pull request #3824: [HUDI-1292] Millisecond granularity for instant timestamps

2021-10-26 Thread GitBox
davehagman commented on a change in pull request #3824: URL: https://github.com/apache/hudi/pull/3824#discussion_r73679 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java ## @@ -74,6 +84,43 @@ protected

[GitHub] [hudi] fengjian428 commented on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-26 Thread GitBox
fengjian428 commented on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-952137960 > @fengjian428 FYI. error from CI test. seems related to the change > > ``` > [ERROR] TestHiveSchemaProvider.testSourceSchema() Time elapsed: 0.569 s <<< ERROR!

[GitHub] [hudi] kywe665 commented on issue #3839: [Documentation] How can I translate the docs ?

2021-10-26 Thread GitBox
kywe665 commented on issue #3839: URL: https://github.com/apache/hudi/issues/3839#issuecomment-952135431 Hi @laurieliyang I just discovered that it looks like the Chinese localized docs only go up to v0.8.0. I am working to fix this so it also applies to current version.

[jira] [Updated] (HUDI-1958) [Umbrella] Follow up items from 1 pass over GH issues

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-1958: -- Priority: Minor (was: Blocker) > [Umbrella] Follow up items from 1 pass over GH issues >

[jira] [Updated] (HUDI-1958) [Umbrella] Follow up items from 1 pass over GH issues

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-1958: -- Fix Version/s: (was: 0.10.0) > [Umbrella] Follow up items from 1 pass over GH issues >

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * ec8f5faf7e22343d3beee4c204bdd26de07436a1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-920215882 ## CI report: * 48f27001b3fe89ab09314e986784eec74c202d65 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * ec8f5faf7e22343d3beee4c204bdd26de07436a1 Azure:

[jira] [Updated] (HUDI-2628) Fix Chinese Docs

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2628: -- Status: In Progress (was: Open) > Fix Chinese Docs > > > Key:

[jira] [Updated] (HUDI-2628) Fix Chinese Docs

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2628: -- Priority: Blocker (was: Minor) > Fix Chinese Docs > > > Key:

[jira] [Updated] (HUDI-2628) Fix Chinese Docs

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2628: -- Fix Version/s: 0.10.0 > Fix Chinese Docs > > > Key: HUDI-2628 >

[jira] [Updated] (HUDI-2607) Reorganize Hudi docs

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2607: -- Status: Patch Available (was: In Progress) > Reorganize Hudi docs > > >

[jira] [Updated] (HUDI-2607) Reorganize Hudi docs

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2607: -- Fix Version/s: 0.10.0 > Reorganize Hudi docs > > > Key: HUDI-2607

[jira] [Updated] (HUDI-2607) Reorganize Hudi docs

2021-10-26 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2607: -- Priority: Blocker (was: Minor) > Reorganize Hudi docs > > > Key:

[jira] [Created] (HUDI-2630) Add undocumented features

2021-10-26 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2630: - Summary: Add undocumented features Key: HUDI-2630 URL: https://issues.apache.org/jira/browse/HUDI-2630 Project: Apache Hudi Issue Type: Sub-task

[jira] [Created] (HUDI-2629) Improve Overview Page

2021-10-26 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2629: - Summary: Improve Overview Page Key: HUDI-2629 URL: https://issues.apache.org/jira/browse/HUDI-2629 Project: Apache Hudi Issue Type: Sub-task Reporter:

[jira] [Created] (HUDI-2628) Fix Chinese Docs

2021-10-26 Thread Kyle Weller (Jira)
Kyle Weller created HUDI-2628: - Summary: Fix Chinese Docs Key: HUDI-2628 URL: https://issues.apache.org/jira/browse/HUDI-2628 Project: Apache Hudi Issue Type: Sub-task Reporter: Kyle

[GitHub] [hudi] YannByron commented on a change in pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
YannByron commented on a change in pull request #3823: URL: https://github.com/apache/hudi/pull/3823#discussion_r736729813 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -74,16 +77,23 @@ object

[jira] [Updated] (HUDI-1937) When clustering fail, generating unfinished replacecommit timeline.

2021-10-26 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra updated HUDI-1937: -- Status: Patch Available (was: In Progress) > When clustering fail, generating unfinished

[jira] [Assigned] (HUDI-2590) Validate Diff key gen w/ and w/o glob path with and w/o metadata enabled

2021-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2590: - Assignee: Sagar Sumit (was: Manoj Govindassamy) > Validate Diff key gen w/ and

[GitHub] [hudi] YannByron commented on a change in pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
YannByron commented on a change in pull request #3823: URL: https://github.com/apache/hudi/pull/3823#discussion_r736728472 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/factory/HoodieSparkKeyGeneratorFactory.java ## @@ -51,44 +49,70 @@

[GitHub] [hudi] YannByron commented on a change in pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
YannByron commented on a change in pull request #3823: URL: https://github.com/apache/hudi/pull/3823#discussion_r736728141 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java ## @@ -717,6 +719,16 @@ public PropertyBuilder

[GitHub] [hudi] YannByron commented on a change in pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
YannByron commented on a change in pull request #3823: URL: https://github.com/apache/hudi/pull/3823#discussion_r736724131 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -64,7 +67,7 @@ object HoodieSparkSqlWriter

[GitHub] [hudi] YannByron commented on a change in pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
YannByron commented on a change in pull request #3823: URL: https://github.com/apache/hudi/pull/3823#discussion_r736720713 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/keygen/TestCustomKeyGenerator.java ## @@ -259,7 +268,7 @@ public void

[GitHub] [hudi] nsivabalan commented on a change in pull request #3746: [HUDI-2515] Add close when producing records failed

2021-10-26 Thread GitBox
nsivabalan commented on a change in pull request #3746: URL: https://github.com/apache/hudi/pull/3746#discussion_r736719988 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetReaderIterator.java ## @@ -49,8 +49,9 @@ public boolean hasNext() {

[GitHub] [hudi] YannByron commented on a change in pull request #3823: [HUDI-2538] persist some configs to hoodie.properties when the first write

2021-10-26 Thread GitBox
YannByron commented on a change in pull request #3823: URL: https://github.com/apache/hudi/pull/3823#discussion_r736718500 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/keygen/factory/HoodieSparkKeyGeneratorFactory.java ## @@ -51,44 +49,70 @@

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * ec8f5faf7e22343d3beee4c204bdd26de07436a1 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-920215882 ## CI report: * 2593606faf5365b7a8f4816ad85572b4d888bd04 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * 70b236a91a85c1e0d306798cd30edb8ec85162a0 Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3671: [HUDI-2418] add HiveSchemaProvider

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3671: URL: https://github.com/apache/hudi/pull/3671#issuecomment-920215882 ## CI report: * 2593606faf5365b7a8f4816ad85572b4d888bd04 Azure:

[jira] [Updated] (HUDI-1623) Support start_commit_time & end_commit_times for serializable incremental pull

2021-10-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1623: -- Status: In Progress (was: Open) > Support start_commit_time & end_commit_times for

[GitHub] [hudi] YannByron commented on pull request #3700: [HUDI-2471] Add support ignoring case in merge into

2021-10-26 Thread GitBox
YannByron commented on pull request #3700: URL: https://github.com/apache/hudi/pull/3700#issuecomment-952084030 > > @dongkelun Sorry, I personally think the previous solution to lowercase fields may not be the best and most correct one. We should dig into the root cause. > > In

[GitHub] [hudi] hudi-bot edited a comment on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 2f7738ef847d6a237d5d9800aab36769d4f8ab8d Azure:

[GitHub] [hudi] hudi-bot edited a comment on pull request #3173: [HUDI-1951] Add bucket hash index, compatible with the hive bucket

2021-10-26 Thread GitBox
hudi-bot edited a comment on pull request #3173: URL: https://github.com/apache/hudi/pull/3173#issuecomment-869653867 ## CI report: * 70b236a91a85c1e0d306798cd30edb8ec85162a0 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3866: [HUDI-1430] SparkDataFrameWriteClient

2021-10-26 Thread GitBox
hudi-bot commented on pull request #3866: URL: https://github.com/apache/hudi/pull/3866#issuecomment-952070379 ## CI report: * 2f7738ef847d6a237d5d9800aab36769d4f8ab8d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run travis`

  1   2   3   >