[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972587261 ## CI report: * 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
hudi-bot commented on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972619707 ## CI report: * eb3383de0645ad08dcd959924b9f3fc6588823b1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-order Layout Optimization

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972617117 ## CI report: * e3e66985c79e4081759a4c3dcd5837b85803d4bd Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-order Layout Optimization

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972594379 ## CI report: * e3e66985c79e4081759a4c3dcd5837b85803d4bd Azure:

[GitHub] [hudi] nsivabalan edited a comment on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
nsivabalan edited a comment on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-968058611 I tried to test this patch locally. I am seeing a stacktrace if hudi-defaults.conf file is not present. We should definitely fix this. For users who don't have this

[GitHub] [hudi] nsivabalan edited a comment on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
nsivabalan edited a comment on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-968060623 Tested scenarios: 1. w/o setting HUDI_CONF_DIR, having issues as reported above. Needs fixing. 2. set proper HUDI_CONF_DIR env, but the dir does not contain the

[GitHub] [hudi] hudi-bot commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972606180 ## CI report: * 23ef0dc3cf648cef640263c06432fd7fc4708327 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972591270 ## CI report: * 23ef0dc3cf648cef640263c06432fd7fc4708327 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-order Layout Optimization

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972594379 ## CI report: * e3e66985c79e4081759a4c3dcd5837b85803d4bd Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-order Layout Optimization

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972592878 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-order Layout Optimization

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972585151 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-order Layout Optimization

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972592878 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972591270 ## CI report: * 23ef0dc3cf648cef640263c06432fd7fc4708327 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972589905 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4029: [HUDI-2790] Fix the changelog mode of HoodieTableSource

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4029: URL: https://github.com/apache/hudi/pull/4029#issuecomment-972589960 ## CI report: * c6817fa8582f0ff62479a4a31a327d6db2dc0ca8 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4029: [HUDI-2790] Fix the changelog mode of HoodieTableSource

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4029: URL: https://github.com/apache/hudi/pull/4029#issuecomment-972567125 ## CI report: * c6817fa8582f0ff62479a4a31a327d6db2dc0ca8 Azure:

[GitHub] [hudi] xiarixiaoyao commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
xiarixiaoyao commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972589911 @leesf @vinothchandar @alexeykudinkin address all comments and update the codes and more test case. could you help me review this pr again , thanks. -- This is

[GitHub] [hudi] hudi-bot commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972589905 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order add fix some bugs

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972577078 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972586010 ## CI report: * 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
hudi-bot commented on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972587261 ## CI report: * 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
hudi-bot commented on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972586010 ## CI report: * 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #3416: [HUDI-2362] Add external config file support

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #3416: URL: https://github.com/apache/hudi/pull/3416#issuecomment-972305777 ## CI report: * 44f4575ea51c6dfdbe6424d0d236b242f8bc81ba Azure:

[jira] [Commented] (HUDI-1870) Move spark avro serialization class into hudi repo

2021-11-17 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445674#comment-17445674 ] Yann Byron commented on HUDI-1870: -- [~xushiyan] Got it, and will fix it. > Move spark avro

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972584061 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972585151 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972538242 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972584061 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972577078 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972575950 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972575950 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4016: [HUDI-2675] Fix the exception 'Not an Avro data file' when archive and clean

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4016: URL: https://github.com/apache/hudi/pull/4016#issuecomment-972575976 ## CI report: * aec4dde1fb90319de9cf0c6f34771c0f193ccfd9 UNKNOWN * f426cb3cc3513d1baf26a70fdcb18114ffe5ddc5 UNKNOWN * 32ec46f289e4ecf4c1e66241ea954a9f3b34e9a6

[GitHub] [hudi] hudi-bot removed a comment on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-971332508 ## CI report: * 9a11df297537d5dc7e68deb032f9c8ad70b0e049 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4016: [HUDI-2675] Fix the exception 'Not an Avro data file' when archive and clean

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4016: URL: https://github.com/apache/hudi/pull/4016#issuecomment-972556249 ## CI report: * aec4dde1fb90319de9cf0c6f34771c0f193ccfd9 UNKNOWN * f426cb3cc3513d1baf26a70fdcb18114ffe5ddc5 UNKNOWN *

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order

2021-11-17 Thread GitBox
xiarixiaoyao commented on a change in pull request #4013: URL: https://github.com/apache/hudi/pull/4013#discussion_r751938029 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/DataSkippingUtils.scala ## @@ -179,7 +179,7 @@ object

[GitHub] [hudi] yanghua commented on pull request #4019: [MINOR] Add RocketMQ to hudi lake landing page

2021-11-17 Thread GitBox
yanghua commented on pull request #4019: URL: https://github.com/apache/hudi/pull/4019#issuecomment-972571274 +1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [hudi] yanghua commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-17 Thread GitBox
yanghua commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-972569536 @danny0405 Double check? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [hudi] dik111 opened a new issue #4030: [SUPPORT] Flink uses updated fields to update data

2021-11-17 Thread GitBox
dik111 opened a new issue #4030: URL: https://github.com/apache/hudi/issues/4030 At some point, we can only get the updated fields. For example, Table A has three fields (a, b, c), but only two fields (a, b) are in the updated-changelog. Can we support updating only some fields operate in

[GitHub] [hudi] hudi-bot commented on pull request #4029: [HUDI-2790] Fix the changelog mode of HoodieTableSource

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4029: URL: https://github.com/apache/hudi/pull/4029#issuecomment-972567125 ## CI report: * c6817fa8582f0ff62479a4a31a327d6db2dc0ca8 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4029: [HUDI-2790] Fix the changelog mode of HoodieTableSource

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4029: URL: https://github.com/apache/hudi/pull/4029#issuecomment-972565837 ## CI report: * c6817fa8582f0ff62479a4a31a327d6db2dc0ca8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4029: [HUDI-2790] Fix the changelog mode of HoodieTableSource

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4029: URL: https://github.com/apache/hudi/pull/4029#issuecomment-972565837 ## CI report: * c6817fa8582f0ff62479a4a31a327d6db2dc0ca8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-2790) Fix the changelog mode of HoodieTableSource

2021-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2790: - Labels: pull-request-available (was: ) > Fix the changelog mode of HoodieTableSource >

[GitHub] [hudi] danny0405 opened a new pull request #4029: [HUDI-2790] Fix the changelog mode of HoodieTableSource

2021-11-17 Thread GitBox
danny0405 opened a new pull request #4029: URL: https://github.com/apache/hudi/pull/4029 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Created] (HUDI-2790) Fix the changelog mode of HoodieTableSource

2021-11-17 Thread Danny Chen (Jira)
Danny Chen created HUDI-2790: Summary: Fix the changelog mode of HoodieTableSource Key: HUDI-2790 URL: https://issues.apache.org/jira/browse/HUDI-2790 Project: Apache Hudi Issue Type: Bug

[jira] [Resolved] (HUDI-2789) Flink batch upsert for non partitioned table does not work

2021-11-17 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-2789. -- > Flink batch upsert for non partitioned table does not work >

[jira] [Commented] (HUDI-2789) Flink batch upsert for non partitioned table does not work

2021-11-17 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445652#comment-17445652 ] Danny Chen commented on HUDI-2789: -- Fixed via master branch: 71a2ae0fd6163d3108c6557ce6295f649246adcb >

[hudi] branch master updated (2d3f2a3 -> 71a2ae0)

2021-11-17 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 2d3f2a3 [HUDI-2734] Setting default metadata enable as false for Java (#4003) add 71a2ae0 [HUDI-2789] Flink

[GitHub] [hudi] danny0405 merged pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
danny0405 merged pull request #4028: URL: https://github.com/apache/hudi/pull/4028 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4028: URL: https://github.com/apache/hudi/pull/4028#issuecomment-972539248 ## CI report: * ce9a5f9f58fba43ec1a98a2cd898fc25a5ca620e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4028: URL: https://github.com/apache/hudi/pull/4028#issuecomment-972560107 ## CI report: * ce9a5f9f58fba43ec1a98a2cd898fc25a5ca620e Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4016: [HUDI-2675] Fix the exception 'Not an Avro data file' when archive and clean

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4016: URL: https://github.com/apache/hudi/pull/4016#issuecomment-972556249 ## CI report: * aec4dde1fb90319de9cf0c6f34771c0f193ccfd9 UNKNOWN * f426cb3cc3513d1baf26a70fdcb18114ffe5ddc5 UNKNOWN * 32ec46f289e4ecf4c1e66241ea954a9f3b34e9a6

[GitHub] [hudi] hudi-bot removed a comment on pull request #4016: [HUDI-2675] Fix the exception 'Not an Avro data file' when archive and clean

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4016: URL: https://github.com/apache/hudi/pull/4016#issuecomment-972541462 ## CI report: * aec4dde1fb90319de9cf0c6f34771c0f193ccfd9 UNKNOWN * f426cb3cc3513d1baf26a70fdcb18114ffe5ddc5 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4016: [HUDI-2675] Fix the exception 'Not an Avro data file' when archive and clean

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4016: URL: https://github.com/apache/hudi/pull/4016#issuecomment-972541462 ## CI report: * aec4dde1fb90319de9cf0c6f34771c0f193ccfd9 UNKNOWN * f426cb3cc3513d1baf26a70fdcb18114ffe5ddc5 UNKNOWN * 32ec46f289e4ecf4c1e66241ea954a9f3b34e9a6

[GitHub] [hudi] hudi-bot removed a comment on pull request #4016: [HUDI-2675] Fix the exception 'Not an Avro data file' when archive and clean

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4016: URL: https://github.com/apache/hudi/pull/4016#issuecomment-971744837 ## CI report: * aec4dde1fb90319de9cf0c6f34771c0f193ccfd9 UNKNOWN * f426cb3cc3513d1baf26a70fdcb18114ffe5ddc5 UNKNOWN *

[GitHub] [hudi] hudi-bot commented on pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4028: URL: https://github.com/apache/hudi/pull/4028#issuecomment-972539248 ## CI report: * ce9a5f9f58fba43ec1a98a2cd898fc25a5ca620e Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4028: URL: https://github.com/apache/hudi/pull/4028#issuecomment-972538262 ## CI report: * ce9a5f9f58fba43ec1a98a2cd898fc25a5ca620e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972538242 ## CI report: * 35605e6aa6afa0c5333dfcc5a3b63f767789be09 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972500657 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4028: URL: https://github.com/apache/hudi/pull/4028#issuecomment-972538262 ## CI report: * ce9a5f9f58fba43ec1a98a2cd898fc25a5ca620e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-2789) Flink batch upsert for non partitioned table does not work

2021-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2789: - Labels: pull-request-available (was: ) > Flink batch upsert for non partitioned table does not

[GitHub] [hudi] danny0405 opened a new pull request #4028: [HUDI-2789] Flink batch upsert for non partitioned table does not work

2021-11-17 Thread GitBox
danny0405 opened a new pull request #4028: URL: https://github.com/apache/hudi/pull/4028 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Created] (HUDI-2789) Flink batch upsert for non partitioned table does not work

2021-11-17 Thread Danny Chen (Jira)
Danny Chen created HUDI-2789: Summary: Flink batch upsert for non partitioned table does not work Key: HUDI-2789 URL: https://issues.apache.org/jira/browse/HUDI-2789 Project: Apache Hudi Issue

[GitHub] [hudi] hudi-bot commented on pull request #4025: [HUDI-2742] - Added s3 object filter to support multiple S3EventsHood…

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4025: URL: https://github.com/apache/hudi/pull/4025#issuecomment-972533498 ## CI report: * 284f739772e4ff8f337a8d2c6d4c72302be4cdaa UNKNOWN * 8dc9c77f5035e0ab54a4d731a43ff545e053d9f1 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4025: [HUDI-2742] - Added s3 object filter to support multiple S3EventsHood…

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4025: URL: https://github.com/apache/hudi/pull/4025#issuecomment-972498000 ## CI report: * 5e9a288bf8a8634662f7d3fa42abe7253d80d6b1 Azure:

[jira] [Comment Edited] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445622#comment-17445622 ] Raymond Xu edited comment on HUDI-2234 at 11/18/21, 4:39 AM: -   {code:java}

[GitHub] [hudi] JoshuaZhuCN edited a comment on issue #3981: [SUPPORT] If the HUDI table(MOR) contains only log files, the Spark Datasource cannot obtain data in snapshot mode

2021-11-17 Thread GitBox
JoshuaZhuCN edited a comment on issue #3981: URL: https://github.com/apache/hudi/issues/3981#issuecomment-971393339 @xushiyan Hi,Here is my test code: ``` import com.leqee.sparktool.date.DateUtil import com.leqee.sparktool.hoodie.HoodieProp import

[GitHub] [hudi] JoshuaZhuCN edited a comment on issue #3981: [SUPPORT] If the HUDI table(MOR) contains only log files, the Spark Datasource cannot obtain data in snapshot mode

2021-11-17 Thread GitBox
JoshuaZhuCN edited a comment on issue #3981: URL: https://github.com/apache/hudi/issues/3981#issuecomment-971393339 @xushiyan Hi,Here is my test code: ``` import com.leqee.sparktool.date.DateUtil import com.leqee.sparktool.hoodie.HoodieProp import

[GitHub] [hudi] JoshuaZhuCN edited a comment on issue #3981: [SUPPORT] If the HUDI table(MOR) contains only log files, the Spark Datasource cannot obtain data in snapshot mode

2021-11-17 Thread GitBox
JoshuaZhuCN edited a comment on issue #3981: URL: https://github.com/apache/hudi/issues/3981#issuecomment-971393339 @xushiyan Hi,Here is my test code: ``` import com.leqee.sparktool.date.DateUtil import com.leqee.sparktool.hoodie.HoodieProp import

[jira] [Closed] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2234. > MERGE INTO works only ON primary key > > > Key:

[jira] [Resolved] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2234. -- > MERGE INTO works only ON primary key > > > Key:

[jira] [Commented] (HUDI-2234) MERGE INTO works only ON primary key

2021-11-17 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445622#comment-17445622 ] Raymond Xu commented on HUDI-2234: --   {code:java} create table if not exists h1 (id int, name string,

[GitHub] [hudi] hudi-bot removed a comment on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-972475571 ## CI report: * 9c1e75f71938f6c57104cf80d5bc5ce010f6fdb3 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #3813: [HUDI-2563][hudi-client] Refactor CompactionTriggerStrategy.

2021-11-17 Thread GitBox
hudi-bot commented on pull request #3813: URL: https://github.com/apache/hudi/pull/3813#issuecomment-972510246 ## CI report: * 08173246c29fda1c9880f5ad897cf61423523e1a Azure:

[jira] [Updated] (HUDI-2788) Z-ordering Layout Optimization Strategy fails w/ Data Skipping enabled

2021-11-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2788: - Labels: pull-request-available (was: ) > Z-ordering Layout Optimization Strategy fails w/ Data

[GitHub] [hudi] hudi-bot commented on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972500657 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [HUDI-2788][WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972484501 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4025: [HUDI-2742] - Added s3 object filter to support multiple S3EventsHood…

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4025: URL: https://github.com/apache/hudi/pull/4025#issuecomment-972490440 ## CI report: * 5e9a288bf8a8634662f7d3fa42abe7253d80d6b1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4025: [HUDI-2742] - Added s3 object filter to support multiple S3EventsHood…

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4025: URL: https://github.com/apache/hudi/pull/4025#issuecomment-972498000 ## CI report: * 5e9a288bf8a8634662f7d3fa42abe7253d80d6b1 Azure:

[jira] [Created] (HUDI-2788) Z-ordering Layout Optimization Strategy fails w/ Data Skipping enabled

2021-11-17 Thread Alexey Kudinkin (Jira)
Alexey Kudinkin created HUDI-2788: - Summary: Z-ordering Layout Optimization Strategy fails w/ Data Skipping enabled Key: HUDI-2788 URL: https://issues.apache.org/jira/browse/HUDI-2788 Project: Apache

[GitHub] [hudi] prashantwason commented on a change in pull request #4023: [HUDI-2472] Enabling metadata table for TestHoodieMergeOnReadTable and TestHoodieCompactor

2021-11-17 Thread GitBox
prashantwason commented on a change in pull request #4023: URL: https://github.com/apache/hudi/pull/4023#discussion_r751883243 ## File path: hudi-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestTable.java ## @@ -131,6 +131,7 @@ protected HoodieTestTable(String

[jira] [Updated] (HUDI-2716) InLineFS support for S3FS

2021-11-17 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-2716: - Summary: InLineFS support for S3FS (was: Fix InLineFS path conversions for S3FS paths)

[GitHub] [hudi] hudi-bot removed a comment on pull request #4025: [HUDI-2742] - Added s3 object filter to support multiple S3EventsHood…

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4025: URL: https://github.com/apache/hudi/pull/4025#issuecomment-972473090 ## CI report: * 5e9a288bf8a8634662f7d3fa42abe7253d80d6b1 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4025: [HUDI-2742] - Added s3 object filter to support multiple S3EventsHood…

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4025: URL: https://github.com/apache/hudi/pull/4025#issuecomment-972490440 ## CI report: * 5e9a288bf8a8634662f7d3fa42abe7253d80d6b1 Azure:

[GitHub] [hudi] liujinhui1994 edited a comment on issue #4027: [SUPPORT] Structured streaming Async clustering IndexOutOfBoundsException

2021-11-17 Thread GitBox
liujinhui1994 edited a comment on issue #4027: URL: https://github.com/apache/hudi/issues/4027#issuecomment-972486708 If it is my usage problem, please let me know. If you need me to provide other information, please let me know. thanks -- This is an automated message from the

[GitHub] [hudi] liujinhui1994 commented on issue #4027: [SUPPORT] Structured streaming Async clustering IndexOutOfBoundsException

2021-11-17 Thread GitBox
liujinhui1994 commented on issue #4027: URL: https://github.com/apache/hudi/issues/4027#issuecomment-972486708 If it is my usage problem, please let me know. If you need me to provide other information, please let me know -- This is an automated message from the Apache Git Service. To

[GitHub] [hudi] liujinhui1994 commented on issue #4027: [SUPPORT] Structured streaming Async clustering IndexOutOfBoundsException

2021-11-17 Thread GitBox
liujinhui1994 commented on issue #4027: URL: https://github.com/apache/hudi/issues/4027#issuecomment-972486455 ![image](https://user-images.githubusercontent.com/25769285/142346521-c6c53e17-6d94-47d2-859e-01c6f31648b6.png) -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] liujinhui1994 commented on issue #4027: [SUPPORT] Structured streaming Async clustering IndexOutOfBoundsException

2021-11-17 Thread GitBox
liujinhui1994 commented on issue #4027: URL: https://github.com/apache/hudi/issues/4027#issuecomment-972485283 ![image](https://user-images.githubusercontent.com/25769285/142346330-f90a656e-3401-452a-9be4-4b320cd68275.png) -- This is an automated message from the Apache Git Service.

[GitHub] [hudi] 0x574C closed issue #3971: [SUPPORT] HoodieFlinkStreamer parameter bug

2021-11-17 Thread GitBox
0x574C closed issue #3971: URL: https://github.com/apache/hudi/issues/3971 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972483415 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[GitHub] [hudi] hudi-bot commented on pull request #4026: [WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972484501 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[jira] [Assigned] (HUDI-1974) Run pyspark and validate that it works correctly with all hudi versions

2021-11-17 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra reassigned HUDI-1974: - Assignee: Rajesh Mahindra > Run pyspark and validate that it works correctly with all

[jira] [Assigned] (HUDI-2761) IllegalArgException from timeline server when serving getLastestBaseFiles with multi-writer

2021-11-17 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra reassigned HUDI-2761: - Assignee: Manoj Govindassamy (was: sivabalan narayanan) > IllegalArgException from

[jira] [Assigned] (HUDI-2590) Validate Diff key gen w/ and w/o glob path with and w/o metadata enabled

2021-11-17 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra reassigned HUDI-2590: - Assignee: Manoj Govindassamy (was: sivabalan narayanan) > Validate Diff key gen w/ and

[jira] [Assigned] (HUDI-2527) Flaky test: TestHoodieClientMultiWriter.testMultiWriterWithAsyncTableServicesWithConflict

2021-11-17 Thread Rajesh Mahindra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra reassigned HUDI-2527: - Assignee: Manoj Govindassamy (was: sivabalan narayanan) > Flaky test: >

[GitHub] [hudi] hudi-bot commented on pull request #4026: [WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot commented on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972483415 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4026: [WIP] Fixing issues w/ Z-ordering

2021-11-17 Thread GitBox
hudi-bot removed a comment on pull request #4026: URL: https://github.com/apache/hudi/pull/4026#issuecomment-972469707 ## CI report: * 90cf3fd6c12fb8d4b0b302deebf3e60f96603842 Azure:

[GitHub] [hudi] yanghua commented on a change in pull request #3888: [HUDI-2624] Implement Non Index type for HUDI

2021-11-17 Thread GitBox
yanghua commented on a change in pull request #3888: URL: https://github.com/apache/hudi/pull/3888#discussion_r751875479 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestNonIndex.scala ## @@ -0,0 +1,112 @@ +/* + * Licensed to the Apache

[GitHub] [hudi] vinothchandar commented on pull request #4013: [HUDI-2778] Optimize statistics collection related codes and add some docs for z-order

2021-11-17 Thread GitBox
vinothchandar commented on pull request #4013: URL: https://github.com/apache/hudi/pull/4013#issuecomment-972482783 cc @alexeykudinkin can you review this once as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Updated] (HUDI-2314) Add DynamoDb based lock provider

2021-11-17 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2314: -- Status: Closed (was: Patch Available) > Add DynamoDb based lock provider >

[jira] [Reopened] (HUDI-2314) Add DynamoDb based lock provider

2021-11-17 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-2314: --- > Add DynamoDb based lock provider > > >

  1   2   3   4   >