[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364644370 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java

[GitHub] [incubator-hudi] leesf opened a new pull request #1201: [HUDI-248] CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread GitBox
leesf opened a new pull request #1201: [HUDI-248] CLI doesn't allow rolling back a Delta commit URL: https://github.com/apache/incubator-hudi/pull/1201 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before

[incubator-hudi] branch master updated (d09eacd -> 5af3dc6)

2020-01-09 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from d09eacd [HUDI-25] Optimize HoodieInputformat.listStatus() for faster Hive incremental queries on Hoodie

[jira] [Updated] (HUDI-514) A schema provider to get metadata through Jdbc

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-514: Labels: pull-request-available (was: ) > A schema provider to get metadata through Jdbc >

[GitHub] [incubator-hudi] OpenOpened closed pull request #1199: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-09 Thread GitBox
OpenOpened closed pull request #1199: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1199 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-hudi] OpenOpened closed pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-09 Thread GitBox
OpenOpened closed pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-hudi] OpenOpened opened a new pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc

2020-01-09 Thread GitBox
OpenOpened opened a new pull request #1200: [HUDI-514] A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200 ## What is the purpose of the pull request In our production environment, we usually need to synchronize data from mysql,

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364648475 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/RocksDBDAO.java ##

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364648753 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/TimelineDiffHelper.java

[jira] [Commented] (HUDI-397) Normalize log print statement

2020-01-09 Thread jorge arada (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011688#comment-17011688 ] jorge arada commented on HUDI-397: -- Hi, I'm new to open source. I would like to pick this up. Can I?  

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364647724 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FailSafeConsistencyGuard.java

[jira] [Commented] (HUDI-343) Create a DOAP File for Hudi

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011636#comment-17011636 ] leesf commented on HUDI-343: [~smarthi] Hi, Seems like we need one more step to complete the issue, I found

[GitHub] [incubator-hudi] RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-09 Thread GitBox
RonBarabash commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-572489315 ```

[GitHub] [incubator-hudi] RonBarabash edited a comment on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-09 Thread GitBox
RonBarabash edited a comment on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-572489315 com.uber.hoodie.exception.CorruptedLogFileException:

[jira] [Resolved] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-331. Resolution: Fixed Fixed via master: 5af3dc6aedcfc8d7d4cd5da21300d9cfb92c16ba > Fix java docs for all public apis

[jira] [Updated] (HUDI-514) A schema provider to get metadata through Jdbc

2020-01-09 Thread zhang peng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang peng updated HUDI-514: Description: In our production environment, we usually need to synchronize data from mysql, and at the same

[GitHub] [incubator-hudi] OpenOpened opened a new pull request #1200: A schema provider to get metadata through Jdbc

2020-01-09 Thread GitBox
OpenOpened opened a new pull request #1200: A schema provider to get metadata through Jdbc URL: https://github.com/apache/incubator-hudi/pull/1200 ## What is the purpose of the pull request In our production environment, we usually need to synchronize data from mysql, and at the

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364646565 ## File path:

[jira] [Updated] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-248: Labels: aws-emr pull-request-available (was: aws-emr) > CLI doesn't allow rolling back a Delta

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364646700 ## File path:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364648898 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/collection/DiskBasedMap.java

[jira] [Updated] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-248: --- Status: In Progress (was: Open) > CLI doesn't allow rolling back a Delta commit >

[jira] [Updated] (HUDI-496) Fix wrong check logic in HoodieIncrementalPull

2020-01-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-496: Status: Open (was: New) > Fix wrong check logic in HoodieIncrementalPull >

[jira] [Closed] (HUDI-496) Fix wrong check logic in HoodieIncrementalPull

2020-01-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken closed HUDI-496. --- Resolution: Duplicate > Fix wrong check logic in HoodieIncrementalPull >

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364646882 ## File path:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364646974 ## File path:

[GitHub] [incubator-hudi] RonBarabash opened a new issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-09 Thread GitBox
RonBarabash opened a new issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202 Hey Guys, We encountered this error running Hudi with MergeOnRead and inline

[jira] [Comment Edited] (HUDI-397) Normalize log print statement

2020-01-09 Thread jorge arada (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011688#comment-17011688 ] jorge arada edited comment on HUDI-397 at 1/9/20 11:05 AM: --- Hi, I'm new to open

[jira] [Comment Edited] (HUDI-397) Normalize log print statement

2020-01-09 Thread jorge arada (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011688#comment-17011688 ] jorge arada edited comment on HUDI-397 at 1/9/20 11:05 AM: --- Hi, I'm new to open

[GitHub] [incubator-hudi] cdmikechen commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-09 Thread GitBox
cdmikechen commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-572542639 Maybe you can upgrade to hudi 0.5.1 ?

[jira] [Closed] (HUDI-500) Use enum method to replace switch case in HoodieTableMetaClient

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-500. -- Resolution: Won't Fix > Use enum method to replace switch case in HoodieTableMetaClient >

[jira] [Updated] (HUDI-500) Use enum method to replace switch case in HoodieTableMetaClient

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-500: --- Status: Open (was: New) > Use enum method to replace switch case in HoodieTableMetaClient >

[jira] [Updated] (HUDI-459) Redo hudi-hive log statements using SLF4J

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-459: Labels: pull-request-available (was: ) > Redo hudi-hive log statements using SLF4J >

[GitHub] [incubator-hudi] sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364786423 ## File path:

[GitHub] [incubator-hudi] sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364786885 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/FailSafeConsistencyGuard.java

[jira] [Commented] (HUDI-397) Normalize log print statement

2020-01-09 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011786#comment-17011786 ] vinoyang commented on HUDI-397: --- Hi [~jotarada] Absolutely, you can. However, I have assigned this ticket to

[jira] [Assigned] (HUDI-458) Redo hudi-hadoop-mr log statements using SLF4J

2020-01-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-458: --- Assignee: (was: lamber-ken) > Redo hudi-hadoop-mr log statements using SLF4J >

[jira] [Assigned] (HUDI-459) Redo hudi-hive log statements using SLF4J

2020-01-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-459: --- Assignee: lamber-ken > Redo hudi-hive log statements using SLF4J >

[GitHub] [incubator-hudi] pratyakshsharma commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

2020-01-09 Thread GitBox
pratyakshsharma commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#issuecomment-572567372 @vinothchandar @bvaradar Done with the final changes and rebasing.

[GitHub] [incubator-hudi] sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364786423 ## File path:

[GitHub] [incubator-hudi] lamber-ken commented on issue #1196: [feedback] new site feedback

2020-01-09 Thread GitBox
lamber-ken commented on issue #1196: [feedback] new site feedback URL: https://github.com/apache/incubator-hudi/issues/1196#issuecomment-572589582 ApacheCN, https://hudi.apachecn.org/docs/0.5.0

[GitHub] [incubator-hudi] sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
sev7e0 commented on a change in pull request #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#discussion_r364782798 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java

[GitHub] [incubator-hudi] leesf commented on a change in pull request #1188: [HUDI-502] provide a custom time zone definition for TimestampBasedKeyGenerator

2020-01-09 Thread GitBox
leesf commented on a change in pull request #1188: [HUDI-502] provide a custom time zone definition for TimestampBasedKeyGenerator URL: https://github.com/apache/incubator-hudi/pull/1188#discussion_r364722588 ## File path:

[jira] [Resolved] (HUDI-495) Update deprecated HBase API

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf resolved HUDI-495. Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: aba83876e7c20e8c2402c74c2465ef3ebc93ef85 > Update

[jira] [Updated] (HUDI-495) Update deprecated HBase API

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-495: --- Status: Open (was: New) > Update deprecated HBase API > --- > > Key: HUDI-495

[jira] [Updated] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-248: --- Status: Patch Available (was: In Progress) > CLI doesn't allow rolling back a Delta commit >

[GitHub] [incubator-hudi] vinothchandar commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-09 Thread GitBox
vinothchandar commented on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-572624688 `Did not find the magic bytes at the start of the block` ;

[jira] [Assigned] (HUDI-459) Redo hudi-hive log statements using SLF4J

2020-01-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-459: --- Assignee: (was: lamber-ken) > Redo hudi-hive log statements using SLF4J >

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1203: [HUDI-459] Redo hudi-hive log statements using SLF4J

2020-01-09 Thread GitBox
lamber-ken opened a new pull request #1203: [HUDI-459] Redo hudi-hive log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1203 ## What is the purpose of the pull request Redo hudi-hive log statements using SLF4J. ## Brief change log - *Redo

[GitHub] [incubator-hudi] lamber-ken edited a comment on issue #1196: [feedback] new site feedback

2020-01-09 Thread GitBox
lamber-ken edited a comment on issue #1196: [feedback] new site feedback URL: https://github.com/apache/incubator-hudi/issues/1196#issuecomment-572589582 ApacheCN, https://hudi.apachecn.org/docs/0.5.0

[GitHub] [incubator-hudi] RonBarabash edited a comment on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File

2020-01-09 Thread GitBox
RonBarabash edited a comment on issue #1202: [SUPPORT] com.uber.hoodie.exception.HoodieIOException: IOException when reading log file + Corrupted Log File URL: https://github.com/apache/incubator-hudi/issues/1202#issuecomment-572489315 ```

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Deci

2020-01-09 Thread GitBox
bvaradar commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#discussion_r364851683 ## File path:

[jira] [Commented] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread Rahul Bhartia (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012149#comment-17012149 ] Rahul Bhartia commented on HUDI-248: [~xleesf]-  Thank you for picking this up. Sorry, was out on

[GitHub] [incubator-hudi] sev7e0 commented on issue #1161: [HUDI-457]Redo hudi-common log statements using SLF4J

2020-01-09 Thread GitBox
sev7e0 commented on issue #1161: [HUDI-457]Redo hudi-common log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1161#issuecomment-572608900 > Thanks for opening this PR @sev7e0 ! Looks good overall, only left some minor comments. Thanks for your review

[jira] [Created] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-01-09 Thread Wenning Ding (Jira)
Wenning Ding created HUDI-515: - Summary: Resolve API conflict for Hive 2 and Hive 3 Key: HUDI-515 URL: https://issues.apache.org/jira/browse/HUDI-515 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Deci

2020-01-09 Thread GitBox
umehrot2 commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#discussion_r364978036 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Deci

2020-01-09 Thread GitBox
umehrot2 commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#discussion_r364979631 ## File path:

[jira] [Updated] (HUDI-506) Optimize the new website based on feedback

2020-01-09 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-506: Summary: Optimize the new website based on feedback (was: Broken/Wrong links in new website) > Optimize

[jira] [Commented] (HUDI-397) Normalize log print statement

2020-01-09 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012362#comment-17012362 ] wangxianghu commented on HUDI-397: -- Hi [~jotarada] , I have not started yet, feel free to take it. As for

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1201: [HUDI-248] CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1201: [HUDI-248] CLI doesn't allow rolling back a Delta commit URL: https://github.com/apache/incubator-hudi/pull/1201#discussion_r365045316 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/CommitsCommand.java

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r365045991 ## File path:

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for

2020-01-09 Thread GitBox
vinothchandar commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#discussion_r364995790 ## File

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1205: [HUDI-506] Optimize the new website based on feedback

2020-01-09 Thread GitBox
lamber-ken opened a new pull request #1205: [HUDI-506] Optimize the new website based on feedback URL: https://github.com/apache/incubator-hudi/pull/1205 ## What is the purpose of the pull request **Feedback Record** https://github.com/apache/incubator-hudi/issues/1196 - Fix some

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Deci

2020-01-09 Thread GitBox
umehrot2 commented on a change in pull request #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#discussion_r365012947 ## File path:

[jira] [Created] (HUDI-516) Avoid need to import spark-avro package when submitting Hudi job in spark

2020-01-09 Thread Udit Mehrotra (Jira)
Udit Mehrotra created HUDI-516: -- Summary: Avoid need to import spark-avro package when submitting Hudi job in spark Key: HUDI-516 URL: https://issues.apache.org/jira/browse/HUDI-516 Project: Apache Hudi

[jira] [Commented] (HUDI-481) Support SQL-like method

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012328#comment-17012328 ] cdmikechen commented on HUDI-481: - [~vinoth] I opened Spark's GitHub again this morning, and suddenly

[GitHub] [incubator-hudi] hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-09 Thread GitBox
hddong commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-572830782 @bvaradar All has been fixed, please review again. And `operationType` now be `String`,

[GitHub] [incubator-hudi] hddong edited a comment on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-09 Thread GitBox
hddong edited a comment on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-572830782 @bvaradar All has been fixed, please review again. And `operationType` now be

[jira] [Comment Edited] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012371#comment-17012371 ] cdmikechen edited comment on HUDI-91 at 1/10/20 1:37 AM: - [~vinoth] Yes, I know

[jira] [Comment Edited] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012371#comment-17012371 ] cdmikechen edited comment on HUDI-91 at 1/10/20 1:38 AM: - [~vinoth] Yes, I know

[incubator-hudi] branch redo-log updated: [HUDI-459] Redo hudi-hive log statements using SLF4J (#1203)

2020-01-09 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a commit to branch redo-log in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/redo-log by this push: new ac105e6 [HUDI-459] Redo hudi-hive

[GitHub] [incubator-hudi] leesf merged pull request #1203: [HUDI-459] Redo hudi-hive log statements using SLF4J

2020-01-09 Thread GitBox
leesf merged pull request #1203: [HUDI-459] Redo hudi-hive log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1203 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r365046553 ## File path:

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1204: [CLEAN] replace utf-8 constant with StandardCharsets.UTF_8

2020-01-09 Thread GitBox
lamber-ken opened a new pull request #1204: [CLEAN] replace utf-8 constant with StandardCharsets.UTF_8 URL: https://github.com/apache/incubator-hudi/pull/1204 ## What is the purpose of the pull request Replace utf-8 constant with StandardCharsets.UTF_8. ## Brief change log

[jira] [Updated] (HUDI-506) Optimize the new website based on feedback

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-506: Labels: pull-request-available (was: ) > Optimize the new website based on feedback >

[jira] [Commented] (HUDI-397) Normalize log print statement

2020-01-09 Thread wangxianghu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012365#comment-17012365 ] wangxianghu commented on HUDI-397: -- Hi [~jotarada] ,It seems that you don't have the contributor

[GitHub] [incubator-hudi] hmatu commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

2020-01-09 Thread GitBox
hmatu commented on issue #1157: [HUDI-332]Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata URL: https://github.com/apache/incubator-hudi/pull/1157#issuecomment-572835965 IMO, `WriteOperationType` duplicate to `OperationType`, keep one is a better way.

[GitHub] [incubator-hudi] cdmikechen commented on issue #1119: [HUDI-469] Fix: HoodieCommitMetadata only show first commit insert rows.

2020-01-09 Thread GitBox
cdmikechen commented on issue #1119: [HUDI-469] Fix: HoodieCommitMetadata only show first commit insert rows. URL: https://github.com/apache/incubator-hudi/pull/1119#issuecomment-572833967 @n3nash have deleted, you can check again, please.

[jira] [Commented] (HUDI-91) Replace Databricks spark-avro with native spark-avro #628

2020-01-09 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-91?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012371#comment-17012371 ] cdmikechen commented on HUDI-91: [~vinoth] Yes, I know your point. We can use hudi fine by using

[jira] [Commented] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2020-01-09 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012391#comment-17012391 ] leesf commented on HUDI-248: [~rbhartia] No worries, thanks for your report and you would still pick up some

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r365045991 ## File path:

[GitHub] [incubator-hudi] n3nash commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
n3nash commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#issuecomment-572843370 @yanghua Left some comments

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#discussion_r365047400 ## File path: hudi-test-suite/README.md ## @@ -0,0

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#discussion_r365046918 ## File path: hudi-test-suite/README.md ## @@ -0,0

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#discussion_r365046918 ## File path: hudi-test-suite/README.md ## @@ -0,0

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#discussion_r365046901 ## File path: hudi-test-suite/README.md ## @@ -0,0

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
n3nash commented on a change in pull request #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#discussion_r365047159 ## File path: hudi-test-suite/README.md ## @@ -0,0

[GitHub] [incubator-hudi] harveyyue opened a new pull request #1206: [HUDI-322] DeltaSteamer should pick checkpoints off only deltacommits…

2020-01-09 Thread GitBox
harveyyue opened a new pull request #1206: [HUDI-322] DeltaSteamer should pick checkpoints off only deltacommits… URL: https://github.com/apache/incubator-hudi/pull/1206 ## What is the purpose of the pull request This code change fix the correct checkpoints to deltacommit/commit

[jira] [Updated] (HUDI-322) DeltaSteamer should pick checkpoints off only deltacommits for MOR tables

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-322: Labels: pull-request-available (was: ) > DeltaSteamer should pick checkpoints off only deltacommits

[GitHub] [incubator-hudi] bschell commented on issue #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-09 Thread GitBox
bschell commented on issue #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#issuecomment-572716995 @n3nash just updated the pull request to a new GlobalDelete key generator and the tests pass locally for me.

[jira] [Updated] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-01-09 Thread Wenning Ding (Jira)
[ https://issues.apache.org/jira/browse/HUDI-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenning Ding updated HUDI-515: -- Description: Currently I am working on supporting HIVE 3. There is an API issue. In

[jira] [Commented] (HUDI-515) Resolve API conflict for Hive 2 and Hive 3

2020-01-09 Thread Nishith Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HUDI-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012405#comment-17012405 ] Nishith Agarwal commented on HUDI-515: -- [~wenningd] Most of the code of 

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

2020-01-09 Thread liujinhui (Jira)
[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012411#comment-17012411 ] liujinhui commented on HUDI-76: --- [~guoyihua] I tried it, it seems that it will cause data misalignment and

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #155

2020-01-09 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.20 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-09 Thread GitBox
bschell commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r365062845 ## File path:

[GitHub] [incubator-hudi] bschell commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key

2020-01-09 Thread GitBox
bschell commented on a change in pull request #1194: [HUDI-326] Add support to delete records with only record_key URL: https://github.com/apache/incubator-hudi/pull/1194#discussion_r365062782 ## File path:

[jira] [Updated] (HUDI-512) Decouple logical partitioning from physical one.

2020-01-09 Thread Jiaqi Li (Jira)
[ https://issues.apache.org/jira/browse/HUDI-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiaqi Li updated HUDI-512: -- Description: This one is more inspirational, but, I believe, will be very useful. Currently hudi is following

[GitHub] [incubator-hudi] yanghua commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module

2020-01-09 Thread GitBox
yanghua commented on issue #1191: [HUDI-503] Add hudi test suite documentation into the README file of the test suite module URL: https://github.com/apache/incubator-hudi/pull/1191#issuecomment-572890224 @n3nash Have done renaming work. Please have another look.

[GitHub] [incubator-hudi] bvaradar commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

2020-01-09 Thread GitBox
bvaradar commented on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#issuecomment-572894670 Looks good. This is an

[incubator-hudi] branch master updated (5af3dc6 -> 3c90d25)

2020-01-09 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 5af3dc6 [HUDI-331]Fix java docs for all public apis in HoodieWriteClient (#) add 3c90d25

  1   2   >