[jira] [Comment Edited] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054532#comment-17054532 ] Vinoth Chandar edited comment on HUDI-662 at 3/8/20, 10:37 PM: --- cc

[GitHub] [incubator-hudi] lamber-ken commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

2020-03-08 Thread GitBox
lamber-ken commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle URL: https://github.com/apache/incubator-hudi/pull/1387#issuecomment-596297205 Hi @bvaradar, reasonable. Keep it WIP untill next release version.

[GitHub] [incubator-hudi] OpenOpened commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

2020-03-08 Thread GitBox
OpenOpened commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter URL: https://github.com/apache/incubator-hudi/pull/1360#discussion_r389444912 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieSnapshotExporter.java

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

2020-03-08 Thread GitBox
xushiyan commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter URL: https://github.com/apache/incubator-hudi/pull/1360#discussion_r389449973 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieSnapshotExporter.java

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #211

2020-03-08 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.38 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/conf: logging settings.xml toolchains.xml

[GitHub] [incubator-hudi] codecov-io edited a comment on issue #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

2020-03-08 Thread GitBox
codecov-io edited a comment on issue #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer URL: https://github.com/apache/incubator-hudi/pull/1386#issuecomment-596163892 # [Codecov](https://codecov.io/gh/apache/incubator-hudi/pull/1386?src=pr=h1) Report > Merging

[GitHub] [incubator-hudi] lamber-ken commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly

2020-03-08 Thread GitBox
lamber-ken commented on issue #1377: [HUDI-663] Fix HoodieDeltaStreamer offset not handled correctly URL: https://github.com/apache/incubator-hudi/pull/1377#issuecomment-596299950 Will come back, after #1373, it may needs more time to debuging.

[jira] [Updated] (HUDI-681) Remove the dependency of EmbeddedTimelineService from HoodieReadClient

2020-03-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-681: Labels: pull-request-available (was: ) > Remove the dependency of EmbeddedTimelineService from

[GitHub] [incubator-hudi] hddong opened a new pull request #1388: [HUDI-681]Remove embeddedTimelineService from HoodieReadClient

2020-03-08 Thread GitBox
hddong opened a new pull request #1388: [HUDI-681]Remove embeddedTimelineService from HoodieReadClient URL: https://github.com/apache/incubator-hudi/pull/1388 ## What is the purpose of the pull request *Remove the `EmbeddedTimelineService` from `HoodieReadClient`, so that we can

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054622#comment-17054622 ] vinoyang commented on HUDI-662: --- +1 too > Attribute binary dependencies that are included in the bundle jars

[GitHub] [incubator-hudi] OpenOpened commented on issue #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

2020-03-08 Thread GitBox
OpenOpened commented on issue #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter URL: https://github.com/apache/incubator-hudi/pull/1360#issuecomment-596311930 @xushiyan `@experimental` annotation doesn't seem to exist in jdk8, so I just added comments for HoodieSnapshotExporter.

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Suneel Marthi (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054575#comment-17054575 ] Suneel Marthi commented on HUDI-662: +1 to this.  > Attribute binary dependencies that are included in

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

2020-03-08 Thread GitBox
yanghua commented on a change in pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer URL: https://github.com/apache/incubator-hudi/pull/1386#discussion_r389437581 ## File path: DISCLAIMER-STANDARD ## @@ -0,0 +1,10 @@ +Apache Hudi

[GitHub] [incubator-hudi] vinothchandar commented on issue #1384: [SUPPORT] Hudi datastore missing updates for many records

2020-03-08 Thread GitBox
vinothchandar commented on issue #1384: [SUPPORT] Hudi datastore missing updates for many records URL: https://github.com/apache/incubator-hudi/issues/1384#issuecomment-596226463 Hmmm the datasource does fail the commit if there are such errors.. ``` } else {

[jira] [Updated] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-662: Description: https://www.apache.org/legal/resolved.html is the comprehensive guide here. >

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054528#comment-17054528 ] Vinoth Chandar commented on HUDI-662: - Skywalking also has source reuses as

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054530#comment-17054530 ] Vinoth Chandar commented on HUDI-662: - Spark follows a similar model

[incubator-hudi] branch release-0.5.2 updated: [HUDI-581] NOTICE need more work as it missing content form included 3rd party ALv2 licensed NOTICE files (#1354)

2020-03-08 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a commit to branch release-0.5.2 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/release-0.5.2 by this push: new e9f114f [HUDI-581]

[GitHub] [incubator-hudi] vinothchandar commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

2020-03-08 Thread GitBox
vinothchandar commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle URL: https://github.com/apache/incubator-hudi/pull/1387#issuecomment-596225503 @bvaradar can you take a pass at this? This

[jira] [Assigned] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-677: --- Assignee: hong dongdong (was: Vinoth Chandar) > Abstract/Refactor all transaction management

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054466#comment-17054466 ] Vinoth Chandar commented on HUDI-677: - Sounds good . This is ultra critical for the project.. So please

[GitHub] [incubator-hudi] smarthi commented on a change in pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

2020-03-08 Thread GitBox
smarthi commented on a change in pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer URL: https://github.com/apache/incubator-hudi/pull/1386#discussion_r389391341 ## File path: DISCLAIMER-STANDARD ## @@ -0,0 +1,10 @@ +Apache Hudi

[GitHub] [incubator-hudi] bvaradar commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle

2020-03-08 Thread GitBox
bvaradar commented on issue #1387: [HUDI-674] Rename hudi-hadoop-mr-bundle to hudi-hive-bundle URL: https://github.com/apache/incubator-hudi/pull/1387#issuecomment-596256048 I went through the relevant DISCUSS thread. @lamber-ken : I strongly feel we should at the least wait for next

[jira] [Updated] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-662: Description: https://www.apache.org/legal/resolved.html is the comprehensive guide here.

[jira] [Updated] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-662: Description: https://www.apache.org/legal/resolved.html is the comprehensive guide here.

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer

2020-03-08 Thread GitBox
vinothchandar commented on a change in pull request #1386: [HUDI-676] Address issues towards removing use of WIP Disclaimer URL: https://github.com/apache/incubator-hudi/pull/1386#discussion_r389386255 ## File path: DISCLAIMER-STANDARD ## @@ -0,0 +1,10 @@ +Apache Hudi

[jira] [Commented] (HUDI-662) Attribute binary dependencies that are included in the bundle jars

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054532#comment-17054532 ] Vinoth Chandar commented on HUDI-662: - cc [~vinoyang] [~smarthi] This seems like a model we can emulate

[jira] [Assigned] (HUDI-646) Re-enable TestUpdateSchemaEvolution after triaging weird CI issue

2020-03-08 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-646: --- Assignee: lamber-ken (was: Vinoth Chandar) > Re-enable TestUpdateSchemaEvolution after

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-08 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054339#comment-17054339 ] vinoyang commented on HUDI-677: --- [~vinoth], [~hongdongdong] want to give a try with this issue, I will

[jira] [Created] (HUDI-681) Remove the dependency of EmbeddedTimelineService from HoodieReadClient

2020-03-08 Thread vinoyang (Jira)
vinoyang created HUDI-681: - Summary: Remove the dependency of EmbeddedTimelineService from HoodieReadClient Key: HUDI-681 URL: https://issues.apache.org/jira/browse/HUDI-681 Project: Apache Hudi (incubating)

[jira] [Created] (HUDI-682) Move HoodieReadClient into hudi-spark module

2020-03-08 Thread vinoyang (Jira)
vinoyang created HUDI-682: - Summary: Move HoodieReadClient into hudi-spark module Key: HUDI-682 URL: https://issues.apache.org/jira/browse/HUDI-682 Project: Apache Hudi (incubating) Issue Type:

[jira] [Closed] (HUDI-409) Replace Log Magic header with a secure hash to avoid clashes with data

2020-03-08 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-409. -- Resolution: Fixed Fixed via master: 9d46ce380a3929605b3838238e8aa07a9918ab7a > Replace Log Magic header with a secure

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

2020-03-08 Thread GitBox
xushiyan commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter URL: https://github.com/apache/incubator-hudi/pull/1360#discussion_r389365076 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieSnapshotExporter.java

[GitHub] [incubator-hudi] xushiyan commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

2020-03-08 Thread GitBox
xushiyan commented on a change in pull request #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter URL: https://github.com/apache/incubator-hudi/pull/1360#discussion_r389365583 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieSnapshotExporter.java

[jira] [Commented] (HUDI-677) Abstract/Refactor all transaction management logic into a set of classes from HoodieWriteClient

2020-03-08 Thread hong dongdong (Jira)
[ https://issues.apache.org/jira/browse/HUDI-677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17054391#comment-17054391 ] hong dongdong commented on HUDI-677: yep,I will try with this issue. > Abstract/Refactor all

[GitHub] [incubator-hudi] xushiyan commented on issue #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter

2020-03-08 Thread GitBox
xushiyan commented on issue #1360: [HUDI-344][RFC-09] Hudi Dataset Snapshot Exporter URL: https://github.com/apache/incubator-hudi/pull/1360#issuecomment-596201573 @OpenOpened To summarize from the review comments, could you make these changes as last round of changes? thanks 1. remove