[GitHub] [incubator-hudi] HariprasadAllaka1612 commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

HariprasadAllaka1612 commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532071607 Hi Vinoth, Thanks for the reply. a.

[jira] [Assigned] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen reassigned HUDI-29: -- Assignee: cdmikechen (was: Nishith Agarwal) > Patch to Hive-sync to enable stats on Hive tables #393 >

[incubator-hudi] branch master updated: [HUDI-252] Identify packages which are under non-apache license in LICENSE file

This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 96a46d8 [HUDI-252] Identify packages

[GitHub] [incubator-hudi] bvaradar merged pull request #897: [HUDI-252] Identify packages which are under non-apache license in LICENSE file

bvaradar merged pull request #897: [HUDI-252] Identify packages which are under non-apache license in LICENSE file URL: https://github.com/apache/incubator-hudi/pull/897 This is an automated message from the Apache Git

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #40

See -- [...truncated 2.25 KB...] mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache-maven-3.5.4/boot: plexus-classworlds-2.5.2.jar

[GitHub] [incubator-hudi] vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath URL: https://github.com/apache/incubator-hudi/issues/869#issuecomment-532048279 @umehrot2 https://issues.apache.org/jira/browse/HUDI-254 lets continue here. Please see if you can

[jira] [Comment Edited] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931066#comment-16931066 ] Vinoth Chandar edited comment on HUDI-254 at 9/17/19 3:57 AM: -- h3. Spark 2.4.4

[jira] [Commented] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931066#comment-16931066 ] Vinoth Chandar commented on HUDI-254: - Spark 2.4.4 on master   Also seems to pass all cases  

[jira] [Comment Edited] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930985#comment-16930985 ] Vinoth Chandar edited comment on HUDI-254 at 9/17/19 3:49 AM: -- h3. Spark 2.3.1

[GitHub] [incubator-hudi] vinothchandar commented on issue #736: hoodie-hive-hundle don't have hive jars

vinothchandar commented on issue #736: hoodie-hive-hundle don't have hive jars URL: https://github.com/apache/incubator-hudi/issues/736#issuecomment-532045026 No worries. This is an automated message from the Apache Git

[GitHub] [incubator-hudi] cdmikechen commented on issue #736: hoodie-hive-hundle don't have hive jars

cdmikechen commented on issue #736: hoodie-hive-hundle don't have hive jars URL: https://github.com/apache/incubator-hudi/issues/736#issuecomment-532043599 @vinothchandar Sorry, I may not have time to re-validate it recently. I will upgrade my Hudi to 0.5.0 next week and then test

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532039500 @umehrot2 It is base in 0.4.8 version, You also need to upgrade avro to 1.8.2 or higher version

[GitHub] [incubator-hudi] cdmikechen commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

cdmikechen commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532039500 @umehrot2 It is base in 0.4.8 version, You also need to upgrade avro to 1.8.2 or higher version (support

[GitHub] [incubator-hudi] umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532026904 > @umehrot2 Great analysis.. Would upgrading parquet-avro help? Good point @vinothchandar .

[GitHub] [incubator-hudi] umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532026904 > @umehrot2 Great analysis.. Would upgrading parquet-avro help? Good point @vinothchandar .

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532026904 > @umehrot2 Great analysis.. Would upgrading parquet-avro help? Good point @vinothchandar . Upon a

[jira] [Issue Comment Deleted] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-159: --- Comment: was deleted (was: Fixed via master: 7a973a694488930627028b3175a731a23e3d3f32) > Collection of past, present

[GitHub] [incubator-hudi] vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532016398 @umehrot2 Great analysis.. Would upgrading parquet-avro help?

[GitHub] [incubator-hudi] umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532014549 > should we first rebase and resolve the conflicts? For my testing, I had re-based this patch

[GitHub] [incubator-hudi] umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532014549 > should we first rebase and resolve the conflicts? For my testing, I had re-based this PR on

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532014549 > should we first rebase and resolve the conflicts? For my testing, I had re-based this PR on top of

[jira] [Commented] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930985#comment-16930985 ] Vinoth Chandar commented on HUDI-254: - h3. Spark 2.3.3 on master    Once I copy the hudi-spark-bundle

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-254: Description: A lot of discussions around this kicked off from

[GitHub] [incubator-hudi] vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532011412 should we first rebase and resolve the conflicts?

[GitHub] [incubator-hudi] vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath URL: https://github.com/apache/incubator-hudi/issues/869#issuecomment-532008631 Also I tried to reproduce this on the demo setup. (it'd be great if we can standardize on that since

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-254: Description: A lot of discussions around this kicked off from

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-254: Description: A lot of discussions around this kicked off from

[GitHub] [incubator-hudi] vinothchandar closed issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

vinothchandar closed issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath URL: https://github.com/apache/incubator-hudi/issues/869 This is an automated message from the Apache Git Service. To

[jira] [Created] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

Vinoth Chandar created HUDI-254: --- Summary: Provide mechanism for installing hudi-spark-bundle onto an existing spark installation Key: HUDI-254 URL: https://issues.apache.org/jira/browse/HUDI-254

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 commented on a change in pull request #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#discussion_r324935647 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 commented on a change in pull request #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#discussion_r324935297 ## File path:

[GitHub] [incubator-hudi] umehrot2 commented on a change in pull request #770: remove com.databricks:spark-avro to build spark avro schema by itself

umehrot2 commented on a change in pull request #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#discussion_r324935297 ## File path:

[GitHub] [incubator-hudi] vinothchandar closed issue #817: spark-submit with userClassPathFirst config error

vinothchandar closed issue #817: spark-submit with userClassPathFirst config error URL: https://github.com/apache/incubator-hudi/issues/817 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on issue #817: spark-submit with userClassPathFirst config error

vinothchandar commented on issue #817: spark-submit with userClassPathFirst config error URL: https://github.com/apache/incubator-hudi/issues/817#issuecomment-532002936 This should not happen anymore with the new bundling, since scala classes are nt there ``` $ jar tf

[GitHub] [incubator-hudi] vinothchandar commented on issue #757: spark-hoodie-bundle using hive-serde to sync hive table(Hive2.3.5)

vinothchandar commented on issue #757: spark-hoodie-bundle using hive-serde to sync hive table(Hive2.3.5) URL: https://github.com/apache/incubator-hudi/issues/757#issuecomment-532002483 Closing due to inactivity This is an

[GitHub] [incubator-hudi] vinothchandar closed issue #757: spark-hoodie-bundle using hive-serde to sync hive table(Hive2.3.5)

vinothchandar closed issue #757: spark-hoodie-bundle using hive-serde to sync hive table(Hive2.3.5) URL: https://github.com/apache/incubator-hudi/issues/757 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] vinothchandar commented on issue #897: [HUDI-252] Identify packages which are under non-apache license in LICENSE file

vinothchandar commented on issue #897: [HUDI-252] Identify packages which are under non-apache license in LICENSE file URL: https://github.com/apache/incubator-hudi/pull/897#issuecomment-531996421 Please merge whenever CI passes. (should be a no-op for this patch)

[jira] [Commented] (HUDI-83) Support for timestamp datatype in Hudi

[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930961#comment-16930961 ] Vinoth Chandar commented on HUDI-83: [~bhasudha] also.. this needs spark 2.4 also I think > Support for

[jira] [Assigned] (HUDI-83) Support for timestamp datatype in Hudi

[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-83: -- Assignee: BALAJI VARADARAJAN (was: Vinoth Chandar) > Support for timestamp datatype in Hudi >

[jira] [Assigned] (HUDI-194) Support for writing Iceberg metadata on Hoodie RO tables

[ https://issues.apache.org/jira/browse/HUDI-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-194: --- Assignee: BALAJI VARADARAJAN (was: Vinoth Chandar) > Support for writing Iceberg metadata on

[jira] [Resolved] (HUDI-158) Issues that need to be addressed noticed during pom clean up

[ https://issues.apache.org/jira/browse/HUDI-158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-158. - Resolution: Fixed > Issues that need to be addressed noticed during pom clean up >

[jira] [Commented] (HUDI-141) GCS : DeltaStreamer requiring hoodie-spark bundle to run on Hadoop 2.9.2

[ https://issues.apache.org/jira/browse/HUDI-141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930960#comment-16930960 ] Vinoth Chandar commented on HUDI-141: - Keeping this open to verify either me or someone else on GCS >

[jira] [Closed] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-159. --- Resolution: Fixed > Collection of past, present jar mismatch related issues/reports >

[jira] [Comment Edited] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874983#comment-16874983 ] Vinoth Chandar edited comment on HUDI-159 at 9/16/19 11:21 PM: ---   Things to

[jira] [Comment Edited] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867224#comment-16867224 ] Vinoth Chandar edited comment on HUDI-159 at 9/16/19 11:20 PM: --- *Hadoop

[jira] [Commented] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930958#comment-16930958 ] Vinoth Chandar commented on HUDI-159: - Verified most of the issues are now fixed. Rest are all related

[GitHub] [incubator-hudi] bvaradar opened a new pull request #897: [HUDI-252] Identify packages which are under non-apache license in LICENSE file

bvaradar opened a new pull request #897: [HUDI-252] Identify packages which are under non-apache license in LICENSE file URL: https://github.com/apache/incubator-hudi/pull/897 [HUDI-252] Identify packages which are under non-apache license in LICENSE file

[GitHub] [incubator-hudi] vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-531988780 Hmmm. I tested with Hive version - Hive 2.3.3 Spark version - 2.4.4 by simply using spark2.4.4

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #896: Updating site to reflect recent doc changes

bhasudha commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r324904727 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #896: Updating site to reflect recent doc changes

vinothchandar commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r324891387 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[GitHub] [incubator-hudi] bhasudha opened a new pull request #896: Updating site to reflect recent doc changes

bhasudha opened a new pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896 This bundles all commits (into asf-site branch) that happened after previous site update. No new changes are introduced as part of this commit. Was

[incubator-hudi] branch master updated: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 629698d [HUDI-252] Add Disclaimer and

[GitHub] [incubator-hudi] vinothchandar merged pull request #895: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

vinothchandar merged pull request #895: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi URL: https://github.com/apache/incubator-hudi/pull/895 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] bvaradar commented on issue #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

bvaradar commented on issue #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi URL: https://github.com/apache/incubator-hudi/pull/893#issuecomment-531925634 @vinothchandar : Closing this. Have opened a new one against master. Will rebase release branch against

[GitHub] [incubator-hudi] bvaradar closed pull request #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

bvaradar closed pull request #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi URL: https://github.com/apache/incubator-hudi/pull/893 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] bvaradar opened a new pull request #895: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

bvaradar opened a new pull request #895: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi URL: https://github.com/apache/incubator-hudi/pull/895 This is an automated message from the Apache Git

[incubator-hudi] branch master updated: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new c0f42af [HUDI-62] Index Lookup Timer

[GitHub] [incubator-hudi] vinothchandar commented on issue #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

vinothchandar commented on issue #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876#issuecomment-531893305 @taherk77 no worries.. hope this helps you to build momentum!

[GitHub] [incubator-hudi] vinothchandar merged pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

vinothchandar merged pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876 This is an automated message from the Apache Git Service. To respond to

[GitHub] [incubator-hudi] vinothchandar commented on issue #849: [HUDI-62] Added index handle times

vinothchandar commented on issue #849: [HUDI-62] Added index handle times URL: https://github.com/apache/incubator-hudi/pull/849#issuecomment-531893046 Closing in favor of #876 This is an automated message from the Apache

[jira] [Comment Edited] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867224#comment-16867224 ] Vinoth Chandar edited comment on HUDI-159 at 9/16/19 4:29 PM: -- *Hadoop Compat*

[GitHub] [incubator-hudi] vinothchandar closed issue #774: Matching question of the version in Spark and Hive2

vinothchandar closed issue #774: Matching question of the version in Spark and Hive2 URL: https://github.com/apache/incubator-hudi/issues/774 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on issue #774: Matching question of the version in Spark and Hive2

vinothchandar commented on issue #774: Matching question of the version in Spark and Hive2 URL: https://github.com/apache/incubator-hudi/issues/774#issuecomment-531853897 Tracking this in HUDI-159 This is an automated

[GitHub] [incubator-hudi] vinothchandar commented on issue #736: hoodie-hive-hundle don't have hive jars

vinothchandar commented on issue #736: hoodie-hive-hundle don't have hive jars URL: https://github.com/apache/incubator-hudi/issues/736#issuecomment-531854059 @cdmikechen any updates on this? This is an automated message

[jira] [Comment Edited] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867224#comment-16867224 ] Vinoth Chandar edited comment on HUDI-159 at 9/16/19 4:27 PM: -- *Hadoop Compat*

[jira] [Comment Edited] (HUDI-159) Collection of past, present jar mismatch related issues/reports

[ https://issues.apache.org/jira/browse/HUDI-159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867224#comment-16867224 ] Vinoth Chandar edited comment on HUDI-159 at 9/16/19 4:26 PM: -- *Hadoop Compat*

[GitHub] [incubator-hudi] taherk77 commented on issue #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

taherk77 commented on issue #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876#issuecomment-531852443 > small nits.. otherwise lgtm. will merge once you push an update and CI passes again! thanks for working through this

[GitHub] [incubator-hudi] taherk77 commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

taherk77 commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876#discussion_r324766415 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

vinothchandar commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876#discussion_r324761316 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

vinothchandar commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876#discussion_r324761029 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/HoodieMetrics.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient

vinothchandar commented on a change in pull request #876: [HUDI-62] Index Lookup Timer added to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/876#discussion_r324760642 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/HoodieMetrics.java

[GitHub] [incubator-hudi] vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

vinothchandar commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath URL: https://github.com/apache/incubator-hudi/issues/869#issuecomment-531845542 I think this is consistent with the behavior @umehrot2 also saw. Planning to look into this week.

[GitHub] [incubator-hudi] vinothchandar commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

vinothchandar commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-531843646 I suspect this has something to do with the SaveMode being

[jira] [Created] (HUDI-253) DeltaStreamer should report nicer error messages for misconfigs

Vinoth Chandar created HUDI-253: --- Summary: DeltaStreamer should report nicer error messages for misconfigs Key: HUDI-253 URL: https://issues.apache.org/jira/browse/HUDI-253 Project: Apache Hudi

[GitHub] [incubator-hudi] vinothchandar commented on issue #891: Metrics only reported upon shutdown

vinothchandar commented on issue #891: Metrics only reported upon shutdown URL: https://github.com/apache/incubator-hudi/issues/891#issuecomment-531839080 @jaguarx Most of the metrics are off the commit metadata and we typically run Hudi writers in a batch job that starts and terminates.

[GitHub] [incubator-hudi] vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-531825236 Seems like a jar mismatch isssue.. ``` at

[GitHub] [incubator-hudi] vinothchandar commented on issue #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

vinothchandar commented on issue #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi URL: https://github.com/apache/incubator-hudi/pull/893#issuecomment-531823862 Why not do this on master and then redo to release-0.5.0 branch? changes lgtm, go ahead and merge if

[GitHub] [incubator-hudi] firecast opened a new issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

firecast opened a new issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894 I started getting this issue after the POM cleanup merge. The data gets written to the path but the Hive sync fails. Using the

[GitHub] [incubator-hudi] bvaradar opened a new pull request #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

bvaradar opened a new pull request #893: [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi URL: https://github.com/apache/incubator-hudi/pull/893 [HUDI-252] Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

[jira] [Updated] (HUDI-252) Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

[ https://issues.apache.org/jira/browse/HUDI-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-252: Summary: Add Disclaimer and cleanup NOTICE and LICENSE files in hudi (was: Add DIsclaimer

[jira] [Assigned] (HUDI-252) Add DIsclaimer and cleanup NOTICE and LICENSE files in hudi

[ https://issues.apache.org/jira/browse/HUDI-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reassigned HUDI-252: --- Assignee: BALAJI VARADARAJAN > Add DIsclaimer and cleanup NOTICE and LICENSE files in

[jira] [Updated] (HUDI-252) Add DIsclaimer and cleanup NOTICE and LICENSE files in hudi

[ https://issues.apache.org/jira/browse/HUDI-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-252: Fix Version/s: 0.5.0 > Add DIsclaimer and cleanup NOTICE and LICENSE files in hudi >

[jira] [Created] (HUDI-252) Add DIsclaimer and cleanup NOTICE and LICENSE files in hudi

BALAJI VARADARAJAN created HUDI-252: --- Summary: Add DIsclaimer and cleanup NOTICE and LICENSE files in hudi Key: HUDI-252 URL: https://issues.apache.org/jira/browse/HUDI-252 Project: Apache Hudi

[GitHub] [incubator-hudi] firecast edited a comment on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

firecast edited a comment on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857#issuecomment-531657118 I have been experimenting with Delta Lake for quite some time now and chose HUDI over it

[GitHub] [incubator-hudi] firecast commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

firecast commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857#issuecomment-531657118 I have been experimenting with Delta Lake for quite some time now and chose HUDI over it just last

[jira] [Created] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

Taher Koitawala created HUDI-251: Summary: JDBC incremental load to HUDI with DeltaStreamer Key: HUDI-251 URL: https://issues.apache.org/jira/browse/HUDI-251 Project: Apache Hudi (incubating)