[GitHub] [incubator-hudi] umehrot2 opened a new pull request #915: Shade and relocate Avro dependency in hadoop-mr-bundle

umehrot2 opened a new pull request #915: Shade and relocate Avro dependency in hadoop-mr-bundle URL: https://github.com/apache/incubator-hudi/pull/915 As of now Hudi depends on Parquet 1.8.1 and Avro 1.7.7 which might work fine for older versions of Spark and Hive. But when we

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-268: --- Description: As of now Hudi depends on *Parquet* *1.8.1* and *Avro* *1.7.7* which might work fine for

[jira] [Created] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

Udit Mehrotra created HUDI-268: -- Summary: Allow parquet/avro versions upgrading in Hudi Key: HUDI-268 URL: https://issues.apache.org/jira/browse/HUDI-268 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] kevinthfang commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

kevinthfang commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857#issuecomment-533711984 @firecast, would you please share the major reasons for choosing HUDI over Delta Lake?

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-268: --- Description: As of now Hudi depends on *Parquet* *1.8.1* and *Avro* *1.7.7* which might work fine for

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-268: --- Description: As of now Hudi depends on *Parquet* *1.8.1* and *Avro* *1.7.7* which might work fine for

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-268: --- Description: As of now Hudi depends on *Parquet* *1.8.1* and *Avro* *1.7.7* which might work fine for

[jira] [Assigned] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra reassigned HUDI-268: -- Assignee: Udit Mehrotra > Allow parquet/avro versions upgrading in Hudi >

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-268: --- Description: As of now Hudi depends on *Parquet* *1.8.1* and *Avro* *1.7.7* which might work fine for

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udit Mehrotra updated HUDI-268: --- Component/s: (was: Presto Integration) > Allow parquet/avro versions upgrading in Hudi >

[jira] [Commented] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934817#comment-16934817 ] Udit Mehrotra commented on HUDI-268: Created PR for the same

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType and

[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-267: -- Summary: Refactor bad method name HoodieTestUtils#initTableType and (was: Refactor bad method name

[jira] [Commented] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934894#comment-16934894 ] vinoyang commented on HUDI-267: --- +1 to rename {{HoodieTableMetaClient.initializePathAsHoodieDataset}} to

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType and HoodieTableMetaClient#initializePathAsHoodieDataset

[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-267: -- Summary: Refactor bad method name HoodieTestUtils#initTableType and

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #44

See -- [...truncated 2.21 KB...] mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache-maven-3.5.4/boot: plexus-classworlds-2.5.2.jar

[GitHub] [incubator-hudi] taherk77 closed pull request #912: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

taherk77 closed pull request #912: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/912 This is an automated message from the Apache Git Service. To respond to

[jira] [Updated] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-251: Labels: pull-request-available (was: ) > JDBC incremental load to HUDI with DeltaStreamer >

[GitHub] [incubator-hudi] taherk77 opened a new pull request #912: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

taherk77 opened a new pull request #912: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/912 Work in progress. For now created a jdbc-source-properties file and JDBCSource class

[jira] [Commented] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934162#comment-16934162 ] vinoyang commented on HUDI-267: --- [~vinoth] What do you think? > Refactor bad method name

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-267: -- Description: There are some bad method name about {{HoodieTableMetaClient}}, e.g. （1）

[jira] [Created] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

vinoyang created HUDI-267: - Summary: Refactor bad method name HoodieTestUtils#initTableType Key: HUDI-267 URL: https://issues.apache.org/jira/browse/HUDI-267 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] leesf commented on a change in pull request #911: HUDI-220 Translate root index page

leesf commented on a change in pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#discussion_r326523330 ## File path: docs/index.cn.md ## @@ -1,23 +1,24 @@ --- -title: What is Hudi? +title: 什么是Hudi? keywords: big

[GitHub] [incubator-hudi] leesf commented on a change in pull request #911: HUDI-220 Translate root index page

leesf commented on a change in pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#discussion_r326521813 ## File path: docs/index.cn.md ## @@ -1,23 +1,24 @@ --- -title: What is Hudi? +title: 什么是Hudi? keywords: big

[GitHub] [incubator-hudi] leesf commented on a change in pull request #911: HUDI-220 Translate root index page

leesf commented on a change in pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#discussion_r326523868 ## File path: docs/index.cn.md ## @@ -1,23 +1,24 @@ --- -title: What is Hudi? +title: 什么是Hudi? keywords: big

[GitHub] [incubator-hudi] yanghua commented on issue #911: HUDI-220 Translate root index page

yanghua commented on issue #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#issuecomment-533424711 cc @leesf This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (HUDI-220) Translate root index page

[ https://issues.apache.org/jira/browse/HUDI-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-220: Labels: pull-request-available (was: ) > Translate root index page > - > >

[GitHub] [incubator-hudi] yanghua opened a new pull request #911: HUDI-220 Translate root index page

yanghua opened a new pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911 jira ref: https://issues.apache.org/jira/browse/HUDI-220 This is an automated message from the

[GitHub] [incubator-hudi] utk-spartan commented on issue #143: Tracking ticket for folks to be added to slack group

utk-spartan commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-533480607 Hi @vinothchandar , Please add utkarsh.sax...@razorpay.com to the slack group

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #911: HUDI-220 Translate root index page

yanghua commented on a change in pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#discussion_r326556053 ## File path: docs/index.cn.md ## @@ -1,23 +1,24 @@ --- -title: What is Hudi? +title: 什么是Hudi? keywords:

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #911: HUDI-220 Translate root index page

yanghua commented on a change in pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#discussion_r326558375 ## File path: docs/index.cn.md ## @@ -1,23 +1,24 @@ --- -title: What is Hudi? +title: 什么是Hudi? keywords:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #911: HUDI-220 Translate root index page

leesf commented on a change in pull request #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#discussion_r326526750 ## File path: docs/index.cn.md ## @@ -1,23 +1,24 @@ --- -title: What is Hudi? +title: 什么是Hudi? keywords: big

[GitHub] [incubator-hudi] leesf commented on issue #911: HUDI-220 Translate root index page

leesf commented on issue #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#issuecomment-533464650 @yanghua LGTM overall. left some minor comments. This is an automated message

[GitHub] [incubator-hudi] vinothchandar commented on issue #911: HUDI-220 Translate root index page

vinothchandar commented on issue #911: HUDI-220 Translate root index page URL: https://github.com/apache/incubator-hudi/pull/911#issuecomment-533572553 Let me know once this is addressed.. Can merge it in. This is an

[GitHub] [incubator-hudi] Panxing4game opened a new pull request #914: Config from different bucket

Panxing4game opened a new pull request #914: Config from different bucket URL: https://github.com/apache/incubator-hudi/pull/914 minimal change to have config file in another s3 bucket This is an automated message from the

[jira] [Commented] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType

[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934453#comment-16934453 ] Vinoth Chandar commented on HUDI-267: - +1 on the first one. Second one is explicitly named to let the

[GitHub] [incubator-hudi] vinothchandar commented on issue #896: Updating site to reflect recent doc changes

vinothchandar commented on issue #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#issuecomment-533570286 The use-case for being able to open html in browser is to be able to verify the final `content` folder is ok. If it does not

[GitHub] [incubator-hudi] vinothchandar merged pull request #896: Updating site to reflect recent doc changes

vinothchandar merged pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] Panxing4game commented on issue #909: Can't have config file and hudi base path in different S3 bucket.

Panxing4game commented on issue #909: Can't have config file and hudi base path in different S3 bucket. URL: https://github.com/apache/incubator-hudi/issues/909#issuecomment-53351 @vinothchandar sure，https://github.com/apache/incubator-hudi/pull/914 I just raised a pr for this

[GitHub] [incubator-hudi] vinothchandar commented on issue #910: hoodie.*.consume.* should be set whitelist in hive-site.xml

vinothchandar commented on issue #910: hoodie.*.consume.* should be set whitelist in hive-site.xml URL: https://github.com/apache/incubator-hudi/issues/910#issuecomment-533573078 @cdmikechen great point.. @bhasudha can you add this to the list you are compiling ?

[GitHub] [incubator-hudi] vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-533596837 Got it. To run from IDE what I do is to add spark jars to the class path of my module in IntelliJ. You dont have

[GitHub] [incubator-hudi] taherk77 commented on issue #912: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer

taherk77 commented on issue #912: [HUDI-251] JDBC incremental load to HUDI with DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/912#issuecomment-533569620 Work still in-progress. Code hasn't been tested yet. Wanted to know a few things about incremental loading and

[GitHub] [incubator-hudi] bvaradar commented on issue #913: Help needed to read read-optmized view from Hoodie tables

bvaradar commented on issue #913: Help needed to read read-optmized view from Hoodie tables URL: https://github.com/apache/incubator-hudi/issues/913#issuecomment-533576855 @HariprasadAllaka1612 : Not enough context here to find out what is going on. Can you see if the below link helps you

[jira] [Commented] (HUDI-83) Support for timestamp datatype in Hudi

[ https://issues.apache.org/jira/browse/HUDI-83?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16934546#comment-16934546 ] cdmikechen commented on HUDI-83: I raise an issue in Hive https://issues.apache.org/jira/browse/HIVE-4

[GitHub] [incubator-hudi] HariprasadAllaka1612 opened a new issue #913: Help needed to read read-optmized view from Hoodie tables

HariprasadAllaka1612 opened a new issue #913: Help needed to read read-optmized view from Hoodie tables URL: https://github.com/apache/incubator-hudi/issues/913 Hi, I am trying to read the RO view of the Hoodie data from s3 using spark data source. I am little confused from the