[GitHub] [incubator-hudi] nsivabalan commented on issue #976: [WIP] [HUDI-106] Adding support for DynamicBloomFilter

nsivabalan commented on issue #976: [WIP] [HUDI-106] Adding support for DynamicBloomFilter URL: https://github.com/apache/incubator-hudi/pull/976#issuecomment-554245579 @vinothchandar : wrt your point "if we don't have a way to configure the bloom type to use, we should add one", we have

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554245095 @umehrot2 : Comparing this run's logs wit

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346686064 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325

[jira] [Created] (HUDI-332) Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata

sivabalan narayanan created HUDI-332: Summary: Add operation type (insert/upsert/bulkinsert/delete) to HoodieCommitMetadata Key: HUDI-332 URL: https://issues.apache.org/jira/browse/HUDI-332 Projec

[jira] [Created] (HUDI-331) Fix java docs for all public apis (HoodieWriteClient)

sivabalan narayanan created HUDI-331: Summary: Fix java docs for all public apis (HoodieWriteClient) Key: HUDI-331 URL: https://issues.apache.org/jira/browse/HUDI-331 Project: Apache Hudi (incubati

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346686064 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346685092 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346684864 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325

[GitHub] [incubator-hudi] nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

nsivabalan commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346684533 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #99

See Changes: -- [...truncated 2.17 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache

[GitHub] [incubator-hudi] yanghua commented on issue #991: Hudi Test Suite (Refactor)

yanghua commented on issue #991: Hudi Test Suite (Refactor) URL: https://github.com/apache/incubator-hudi/pull/991#issuecomment-554197224 @n3nash If your lastest force-pushed commit try to fix CI issues? I would not suggest using force-push for the big PR which needs to be iterated many t

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554169864 > > @bvaradar can we re-trigger the tests

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554162862 > @bvaradar can we re-trigger the tests ?

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554148996 @bvaradar can we re-trigger the tests ? I

[GitHub] [incubator-hudi] umehrot2 edited a comment on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date typ

umehrot2 edited a comment on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554089712 @modi95 @bvaradar I was ab

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554089712 @modi95 @bvaradar I was able to f

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974563#comment-16974563 ] Ethan Guo commented on HUDI-76: --- And the performance problem will be resolved once the row-to-

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974562#comment-16974562 ] Ethan Guo commented on HUDI-76: --- [~vinoth]  CSV to Row conversion would make the change much s

[GitHub] [incubator-hudi] umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

umehrot2 commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554016570 > Looks like the integration tests are fa

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-554001497 Looks like the integration tests are fail

[GitHub] [incubator-hudi] bvaradar commented on issue #994: [HUDI-151] Enable HiveOnSpark queries for RT tables

bvaradar commented on issue #994: [HUDI-151] Enable HiveOnSpark queries for RT tables URL: https://github.com/apache/incubator-hudi/pull/994#issuecomment-553997169 @n3nash : Once you address the comment, I will merge this diff ---

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346447994 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325,6

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346443167 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -327,2

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346440995 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325,6

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346448367 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325,6

[GitHub] [incubator-hudi] broussea1901 commented on issue #1007: Azure Support

broussea1901 commented on issue #1007: Azure Support URL: https://github.com/apache/incubator-hudi/issues/1007#issuecomment-553992048 Considering IGFS is provided it might also be nice to support Alluxio FS https://docs.alluxio.io/os/user/stable/en/api/FS-API.html

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient

bvaradar commented on a change in pull request #1004: [HUDI-328] Adding delete api to HoodieWriteClient URL: https://github.com/apache/incubator-hudi/pull/1004#discussion_r346439185 ## File path: hudi-client/src/main/java/org/apache/hudi/HoodieWriteClient.java ## @@ -325,6

[GitHub] [incubator-hudi] bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types

bvaradar commented on issue #1005: [HUDI-91][HUDI-12]Migrate to spark 2.4.4, migrate to spark-avro library instead of databricks-avro, add support for Decimal/Date types URL: https://github.com/apache/incubator-hudi/pull/1005#issuecomment-553983078 Re-kicked Integration tests

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974429#comment-16974429 ] Vinoth Chandar commented on HUDI-64: Sure. sg!  > JIRA issue HUDI-184 related to integr

[jira] [Updated] (HUDI-184) Integrate Hudi with Apache Flink

[ https://issues.apache.org/jira/browse/HUDI-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-184: Component/s: Write Client > Integrate Hudi with Apache Flink > > >

[jira] [Commented] (HUDI-76) CSV Source support for Hudi Delta Streamer

[ https://issues.apache.org/jira/browse/HUDI-76?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974425#comment-16974425 ] Vinoth Chandar commented on HUDI-76: [~guoyihua] yes, may be we can follow same approach

[incubator-hudi] 01/02: [MINOR] Cosmetic improvements to site

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit b57bbd0228a17b3571708f17c88ceed192d18b21 Author: vinothchandar AuthorDate: Thu Nov 14 06:01:34 2019 -080

[incubator-hudi] branch asf-site updated (a042fb9 -> 98591dd)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from a042fb9 [SITE] change footer text-align (#1016) new b57bbd0 [MINOR] Cosmetic improvements to s

[GitHub] [incubator-hudi] bhasudha merged pull request #1018: [DOCS] Fixes to code styling & updating to latest site content

bhasudha merged pull request #1018: [DOCS] Fixes to code styling & updating to latest site content URL: https://github.com/apache/incubator-hudi/pull/1018 This is an automated message from the Apache Git Service. To respond

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #1018: [DOCS] Fixes to code styling & updating to latest site content

vinothchandar opened a new pull request #1018: [DOCS] Fixes to code styling & updating to latest site content URL: https://github.com/apache/incubator-hudi/pull/1018 This is an automated message from the Apache Git Service.

[GitHub] [incubator-hudi] lamber-ken commented on issue #1017: [Question] what's different between -DskipTests and -DskipITs?

lamber-ken commented on issue #1017: [Question] what's different between -DskipTests and -DskipITs? URL: https://github.com/apache/incubator-hudi/issues/1017#issuecomment-553874784 > Hi, `-DskipTests ` means skip Unit Tests and `-DskipITs` means skip Intergrate Test(mainly in hudi-integ-te

[GitHub] [incubator-hudi] lamber-ken closed issue #1017: [Question] what's different between -DskipTests and -DskipITs?

lamber-ken closed issue #1017: [Question] what's different between -DskipTests and -DskipITs? URL: https://github.com/apache/incubator-hudi/issues/1017 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974197#comment-16974197 ] vinoyang commented on HUDI-64: -- [~vinoth] There is a JIRA issue HUDI-184 related to integrating

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974157#comment-16974157 ] Vinoth Chandar commented on HUDI-64: [~yanghua] thats a great summary. Sadly, not sure

[GitHub] [incubator-hudi] leesf commented on issue #1017: [Question] what's different between -DskipTests and -DskipITs?

leesf commented on issue #1017: [Question] what's different between -DskipTests and -DskipITs? URL: https://github.com/apache/incubator-hudi/issues/1017#issuecomment-553835426 Hi, `-DskipTests ` means skip Unit Tests and `-DskipITs` means skip Intergrate Test(mainly in hudi-integ-test modu