[GitHub] [incubator-hudi] n3nash opened a new pull request #667: Caching Avro Binary encoder/decoder to avoid creating new one for every record

2019-05-05 Thread GitBox
n3nash opened a new pull request #667: Caching Avro Binary encoder/decoder to avoid creating new one for every record URL: https://github.com/apache/incubator-hudi/pull/667 This is an automated message from the Apache Git

[GitHub] [incubator-hudi] n3nash opened a new pull request #666: Add support for dynamic bloom filter to increase efficiency of bloom filter for static sizing

2019-05-05 Thread GitBox
n3nash opened a new pull request #666: Add support for dynamic bloom filter to increase efficiency of bloom filter for static sizing URL: https://github.com/apache/incubator-hudi/pull/666 Performed the following tests to check for correctness & performance: |Correctness| |--|

[GitHub] [incubator-hudi] abhioncbr commented on issue #665: Revert "HUDI-101: added mevn-shade plugin with filters."

2019-05-05 Thread GitBox
abhioncbr commented on issue #665: Revert "HUDI-101: added mevn-shade plugin with filters." URL: https://github.com/apache/incubator-hudi/pull/665#issuecomment-489485580 @bvaradar I will try to look if shade plugin can be applicable on selective sub-projects or using some else plugin

[GitHub] [incubator-hudi] bvaradar commented on issue #665: Revert "HUDI-101: added mevn-shade plugin with filters."

2019-05-05 Thread GitBox
bvaradar commented on issue #665: Revert "HUDI-101: added mevn-shade plugin with filters." URL: https://github.com/apache/incubator-hudi/pull/665#issuecomment-489482085 Merging this change myself to keep master sane This is

[incubator-hudi] branch master updated: Revert "HUDI-101: added mevn-shade plugin with filters." Creates fat jars for all hoodie packages

2019-05-05 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new ee1feb7 Revert "HUDI-101: added

[GitHub] [incubator-hudi] bvaradar merged pull request #665: Revert "HUDI-101: added mevn-shade plugin with filters."

2019-05-05 Thread GitBox
bvaradar merged pull request #665: Revert "HUDI-101: added mevn-shade plugin with filters." URL: https://github.com/apache/incubator-hudi/pull/665 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] bvaradar commented on issue #665: Revert "HUDI-101: added mevn-shade plugin with filters."

2019-05-05 Thread GitBox
bvaradar commented on issue #665: Revert "HUDI-101: added mevn-shade plugin with filters." URL: https://github.com/apache/incubator-hudi/pull/665#issuecomment-489481897 @abhioncbr : While investigating another issue, I realized even hoodie-common has become a fat jar. You might need to

[GitHub] [incubator-hudi] bvaradar opened a new pull request #665: Revert "HUDI-101: added mevn-shade plugin with filters."

2019-05-05 Thread GitBox
bvaradar opened a new pull request #665: Revert "HUDI-101: added mevn-shade plugin with filters." URL: https://github.com/apache/incubator-hudi/pull/665 The original PR is accidentally creating fat jars for all hoodie packages ( including hoodie-common, hoodie-client,) This

[GitHub] [incubator-hudi] bvaradar commented on issue #664: Updating Apache Hudi Website with latest changes in docs

2019-05-05 Thread GitBox
bvaradar commented on issue #664: Updating Apache Hudi Website with latest changes in docs URL: https://github.com/apache/incubator-hudi/pull/664#issuecomment-489475044 @vinothchandar : Please review This is an automated

[GitHub] [incubator-hudi] bvaradar opened a new pull request #664: Updating Apache Hudi Website with latest changes in docs

2019-05-05 Thread GitBox
bvaradar opened a new pull request #664: Updating Apache Hudi Website with latest changes in docs URL: https://github.com/apache/incubator-hudi/pull/664 Updating Apache Hudi Website with latest changes in docs This is an

[GitHub] [incubator-hudi] SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489427860 * Built a production grade file based data lake for Yields.io (in production). * Building

[GitHub] [incubator-hudi] SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489427860 * Built a production grade file based data lake for Yields.io (in production). * Building

[GitHub] [incubator-hudi] SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489427860 * Built a production grade file based data lake for Yields.io (in production). * Building

[GitHub] [incubator-hudi] SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489427860 * Built a production grade file based data lake for Yields.io (in production). * Building

[GitHub] [incubator-hudi] SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
SemanticBeeng edited a comment on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489427860 Built a production grade file based data lake for Yields.io (in production). Building infrastructure

[GitHub] [incubator-hudi] SemanticBeeng commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
SemanticBeeng commented on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489427860 Built a production grade file based data lake for Yields.io. Building infrastructure for incremental, cross

[GitHub] [incubator-hudi] leilinen commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-05-05 Thread GitBox
leilinen commented on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-489426538 We are exploring incremental data updates with HUDI, and rewrited code of consuming data. We hope HUDI help us

[GitHub] [incubator-hudi] zk19930911 commented on issue #654: Many small files

2019-05-05 Thread GitBox
zk19930911 commented on issue #654: Many small files URL: https://github.com/apache/incubator-hudi/issues/654#issuecomment-489409698 @vinothchandar many updates This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281010187 ## File path: hoodie-client/src/test/java/com/uber/hoodie/common/HoodieClientTestUtils.java ## @@ -113,6 +113,7

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281007101 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/storage/HoodieOrcWriter.java ## @@ -0,0 +1,192 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281007136 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/storage/HoodieOrcWriter.java ## @@ -0,0 +1,192 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281006974 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/storage/HoodieOrcWriter.java ## @@ -0,0 +1,192 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281006784 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/storage/HoodieOrcConfig.java ## @@ -0,0 +1,73 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281006414 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java ## @@ -369,6 +377,42 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281006391 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/storage/HoodieOrcWriter.java ## @@ -0,0 +1,192 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281006108 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieStorageConfig.java ## @@ -51,6 +51,19 @@

[GitHub] [incubator-hudi] ambition119 commented on a change in pull request #657: [HUDI-57] support orc file

2019-05-05 Thread GitBox
ambition119 commented on a change in pull request #657: [HUDI-57] support orc file URL: https://github.com/apache/incubator-hudi/pull/657#discussion_r281006021 ## File path: hoodie-client/pom.xml ## @@ -208,6 +208,12 @@ 3.0.4 + + org.apache.orc +