[GitHub] [incubator-hudi] ambition119 closed pull request #618: fix Schema.parse to new Schema.Parser().parse

2019-04-03 Thread GitBox
ambition119 closed pull request #618: fix Schema.parse to new Schema.Parser().parse URL: https://github.com/apache/incubator-hudi/pull/618 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271957117 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271990580 ## File path: hoodie-client/src/main/java/com/uber/hoodie/table/HoodieCopyOnWriteTable.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271987616 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271962356 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271956786 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271992170 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/timeline/request/Com

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271961846 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271992787 ## File path: hoodie-common/pom.xml ## @@ -70,6 +70,18 @@ + + c

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271960908 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieWriteClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271956153 ## File path: hoodie-client/pom.xml ## @@ -68,6 +68,11 @@ hoodie-common

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271987557 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271951606 ## File path: hoodie-client/src/main/java/com/uber/hoodie/CompactionAdminClient.java #

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271988556 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/HoodieAppendHandle.java #

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271961447 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271955774 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271948205 ## File path: hoodie-cli/src/main/java/com/uber/hoodie/cli/commands/SparkMain.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271960163 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieReadClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271961182 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieWriteClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271987839 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271962181 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271991447 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieTimeline.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271989158 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/HoodieMergeHandle.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271956861 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271990953 ## File path: hoodie-common/src/main/avro/HoodieCommitMetadata.avsc ## @@ -92,6 +9

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271991690 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieView.java ###

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271992628 ## File path: hoodie-common/pom.xml ## @@ -70,6 +70,18 @@ + Revie

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271987750 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271988023 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
vinothchandar commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271961303 ## File path: hoodie-client/src/main/java/com/uber/hoodie/config/HoodieWriteConfig.java ##

[GitHub] [incubator-hudi] vinothchandar closed issue #591: Hudi write phase (final writing to parquet) fails if there is a large number of Spark partitions

2019-04-03 Thread GitBox
vinothchandar closed issue #591: Hudi write phase (final writing to parquet) fails if there is a large number of Spark partitions URL: https://github.com/apache/incubator-hudi/issues/591 This is an automated message from the

[GitHub] [incubator-hudi] vinothchandar commented on issue #591: Hudi write phase (final writing to parquet) fails if there is a large number of Spark partitions

2019-04-03 Thread GitBox
vinothchandar commented on issue #591: Hudi write phase (final writing to parquet) fails if there is a large number of Spark partitions URL: https://github.com/apache/incubator-hudi/issues/591#issuecomment-479707124 @n3nash HUDI-72 tracks this -

[GitHub] [incubator-hudi] vinothchandar merged pull request #629: 1. Minor changes to fix compaction 2. Adding 2 compaction policies 3. Adding a Hbase index property

2019-04-03 Thread GitBox
vinothchandar merged pull request #629: 1. Minor changes to fix compaction 2. Adding 2 compaction policies 3. Adding a Hbase index property URL: https://github.com/apache/incubator-hudi/pull/629 This is an automated message

[incubator-hudi] branch master updated: 1. Minor changes to fix compaction 2. Adding 2 compaction policies

2019-04-03 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 2577014 1. Minor changes to fix compact

[GitHub] [incubator-hudi] n3nash merged pull request #627: [HUDI-66] FSUtils.getRelativePartitionPath does not handle repeated f…

2019-04-03 Thread GitBox
n3nash merged pull request #627: [HUDI-66] FSUtils.getRelativePartitionPath does not handle repeated f… URL: https://github.com/apache/incubator-hudi/pull/627 This is an automated message from the Apache Git Service. To resp

[incubator-hudi] branch master updated: [HUDI-66] FSUtils.getRelativePartitionPath does not handle repeated folder names

2019-04-03 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new d1d33f7 [HUDI-66] FSUtils.getRelative

[GitHub] [incubator-hudi] n3nash commented on issue #627: [HUDI-66] FSUtils.getRelativePartitionPath does not handle repeated f…

2019-04-03 Thread GitBox
n3nash commented on issue #627: [HUDI-66] FSUtils.getRelativePartitionPath does not handle repeated f… URL: https://github.com/apache/incubator-hudi/pull/627#issuecomment-479706667 LGTM This is an automated message from the A

[GitHub] [incubator-hudi] vinothchandar commented on issue #625: fix(spark): fix shading for spark bundle to include all hive's libraries unshaded

2019-04-03 Thread GitBox
vinothchandar commented on issue #625: fix(spark): fix shading for spark bundle to include all hive's libraries unshaded URL: https://github.com/apache/incubator-hudi/pull/625#issuecomment-479705385 > java.util.concurrent.ExecutionException: java.lang.IllegalArgumentException: hoodie-file:

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #618: fix Schema.parse to new Schema.Parser().parse

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #618: fix Schema.parse to new Schema.Parser().parse URL: https://github.com/apache/incubator-hudi/pull/618#discussion_r271980252 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/log/HoodieLogFormatVersion.java

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #618: fix Schema.parse to new Schema.Parser().parse

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #618: fix Schema.parse to new Schema.Parser().parse URL: https://github.com/apache/incubator-hudi/pull/618#discussion_r271980289 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/log/HoodieLogFormatVersion.java

[GitHub] [incubator-hudi] vinothchandar closed issue #628: Replace Databricks spark-avro with native spark-avro

2019-04-03 Thread GitBox
vinothchandar closed issue #628: Replace Databricks spark-avro with native spark-avro URL: https://github.com/apache/incubator-hudi/issues/628 This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [incubator-hudi] vinothchandar commented on issue #628: Replace Databricks spark-avro with native spark-avro

2019-04-03 Thread GitBox
vinothchandar commented on issue #628: Replace Databricks spark-avro with native spark-avro URL: https://github.com/apache/incubator-hudi/issues/628#issuecomment-479696908 https://issues.apache.org/jira/browse/HUDI-91 tracks this.. Closing GH issue in favor of that ---

[GitHub] [incubator-hudi] vinothchandar commented on issue #143: Tracking ticket for folks to be added to slack group

2019-04-03 Thread GitBox
vinothchandar commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-479688359 done.. Also please join our mailing list. https://hudi.apache.org/community.html :) -

[GitHub] [incubator-hudi] milantracy commented on issue #143: Tracking ticket for folks to be added to slack group

2019-04-03 Thread GitBox
milantracy commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-479685833 could you add me to the slack channel, milantr...@gmail.com :) thanks a lot -

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271948421 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/view/HoodieTableFileSystemV

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271948059 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/view/FileSystemViewStorageT

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271931617 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/view/AbstractTableFileSyste

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271928501 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/timeline/HoodieDefaultTimel

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271928501 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/timeline/HoodieDefaultTimel

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271928350 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/timeline/HoodieDefaultTimel

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271927580 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/timeline/HoodieActiveTimeli

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271927078 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/TableFileSystemView.java #

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271926261 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieView.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271925979 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieView.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271925460 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieTimeline.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271925460 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieTimeline.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271925335 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/table/HoodieTimeline.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271924558 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/model/HoodieWriteStat.java #

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271924252 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/model/HoodieLogFile.java ###

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271924427 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/model/HoodieLogFile.java ###

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271923395 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/model/HoodieDataFile.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271923395 ## File path: hoodie-common/src/main/java/com/uber/hoodie/common/model/HoodieDataFile.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271922608 ## File path: hoodie-client/src/test/java/com/uber/hoodie/table/TestMergeOnReadTable.java ###

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271922431 ## File path: hoodie-client/src/test/java/com/uber/hoodie/io/strategy/TestHoodieDataFile.java ###

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271921970 ## File path: hoodie-client/src/test/java/com/uber/hoodie/TestMultiFS.java ## @@ -109,6 +

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271921122 ## File path: hoodie-client/src/test/java/com/uber/hoodie/TestAsyncCompactionWithEmbeddedTimelineS

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271918483 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/compact/HoodieRealtimeTableCompactor.

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271918483 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/compact/HoodieRealtimeTableCompactor.

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271917051 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/HoodieCleanHelper.java ## @

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271915076 ## File path: hoodie-client/src/main/java/com/uber/hoodie/io/HoodieAppendHandle.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271914607 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271913778 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271913114 ## File path: hoodie-client/src/main/java/com/uber/hoodie/func/EmbeddedTimelineServer.java ##

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271912046 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieWriteClient.java ## @@ -1

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271911256 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieWriteClient.java ## @@ -1

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271910725 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieWriteClient.java ## @@ -1

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271910582 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieReadClient.java ## @@ -13

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271906279 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ## @@ -0,

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271905880 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ## @@ -0,

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271905565 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ## @@ -0,

[GitHub] [incubator-hudi] n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support

2019-04-03 Thread GitBox
n3nash commented on a change in pull request #600: Timeline Service with Incremental View Syncing support URL: https://github.com/apache/incubator-hudi/pull/600#discussion_r271905131 ## File path: hoodie-client/src/main/java/com/uber/hoodie/HoodieBaseClient.java ## @@ -0,

[GitHub] [incubator-hudi] n3nash opened a new pull request #629: 1. Minor changes to fix compaction 2. Adding 2 compaction policies 3. Adding a Hbase index property

2019-04-03 Thread GitBox
n3nash opened a new pull request #629: 1. Minor changes to fix compaction 2. Adding 2 compaction policies 3. Adding a Hbase index property URL: https://github.com/apache/incubator-hudi/pull/629 This is an automated message f

[incubator-hudi] branch master updated: Fixing small file handling, inline compaction defaults

2019-04-03 Thread nagarwal
This is an automated email from the ASF dual-hosted git repository. nagarwal pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new b34a204 Fixing small file handling, i

[GitHub] [incubator-hudi] n3nash merged pull request #599: Fixing small file handling, inline compaction defaults

2019-04-03 Thread GitBox
n3nash merged pull request #599: Fixing small file handling, inline compaction defaults URL: https://github.com/apache/incubator-hudi/pull/599 This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [incubator-hudi] n3nash commented on issue #599: Fixing small file handling, inline compaction defaults

2019-04-03 Thread GitBox
n3nash commented on issue #599: Fixing small file handling, inline compaction defaults URL: https://github.com/apache/incubator-hudi/pull/599#issuecomment-479593132 Yeah, good for now, we anyways have to solve this in general for all tests.

[GitHub] [incubator-hudi] vinothchandar commented on issue #498: Is there any record delete examples?

2019-04-03 Thread GitBox
vinothchandar commented on issue #498: Is there any record delete examples? URL: https://github.com/apache/incubator-hudi/issues/498#issuecomment-479586491 yes .. :) .. this is something we have mulling on how to support this using the datasource APIs, which is kind of awkward for this..

[GitHub] [incubator-hudi] vinothchandar commented on issue #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark

2019-04-03 Thread GitBox
vinothchandar commented on issue #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark URL: https://github.com/apache/incubator-hudi/pull/620#issuecomment-479576736 Also lets take this discussion to the mailing list, so others also benefit :) https://hudi.apache.org/commu

[GitHub] [incubator-hudi] vinothchandar commented on issue #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark

2019-04-03 Thread GitBox
vinothchandar commented on issue #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark URL: https://github.com/apache/incubator-hudi/pull/620#issuecomment-479576565 @leilinen so may be with increased parallelism, hitting the race condition becomes more probable. Actual

[GitHub] [incubator-hudi] leilinen commented on issue #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark

2019-04-03 Thread GitBox
leilinen commented on issue #620: Fix HUDI-27 : Support num_cores > 1 for writing through spark URL: https://github.com/apache/incubator-hudi/pull/620#issuecomment-479521042 @vinothchandar Today I tested my process and found if the parameter of limitSource in HoodieDeltaStreamer is lar