[GitHub] [hudi] umehrot2 commented on a change in pull request #1768: [HUDI-1054][Peformance] Several performance fixes during finalizing writes

2020-07-30 Thread GitBox
umehrot2 commented on a change in pull request #1768: URL: https://github.com/apache/hudi/pull/1768#discussion_r463323604 ## File path: hudi-client/src/main/java/org/apache/hudi/table/MarkerFiles.java ## @@ -110,6 +158,10 @@ private String translateMarkerToDataPath(String

[GitHub] [hudi] umehrot2 commented on a change in pull request #1768: [HUDI-1054][Peformance] Several performance fixes during finalizing writes

2020-07-15 Thread GitBox
umehrot2 commented on a change in pull request #1768: URL: https://github.com/apache/hudi/pull/1768#discussion_r455390259 ## File path: hudi-client/src/main/java/org/apache/hudi/table/HoodieTable.java ## @@ -386,13 +389,26 @@ public void finalizeWrite(JavaSparkContext jsc,

[GitHub] [hudi] umehrot2 commented on a change in pull request #1768: [HUDI-1054][Peformance] Several performance fixes during finalizing writes

2020-06-29 Thread GitBox
umehrot2 commented on a change in pull request #1768: URL: https://github.com/apache/hudi/pull/1768#discussion_r447264716 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FSUtils.java ## @@ -199,16 +201,40 @@ public static String getRelativePartitionPath(Path

[GitHub] [hudi] umehrot2 commented on a change in pull request #1768: [HUDI-1054][Peformance] Several performance fixes during finalizing writes

2020-06-29 Thread GitBox
umehrot2 commented on a change in pull request #1768: URL: https://github.com/apache/hudi/pull/1768#discussion_r447264262 ## File path: hudi-common/pom.xml ## @@ -147,6 +147,16 @@ test + + + org.apache.spark + spark-core_${scala.binary.version}