[jira] [Created] (HUDI-230) Add missing Apache License in some files

2019-08-29 Thread leesf (Jira)
leesf created HUDI-230: -- Summary: Add missing Apache License in some files Key: HUDI-230 URL: https://issues.apache.org/jira/browse/HUDI-230 Project: Apache Hudi (incubating) Issue Type: Improvement

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to overri

2019-08-29 Thread GitBox
bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319356000 ##

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to overri

2019-08-29 Thread GitBox
bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319355998 ##

[jira] [Updated] (HUDI-229) Fix mvn notice:generate issue in windows

2019-08-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-229: Labels: pull-request-available (was: ) > Fix mvn notice:generate issue in windows >

[GitHub] [incubator-hudi] leesf opened a new pull request #865: [HUDI-229] Fix mvn notice:generate issue in windows

2019-08-29 Thread GitBox
leesf opened a new pull request #865: [HUDI-229] Fix mvn notice:generate issue in windows URL: https://github.com/apache/incubator-hudi/pull/865 see jira:[HUDI-229](https://jira.apache.org/jira/projects/HUDI/issues/HUDI-229)

[GitHub] [incubator-hudi] leesf commented on a change in pull request #865: [HUDI-229] Fix mvn notice:generate issue in windows

2019-08-29 Thread GitBox
leesf commented on a change in pull request #865: [HUDI-229] Fix mvn notice:generate issue in windows URL: https://github.com/apache/incubator-hudi/pull/865#discussion_r319354103 ## File path: pom.xml ## @@ -202,9 +202,9 @@ - file:

[GitHub] [incubator-hudi] leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override

2019-08-29 Thread GitBox
leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319353211 ## F

[GitHub] [incubator-hudi] leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override

2019-08-29 Thread GitBox
leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319353447 ## F

[GitHub] [incubator-hudi] leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override

2019-08-29 Thread GitBox
leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319353211 ## F

[GitHub] [incubator-hudi] leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override

2019-08-29 Thread GitBox
leesf commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319352094 ## F

[GitHub] [incubator-hudi] leesf edited a comment on issue #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs thro

2019-08-29 Thread GitBox
leesf edited a comment on issue #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#issuecomment-526449356 Some checkstyle violati

[GitHub] [incubator-hudi] leesf commented on issue #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through pro

2019-08-29 Thread GitBox
leesf commented on issue #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#issuecomment-526449356 Some checkstyle violations. -

[jira] [Closed] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-225. -- Resolution: Fixed > Create Hudi Timeline Server Fat Jar > > > Key:

[jira] [Updated] (HUDI-229) Fix mvn notice:generate issue in windows

2019-08-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-229: --- Fix Version/s: 0.5.0 > Fix mvn notice:generate issue in windows > > >

[jira] [Commented] (HUDI-228) Add Jira Conventions to contributing/community pages of HUDI

2019-08-29 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919150#comment-16919150 ] leesf commented on HUDI-228: When opening a PR,  the commit message could be _[HUDI-xxx] Jira s

[GitHub] [incubator-hudi] bvaradar merged pull request #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
bvaradar merged pull request #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861 This is an automated message from the Apache Git Service. To respond to the message, pl

[incubator-hudi] branch master updated (5f9fa82 -> 5c2da60)

2019-08-29 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 5f9fa82 HUDI-124 : Exclude jdk.tools from hadoop-common and update Notice files (#858) add 5c2da60 [

[GitHub] [incubator-hudi] bvaradar commented on issue #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through

2019-08-29 Thread GitBox
bvaradar commented on issue #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#issuecomment-526434725 @vinothchandar : Addressed

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to overri

2019-08-29 Thread GitBox
bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319339853 ##

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to overri

2019-08-29 Thread GitBox
bvaradar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319339831 ##

[GitHub] [incubator-hudi] leesf commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake

2019-08-29 Thread GitBox
leesf commented on issue #857: http://hudi.apache.org/comparison.html# should mention Iceberg and DeltaLake URL: https://github.com/apache/incubator-hudi/issues/857#issuecomment-526433763 +1 for the mention since Iceberg and DeltaLake are similar to Hudi. --

[jira] [Created] (HUDI-229) Fix mvn notice:generate issue in windows

2019-08-29 Thread leesf (Jira)
leesf created HUDI-229: -- Summary: Fix mvn notice:generate issue in windows Key: HUDI-229 URL: https://issues.apache.org/jira/browse/HUDI-229 Project: Apache Hudi (incubating) Issue Type: Bug C

[GitHub] [incubator-hudi] leesf commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
leesf commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861#issuecomment-526421500 @bvaradar Thanks for your reminder, updated the PR. And will file another jira ticket to track mvn notice:generate issue in windows. -

[GitHub] [incubator-hudi] tribbloid commented on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
tribbloid commented on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526413598 Also affects me @vinothchandar thanks a lot for the hint! You are right it is indeed caused by ObjectSizeCalculator. After I swap it

[GitHub] [incubator-hudi] afilipchik opened a new pull request #864: Support nested ordering fields

2019-08-29 Thread GitBox
afilipchik opened a new pull request #864: Support nested ordering fields URL: https://github.com/apache/incubator-hudi/pull/864 Allow ordering fields to be nested This is an automated message from the Apache Git Service. To r

[GitHub] [incubator-hudi] bvaradar edited a comment on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
bvaradar edited a comment on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861#issuecomment-526406301 @leesf:We found mvn notice:generate to be noisy in that it perceives changes when there shouldn't be (depending in the maven

[GitHub] [incubator-hudi] bvaradar commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
bvaradar commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861#issuecomment-526406301 @leesf: As far as this PR goes, it looks good. We found mvn notice:generate to be noisy in that it perceives changes when there shou

[GitHub] [incubator-hudi] leesf commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
leesf commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861#issuecomment-526392030 @vinothchandar @bvaradar Thanks for the review, addressed the comments and squashed the commits. And two things to point out. First whe

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to o

2019-08-29 Thread GitBox
vinothchandar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319283147 #

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to o

2019-08-29 Thread GitBox
vinothchandar commented on a change in pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319287729 #

[jira] [Created] (HUDI-228) Add Jira Conventions to contributing/community pages of HUDI

2019-08-29 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-228: --- Summary: Add Jira Conventions to contributing/community pages of HUDI Key: HUDI-228 URL: https://issues.apache.org/jira/browse/HUDI-228 Project: Apache Hudi (in

[jira] [Updated] (HUDI-227) DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties

2019-08-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-227: Labels: pull-request-available (was: ) > DeltaStreamer Improvements : Commit empty input batch with

[GitHub] [incubator-hudi] bvaradar opened a new pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs t

2019-08-29 Thread GitBox
bvaradar opened a new pull request #863: [HUDI-227] : DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties URL: https://github.com/apache/incubator-hudi/pull/863 Original PR : PR-805 and PR-806 http

[jira] [Created] (HUDI-227) DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties

2019-08-29 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-227: --- Summary: DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties Key: HUDI-227 URL: https

[GitHub] [incubator-hudi] DavisBroda commented on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
DavisBroda commented on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526321219 To give more context, hudi is being used as one component of a larger codebase that is intended to run on multiple environments, one of whi

[GitHub] [incubator-hudi] DavisBroda edited a comment on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
DavisBroda edited a comment on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526321219 To give more context, hudi is being used as one dependency of a larger codebase that is intended to run on multiple environments, on

[GitHub] [incubator-hudi] afilipchik opened a new pull request #862: Add support for composite key

2019-08-29 Thread GitBox
afilipchik opened a new pull request #862: Add support for composite key URL: https://github.com/apache/incubator-hudi/pull/862 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [incubator-hudi] DavisBroda commented on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
DavisBroda commented on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526313932 Switching to another JVM is not possible. The environment in which I have to run the code cannot be changed. -

[GitHub] [incubator-hudi] vinothchandar commented on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
vinothchandar commented on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526309772 ah. missed .java I guess. my bad... Is it possible for you to switch to other jvms? trying to understand what you are trying to a

[GitHub] [incubator-hudi] DavisBroda commented on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
DavisBroda commented on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526283453 @vinothchandar link you provided does not work on click. here's a [working one](https://github.com/twitter/commons/blob/master/src/java/com

[GitHub] [incubator-hudi] DavisBroda edited a comment on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
DavisBroda edited a comment on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526283453 @vinothchandar link you provided is not clickable. here's a [working one](https://github.com/twitter/commons/blob/master/src/java/co

[GitHub] [incubator-hudi] vinothchandar commented on issue #860: Unit tests fail when run on IBM SDK

2019-08-29 Thread GitBox
vinothchandar commented on issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526273162 `Caused by: java.lang.UnsupportedOperationException: ObjectSizeCalculator only supported on HotSpot VM` - This seems like a legit issue.

[GitHub] [incubator-hudi] vinothchandar commented on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0...

2019-08-29 Thread GitBox
vinothchandar commented on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0... URL: https://github.com/apache/incubator-hudi/pull/638#issuecomment-526271372 yes its still in the plan. Actually, with cleanups to pom from @thesuperzapper and me already merged to master

[GitHub] [incubator-hudi] vinothchandar commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
vinothchandar commented on issue #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861#issuecomment-526269941 @bvaradar Tip: I have been using "squash and merge" option which lets you control commit message and also squashes automatica

[jira] [Updated] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-225: Labels: pull-request-available (was: ) > Create Hudi Timeline Server Fat Jar >

[GitHub] [incubator-hudi] leesf opened a new pull request #861: [HUDI-225] Create Hudi Timeline Server Fat Jar

2019-08-29 Thread GitBox
leesf opened a new pull request #861: [HUDI-225] Create Hudi Timeline Server Fat Jar URL: https://github.com/apache/incubator-hudi/pull/861 see jira:[HUDI-225](https://jira.apache.org/jira/projects/HUDI/issues/HUDI-225) This