[GitHub] [incubator-hudi] leesf opened a new pull request #856: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread GitBox
leesf opened a new pull request #856: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh URL: https://github.com/apache/incubator-hudi/pull/856 see jira:[HUDI-222](https://jira.apache.org/jira/projects/HUDI/issues/HUDI-222)

[jira] [Updated] (HUDI-222) Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-222: Labels: pull-request-available (was: ) > Rename main class path to

[GitHub] [incubator-hudi] leesf opened a new pull request #855: [HUDI-222] Rename main class path to org.apache.hudi.timeline.serviceTimelineService in run_server.sh

2019-08-28 Thread GitBox
leesf opened a new pull request #855: [HUDI-222] Rename main class path to org.apache.hudi.timeline.serviceTimelineService in run_server.sh URL: https://github.com/apache/incubator-hudi/pull/855 see jira: [HUDI-222](https://jira.apache.org/jira/projects/HUDI/issues/HUDI-222) Rename

[GitHub] [incubator-hudi] leesf closed pull request #855: [HUDI-222] Rename main class path to org.apache.hudi.timeline.serviceTimelineService in run_server.sh

2019-08-28 Thread GitBox
leesf closed pull request #855: [HUDI-222] Rename main class path to org.apache.hudi.timeline.serviceTimelineService in run_server.sh URL: https://github.com/apache/incubator-hudi/pull/855 This is an automated message from

[jira] [Created] (HUDI-222) rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread leesf (Jira)
leesf created HUDI-222: -- Summary: rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh Key: HUDI-222 URL: https://issues.apache.org/jira/browse/HUDI-222 Project: Apache

[jira] [Updated] (HUDI-222) Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-222: --- Summary: Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh (was: rename

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #18

2019-08-28 Thread Apache Jenkins Server
See -- Started by user vbalaji [EnvInject] - Loading node environment variables. Building remotely on H37 (ubuntu xenial) in workspace

[jira] [Created] (HUDI-223) Allow for simply using the the Spark Row schema in DeltaSync

2019-08-28 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-223: --- Summary: Allow for simply using the the Spark Row schema in DeltaSync Key: HUDI-223 URL: https://issues.apache.org/jira/browse/HUDI-223 Project: Apache Hudi

[GitHub] [incubator-hudi] taherk77 commented on issue #849: [HUDI-62] Added index handle times

2019-08-28 Thread GitBox
taherk77 commented on issue #849: [HUDI-62] Added index handle times URL: https://github.com/apache/incubator-hudi/pull/849#issuecomment-525739928 > @taherk77 you can click on "Details" and it will take you to the job page.. there you can click again on the failing job and look at the logs

[GitHub] [incubator-hudi] vinothchandar commented on issue #856: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread GitBox
vinothchandar commented on issue #856: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh URL: https://github.com/apache/incubator-hudi/pull/856#issuecomment-525701454 Rekicked off travis. Seems like the jvm just got killed. Not sure why.

[incubator-hudi] branch master updated: [HUDI-223] Adding a way to infer target schema from the dataset after the transformation (#854)

2019-08-28 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e0ab89b [HUDI-223] Adding a way to

[jira] [Updated] (HUDI-223) Allow for simply using the the Spark Row schema in DeltaSync

2019-08-28 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-223: Status: Patch Available (was: In Progress) > Allow for simply using the the Spark Row schema in

[jira] [Assigned] (HUDI-223) Allow for simply using the the Spark Row schema in DeltaSync

2019-08-28 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-223: --- Assignee: Vinoth Chandar > Allow for simply using the the Spark Row schema in DeltaSync >

[jira] [Resolved] (HUDI-128) Setup infra for nightly/snapshot releases

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN resolved HUDI-128. - Resolution: Fixed > Setup infra for nightly/snapshot releases >

[jira] [Reopened] (HUDI-124) Ensure third party libs are compatible with ASF policy

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reopened HUDI-124: - Need to update pom file w.r.t to license compatibility > Ensure third party libs are

[GitHub] [incubator-hudi] bvaradar opened a new pull request #858: HUDI-124 : Exclude jdk.tools from hadoop-common and update Notice files

2019-08-28 Thread GitBox
bvaradar opened a new pull request #858: HUDI-124 : Exclude jdk.tools from hadoop-common and update Notice files URL: https://github.com/apache/incubator-hudi/pull/858 Updating NOTICE.txt to be in sync with latest master. Added exclusion in hadoop-common dependency to exclude jdk.tools

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #853: Ignore duplicate of a compaction file

2019-08-28 Thread GitBox
vinothchandar commented on a change in pull request #853: Ignore duplicate of a compaction file URL: https://github.com/apache/incubator-hudi/pull/853#discussion_r318532604 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CompactionUtils.java ## @@

[jira] [Updated] (HUDI-223) Allow for simply using the the Spark Row schema in DeltaSync

2019-08-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-223: Labels: pull-request-available (was: ) > Allow for simply using the the Spark Row schema in

[GitHub] [incubator-hudi] bvaradar commented on a change in pull request #853: [HUDI-174] Ignore duplicate of a compaction file

2019-08-28 Thread GitBox
bvaradar commented on a change in pull request #853: [HUDI-174] Ignore duplicate of a compaction file URL: https://github.com/apache/incubator-hudi/pull/853#discussion_r318574724 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/CompactionUtils.java ##

[GitHub] [incubator-hudi] bvaradar merged pull request #853: [HUDI-174] Ignore duplicate of a compaction file

2019-08-28 Thread GitBox
bvaradar merged pull request #853: [HUDI-174] Ignore duplicate of a compaction file URL: https://github.com/apache/incubator-hudi/pull/853 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HUDI-174) Investigate atomicity guarantees out of cloud storage

2019-08-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-174: Labels: pull-request-available (was: ) > Investigate atomicity guarantees out of cloud storage >

[incubator-hudi] branch master updated (e0ab89b -> 41dbac6)

2019-08-28 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from e0ab89b [HUDI-223] Adding a way to infer target schema from the dataset after the transformation (#854)

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #19

2019-08-28 Thread Apache Jenkins Server
See -- Started by user vbalaji [EnvInject] - Loading node environment variables. Building remotely on H24 (ubuntu xenial) in workspace

svn commit: r35439 - in /release/hudi: ./ KEYS

2019-08-28 Thread vbalaji
Author: vbalaji Date: Wed Aug 28 17:00:56 2019 New Revision: 35439 Log: Adding hudi KEYS Added: release/hudi/ release/hudi/KEYS Added: release/hudi/KEYS == --- release/hudi/KEYS (added) +++ release/hudi/KEYS

[jira] [Closed] (HUDI-224) Upload KEYS to dist.apache.hudi

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN closed HUDI-224. --- > Upload KEYS to dist.apache.hudi > --- > > Key:

[GitHub] [incubator-hudi] smdahmed opened a new issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear.

2019-08-28 Thread GitBox
smdahmed opened a new issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear. URL: https://github.com/apache/incubator-hudi/issues/859 How to replicate this issue: 1. Insert data into certain partition (eg: p1) -> (1, kabeer | 2, vinoth)

svn commit: r35437 - /dev/hudi/

2019-08-28 Thread vbalaji
Author: vbalaji Date: Wed Aug 28 16:54:45 2019 New Revision: 35437 Log: Adding hudi folder Added: dev/hudi/

[jira] [Reopened] (HUDI-104) Replace ThreadLocal with Resource pool when caching resource type classes

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reopened HUDI-104: - > Replace ThreadLocal with Resource pool when caching resource type classes >

Jenkins build is back to normal : hudi-snapshot-deployment-0.5 #20

2019-08-28 Thread Apache Jenkins Server
See

[jira] [Resolved] (HUDI-224) Upload KEYS to dist.apache.hudi

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN resolved HUDI-224. - Resolution: Fixed > Upload KEYS to dist.apache.hudi > --- > >

[jira] [Assigned] (HUDI-224) Upload KEYS to dist.apache.hudi

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reassigned HUDI-224: --- Assignee: BALAJI VARADARAJAN > Upload KEYS to dist.apache.hudi >

[jira] [Commented] (HUDI-224) Upload KEYS to dist.apache.hudi

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16917931#comment-16917931 ] BALAJI VARADARAJAN commented on HUDI-224: - KEYS file added to 

svn commit: r35438 - /dev/hudi/KEYS

2019-08-28 Thread vbalaji
Author: vbalaji Date: Wed Aug 28 16:58:40 2019 New Revision: 35438 Log: Adding hudi KEYS Added: dev/hudi/KEYS Added: dev/hudi/KEYS == --- dev/hudi/KEYS (added) +++ dev/hudi/KEYS Wed Aug 28 16:58:40 2019 @@ -0,0

[GitHub] [incubator-hudi] bvaradar commented on issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear.

2019-08-28 Thread GitBox
bvaradar commented on issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear. URL: https://github.com/apache/incubator-hudi/issues/859#issuecomment-525855438 @smdahmed : I am assuming each step is a separate hoodie commit. Is it possible for

[jira] [Created] (HUDI-226) Hudi Website - Provide links to documentation corresponding to older release versions

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-226: --- Summary: Hudi Website - Provide links to documentation corresponding to older release versions Key: HUDI-226 URL: https://issues.apache.org/jira/browse/HUDI-226

[jira] [Commented] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918153#comment-16918153 ] leesf commented on HUDI-225: Will work on this ticket. > Create Hudi Timeline Server Fat Jar >

[jira] [Commented] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16918156#comment-16918156 ] BALAJI VARADARAJAN commented on HUDI-225: - Thanks [~xleesf] > Create Hudi Timeline Server Fat Jar

[GitHub] [incubator-hudi] thesuperzapper edited a comment on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0...

2019-08-28 Thread GitBox
thesuperzapper edited a comment on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0... URL: https://github.com/apache/incubator-hudi/pull/638#issuecomment-525954787 #846, and #850 have made most of this PR redundant. @vinothchandar @bvaradar do we still want

[GitHub] [incubator-hudi] vinothchandar merged pull request #858: HUDI-124 : Exclude jdk.tools from hadoop-common and update Notice files

2019-08-28 Thread GitBox
vinothchandar merged pull request #858: HUDI-124 : Exclude jdk.tools from hadoop-common and update Notice files URL: https://github.com/apache/incubator-hudi/pull/858 This is an automated message from the Apache Git

[incubator-hudi] branch master updated: HUDI-124 : Exclude jdk.tools from hadoop-common and update Notice files (#858)

2019-08-28 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 5f9fa82 HUDI-124 : Exclude jdk.tools

[incubator-hudi] tag hoodie-site-0.4.6 created (now 5976398)

2019-08-28 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to tag hoodie-site-0.4.6 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at 5976398 (commit) No new revisions were added by this update.

[GitHub] [incubator-hudi] afilipchik commented on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0...

2019-08-28 Thread GitBox
afilipchik commented on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0... URL: https://github.com/apache/incubator-hudi/pull/638#issuecomment-525947387 hey, are there any plans to finish this one?

[jira] [Assigned] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf reassigned HUDI-225: -- Assignee: leesf > Create Hudi Timeline Server Fat Jar > > >

[jira] [Closed] (HUDI-222) Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-222. -- Fix Version/s: 0.6.0 Resolution: Fixed > Rename main class path to

[GitHub] [incubator-hudi] thesuperzapper commented on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0...

2019-08-28 Thread GitBox
thesuperzapper commented on issue #638: [HUDI-12] Upgrade to Spark 2.4, Avro 1.8.2, Parquet 1.10.0... URL: https://github.com/apache/incubator-hudi/pull/638#issuecomment-525954787 #846, and #851 have made most of this PR redundant. @vinothchandar @bvaradar do we still want to bump

[jira] [Created] (HUDI-225) Create Hudi Timeline Server Fat bundle

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-225: --- Summary: Create Hudi Timeline Server Fat bundle Key: HUDI-225 URL: https://issues.apache.org/jira/browse/HUDI-225 Project: Apache Hudi (incubating)

[jira] [Updated] (HUDI-225) Create Hudi Timeline Server Fat bundle

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-225: Component/s: newbie > Create Hudi Timeline Server Fat bundle >

[incubator-hudi] 02/02: [hotfix] change hoodie-timeline-*.jar to hudi-timeline-*.jar

2019-08-28 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 00cfe72c5d56dbaa2e170a087cf04b1e56a87bc3 Author: leesf <490081...@qq.com> AuthorDate: Wed Aug 28 16:42:18 2019

[incubator-hudi] 01/02: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit b44f8521f2b25928bccce9a6ba5c89fb76e5330e Author: leesf <490081...@qq.com> AuthorDate: Wed Aug 28 16:14:15 2019

[incubator-hudi] branch master updated (41dbac6 -> 00cfe72)

2019-08-28 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 41dbac6 Fixed unit test new b44f852 [HUDI-222] Rename main class path to

[GitHub] [incubator-hudi] DavisBroda opened a new issue #860: Unit tests fail when run on IBM SDK

2019-08-28 Thread GitBox
DavisBroda opened a new issue #860: Unit tests fail when run on IBM SDK URL: https://github.com/apache/incubator-hudi/issues/860 When running tests on hudi-incubator using the IBM SDK as a JVM, there are several failures, which do not occur when running with openjdk. IBM SDK

[jira] [Updated] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-28 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-225: Summary: Create Hudi Timeline Server Fat Jar (was: Create Hudi Timeline Server Fat bundle

[GitHub] [incubator-hudi] bvaradar commented on issue #856: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread GitBox
bvaradar commented on issue #856: [HUDI-222] Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh URL: https://github.com/apache/incubator-hudi/pull/856#issuecomment-525919843 @vinothchandar : Added https://jira.apache.org/jira/browse/HUDI-225 , a

[incubator-hudi] tag hoodie-site-0.4.7 created (now d1d74fe)

2019-08-28 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to tag hoodie-site-0.4.7 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at d1d74fe (commit) No new revisions were added by this update.

[GitHub] [incubator-hudi] vinothchandar closed pull request #790: Update docker_demo based on new bundling

2019-08-28 Thread GitBox
vinothchandar closed pull request #790: Update docker_demo based on new bundling URL: https://github.com/apache/incubator-hudi/pull/790 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] vinothchandar commented on issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear.

2019-08-28 Thread GitBox
vinothchandar commented on issue #859: Hudi upsert after a delete in partition will cause valid records inserted to disappear. URL: https://github.com/apache/incubator-hudi/issues/859#issuecomment-526015827 I will try to reproduce this and report back.

[jira] [Updated] (HUDI-223) Allow for simply using the the Spark Row schema in DeltaSync

2019-08-28 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-223: Status: Closed (was: Patch Available) > Allow for simply using the the Spark Row schema in