[GitHub] [incubator-hudi] HariprasadAllaka1612 edited a comment on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

2019-09-17 Thread GitBox
HariprasadAllaka1612 edited a comment on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532071607 Hi Vinoth, Thanks for the reply.

[GitHub] [incubator-hudi] HariprasadAllaka1612 edited a comment on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

2019-09-17 Thread GitBox
HariprasadAllaka1612 edited a comment on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532071607 Hi Vinoth, Thanks for the reply.

[GitHub] [incubator-hudi] firecast edited a comment on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

2019-09-17 Thread GitBox
firecast edited a comment on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-532158394 Will test that @vinothchandar and let you know. Just to put the whole setup I'm using into context, I am using

[GitHub] [incubator-hudi] firecast commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

2019-09-17 Thread GitBox
firecast commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-532158394 Will test that @vinothchandar and let you know. Just to put the whole setup I'm using into context, I am using

[jira] [Assigned] (HUDI-215) Update documentation for joining slack group

2019-09-17 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma reassigned HUDI-215: - Assignee: Pratyaksh Sharma > Update documentation for joining slack group >

[jira] [Updated] (HUDI-215) Update documentation for joining slack group

2019-09-17 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-215: -- Status: Patch Available (was: In Progress) > Update documentation for joining slack group >

[jira] [Updated] (HUDI-215) Update documentation for joining slack group

2019-09-17 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma updated HUDI-215: -- Status: Closed (was: Patch Available) > Update documentation for joining slack group >

[GitHub] [incubator-hudi] HariprasadAllaka1612 opened a new issue #898: Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to upsert for commit time

2019-09-17 Thread GitBox
HariprasadAllaka1612 opened a new issue #898: Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to upsert for commit time URL: https://github.com/apache/incubator-hudi/issues/898 I am trying to write data to s3 as Hudi file. Code: inputDF

[jira] [Updated] (HUDI-228) Add Jira Conventions to contributing/community pages of HUDI

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-228: Labels: pull-request-available (was: ) > Add Jira Conventions to contributing/community pages of

[jira] [Created] (HUDI-255) Translate Talks & Powered By page

2019-09-17 Thread leesf (Jira)
leesf created HUDI-255: -- Summary: Translate Talks & Powered By page Key: HUDI-255 URL: https://issues.apache.org/jira/browse/HUDI-255 Project: Apache Hudi (incubating) Issue Type: Sub-task

[GitHub] [incubator-hudi] pratyakshsharma opened a new pull request #899: [HUDI-228] Contributing page updated to include JIRA guidelines

2019-09-17 Thread GitBox
pratyakshsharma opened a new pull request #899: [HUDI-228] Contributing page updated to include JIRA guidelines URL: https://github.com/apache/incubator-hudi/pull/899 Jira - HUDI-228 This is an automated message from the

[jira] [Resolved] (HUDI-228) Add Jira Conventions to contributing/community pages of HUDI

2019-09-17 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma resolved HUDI-228. --- Fix Version/s: 0.5.0 Resolution: Fixed > Add Jira Conventions to contributing/community

[GitHub] [incubator-hudi] leesf commented on issue #900: [docs][chinese] update permalink for translated pages(quickstart.cn.md, use_cases.cn.md)

2019-09-17 Thread GitBox
leesf commented on issue #900: [docs][chinese] update permalink for translated pages(quickstart.cn.md, use_cases.cn.md) URL: https://github.com/apache/incubator-hudi/pull/900#issuecomment-532177020 cc @vinothchandar This is

[GitHub] [incubator-hudi] leesf opened a new pull request #900: [docs][chinese] update permalink for translated pages(quickstart.cn.md, use_cases.cn.md)

2019-09-17 Thread GitBox
leesf opened a new pull request #900: [docs][chinese] update permalink for translated pages(quickstart.cn.md, use_cases.cn.md) URL: https://github.com/apache/incubator-hudi/pull/900 Fix pernalink. This is an automated

[jira] [Assigned] (HUDI-253) DeltaStreamer should report nicer error messages for misconfigs

2019-09-17 Thread Pratyaksh Sharma (Jira)
[ https://issues.apache.org/jira/browse/HUDI-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pratyaksh Sharma reassigned HUDI-253: - Assignee: Pratyaksh Sharma > DeltaStreamer should report nicer error messages for

[jira] [Created] (HUDI-256) Translate Comparison page

2019-09-17 Thread leesf (Jira)
leesf created HUDI-256: -- Summary: Translate Comparison page Key: HUDI-256 URL: https://issues.apache.org/jira/browse/HUDI-256 Project: Apache Hudi (incubating) Issue Type: Sub-task

[jira] [Updated] (HUDI-255) Translate Talks & Powered By page

2019-09-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-255: --- Component/s: docs-chinese > Translate Talks & Powered By page > - > >

[jira] [Updated] (HUDI-255) Translate Talks & Powered By page

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-255: Labels: pull-request-available (was: ) > Translate Talks & Powered By page >

[GitHub] [incubator-hudi] leesf opened a new pull request #901: [HUDI-255] Translate Talks & Powered By page

2019-09-17 Thread GitBox
leesf opened a new pull request #901: [HUDI-255] Translate Talks & Powered By page URL: https://github.com/apache/incubator-hudi/pull/901 see [jira](https://jira.apache.org/jira/browse/HUDI-255) cc @yihua PTAL when you are free. Thanks.

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #896: Updating site to reflect recent doc changes

2019-09-17 Thread GitBox
bhasudha commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r325156491 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #896: Updating site to reflect recent doc changes

2019-09-17 Thread GitBox
vinothchandar commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r325244857 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[incubator-hudi] branch master updated: [HUDI-121] Update Release notes and fix master version

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new c1e7d0e [HUDI-121] Update Release

svn commit: r35916 - /release/incubator/hudi/KEYS

2019-09-17 Thread vbalaji
Author: vbalaji Date: Tue Sep 17 18:27:29 2019 New Revision: 35916 Log: Adding KEYS to HUDI release dist Added: release/incubator/hudi/KEYS Added: release/incubator/hudi/KEYS == --- release/incubator/hudi/KEYS

svn commit: r35917 - /release/hudi/

2019-09-17 Thread vbalaji
Author: vbalaji Date: Tue Sep 17 18:28:58 2019 New Revision: 35917 Log: Removing HUDI directory from top-level and moving to incubator Removed: release/hudi/

[GitHub] [incubator-hudi] umehrot2 commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

2019-09-17 Thread GitBox
umehrot2 commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath URL: https://github.com/apache/incubator-hudi/issues/869#issuecomment-532352413 @vinothchandar Yes will continue the discussion there. Will test the my job, as well as demo setup by

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-254: Labels: pull-request-available (was: ) > Provide mechanism for installing hudi-spark-bundle onto an

[GitHub] [incubator-hudi] vinothchandar opened a new pull request #903: [HUDI-254]: Bundle and shade databricks/avro with spark bundle

2019-09-17 Thread GitBox
vinothchandar opened a new pull request #903: [HUDI-254]: Bundle and shade databricks/avro with spark bundle URL: https://github.com/apache/incubator-hudi/pull/903 - spark 2.4 onwards, spark has built in support. shading to avoid conflicts - spark 2.3 still needs this bundled, so that

[GitHub] [incubator-hudi] HariprasadAllaka1612 commented on issue #898: Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to upsert for commit time

2019-09-17 Thread GitBox
HariprasadAllaka1612 commented on issue #898: Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to upsert for commit time URL: https://github.com/apache/incubator-hudi/issues/898#issuecomment-532378362 I will change the version of hadoop to 2.8.4 and check if it works.

[jira] [Updated] (HUDI-259) Hadoop 3 support for Hudi writing

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-259: Description: Sample issues   [https://github.com/apache/incubator-hudi/issues/735]

[incubator-hudi] tag release-0.5.0-incubating-rc2 created (now ffa2be3)

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to tag release-0.5.0-incubating-rc2 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. at ffa2be3 (commit) No new revisions were added by this update.

[jira] [Resolved] (HUDI-62) Add metrics around IOHandle times #297

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-62?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN resolved HUDI-62. Resolution: Fixed > Add metrics around IOHandle times #297 >

[jira] [Closed] (HUDI-62) Add metrics around IOHandle times #297

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-62?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN closed HUDI-62. -- > Add metrics around IOHandle times #297 > -- > >

[jira] [Updated] (HUDI-62) Add metrics around IOHandle times #297

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-62?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-62: --- Fix Version/s: 0.5.0 > Add metrics around IOHandle times #297 >

svn commit: r35918 - /dev/hudi/

2019-09-17 Thread vbalaji
Author: vbalaji Date: Tue Sep 17 18:31:35 2019 New Revision: 35918 Log: Moving hudi from top-level to incubator Removed: dev/hudi/

[GitHub] [incubator-hudi] vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync

2019-09-17 Thread GitBox
vinothchandar commented on issue #894: Getting java.lang.NoSuchMethodError while doing Hive sync URL: https://github.com/apache/incubator-hudi/issues/894#issuecomment-532347935 >>Am I supposed to add hudi-hive jars separately? No.. its all there in the bundle Some general context

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532354352 @vinothchandar @cdmikechen I was able to read and write `Decimal` type correctly by upgrading that

[GitHub] [incubator-hudi] vinothchandar commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

2019-09-17 Thread GitBox
vinothchandar commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532384495 so the structure is getting created, but somehow the path

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #896: Updating site to reflect recent doc changes

2019-09-17 Thread GitBox
yanghua commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r325268090 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[jira] [Updated] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-248: Fix Version/s: (was: 0.6.0) 0.5.1 > CLI doesn't allow rolling back a

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-254: Labels: (was: pull-request-available) > Provide mechanism for installing hudi-spark-bundle onto an

svn commit: r35920 - in /dev/incubator/hudi: ./ hudi-0.5.0-incubating-rc1/ hudi-0.5.0-incubating-rc2/

2019-09-17 Thread vbalaji
Author: vbalaji Date: Tue Sep 17 20:32:22 2019 New Revision: 35920 Log: Uploading hudi-0.5.0-incubating-rc2 source bundle Added: dev/incubator/hudi/KEYS dev/incubator/hudi/hudi-0.5.0-incubating-rc1/ dev/incubator/hudi/hudi-0.5.0-incubating-rc1/hudi-0.5.0-incubating-rc1.src.tgz

[jira] [Assigned] (HUDI-257) Unit tests intermittently failing

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN reassigned HUDI-257: --- Assignee: BALAJI VARADARAJAN > Unit tests intermittently failing >

[jira] [Closed] (HUDI-257) Unit tests intermittently failing

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN closed HUDI-257. --- > Unit tests intermittently failing > -- > > Key:

[jira] [Resolved] (HUDI-257) Unit tests intermittently failing

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN resolved HUDI-257. - Resolution: Fixed > Unit tests intermittently failing >

[GitHub] [incubator-hudi] HariprasadAllaka1612 edited a comment on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

2019-09-17 Thread GitBox
HariprasadAllaka1612 edited a comment on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532071607 Hi Vinoth, Thanks for the reply.

[jira] [Created] (HUDI-259) Hadoop 3 support for Hudi writing

2019-09-17 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-259: --- Summary: Hadoop 3 support for Hudi writing Key: HUDI-259 URL: https://issues.apache.org/jira/browse/HUDI-259 Project: Apache Hudi (incubating) Issue Type:

[jira] [Created] (HUDI-257) Unit tests intermittently failing

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-257: --- Summary: Unit tests intermittently failing Key: HUDI-257 URL: https://issues.apache.org/jira/browse/HUDI-257 Project: Apache Hudi (incubating) Issue

[jira] [Created] (HUDI-258) Hive Query engine not supporting join queries between RT and RO tables

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
BALAJI VARADARAJAN created HUDI-258: --- Summary: Hive Query engine not supporting join queries between RT and RO tables Key: HUDI-258 URL: https://issues.apache.org/jira/browse/HUDI-258 Project:

[GitHub] [incubator-hudi] HariprasadAllaka1612 commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

2019-09-17 Thread GitBox
HariprasadAllaka1612 commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532362160 I can see .hoodie directory under Games3. It

[GitHub] [incubator-hudi] bvaradar opened a new pull request #902: [HUDI-257] Fix Bloom Index unit-test failures

2019-09-17 Thread GitBox
bvaradar opened a new pull request #902: [HUDI-257] Fix Bloom Index unit-test failures URL: https://github.com/apache/incubator-hudi/pull/902 Due to test setup issue. Was able to repro the issue consistently and by adding initialization/cleanup step, the tests are passing consistently

[incubator-hudi] branch master updated: Updating release notes and preparing for 0.5.0-incubating-rc2 release

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 4bda742 Updating release notes and

[incubator-hudi] branch release-0.5.0 updated (9bf8ec3 -> ffa2be3)

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. discard 9bf8ec3 [HUDI-121] Preparing for Release 0.5.0-incubating-rc2 add e217db5 [HUDI-254]: Bundle

[incubator-hudi] 01/01: [HUDI-121] Preparing for Release 0.5.0-incubating-rc2

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit ffa2be321dd4b894b66f0453080b7a60a3260831 Author: Balaji Varadarajan AuthorDate: Tue Sep 17 10:35:16

[GitHub] [incubator-hudi] vinothchandar commented on issue #898: Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to upsert for commit time

2019-09-17 Thread GitBox
vinothchandar commented on issue #898: Caused by: org.apache.hudi.exception.HoodieUpsertException: Failed to upsert for commit time URL: https://github.com/apache/incubator-hudi/issues/898#issuecomment-532290482 @HariprasadAllaka1612 what version of Hadoop and Hudi are you using? We have

[incubator-hudi] 01/01: [HUDI-121] Preparing for Release 0.5.0-incubating-rc2

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 9bf8ec3807dfc70f8967e125170488ed9a206234 Author: Balaji Varadarajan AuthorDate: Tue Sep 17 10:35:16

[incubator-hudi] branch release-0.5.0 updated (26966c5 -> 9bf8ec3)

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch release-0.5.0 in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. omit 26966c5 [HUDI-121] ASF Release : Ensure NOTICE.txt is generated as part of cutting release branch

[jira] [Updated] (HUDI-255) Translate Talks & Powered By page

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-255: Fix Version/s: (was: 0.5.0) 0.5.1 > Translate Talks & Powered By page

[jira] [Updated] (HUDI-256) Translate Comparison page

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-256: Fix Version/s: (was: 0.5.0) 0.5.1 > Translate Comparison page >

[jira] [Closed] (HUDI-252) Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN closed HUDI-252. --- > Add Disclaimer and cleanup NOTICE and LICENSE files in hudi >

[jira] [Resolved] (HUDI-252) Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN resolved HUDI-252. - Resolution: Fixed > Add Disclaimer and cleanup NOTICE and LICENSE files in hudi >

[GitHub] [incubator-hudi] vinothchandar commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path

2019-09-17 Thread GitBox
vinothchandar commented on issue #888: Exception in thread "main" com.uber.hoodie.exception.DatasetNotFoundException: Hoodie dataset not found in path URL: https://github.com/apache/incubator-hudi/issues/888#issuecomment-532353921 This does not seem like a jar issue `Exception in

[jira] [Updated] (HUDI-257) Unit tests intermittently failing

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-257: Labels: pull-request-available (was: ) > Unit tests intermittently failing >

[GitHub] [incubator-hudi] bvaradar commented on issue #902: [HUDI-257] Fix Bloom Index unit-test failures

2019-09-17 Thread GitBox
bvaradar commented on issue #902: [HUDI-257] Fix Bloom Index unit-test failures URL: https://github.com/apache/incubator-hudi/pull/902#issuecomment-532302020 @vinothchandar @n3nash : Going ahead and merging this change to master to kickstart RC2.

[GitHub] [incubator-hudi] bvaradar merged pull request #902: [HUDI-257] Fix Bloom Index unit-test failures

2019-09-17 Thread GitBox
bvaradar merged pull request #902: [HUDI-257] Fix Bloom Index unit-test failures URL: https://github.com/apache/incubator-hudi/pull/902 This is an automated message from the Apache Git Service. To respond to the message,

[incubator-hudi] branch master updated: [HUDI-257] Fix Bloom Index unit-test failures

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 2c6da09 [HUDI-257] Fix Bloom Index

[GitHub] [incubator-hudi] vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
vinothchandar commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532360758 @umehrot2 https://github.com/apache/incubator-hudi/pull/903 opened this for shading changes.. FYI..

[GitHub] [incubator-hudi] bvaradar merged pull request #903: [HUDI-254]: Bundle and shade databricks/avro with spark bundle

2019-09-17 Thread GitBox
bvaradar merged pull request #903: [HUDI-254]: Bundle and shade databricks/avro with spark bundle URL: https://github.com/apache/incubator-hudi/pull/903 This is an automated message from the Apache Git Service. To respond

[incubator-hudi] branch master updated: [HUDI-254]: Bundle and shade databricks/avro with spark bundle

2019-09-17 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new e217db5 [HUDI-254]: Bundle and shade

[jira] [Created] (HUDI-260) Hudi Spark Bundle does not work when passed in extraClassPath option

2019-09-17 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-260: --- Summary: Hudi Spark Bundle does not work when passed in extraClassPath option Key: HUDI-260 URL: https://issues.apache.org/jira/browse/HUDI-260 Project: Apache Hudi

[jira] [Updated] (HUDI-260) Hudi Spark Bundle does not work when passed in extraClassPath option

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-260: Description: On EMR's side we have the same findings. *a + b + c +d* work in the following cases:

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #896: Updating site to reflect recent doc changes

2019-09-17 Thread GitBox
yanghua commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r325438410 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[GitHub] [incubator-hudi] umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
umehrot2 commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532475222 @vinothchandar At the moment, I cannot think of a good way how we can upgrade avro version while still

[jira] [Updated] (HUDI-261) Failed to create deltacommit.inflight file, duplicate timestamp issue

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-261: Description: {{Hudi jobs started failing with }} {{Found commits after time :20190916210221, please

[jira] [Updated] (HUDI-261) Failed to create deltacommit.inflight file, duplicate timestamp issue

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-261: Description: {{Hudi jobs started failing with }} {{Found commits after time :20190916210221, please

[GitHub] [incubator-hudi] cdmikechen commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
cdmikechen commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532471718 @vinothchandar The jar of avro 1.7.7 under spark can be directly replaced by 1.8.2. I have tested

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532471718 @vinothchandar The jar of avro 1.7.7 under spark can be directly replaced by 1.8.2. I have

[jira] [Closed] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN closed HUDI-254. --- > Provide mechanism for installing hudi-spark-bundle onto an existing spark > installation >

[jira] [Resolved] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN resolved HUDI-254. - Resolution: Fixed > Provide mechanism for installing hudi-spark-bundle onto an existing

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread BALAJI VARADARAJAN (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BALAJI VARADARAJAN updated HUDI-254: Fix Version/s: 0.5.0 > Provide mechanism for installing hudi-spark-bundle onto an existing

[jira] [Commented] (HUDI-260) Hudi Spark Bundle does not work when passed in extraClassPath option

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931904#comment-16931904 ] Vinoth Chandar commented on HUDI-260: - [~uditme] Let me reproduce this on the docker setup and see

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532470332 @umehrot2 In addition to the decimal problem, I also modified a timestamp conversion problem.

[GitHub] [incubator-hudi] cdmikechen commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
cdmikechen commented on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532470332 @umehrot2 In addition to the decimal problem, I also modified a timestamp conversion problem. On

[jira] [Commented] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931817#comment-16931817 ] Udit Mehrotra commented on HUDI-254: [~vinoth] On EMR's side we have the same findings. *a + b + c +d*

[jira] [Created] (HUDI-261) Failed to create deltacommit.inflight file, duplicate timestamp issue

2019-09-17 Thread Elon Azoulay (Jira)
Elon Azoulay created HUDI-261: - Summary: Failed to create deltacommit.inflight file, duplicate timestamp issue Key: HUDI-261 URL: https://issues.apache.org/jira/browse/HUDI-261 Project: Apache Hudi

[jira] [Updated] (HUDI-261) Failed to create deltacommit.inflight file, duplicate timestamp issue

2019-09-17 Thread Elon Azoulay (Jira)
[ https://issues.apache.org/jira/browse/HUDI-261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elon Azoulay updated HUDI-261: -- Description: {{Hudi jobs started failing with }} {{Found commits after time :20190916210221, please

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532471718 @vinothchandar The jar of avro 1.7.7 under spark can be directly replaced by 1.8.2. I have

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself

2019-09-17 Thread GitBox
cdmikechen edited a comment on issue #770: remove com.databricks:spark-avro to build spark avro schema by itself URL: https://github.com/apache/incubator-hudi/pull/770#issuecomment-532471718 @vinothchandar The jar of avro 1.7.7 under spark can be directly replaced by 1.8.2. I have

[jira] [Commented] (HUDI-261) Failed to create deltacommit.inflight file, duplicate timestamp issue

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931939#comment-16931939 ] Vinoth Chandar commented on HUDI-261: - Interesting thing is the timestamps don't match for the commit

[jira] [Commented] (HUDI-261) Failed to create deltacommit.inflight file, duplicate timestamp issue

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931940#comment-16931940 ] Vinoth Chandar commented on HUDI-261: - `Found commits after time :20190916210221, please rollback

[jira] [Commented] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931902#comment-16931902 ] Vinoth Chandar commented on HUDI-254: - [~uditme] sorry to keep switching JIRAs. Seems this needs to be

[GitHub] [incubator-hudi] umehrot2 commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath

2019-09-17 Thread GitBox
umehrot2 commented on issue #869: Hudi Spark error when spark bundle jar is added to spark's classpath URL: https://github.com/apache/incubator-hudi/issues/869#issuecomment-532404509 Did test on our side and commented on https://issues.apache.org/jira/browse/HUDI-254

[jira] [Commented] (HUDI-260) Hudi Spark Bundle does not work when passed in extraClassPath option

2019-09-17 Thread Udit Mehrotra (Jira)
[ https://issues.apache.org/jira/browse/HUDI-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16931918#comment-16931918 ] Udit Mehrotra commented on HUDI-260: Thanks for creating checking on this issue. Here is the exception

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #41

2019-09-17 Thread Apache Jenkins Server
See -- [...truncated 2.18 KB...] m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp /home/jenkins/tools/maven/apache-maven-3.5.4/boot: plexus-classworlds-2.5.2.jar

[jira] [Commented] (HUDI-215) Update documentation for joining slack group

2019-09-17 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932079#comment-16932079 ] leesf commented on HUDI-215: Fixed via asf-site: cb57c912bf3d9ceb8b81a512b17d61cbd7ad1af9 > Update

[GitHub] [incubator-hudi] leesf commented on issue #143: Tracking ticket for folks to be added to slack group

2019-09-17 Thread GitBox
leesf commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-532526762 Hi @vinothchandar , Could you please add leesf0...@gmail.com to the slack group.

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #896: Updating site to reflect recent doc changes

2019-09-17 Thread GitBox
vinothchandar commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r325476668 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review

[GitHub] [incubator-hudi] yanghua commented on a change in pull request #896: Updating site to reflect recent doc changes

2019-09-17 Thread GitBox
yanghua commented on a change in pull request #896: Updating site to reflect recent doc changes URL: https://github.com/apache/incubator-hudi/pull/896#discussion_r325178134 ## File path: content/404.html ## @@ -6,25 +6,25 @@ Page Not Found | Hudi - + Review