[GitHub] [incubator-hudi] bvaradar merged pull request #720: HUDI-124 : Changes related to License Compliance

2019-06-07 Thread GitBox
bvaradar merged pull request #720: HUDI-124 : Changes related to License Compliance URL: https://github.com/apache/incubator-hudi/pull/720 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [incubator-hudi] abhioncbr commented on a change in pull request #673: Hudi-96: Command line options instead of positional arguments

2019-06-07 Thread GitBox
abhioncbr commented on a change in pull request #673: Hudi-96: Command line options instead of positional arguments URL: https://github.com/apache/incubator-hudi/pull/673#discussion_r291786497 ## File path: packaging/hoodie-hive-bundle/pom.xml ## @@ -163,10 +163,6 @@

[GitHub] [incubator-hudi] vinothchandar commented on issue #297: Add metrics around IOHandle times

2019-06-07 Thread GitBox
vinothchandar commented on issue #297: Add metrics around IOHandle times URL: https://github.com/apache/incubator-hudi/issues/297#issuecomment-500069546 @chandresh-pancholi if you give us your jira id, I can assign HUDI-62 to you. is that something you are interested in?

[GitHub] [incubator-hudi] bvaradar commented on issue #720: HUDI-124 : Changes related to License Compliance

2019-06-07 Thread GitBox
bvaradar commented on issue #720: HUDI-124 : Changes related to License Compliance URL: https://github.com/apache/incubator-hudi/pull/720#issuecomment-500067395 cc @ovj This is an automated message from the Apache Git

[GitHub] [incubator-hudi] bvaradar commented on issue #720: HUDI-124 : Changes related to License Compliance

2019-06-07 Thread GitBox
bvaradar commented on issue #720: HUDI-124 : Changes related to License Compliance URL: https://github.com/apache/incubator-hudi/pull/720#issuecomment-500067132 @n3nash @vinothchandar : Most of the changes are about adding NOTICE.txt and LICENSE.txt files to both source directories and in

[GitHub] [incubator-hudi] bvaradar opened a new pull request #720: HUDI-124 : Changes related to License Compliance

2019-06-07 Thread GitBox
bvaradar opened a new pull request #720: HUDI-124 : Changes related to License Compliance URL: https://github.com/apache/incubator-hudi/pull/720 Various Changes : 1. Go through dependencies list one round to ensure compliance. Generated current NOTICE list in all submodules (other

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291712504 ## File path:

[GitHub] [incubator-hudi] bvaradar commented on issue #713: set codehaus.jackson modules to the same version 1.9.13

2019-06-07 Thread GitBox
bvaradar commented on issue #713: set codehaus.jackson modules to the same version 1.9.13 URL: https://github.com/apache/incubator-hudi/pull/713#issuecomment-42906 Thanks @eisig Merging this change This is an automated

[incubator-hudi] 02/02: exlude fasterxml and parquet from presto bundle

2019-06-07 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 173e0b6be4f835c6f0f3b8354d6d402f20dd4903 Author: guanjianhui AuthorDate: Thu Jun 6 16:51:16 2019 +0800

[incubator-hudi] branch master updated (45e65cc -> 173e0b6)

2019-06-07 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 45e65cc Auto generated Slack Channel Notifications setup new b325cbf set codehaus.jackson modules to

[incubator-hudi] 01/02: set codehaus.jackson modules to the same version 1.9.13

2019-06-07 Thread vbalaji
This is an automated email from the ASF dual-hosted git repository. vbalaji pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit b325cbff1018cd25534fc4564593fbb3c5bf53cd Author: guanjianhui AuthorDate: Mon Jun 3 10:16:06 2019 +0800

[GitHub] [incubator-hudi] bvaradar merged pull request #713: set codehaus.jackson modules to the same version 1.9.13

2019-06-07 Thread GitBox
bvaradar merged pull request #713: set codehaus.jackson modules to the same version 1.9.13 URL: https://github.com/apache/incubator-hudi/pull/713 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-06-07 Thread GitBox
vinothchandar commented on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-499983268 @leilinen @amaranathv do you mind providing details of your organizations/teams to add to the blurb

[GitHub] [incubator-hudi] vinothchandar commented on issue #714: Performance Comparison of HoodieDeltaStreamer and DataSourceAPI

2019-06-07 Thread GitBox
vinothchandar commented on issue #714: Performance Comparison of HoodieDeltaStreamer and DataSourceAPI URL: https://github.com/apache/incubator-hudi/issues/714#issuecomment-499981159 Great! Hudi writing is just an (advanced) spark job, so scaling tips that apply for spark also apply

[GitHub] [incubator-hudi] vinothchandar closed issue #179: Impala not supported

2019-06-07 Thread GitBox
vinothchandar closed issue #179: Impala not supported URL: https://github.com/apache/incubator-hudi/issues/179 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [incubator-hudi] vinothchandar commented on issue #179: Impala not supported

2019-06-07 Thread GitBox
vinothchandar commented on issue #179: Impala not supported URL: https://github.com/apache/incubator-hudi/issues/179#issuecomment-499976434 Made a https://issues.apache.org/jira/browse/HUDI-146 and assigned to you for now.. We can work together on this there.. Please let me know if you

[GitHub] [incubator-hudi] garyli1019 commented on issue #179: Impala not supported

2019-06-07 Thread GitBox
garyli1019 commented on issue #179: Impala not supported URL: https://github.com/apache/incubator-hudi/issues/179#issuecomment-499958633 @vinothchandar I was already in the mailing list. My JIRA id was: garyli1019. Thanks!

[GitHub] [incubator-hudi] amaranathv commented on issue #716: Class not found error in mapr platform

2019-06-07 Thread GitBox
amaranathv commented on issue #716: Class not found error in mapr platform URL: https://github.com/apache/incubator-hudi/issues/716#issuecomment-499950443 I used mapR live online with hive 2.3 without any issues.But same thing is not working for hive 2.1 in our environment. I used same

[GitHub] [incubator-hudi] amaranathv commented on issue #661: Tracking ticket for reporting Hudi usages from the community

2019-06-07 Thread GitBox
amaranathv commented on issue #661: Tracking ticket for reporting Hudi usages from the community URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-499944148 I am doing POC on MapR platform to build the datafabric in incremental fashion and for ETL offload needs.

[GitHub] [incubator-hudi] NetsanetGeb commented on issue #714: Performance Comparison of HoodieDeltaStreamer and DataSourceAPI

2019-06-07 Thread GitBox
NetsanetGeb commented on issue #714: Performance Comparison of HoodieDeltaStreamer and DataSourceAPI URL: https://github.com/apache/incubator-hudi/issues/714#issuecomment-499939181 @vinothchandar Thanks, now the performance is similar after i set the parallelism to 2. They have only

[GitHub] [incubator-hudi] amaranathv commented on issue #716: Class not found error in mapr platform

2019-06-07 Thread GitBox
amaranathv commented on issue #716: Class not found error in mapr platform URL: https://github.com/apache/incubator-hudi/issues/716#issuecomment-499934658 thanks for your reply. But i used below maven command only. mvn clean install -DskipTests -DskipITs

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #704: Shutdown hook was not called using spark on Kubernetes

2019-06-07 Thread GitBox
vinothchandar edited a comment on issue #704: Shutdown hook was not called using spark on Kubernetes URL: https://github.com/apache/incubator-hudi/issues/704#issuecomment-499926681 Thanks for testing it out.. In that case, may be we can stop the spark context after this line in the main

[GitHub] [incubator-hudi] vinothchandar commented on issue #704: Shutdown hook was not called using spark on Kubernetes

2019-06-07 Thread GitBox
vinothchandar commented on issue #704: Shutdown hook was not called using spark on Kubernetes URL: https://github.com/apache/incubator-hudi/issues/704#issuecomment-499926681 Thanks for testing it out.. In that case, may be we can stop the spark context in this line in the main method?

[GitHub] [incubator-hudi] vinothchandar commented on issue #715: [Bug]Hudi 0.4.7 HoodieTable not found

2019-06-07 Thread GitBox
vinothchandar commented on issue #715: [Bug]Hudi 0.4.7 HoodieTable not found URL: https://github.com/apache/incubator-hudi/issues/715#issuecomment-499895642 lets work on the other thread. Impala integration won't be very hard I think, but we will need to engage with the project and make a

[incubator-hudi] branch master updated: Auto generated Slack Channel Notifications setup

2019-06-07 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git The following commit(s) were added to refs/heads/master by this push: new 45e65cc Auto generated Slack Channel

[GitHub] [incubator-hudi] vinothchandar merged pull request #718: Auto generated Slack Channel Notifications setup for Travis CI

2019-06-07 Thread GitBox
vinothchandar merged pull request #718: Auto generated Slack Channel Notifications setup for Travis CI URL: https://github.com/apache/incubator-hudi/pull/718 This is an automated message from the Apache Git Service. To

[GitHub] [incubator-hudi] vinothchandar commented on issue #718: Auto generated Slack Channel Notifications setup for Travis CI

2019-06-07 Thread GitBox
vinothchandar commented on issue #718: Auto generated Slack Channel Notifications setup for Travis CI URL: https://github.com/apache/incubator-hudi/pull/718#issuecomment-499890499 sg. This is an automated message from the

[GitHub] [incubator-hudi] vinothchandar commented on issue #179: Impala not supported

2019-06-07 Thread GitBox
vinothchandar commented on issue #179: Impala not supported URL: https://github.com/apache/incubator-hudi/issues/179#issuecomment-499888012 @garyli1019 yes love to support it. If you can drive it, that'd be awesome. It seemed doable back when I checked it out. We can create a HUDI jira on

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291493931 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291485227 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291482454 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291482372 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291480583 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291480131 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291479830 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291478871 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291470327 ## File path:

[GitHub] [incubator-hudi] bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries

2019-06-07 Thread GitBox
bhasudha commented on a change in pull request #689: [HUDI-25] Optimize HoodieInputFormat.listStatus for faster Hive Incremental queries URL: https://github.com/apache/incubator-hudi/pull/689#discussion_r291466204 ## File path: