[GitHub] [incubator-hudi] firecast edited a comment on issue #886: [HUDI-244] : Hive sync should escape partition field name

2019-09-12 Thread GitBox
firecast edited a comment on issue #886: [HUDI-244] : Hive sync should escape partition field name URL: https://github.com/apache/incubator-hudi/pull/886#issuecomment-530683834 @vinothchandar I don't think this will work. Because there is code before that to escape it. ```java

[GitHub] [incubator-hudi] firecast commented on issue #886: [HUDI-244] : Hive sync should escape partition field name

2019-09-12 Thread GitBox
firecast commented on issue #886: [HUDI-244] : Hive sync should escape partition field name URL: https://github.com/apache/incubator-hudi/pull/886#issuecomment-530683834 @vinothchandar I don't think this will work. Because there is code before that to escape it. ```java List

[GitHub] [incubator-hudi] vinothchandar commented on issue #845: how to store null value in columns?

2019-09-12 Thread GitBox
vinothchandar commented on issue #845: how to store null value in columns? URL: https://github.com/apache/incubator-hudi/issues/845#issuecomment-530787872 if you can share a small snippet that I ca use to reproduce/illustrate the problem and what the expected behavior is, then happy to

[GitHub] [incubator-hudi] vinothchandar closed issue #840: presto/hive (s3) - select * is empty! but select count(*) returns correct data. however spark is perfect

2019-09-12 Thread GitBox
vinothchandar closed issue #840: presto/hive (s3) - select * is empty! but select count(*) returns correct data. however spark is perfect URL: https://github.com/apache/incubator-hudi/issues/840 This is an automated message

[GitHub] [incubator-hudi] vinothchandar commented on issue #840: presto/hive (s3) - select * is empty! but select count(*) returns correct data. however spark is perfect

2019-09-12 Thread GitBox
vinothchandar commented on issue #840: presto/hive (s3) - select * is empty! but select count(*) returns correct data. however spark is perfect URL: https://github.com/apache/incubator-hudi/issues/840#issuecomment-530788410 Closing this. We have even tested latest master witha presto node

[jira] [Created] (HUDI-246) Apache Pulsar data source for Hudi

2019-09-12 Thread Taher Koitawala (Jira)
Taher Koitawala created HUDI-246: Summary: Apache Pulsar data source for Hudi Key: HUDI-246 URL: https://issues.apache.org/jira/browse/HUDI-246 Project: Apache Hudi (incubating) Issue Type:

[GitHub] [incubator-hudi] vinothchandar closed issue #877: java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric;

2019-09-12 Thread GitBox
vinothchandar closed issue #877: java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric; URL: https://github.com/apache/incubator-hudi/issues/877 This is an

[GitHub] [incubator-hudi] vinothchandar commented on issue #877: java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric;

2019-09-12 Thread GitBox
vinothchandar commented on issue #877: java.lang.NoSuchMethodError: io.netty.buffer.PooledByteBufAllocator.metric()Lio/netty/buffer/PooledByteBufAllocatorMetric; URL: https://github.com/apache/incubator-hudi/issues/877#issuecomment-530787037 @wannaberich sg. You should be able to use

[jira] [Commented] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-09-12 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928488#comment-16928488 ] Vinoth Chandar commented on HUDI-29: https://cwiki.apache.org/confluence/display/Hive/StatsDev is a

[jira] [Commented] (HUDI-29) Patch to Hive-sync to enable stats on Hive tables #393

2019-09-12 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-29?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928489#comment-16928489 ] Vinoth Chandar commented on HUDI-29: [~chenxiang] feel free to grab this issue if you are intersted >

[incubator-hudi] 03/05: Optimize hoodie client after implementat auto closeable interface

2019-09-12 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 80c27f23510e9c4232ee87e06475d8af4823bb38 Author: yanghua AuthorDate: Tue Sep 3 19:00:37 2019 +0800

[incubator-hudi] 02/05: revert setting jsc spark configuration

2019-09-12 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 90bfb900aa47d4e77873fafe89e4d8bdd0ec4d96 Author: yanghua AuthorDate: Tue Sep 3 07:24:11 2019 +0800 revert

[incubator-hudi] 05/05: refactor code

2019-09-12 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 895d732a1423f3a113d9630aa3c56e4b0837effd Author: yanghua AuthorDate: Thu Sep 12 13:02:59 2019 +0800

[GitHub] [incubator-hudi] vinothchandar merged pull request #871: [HUDI-217] Provide a unified resource management class to standardize the resource allocation and release for hudi client test cases

2019-09-12 Thread GitBox
vinothchandar merged pull request #871: [HUDI-217] Provide a unified resource management class to standardize the resource allocation and release for hudi client test cases URL: https://github.com/apache/incubator-hudi/pull/871

[incubator-hudi] 04/05: refactor code: add docs and init/cleanup resource group for hoodie client test base

2019-09-12 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git commit 5f04241fce99f47abfb7ef9f03292472b3ee23fb Author: yanghua AuthorDate: Tue Sep 10 15:42:54 2019 +0800

[incubator-hudi] branch master updated (64df98f -> 895d732)

2019-09-12 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 64df98f [HUDI-164] Fixes incorrect averageBytesPerRecord new 6f2b166 [HUDI-217] Provide a unified

[jira] [Created] (HUDI-247) Unify the initialization of HoodieTableMetaClient in test for hoodie-client module

2019-09-12 Thread vinoyang (Jira)
vinoyang created HUDI-247: - Summary: Unify the initialization of HoodieTableMetaClient in test for hoodie-client module Key: HUDI-247 URL: https://issues.apache.org/jira/browse/HUDI-247 Project: Apache Hudi

[GitHub] [incubator-hudi] vinothchandar commented on issue #886: [HUDI-244] : Hive sync should escape partition field name

2019-09-12 Thread GitBox
vinothchandar commented on issue #886: [HUDI-244] : Hive sync should escape partition field name URL: https://github.com/apache/incubator-hudi/pull/886#issuecomment-530905521 Fair . That was me being hasty. If its already escaping it (I see that line since 2018-12), the SQL somehow does

[jira] [Commented] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

2019-09-12 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16928719#comment-16928719 ] Vinoth Chandar commented on HUDI-238: - [~DavisBroda] Pasted dependency tree of utilities package for

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #886: [HUDI-244] : Hive sync should escape partition field name

2019-09-12 Thread GitBox
vinothchandar edited a comment on issue #886: [HUDI-244] : Hive sync should escape partition field name URL: https://github.com/apache/incubator-hudi/pull/886#issuecomment-530905521 Fair . That was me being hasty. If its already escaping it (I see that line since 2018-12), the SQL somehow

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r323895316 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r323895356 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r323887264 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r323895886 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r323888340 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r323891191 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[jira] [Updated] (HUDI-238) Make separate release for hudi spark/scala based packages for scala 2.12

2019-09-12 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-238: Description: [https://github.com/apache/incubator-hudi/issues/881#issuecomment-528700749] Suspects: 

[jira] [Created] (HUDI-248) CLI doesn't allow rolling back a Delta commit

2019-09-12 Thread Rahul Bhartia (Jira)
Rahul Bhartia created HUDI-248: -- Summary: CLI doesn't allow rolling back a Delta commit Key: HUDI-248 URL: https://issues.apache.org/jira/browse/HUDI-248 Project: Apache Hudi (incubating) Issue

[GitHub] [incubator-hudi] gautamsnayak commented on issue #143: Tracking ticket for folks to be added to slack group

2019-09-12 Thread GitBox
gautamsnayak commented on issue #143: Tracking ticket for folks to be added to slack group URL: https://github.com/apache/incubator-hudi/issues/143#issuecomment-531091824 Hi @vinothchandar , Could you please add gna...@guardanthealth.com to the slack group.

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324036192 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324037628 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324038535 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324034394 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324037595 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324035571 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324038203 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324035236 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324033554 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324032642 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324037042 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324034722 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use

[GitHub] [incubator-hudi] yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page

2019-09-12 Thread GitBox
yihua commented on a change in pull request #884: [HUDI-240] Translate Use Cases page URL: https://github.com/apache/incubator-hudi/pull/884#discussion_r324036810 ## File path: docs/use_cases.cn.md ## @@ -4,73 +4,65 @@ keywords: hudi, data ingestion, etl, real time, use