[jira] [Updated] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-470: Description: The size of `rows` is error, for example The size of `rows` is error, for example  {code:java}

[jira] [Updated] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken updated HUDI-470: Description: The size of `rows` is error, for example The size of `rows` is error, for example  {code:java}

[GitHub] [incubator-hudi] lamber-ken commented on issue #1138: [HUDI-470] Fix NPE when print result via hudi-cli

2019-12-25 Thread GitBox
lamber-ken commented on issue #1138: [HUDI-470] Fix NPE when print result via hudi-cli URL: https://github.com/apache/incubator-hudi/pull/1138#issuecomment-569002628 > It's a pity. These methods have not unit tests. It would be good to find these issues if we have. Additionally, we can

[jira] [Updated] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated HUDI-470: -- Fix Version/s: 0.5.1 > Fix NPE when print result via hudi-cli > -- > >

[jira] [Resolved] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread vinoyang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang resolved HUDI-470. --- Resolution: Fixed Fixed via master branch: a63bcc7c102e2a71bd63dac699a29d2ad92e9321 > Fix NPE when print

[GitHub] [incubator-hudi] yanghua commented on issue #1138: [HUDI-470] Fix NPE when print result via hudi-cli

2019-12-25 Thread GitBox
yanghua commented on issue #1138: [HUDI-470] Fix NPE when print result via hudi-cli URL: https://github.com/apache/incubator-hudi/pull/1138#issuecomment-569001616 It's a pity. These methods have not unit tests. It would be good to find these issues if we have. Additionally, we can give

[incubator-hudi] branch master updated (def18a5 -> 842eabb)

2019-12-25 Thread vinoyang
This is an automated email from the ASF dual-hosted git repository. vinoyang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from def18a5 [MINOR] optimize hudi timeline service (#1137) add 842eabb [HUDI-470] Fix NPE when print

[GitHub] [incubator-hudi] yanghua merged pull request #1138: [HUDI-470] Fix NPE when print result via hudi-cli

2019-12-25 Thread GitBox
yanghua merged pull request #1138: [HUDI-470] Fix NPE when print result via hudi-cli URL: https://github.com/apache/incubator-hudi/pull/1138 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #1139: [MINOR]Optimize hudi-client module

2019-12-25 Thread GitBox
cdmikechen edited a comment on issue #1139: [MINOR]Optimize hudi-client module URL: https://github.com/apache/incubator-hudi/pull/1139#issuecomment-568963144 maybe use `git merge --squash` first to set a single commit, please.

[GitHub] [incubator-hudi] cdmikechen commented on issue #1139: [MINOR]Optimize hudi-client module

2019-12-25 Thread GitBox
cdmikechen commented on issue #1139: [MINOR]Optimize hudi-client module URL: https://github.com/apache/incubator-hudi/pull/1139#issuecomment-568963144 maybe use `git merge --squash` first to set a single commit, pleas. This

[jira] [Closed] (HUDI-467) Query RT Table in Hive found java.lang.NoClassDefFoundError Exception

2019-12-25 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen closed HUDI-467. --- Resolution: Not A Problem use hadoop-mr-bundle > Query RT Table in Hive found java.lang.NoClassDefFoundError

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file

2019-12-25 Thread GitBox
cdmikechen edited a comment on issue #1075: [HUDI-114]: added option to overwrite payload implementation in hoodie.properties file URL: https://github.com/apache/incubator-hudi/pull/1075#issuecomment-568866635 Can I ask an additional question? I found in first commit hudi will init

Build failed in Jenkins: hudi-snapshot-deployment-0.5 #140

2019-12-25 Thread Apache Jenkins Server
See Changes: -- [...truncated 2.17 KB...] /home/jenkins/tools/maven/apache-maven-3.5.4/bin: m2.conf mvn mvn.cmd mvnDebug mvnDebug.cmd mvnyjp

[GitHub] [incubator-hudi] yanghua commented on issue #626: Adding documentation for hudi test suite

2019-12-25 Thread GitBox
yanghua commented on issue #626: Adding documentation for hudi test suite URL: https://github.com/apache/incubator-hudi/pull/626#issuecomment-568950880 Hi @vinothchandar and @n3nash Can we move it into the root dir of `hudi-test-suite` as a README file.

[GitHub] [incubator-hudi] cdmikechen edited a comment on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
cdmikechen edited a comment on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#issuecomment-568942977 @vinothchandar > Are you asking for incremental pull to provide the both before and after images of a record

[GitHub] [incubator-hudi] listenLearning commented on issue #1135: [HUDI-233]Redo log statements using SLF4J

2019-12-25 Thread GitBox
listenLearning commented on issue #1135: [HUDI-233]Redo log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1135#issuecomment-568947384 copy that This is an automated message from the Apache Git

[GitHub] [incubator-hudi] listenLearning closed pull request #1135: [HUDI-233]Redo log statements using SLF4J

2019-12-25 Thread GitBox
listenLearning closed pull request #1135: [HUDI-233]Redo log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1135 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] leesf commented on issue #1135: [HUDI-233]Redo log statements using SLF4J

2019-12-25 Thread GitBox
leesf commented on issue #1135: [HUDI-233]Redo log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1135#issuecomment-568946135 > @leesf @lamber-ken who were looking into this before.. > @leesf could you shepherd this one? My concerns are mostly around all

[GitHub] [incubator-hudi] SteNicholas opened a new pull request #1139: [MINOR]Optimize hudi-client module

2019-12-25 Thread GitBox
SteNicholas opened a new pull request #1139: [MINOR]Optimize hudi-client module URL: https://github.com/apache/incubator-hudi/pull/1139 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] cdmikechen commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
cdmikechen commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361347283 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.java

[GitHub] [incubator-hudi] cdmikechen commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
cdmikechen commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361347283 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.java

[jira] [Updated] (HUDI-115) Enhance OverwriteWithLatestAvroPayload to also respect ordering value of record in storage

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-115: Status: New (was: Open) > Enhance OverwriteWithLatestAvroPayload to also respect ordering value of

[jira] [Updated] (HUDI-47) Revisit null checks in the Log Blocks, merge lazyreading with this null check #340

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-47?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-47: --- Component/s: Code Cleanup > Revisit null checks in the Log Blocks, merge lazyreading with this null

[jira] [Updated] (HUDI-155) Expose a merge-policy enum

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-155: Status: New (was: Open) > Expose a merge-policy enum > -- > >

[jira] [Updated] (HUDI-72) Cap number of Spark partitions during write/compaction phases

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-72?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-72: --- Status: New (was: Open) > Cap number of Spark partitions during write/compaction phases >

[jira] [Updated] (HUDI-33) Introduce config to allow users to control case-sensitivity in column projections #431

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-33: --- Status: New (was: Open) > Introduce config to allow users to control case-sensitivity in column >

[jira] [Updated] (HUDI-202) Remove all one-time changes done for seamlessly migrating users from com.uber.hoodie to org.apache.hudi

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-202: Status: New (was: Open) > Remove all one-time changes done for seamlessly migrating users from >

[jira] [Updated] (HUDI-23) Consider adding split pruning support #504

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-23?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-23: --- Status: New (was: Open) > Consider adding split pruning support #504 >

[jira] [Updated] (HUDI-55) Investigate support for bucketed tables ala Hive #74

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-55?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-55: --- Status: New (was: Open) > Investigate support for bucketed tables ala Hive #74 >

[jira] [Updated] (HUDI-24) Caching .hoodie file in inputformat to reduce lookups #503

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-24?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-24: --- Status: New (was: Open) > Caching .hoodie file in inputformat to reduce lookups #503 >

[jira] [Updated] (HUDI-145) Limit the amount of partitions considered for GlobalBloomIndex

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-145: Status: New (was: Open) > Limit the amount of partitions considered for GlobalBloomIndex >

[jira] [Updated] (HUDI-95) Support IgniteFS/igfs storage via Hudi

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-95?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-95: --- Status: New (was: Open) > Support IgniteFS/igfs storage via Hudi >

[jira] [Updated] (HUDI-284) Need Tests for Hudi handling of schema evolution

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-284: Component/s: Testing > Need Tests for Hudi handling of schema evolution >

[jira] [Updated] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-64: --- Status: New (was: Open) > Estimation of compression ratio & other dynamic storage knobs based on >

[jira] [Updated] (HUDI-103) Revisit handling of pending compaction in file-system view

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-103: Status: New (was: Open) > Revisit handling of pending compaction in file-system view >

[jira] [Updated] (HUDI-241) Track per column level statistics for each file

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-241: Status: New (was: Open) > Track per column level statistics for each file >

[jira] [Updated] (HUDI-26) Introduce a way to collapse filegroups into one and reindex #491

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-26: --- Status: New (was: Open) > Introduce a way to collapse filegroups into one and reindex #491 >

[jira] [Updated] (HUDI-112) Supporting a Collapse type of operation

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-112: Status: New (was: Open) > Supporting a Collapse type of operation >

[jira] [Updated] (HUDI-16) Merkle tree based Hoodie dataset integrity #527

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-16?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-16: --- Status: New (was: Open) > Merkle tree based Hoodie dataset integrity #527 >

[jira] [Updated] (HUDI-388) Support DDL / DML SparkSQL statements which useful for admins

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-388: Status: New (was: Open) > Support DDL / DML SparkSQL statements which useful for admins >

[jira] [Updated] (HUDI-404) Compile Master's Source Code Error

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-404: Status: New (was: Open) > Compile Master's Source Code Error > ---

[jira] [Updated] (HUDI-443) Add slides for Hadoop summit 2019, Bangalore to powered-by page

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-443: Status: In Progress (was: Open) > Add slides for Hadoop summit 2019, Bangalore to powered-by page >

[jira] [Updated] (HUDI-352) The official documentation about project structure missed hudi-timeline-service module

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-352: Status: New (was: Open) > The official documentation about project structure missed >

[jira] [Updated] (HUDI-281) HiveSync failure through Spark when useJdbc is set to false

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-281: Status: New (was: Open) > HiveSync failure through Spark when useJdbc is set to false >

[jira] [Updated] (HUDI-110) Better defaults for Partition extractor for Spark DataSOurce and DeltaStreamer

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-110: Status: New (was: Open) > Better defaults for Partition extractor for Spark DataSOurce and

[jira] [Updated] (HUDI-142) GCS: Hoodie-CLI failing with NoSuchMethodError:

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-142: Status: New (was: Open) > GCS: Hoodie-CLI failing with NoSuchMethodError: >

[jira] [Updated] (HUDI-110) Better defaults for Partition extractor for Spark DataSOurce and DeltaStreamer

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-110: Status: Open (was: New) > Better defaults for Partition extractor for Spark DataSOurce and

[jira] [Updated] (HUDI-17) Better documentation for paths passed to incr and ro views from Spark datasource

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-17: --- Status: New (was: Open) > Better documentation for paths passed to incr and ro views from Spark >

[GitHub] [incubator-hudi] cdmikechen commented on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
cdmikechen commented on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#issuecomment-568942977 @vinothchandar > Are you asking for incremental pull to provide the both before and after images of a record like how

[jira] [Updated] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-470: Labels: pull-request-available (was: ) > Fix NPE when print result via hudi-cli >

[GitHub] [incubator-hudi] lamber-ken opened a new pull request #1138: [HUDI-470] Fix NPE when print result via hudi-cli

2019-12-25 Thread GitBox
lamber-ken opened a new pull request #1138: [HUDI-470] Fix NPE when print result via hudi-cli URL: https://github.com/apache/incubator-hudi/pull/1138 ## What is the purpose of the pull request The size of `rows` is error, for example ``` List allRecords = Arrays.asList();

[GitHub] [incubator-hudi] SteNicholas edited a comment on issue #1136: [MINOR]Optimize hudi-cli module

2019-12-25 Thread GitBox
SteNicholas edited a comment on issue #1136: [MINOR]Optimize hudi-cli module URL: https://github.com/apache/incubator-hudi/pull/1136#issuecomment-568942473 > `hudi-cli` as it is is weak on unit tests.. Do you want to first take up that task on the current master branch.. that way we would

[GitHub] [incubator-hudi] SteNicholas commented on issue #1136: [MINOR]Optimize hudi-cli module

2019-12-25 Thread GitBox
SteNicholas commented on issue #1136: [MINOR]Optimize hudi-cli module URL: https://github.com/apache/incubator-hudi/pull/1136#issuecomment-568942473 > `hudi-cli` as it is is weak on unit tests.. Do you want to first take up that task on the current master branch.. that way we would know

[GitHub] [incubator-hudi] SteNicholas commented on a change in pull request #1136: [MINOR]Optimize hudi-cli module

2019-12-25 Thread GitBox
SteNicholas commented on a change in pull request #1136: [MINOR]Optimize hudi-cli module URL: https://github.com/apache/incubator-hudi/pull/1136#discussion_r361345650 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/HoodiePrintHelper.java ## @@ -84,7 +84,7 @@

[jira] [Assigned] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread lamber-ken (Jira)
[ https://issues.apache.org/jira/browse/HUDI-470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lamber-ken reassigned HUDI-470: --- Assignee: lamber-ken > Fix NPE when print result via hudi-cli >

[jira] [Created] (HUDI-470) Fix NPE when print result via hudi-cli

2019-12-25 Thread lamber-ken (Jira)
lamber-ken created HUDI-470: --- Summary: Fix NPE when print result via hudi-cli Key: HUDI-470 URL: https://issues.apache.org/jira/browse/HUDI-470 Project: Apache Hudi (incubating) Issue Type: Bug

[jira] [Updated] (HUDI-260) Hudi Spark Bundle does not work when passed in extraClassPath option

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-260: Component/s: (was: Usability) (was: Spark Integration) > Hudi Spark Bundle

[jira] [Updated] (HUDI-307) Dataframe written with Date,Timestamp, Decimal is read with same types

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-307: Component/s: (was: Spark Integration) Spark datasource > Dataframe written with

[jira] [Updated] (HUDI-439) Fix HoodieSparkSqlWriter wrt code refactoring

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-439: Component/s: (was: Spark Integration) Spark datasource > Fix

[jira] [Updated] (HUDI-69) Support realtime view in Spark datasource #136

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-69?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-69: --- Component/s: (was: Spark Integration) (was: Realtime View)

[jira] [Updated] (HUDI-303) Avro schema case sensitivity testing

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-303: Component/s: (was: Testing) (was: Spark Integration)

[jira] [Updated] (HUDI-33) Introduce config to allow users to control case-sensitivity in column projections #431

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-33: --- Component/s: (was: Spark Integration) (was: Presto Integration)

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-254: Component/s: (was: Spark Integration) > Provide mechanism for installing hudi-spark-bundle onto

[GitHub] [incubator-hudi] cdmikechen commented on issue #1119: [HUDI-469] Fix: HoodieCommitMetadata only show first commit insert rows.

2019-12-25 Thread GitBox
cdmikechen commented on issue #1119: [HUDI-469] Fix: HoodieCommitMetadata only show first commit insert rows. URL: https://github.com/apache/incubator-hudi/pull/1119#issuecomment-568941316 > Lets first triage the issue, file a JIRA and then proceed with a PR? OK! I have open a JIRA

[jira] [Updated] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-25 Thread cdmikechen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] cdmikechen updated HUDI-469: Status: Patch Available (was: In Progress) > HoodieCommitMetadata only show first commit insert rows. >

[jira] [Created] (HUDI-469) HoodieCommitMetadata only show first commit insert rows.

2019-12-25 Thread cdmikechen (Jira)
cdmikechen created HUDI-469: --- Summary: HoodieCommitMetadata only show first commit insert rows. Key: HUDI-469 URL: https://issues.apache.org/jira/browse/HUDI-469 Project: Apache Hudi (incubating)

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1136: [MINOR]Optimize hudi-cli module

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1136: [MINOR]Optimize hudi-cli module URL: https://github.com/apache/incubator-hudi/pull/1136#discussion_r361343736 ## File path: hudi-cli/src/main/java/org/apache/hudi/cli/HoodiePrintHelper.java ## @@ -84,7 +84,7 @@

[GitHub] [incubator-hudi] lamber-ken commented on issue #1135: [HUDI-233]Redo log statements using SLF4J

2019-12-25 Thread GitBox
lamber-ken commented on issue #1135: [HUDI-233]Redo log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1135#issuecomment-568940452 > @leesf @lamber-ken who were looking into this before.. > @leesf could you shepherd this one? My concerns are mostly around all

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361343021 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361343052 ## File path: hudi-spark/src/main/java/org/apache/hudi/OverwriteWithLatestAvroPayload.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361342980 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#discussion_r361342961 ## File path: hudi-client/src/test/java/org/apache/hudi/common/HoodieTestDataGenerator.java

[GitHub] [incubator-hudi] vinothchandar edited a comment on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
vinothchandar edited a comment on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#issuecomment-568939561 @cdmikechen its good to check on the payload .. There is also another issue open to track that I think..

[GitHub] [incubator-hudi] vinothchandar commented on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer

2019-12-25 Thread GitBox
vinothchandar commented on issue #1073: [HUDI-377] Adding Delete() support to DeltaStreamer URL: https://github.com/apache/incubator-hudi/pull/1073#issuecomment-568939561 @cdmikechen its good to check on the payload .. There is also another issue open to track that I think.. @nsivabalan

[GitHub] [incubator-hudi] lamber-ken commented on issue #1120: [HUDI-440] Rework the hudi web site

2019-12-25 Thread GitBox
lamber-ken commented on issue #1120: [HUDI-440] Rework the hudi web site URL: https://github.com/apache/incubator-hudi/pull/1120#issuecomment-568939134 Hi @vinothchandar, thanks for your review. I updated pr according to your advice. 

[GitHub] [incubator-hudi] vinothchandar commented on issue #736: hoodie-hive-hundle don't have hive jars

2019-12-25 Thread GitBox
vinothchandar commented on issue #736: hoodie-hive-hundle don't have hive jars URL: https://github.com/apache/incubator-hudi/issues/736#issuecomment-568938832 I think the code assumes everything is in the hadoop conf ``` if [ -z "$HADOOP_CONF_DIR" ]; then echo "setting

[GitHub] [incubator-hudi] vinothchandar commented on issue #828: Synchronizing to hive partition is incorrect

2019-12-25 Thread GitBox
vinothchandar commented on issue #828: Synchronizing to hive partition is incorrect URL: https://github.com/apache/incubator-hudi/issues/828#issuecomment-568938690 In that case, I am not sure why the code would not find the partitions it just wrote? is this S3? may be an eventual

[GitHub] [incubator-hudi] leesf commented on issue #1135: [HUDI-233]Redo log statements using SLF4J

2019-12-25 Thread GitBox
leesf commented on issue #1135: [HUDI-233]Redo log statements using SLF4J URL: https://github.com/apache/incubator-hudi/pull/1135#issuecomment-568937528 Thanks for opening the PR @listenLearning . Here are my some thoughts. - we must ensure the log4j paly well with spark/hive/presto to

[jira] [Updated] (HUDI-453) Throw failed to archive commits error when writing data to MOR/COW table

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-453: Fix Version/s: 0.5.1 > Throw failed to archive commits error when writing data to MOR/COW table >

[jira] [Closed] (HUDI-468) Not an avro data file - error while archiving post rename() change

2019-12-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-468. --- Resolution: Duplicate dupe of HUDI-453  > Not an avro data file - error while archiving post rename()

[jira] [Created] (HUDI-468) Not an avro data file - error while archiving post rename() change

2019-12-25 Thread Vinoth Chandar (Jira)
Vinoth Chandar created HUDI-468: --- Summary: Not an avro data file - error while archiving post rename() change Key: HUDI-468 URL: https://issues.apache.org/jira/browse/HUDI-468 Project: Apache Hudi

[GitHub] [incubator-hudi] vinothchandar merged pull request #1137: [MINOR]Optimize hudi-timeline-service module

2019-12-25 Thread GitBox
vinothchandar merged pull request #1137: [MINOR]Optimize hudi-timeline-service module URL: https://github.com/apache/incubator-hudi/pull/1137 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [incubator-hudi] vinothchandar commented on issue #1137: [MINOR]Optimize hudi-timeline-service module

2019-12-25 Thread GitBox
vinothchandar commented on issue #1137: [MINOR]Optimize hudi-timeline-service module URL: https://github.com/apache/incubator-hudi/pull/1137#issuecomment-568935856 Good cleanup! thanks! This is an automated message from the

[incubator-hudi] branch master updated (3c811ec -> def18a5)

2019-12-25 Thread vinoth
This is an automated email from the ASF dual-hosted git repository. vinoth pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 3c811ec [MINOR] fix typos add def18a5 [MINOR] optimize hudi timeline service (#1137) No new

[GitHub] [incubator-hudi] vinothchandar commented on issue #1077: [HUDI-335] : Improvements to DiskbasedMap

2019-12-25 Thread GitBox
vinothchandar commented on issue #1077: [HUDI-335] : Improvements to DiskbasedMap URL: https://github.com/apache/incubator-hudi/pull/1077#issuecomment-568935637 @nbalajee But this seems simple enough that we can do ourselves right.. I am bit hesitant to reuse code as-is from Cassandra..

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340278 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/Metrics.java ## @@ -47,7

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340214 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/JmxMetricsReporter.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340058 ## File path: hudi-client/src/main/java/org/apache/hudi/client/utils/NetUtils.java ## @@ -0,0

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340146 ## File path: hudi-client/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340118 ## File path: hudi-client/src/main/java/org/apache/hudi/client/utils/UnionIterator.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340224 ## File path: hudi-client/src/main/java/org/apache/hudi/metrics/JmxMetricsReporter.java ##

[GitHub] [incubator-hudi] vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter

2019-12-25 Thread GitBox
vinothchandar commented on a change in pull request #1106: [HUDI-209] Implement JMX metrics reporter URL: https://github.com/apache/incubator-hudi/pull/1106#discussion_r361340109 ## File path: hudi-client/src/main/java/org/apache/hudi/client/utils/NetUtils.java ## @@ -0,0

[GitHub] [incubator-hudi] SteNicholas opened a new pull request #1137: [MINOR]Optimize hudi-timeline-service module

2019-12-25 Thread GitBox
SteNicholas opened a new pull request #1137: [MINOR]Optimize hudi-timeline-service module URL: https://github.com/apache/incubator-hudi/pull/1137 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before

[GitHub] [incubator-hudi] SteNicholas opened a new pull request #1136: [MINOR]Optimize hudi-cli module

2019-12-25 Thread GitBox
SteNicholas opened a new pull request #1136: [MINOR]Optimize hudi-cli module URL: https://github.com/apache/incubator-hudi/pull/1136 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contributing.html before opening a pull

[GitHub] [incubator-hudi] leesf commented on issue #1130: [HUDI-445]Refactor the codes based on scala codestyle BlockImportChecker rule

2019-12-25 Thread GitBox
leesf commented on issue #1130: [HUDI-445]Refactor the codes based on scala codestyle BlockImportChecker rule URL: https://github.com/apache/incubator-hudi/pull/1130#issuecomment-568894069 @sev7e0 close the PR as discussed above. :)

[GitHub] [incubator-hudi] leesf closed pull request #1130: [HUDI-445]Refactor the codes based on scala codestyle BlockImportChecker rule

2019-12-25 Thread GitBox
leesf closed pull request #1130: [HUDI-445]Refactor the codes based on scala codestyle BlockImportChecker rule URL: https://github.com/apache/incubator-hudi/pull/1130 This is an automated message from the Apache Git

[incubator-hudi] branch master updated (8affdf8 -> 3c811ec)

2019-12-25 Thread leesf
This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git. from 8affdf8 [HUDI-416] Improve hint information for cli (#1110) add 3c811ec [MINOR] fix typos No new

[GitHub] [incubator-hudi] leesf merged pull request #1134: [MINOR] fix typo

2019-12-25 Thread GitBox
leesf merged pull request #1134: [MINOR] fix typo URL: https://github.com/apache/incubator-hudi/pull/1134 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Closed] (HUDI-416) Improve hint information for Cli

2019-12-25 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf closed HUDI-416. -- Fix Version/s: 0.5.1 Resolution: Fixed Fixed via master: 8affdf8bcbb4c7b236283e97c3afad186d5b6a3e > Improve hint

[GitHub] [incubator-hudi] leesf merged pull request #1110: [HUDI-416] improve hint information for cli

2019-12-25 Thread GitBox
leesf merged pull request #1110: [HUDI-416] improve hint information for cli URL: https://github.com/apache/incubator-hudi/pull/1110 This is an automated message from the Apache Git Service. To respond to the message, please

  1   2   >