[jira] [Updated] (HUDI-82) Add Presto 0.217 docker to quickstart and pre integration tests

2019-08-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-82?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-82: --- Labels: pull-request-available (was: ) > Add Presto 0.217 docker to quickstart and pre integration

[jira] [Updated] (HUDI-128) Setup infra for nightly/snapshot releases

2019-08-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-128: Labels: pull-request-available (was: ) > Setup infra for nightly/snapshot releases >

[jira] [Updated] (HUDI-170) Updating hoodie record before inserting it into ExternalSpillableMap

2019-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-170: Labels: pull-request-available (was: ) > Updating hoodie record before inserting it into

[jira] [Updated] (HUDI-230) Add missing Apache License in some files

2019-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-230: Labels: pull-request-available (was: ) > Add missing Apache License in some files >

[jira] [Updated] (HUDI-222) Rename main class path to org.apache.hudi.timeline.service.TimelineService in run_server.sh

2019-08-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-222: Labels: pull-request-available (was: ) > Rename main class path to

[jira] [Updated] (HUDI-96) Use Command line options instead of positional arguments when launching spark applications from various CLI commands

2019-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-96: --- Labels: newbie pull-request-available (was: newbie) > Use Command line options instead of positional

[jira] [Updated] (HUDI-180) Move HiveSyncTool registration from hive server (jdbc) to metastore (thrift)

2019-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-180: Labels: pull-request-available (was: ) > Move HiveSyncTool registration from hive server (jdbc) to

[jira] [Updated] (HUDI-231) Support Nested ordering field types in deltastreamer

2019-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-231: Labels: pull-request-available (was: ) > Support Nested ordering field types in deltastreamer >

[jira] [Updated] (HUDI-164) Incorrect averageBytesPerRecord Causes OOM

2019-08-30 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-164: Labels: pull-request-available (was: ) > Incorrect averageBytesPerRecord Causes OOM >

[jira] [Updated] (HUDI-143) GCS: Jackson Databind Issue seen in query side - Presto/Hive

2019-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-143: Labels: gcs-parity pull-request-available (was: gcs-parity) > GCS: Jackson Databind Issue seen in

[jira] [Updated] (HUDI-236) Failed to close stream

2019-09-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-236: Labels: pull-request-available (was: ) > Failed to close stream > -- > >

[jira] [Updated] (HUDI-225) Create Hudi Timeline Server Fat Jar

2019-08-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-225: Labels: pull-request-available (was: ) > Create Hudi Timeline Server Fat Jar >

[jira] [Updated] (HUDI-223) Allow for simply using the the Spark Row schema in DeltaSync

2019-08-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-223: Labels: pull-request-available (was: ) > Allow for simply using the the Spark Row schema in

[jira] [Updated] (HUDI-174) Investigate atomicity guarantees out of cloud storage

2019-08-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-174: Labels: pull-request-available (was: ) > Investigate atomicity guarantees out of cloud storage >

[jira] [Updated] (HUDI-227) DeltaStreamer Improvements : Commit empty input batch with progressing checkpoints and allow users to override configs through properties

2019-08-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-227: Labels: pull-request-available (was: ) > DeltaStreamer Improvements : Commit empty input batch

[jira] [Updated] (HUDI-229) Fix mvn notice:generate issue in windows

2019-08-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-229: Labels: pull-request-available (was: ) > Fix mvn notice:generate issue in windows >

[jira] [Updated] (HUDI-217) Provide a unified resource management class to standardize the resource allocation and release for hudi client test cases

2019-09-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-217: Labels: pull-request-available (was: ) > Provide a unified resource management class to standardize

[jira] [Updated] (HUDI-68) Automated test for demo query integrations with Presto/Spark/Hive #140

2019-08-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-68?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-68: --- Labels: pull-request-available (was: ) > Automated test for demo query integrations with

[jira] [Updated] (HUDI-243) Rename HoodieInputFormat and HoodieRealtimeInputFormat to HoodieParquetInputFormat and HoodieParquetRealtimeInputFormat

2019-09-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-243: Labels: pull-request-available (was: ) > Rename HoodieInputFormat and HoodieRealtimeInputFormat to

[jira] [Updated] (HUDI-244) Hive Sync Should escape partition column name

2019-09-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-244: Labels: pull-request-available (was: ) > Hive Sync Should escape partition column name >

[jira] [Updated] (HUDI-235) Log files generated after pending compaction does not get deleted

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-235: Labels: pull-request-available (was: ) > Log files generated after pending compaction does not get

[jira] [Updated] (HUDI-250) Ensure Hudi CLI wrapper works with non snapshot jars too

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-250: Labels: pull-request-available (was: ) > Ensure Hudi CLI wrapper works with non snapshot jars too >

[jira] [Updated] (HUDI-240) Translate Use Cases page

2019-09-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-240: Labels: pull-request-available (was: ) > Translate Use Cases page > > >

[jira] [Updated] (HUDI-228) Add Jira Conventions to contributing/community pages of HUDI

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-228: Labels: pull-request-available (was: ) > Add Jira Conventions to contributing/community pages of

[jira] [Updated] (HUDI-255) Translate Talks & Powered By page

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-255: Labels: pull-request-available (was: ) > Translate Talks & Powered By page >

[jira] [Updated] (HUDI-254) Provide mechanism for installing hudi-spark-bundle onto an existing spark installation

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-254: Labels: pull-request-available (was: ) > Provide mechanism for installing hudi-spark-bundle onto an

[jira] [Updated] (HUDI-257) Unit tests intermittently failing

2019-09-17 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-257: Labels: pull-request-available (was: ) > Unit tests intermittently failing >

[jira] [Updated] (HUDI-262) Update Hudi website to reflect change in InputFormat Class name

2019-09-18 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-262: Labels: pull-request-available (was: ) > Update Hudi website to reflect change in InputFormat Class

[jira] [Updated] (HUDI-252) Add Disclaimer and cleanup NOTICE and LICENSE files in hudi

2019-09-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-252: Labels: pull-request-available (was: ) > Add Disclaimer and cleanup NOTICE and LICENSE files in

[jira] [Updated] (HUDI-237) Translate quickstart page

2019-09-05 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-237: Labels: pull-request-available (was: ) > Translate quickstart page > - > >

[jira] [Updated] (HUDI-249) Final check to ensure all relevant files have Apache License headers

2019-09-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-249: Labels: pull-request-available (was: ) > Final check to ensure all relevant files have Apache

[jira] [Updated] (HUDI-267) Refactor bad method name HoodieTestUtils#initTableType and HoodieTableMetaClient#initializePathAsHoodieDataset

2019-09-21 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-267: Labels: pull-request-available (was: ) > Refactor bad method name HoodieTestUtils#initTableType and

[jira] [Updated] (HUDI-251) JDBC incremental load to HUDI with DeltaStreamer

2019-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-251: Labels: pull-request-available (was: ) > JDBC incremental load to HUDI with DeltaStreamer >

[jira] [Updated] (HUDI-271) Simplify quickstart documentation

2019-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-271: Labels: pull-request-available (was: ) > Simplify quickstart documentation >

[jira] [Updated] (HUDI-160) Update documents to reflect Hudi supports Hive 2.x +

2019-10-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-160: Labels: pull-request-available (was: ) > Update documents to reflect Hudi supports Hive 2.x + >

[jira] [Updated] (HUDI-265) Failed to delete tmp dirs created in unit tests

2019-09-26 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-265: Labels: pull-request-available (was: ) > Failed to delete tmp dirs created in unit tests >

[jira] [Updated] (HUDI-247) Unify the initialization of HoodieTableMetaClient in test for hoodie-client module

2019-09-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-247: Labels: pull-request-available (was: ) > Unify the initialization of HoodieTableMetaClient in test

[jira] [Updated] (HUDI-269) Provide ability to throttle DeltaStreamer sync runs

2019-09-24 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-269: Labels: pull-request-available (was: ) > Provide ability to throttle DeltaStreamer sync runs >

[jira] [Updated] (HUDI-220) Translate root index page

2019-09-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-220: Labels: pull-request-available (was: ) > Translate root index page > - > >

[jira] [Updated] (HUDI-282) Update documentation to reflect additional option of HiveSync via metastore

2019-10-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-282: Labels: pull-request-available (was: ) > Update documentation to reflect additional option of

[jira] [Updated] (HUDI-287) Remove LICENSE and NOTICE files in hoodie child modules

2019-10-02 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-287: Labels: pull-request-available (was: ) > Remove LICENSE and NOTICE files in hoodie child modules >

[jira] [Updated] (HUDI-279) Regression in Schema Evolution due to PR-755

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-279: Labels: pull-request-available (was: ) > Regression in Schema Evolution due to PR-755 >

[jira] [Updated] (HUDI-256) Translate Comparison page

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-256: Labels: pull-request-available (was: ) > Translate Comparison page > - > >

[jira] [Updated] (HUDI-278) Translate Administering page

2019-09-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-278: Labels: pull-request-available (was: ) > Translate Administering page >

[jira] [Updated] (HUDI-137) Hudi cleaning state changes should be consistent with commit actions

2019-10-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-137: Labels: pull-request-available (was: ) > Hudi cleaning state changes should be consistent with

[jira] [Updated] (HUDI-40) HoodieDeltaStreamer doesn't support parquet files as source #401

2019-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-40?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-40: --- Labels: pull-request-available (was: ) > HoodieDeltaStreamer doesn't support parquet files as source

[jira] [Updated] (HUDI-296) Explore use of spotless to auto fix formatting errors

2019-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-296: Labels: pull-request-available (was: ) > Explore use of spotless to auto fix formatting errors >

[jira] [Updated] (HUDI-292) Consume more entries from kafka than specified sourceLimit.

2019-10-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-292: Labels: pull-request-available (was: ) > Consume more entries from kafka than specified

[jira] [Updated] (HUDI-290) Normalize test class name of all test classes

2019-10-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-290: Labels: pull-request-available (was: ) > Normalize test class name of all test classes >

[jira] [Updated] (HUDI-291) Simplify quickstart

2019-10-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-291: Labels: pull-request-available (was: ) > Simplify quickstart > --- > >

[jira] [Updated] (HUDI-232) Implement sealing/unsealing for HoodieRecord class

2019-10-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-232: Labels: pull-request-available (was: ) > Implement sealing/unsealing for HoodieRecord class >

[jira] [Updated] (HUDI-293) Remove KEYS file from github repository

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-293: Labels: pull-request-available (was: ) > Remove KEYS file from github repository >

[jira] [Updated] (HUDI-130) Paths written in compaction plan needs to be relative to base-path

2019-10-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-130: Labels: pull-request-available (was: ) > Paths written in compaction plan needs to be relative to

[jira] [Updated] (HUDI-285) Implement HoodieStorageWriter based on actual file type

2019-10-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-285: Labels: pull-request-available (was: ) > Implement HoodieStorageWriter based on actual file type >

[jira] [Updated] (HUDI-268) Allow parquet/avro versions upgrading in Hudi

2019-10-11 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-268: Labels: pull-request-available (was: ) > Allow parquet/avro versions upgrading in Hudi >

[jira] [Updated] (HUDI-298) Upsert MOR table but got a NULL value

2019-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-298: Labels: pull-request-available (was: ) > Upsert MOR table but got a NULL value >

[jira] [Updated] (HUDI-273) Translate Documentation -> Writing Data page

2019-10-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-273: Labels: pull-request-available (was: ) > Translate Documentation -> Writing Data page >