vinothchandar commented on issue #859: Hudi upsert after a delete in partition
will cause valid records inserted to disappear.
URL: https://github.com/apache/incubator-hudi/issues/859#issuecomment-526795109
I think to works fine.. Are you accidentally issuing step 3 with
`.mode(SaveMode.Ov
vinothchandar commented on issue #859: Hudi upsert after a delete in partition
will cause valid records inserted to disappear.
URL: https://github.com/apache/incubator-hudi/issues/859#issuecomment-526795069
```/*
* Licensed to the Apache Software Foundation (ASF) under one
* or more
[
https://issues.apache.org/jira/browse/HUDI-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bhavani Sudha Saktheeswaran updated HUDI-164:
-
Status: Patch Available (was: In Progress)
> Incorrect averageBytesPerReco
bhasudha commented on issue #870: [HUDI-164] Fixes incorrect
averageBytesPerRecord
URL: https://github.com/apache/incubator-hudi/pull/870#issuecomment-526783851
I pulled out the averageBytesPerRecord method into a new Util class named
"HoodieWriteClientUtils.java" to be able to test. Orig
[
https://issues.apache.org/jira/browse/HUDI-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-164:
Labels: pull-request-available (was: )
> Incorrect averageBytesPerRecord Causes OOM
> --
bhasudha opened a new pull request #870: [HUDI-164] Fixes incorrect
averageBytesPerRecord
URL: https://github.com/apache/incubator-hudi/pull/870
When number of records written is zero, averageBytesPerRecord results in a
huge size (division by zero and ceiled to Long.MAX_VALUE) causing OOM.
[
https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919970#comment-16919970
]
leesf commented on HUDI-233:
[~vinoth] I would like to use slf4j along with log4j to solve this
[
https://issues.apache.org/jira/browse/HUDI-227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
leesf closed HUDI-227.
--
Resolution: Fixed
> DeltaStreamer Improvements : Commit empty input batch with progressing
> checkpoints and allow user
[
https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919951#comment-16919951
]
Vinoth Chandar commented on HUDI-233:
-
sg. In case you decide to bring slf4j or other l
[
https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919923#comment-16919923
]
leesf commented on HUDI-233:
Big +1 for this logging format since it can improve performance of
[
https://issues.apache.org/jira/browse/HUDI-233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
leesf reassigned HUDI-233:
--
Assignee: leesf
> Redo log statements using {} variable substitution
> -
[
https://issues.apache.org/jira/browse/HUDI-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919915#comment-16919915
]
leesf commented on HUDI-234:
As indicated in the post
[sizeOfAnObject|[https://stackoverflow.c
[
https://issues.apache.org/jira/browse/HUDI-234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919915#comment-16919915
]
leesf edited comment on HUDI-234 at 8/30/19 10:10 PM:
--
As indicated in
leesf commented on issue #661: Tracking ticket for reporting Hudi usages from
the community
URL: https://github.com/apache/incubator-hudi/issues/661#issuecomment-526755266
Not using it in prod yet, but very early stages of investigating its usage.
--
bvaradar merged pull request #864: [HUDI-231] Support nested ordering fields
URL: https://github.com/apache/incubator-hudi/pull/864
This is an automated message from the Apache Git Service.
To respond to the message, please l
[
https://issues.apache.org/jira/browse/HUDI-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-231:
Labels: pull-request-available (was: )
> Support Nested ordering field types in deltastreamer
>
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 555dd55 Support nested ordering fields
umehrot2 opened a new issue #869: Hudi Spark error when spark bundle jar is
added to spark's classpath
URL: https://github.com/apache/incubator-hudi/issues/869
We run into runtime error while packaging Hudi to work on AWS EMR. The issue
is reproducible on latest Spark 2.4.3, as well on pre
n3nash closed pull request #809: HUDI-180 : Adding support for hive
registration using metastore along with JDBC
URL: https://github.com/apache/incubator-hudi/pull/809
This is an automated message from the Apache Git Service
n3nash commented on issue #868: HUDI-180 : Adding support for hive registration
using metastore along with JDBC
URL: https://github.com/apache/incubator-hudi/pull/868#issuecomment-526723586
@vinothchandar @bvaradar ptal
This
n3nash commented on issue #809: HUDI-180 : Adding support for hive registration
using metastore along with JDBC
URL: https://github.com/apache/incubator-hudi/pull/809#issuecomment-526723509
closing in favor of https://github.com/apache/incubator-hudi/pull/868
--
n3nash opened a new pull request #868: HUDI-180 : Adding support for hive
registration using metastore along with JDBC
URL: https://github.com/apache/incubator-hudi/pull/868
This is an automated message from the Apache Git S
[
https://issues.apache.org/jira/browse/HUDI-180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-180:
Labels: pull-request-available (was: )
> Move HiveSyncTool registration from hive server (jdbc) to m
afilipchik commented on a change in pull request #862: Add support for
composite key
URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r319641781
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java
##
n3nash commented on issue #809: HUDI-180 : Adding support for hive registration
using metastore along with JDBC
URL: https://github.com/apache/incubator-hudi/pull/809#issuecomment-526707308
Working on it now
This is an automa
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 8b150a3 [HUDI-230] Add missing Apache
bvaradar merged pull request #867: [HUDI-230] Add missing Apache License in
some files
URL: https://github.com/apache/incubator-hudi/pull/867
This is an automated message from the Apache Git Service.
To respond to the messag
[
https://issues.apache.org/jira/browse/HUDI-207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919706#comment-16919706
]
Vinoth Chandar commented on HUDI-207:
-
Based on the mailing list discussion, seems like
[
https://issues.apache.org/jira/browse/HUDI-207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar reassigned HUDI-207:
---
Assignee: Pratyaksh Sharma
> Introduce secondary source ordering field for breaking ties while
[
https://issues.apache.org/jira/browse/HUDI-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919702#comment-16919702
]
Vinoth Chandar commented on HUDI-230:
-
[~xleesf] :)(y)
> Add missing Apache License in
[
https://issues.apache.org/jira/browse/HUDI-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-163:
Status: Closed (was: Patch Available)
> Updates to HoodieRecord are missing during MergeHandle with
[
https://issues.apache.org/jira/browse/HUDI-73?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919698#comment-16919698
]
Vinoth Chandar commented on HUDI-73:
[~jingc] still working on this ?
> Support vanill
[
https://issues.apache.org/jira/browse/HUDI-175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-175:
Status: Closed (was: Patch Available)
> Easier management of checkpoints using DeltaStreamer
> -
vinothchandar closed issue #860: Unit tests fail when run on IBM SDK
URL: https://github.com/apache/incubator-hudi/issues/860
This is an automated message from the Apache Git Service.
To respond to the message, please log on
vinothchandar commented on issue #860: Unit tests fail when run on IBM SDK
URL: https://github.com/apache/incubator-hudi/issues/860#issuecomment-526663313
@tribbloid @DavisBroda Sounds good. Filed a JIRA
https://issues.apache.org/jira/browse/HUDI-234 to track this. lets move the
conversati
[
https://issues.apache.org/jira/browse/HUDI-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-96:
---
Labels: newbie pull-request-available (was: newbie)
> Use Command line options instead of positional ar
[
https://issues.apache.org/jira/browse/HUDI-234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-234:
Description: https://github.com/apache/incubator-hudi/issues/860 bug report
> Graceful degradation o
vinothchandar commented on issue #673: HUDI-96: Command line options instead of
positional arguments
URL: https://github.com/apache/incubator-hudi/pull/673#issuecomment-526662858
Closing due to inactivity
This is an automate
vinothchandar closed pull request #673: HUDI-96: Command line options instead
of positional arguments
URL: https://github.com/apache/incubator-hudi/pull/673
This is an automated message from the Apache Git Service.
To respon
[
https://issues.apache.org/jira/browse/HUDI-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-96:
---
Status: Closed (was: Patch Available)
> Use Command line options instead of positional arguments when l
[
https://issues.apache.org/jira/browse/HUDI-96?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar reopened HUDI-96:
Assignee: (was: Abhishek Sharma)
Moving ticket back to opened due to inactivity
> Use Command lin
Vinoth Chandar created HUDI-234:
---
Summary: Graceful degradation of ObjectSizeCalculator for non
hotspot jvms
Key: HUDI-234
URL: https://issues.apache.org/jira/browse/HUDI-234
Project: Apache Hudi (incub
[
https://issues.apache.org/jira/browse/HUDI-124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BALAJI VARADARAJAN resolved HUDI-124.
-
Resolution: Fixed
> Ensure third party libs are compatible with ASF policy
> --
vinothchandar commented on issue #805: fix DeltaStreamer writeConfig
URL: https://github.com/apache/incubator-hudi/pull/805#issuecomment-526660821
Closing in favor of #863
This is an automated message from the Apache Git Servi
vinothchandar closed pull request #806: HoodieDeltaStreamer: allow to commit
when the records rdd is empty
URL: https://github.com/apache/incubator-hudi/pull/806
This is an automated message from the Apache Git Service.
To r
vinothchandar closed pull request #805: fix DeltaStreamer writeConfig
URL: https://github.com/apache/incubator-hudi/pull/805
This is an automated message from the Apache Git Service.
To respond to the message, please log on t
vinothchandar commented on issue #806: HoodieDeltaStreamer: allow to commit
when the records rdd is empty
URL: https://github.com/apache/incubator-hudi/pull/806#issuecomment-526660732
Closing in favor of #863
This is an auto
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 376b59a [HUDI-227] : DeltaStreamer Impr
vinothchandar merged pull request #863: [HUDI-227] : DeltaStreamer
Improvements : Commit empty input batch with progressing checkpoints and allow
users to override configs through properties
URL: https://github.com/apache/incubator-hudi/pull/863
-
vinothchandar commented on a change in pull request #863: [HUDI-227] :
DeltaStreamer Improvements : Commit empty input batch with progressing
checkpoints and allow users to override configs through properties
URL: https://github.com/apache/incubator-hudi/pull/863#discussion_r319581971
Vinoth Chandar created HUDI-233:
---
Summary: Redo log statements using {} variable substitution
Key: HUDI-233
URL: https://issues.apache.org/jira/browse/HUDI-233
Project: Apache Hudi (incubating)
vinothchandar commented on issue #809: HUDI-180 : Adding support for hive
registration using metastore along with JDBC
URL: https://github.com/apache/incubator-hudi/pull/809#issuecomment-526658177
@n3nash any updates? like to get this in the release if possible
---
vinothchandar commented on issue #849: [HUDI-62] Added index handle times
URL: https://github.com/apache/incubator-hudi/pull/849#issuecomment-526657934
@taherk77 so checkstyle passes locally for you? Just skimming the code `
indexLookupContext=metrics.getIndexLookupCtx();` for e.g wont p
vinothchandar closed pull request #777: Fix HUDI-170 Updating hoodie record
before inserting it into ExternalSpillableMap
URL: https://github.com/apache/incubator-hudi/pull/777
This is an automated message from the Apache Gi
vinothchandar merged pull request #866: HUDI-170 Updating hoodie record before
inserting it into ExternalSpillableMap
URL: https://github.com/apache/incubator-hudi/pull/866
This is an automated message from the Apache Git Se
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git
The following commit(s) were added to refs/heads/master by this push:
new a6908ef HUDI-170 Updating hoodie record
vinothchandar commented on issue #777: Fix HUDI-170 Updating hoodie record
before inserting it into ExternalSpillableMap
URL: https://github.com/apache/incubator-hudi/pull/777#issuecomment-526657250
Closing due to inactivity #866 has the fix now
---
vinothchandar commented on a change in pull request #866: HUDI-170 Updating
hoodie record before inserting it into ExternalSpillableMap
URL: https://github.com/apache/incubator-hudi/pull/866#discussion_r319578665
##
File path: hudi-client/src/main/java/org/apache/hudi/io/HoodieMerge
Vinoth Chandar created HUDI-232:
---
Summary: Implement sealing/unsealing for HoodieRecord class
Key: HUDI-232
URL: https://issues.apache.org/jira/browse/HUDI-232
Project: Apache Hudi (incubating)
bvaradar commented on issue #867: [HUDI-230] Add missing Apache License in some
files
URL: https://github.com/apache/incubator-hudi/pull/867#issuecomment-526610945
> The travis failed with _Cannot allocate memory_. [travis
link](https://api.travis-ci.org/v3/job/578726588/log.txt), and the
leesf commented on a change in pull request #867: [HUDI-230] Add missing Apache
License in some files
URL: https://github.com/apache/incubator-hudi/pull/867#discussion_r319454518
##
File path: docker/stop_demo.sh
##
@@ -1,3 +1,5 @@
+#!/bin/bash
Review comment:
Add #!
leesf commented on a change in pull request #867: [HUDI-230] Add missing Apache
License in some files
URL: https://github.com/apache/incubator-hudi/pull/867#discussion_r319454413
##
File path: docker/setup_demo.sh
##
@@ -1,3 +1,5 @@
+#!/bin/bash
Review comment:
Add #
leesf commented on issue #867: [HUDI-230] Add missing Apache License in some
files
URL: https://github.com/apache/incubator-hudi/pull/867#issuecomment-526551933
The travis failed with _Cannot allocate memory_. [travis
link](https://api.travis-ci.org/v3/job/578726588/log.txt), and the chang
[
https://issues.apache.org/jira/browse/HUDI-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-230:
Labels: pull-request-available (was: )
> Add missing Apache License in some files
>
leesf opened a new pull request #867: [HUDI-230] Add missing Apache License in
some files
URL: https://github.com/apache/incubator-hudi/pull/867
see jira
[HUDI-230](https://jira.apache.org/jira/projects/HUDI/issues/HUDI-230)
cc @bvaradar
---
[
https://issues.apache.org/jira/browse/HUDI-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919336#comment-16919336
]
leesf commented on HUDI-230:
[~vbalaji] Will provide a PR soon today.
> Add missing Apache Lic
[
https://issues.apache.org/jira/browse/HUDI-229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
leesf closed HUDI-229.
--
Resolution: Fixed
> Fix mvn notice:generate issue in windows
>
>
>
bvaradar commented on issue #864: Support nested ordering fields
URL: https://github.com/apache/incubator-hudi/pull/864#issuecomment-526504342
@afilipchik : can you add "HUDI-231" to the commit message and title of this
PR. Helps us to be structured when generating release notes
--
BALAJI VARADARAJAN created HUDI-231:
---
Summary: Support Nested ordering field types in deltastreamer
Key: HUDI-231
URL: https://issues.apache.org/jira/browse/HUDI-231
Project: Apache Hudi (incubating)
[
https://issues.apache.org/jira/browse/HUDI-170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-170:
Labels: pull-request-available (was: )
> Updating hoodie record before inserting it into ExternalSpi
bvaradar commented on issue #866: HUDI-170 Updating hoodie record before
inserting it into ExternalSpillableMap
URL: https://github.com/apache/incubator-hudi/pull/866#issuecomment-526502311
@n3nash @vinothchandar : Please review when you get a chance.
--
bvaradar opened a new pull request #866: HUDI-170 Updating hoodie record before
inserting it into ExternalSpillableMap
URL: https://github.com/apache/incubator-hudi/pull/866
Added MergeHandle unit-test to #777
This is an aut
[
https://issues.apache.org/jira/browse/HUDI-230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
BALAJI VARADARAJAN updated HUDI-230:
Parent: HUDI-121
Issue Type: Sub-task (was: Improvement)
> Add missing Apache Licens
[
https://issues.apache.org/jira/browse/HUDI-230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919292#comment-16919292
]
BALAJI VARADARAJAN commented on HUDI-230:
-
[~xleesf]: Good catch. Go for it. Actual
bvaradar commented on a change in pull request #862: Add support for composite
key
URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r319386956
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java
##
@
bvaradar commented on a change in pull request #862: Add support for composite
key
URL: https://github.com/apache/incubator-hudi/pull/862#discussion_r319386619
##
File path:
hudi-utilities/src/main/java/org/apache/hudi/utilities/keygen/TimestampBasedKeyGenerator.java
##
@
This is an automated email from the ASF dual-hosted git repository.
vbalaji pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git.
from 5c2da60 [HUDI-225] Create Hudi Timeline Server Fat Jar
add 40dd4dd [HUDI-229] Fix mvn notice:generate
bvaradar merged pull request #865: [HUDI-229] Fix mvn notice:generate issue in
windows
URL: https://github.com/apache/incubator-hudi/pull/865
This is an automated message from the Apache Git Service.
To respond to the messag
78 matches
Mail list logo
