Liulietong commented on a change in pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#discussion_r583434679
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java
##
@@ -104,7 +104,7 @@ public boolean hasNext() {
Liulietong commented on a change in pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#discussion_r583434679
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java
##
@@ -104,7 +104,7 @@ public boolean hasNext() {
codecov-io edited a comment on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-786454326
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2607?src=pr=h1) Report
> Merging
[#2607](https://codecov.io/gh/apache/hudi/pull/2607?src=pr=desc) (ab93c26)
into
codecov-io commented on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-786454326
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2607?src=pr=h1) Report
> Merging
[#2607](https://codecov.io/gh/apache/hudi/pull/2607?src=pr=desc) (ab93c26)
into
t0il3ts0ap edited a comment on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-786029402
@satishkotha Ran again on fresh table, still same issue.
SparkSubmit:
```
spark-submit
--master yarn
--packages
liujinhui1994 commented on pull request #2438:
URL: https://github.com/apache/hudi/pull/2438#issuecomment-786452099
I will add the unit test, and then please review
This is an automated message from the Apache Git Service.
[
https://issues.apache.org/jira/browse/HUDI-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1643:
-
Labels: pull-request-available (was: )
> [Hudi Observability] Framework for reporting stats from
yanghua commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583407438
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java
##
@@ -258,4 +260,142 @@ public String getArchivelogFolder() {
nbalajee opened a new pull request #2607:
URL: https://github.com/apache/hudi/pull/2607
…tors
## What is the purpose of the pull request
Frame work for collecting Hudi Observability stats from the executors.
## Brief change log
- Using distributed registry, report
xushiyan commented on a change in pull request #2541:
URL: https://github.com/apache/hudi/pull/2541#discussion_r583403910
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/util/DateTimeUtils.java
##
@@ -0,0 +1,41 @@
+/*
+ * Licensed to the Apache Software
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new c5d50f0 Travis CI build asf-site
c5d50f0 is
Balajee Nagasubramaniam created HUDI-1643:
-
Summary: [Hudi Observability] Framework for reporting stats from
executors
Key: HUDI-1643
URL: https://issues.apache.org/jira/browse/HUDI-1643
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1dd7a41 [MINOR] Fixing slideshare link
vinothchandar merged pull request #2606:
URL: https://github.com/apache/hudi/pull/2606
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
satishkotha commented on a change in pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#discussion_r583398027
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieLogFormatReader.java
##
@@ -104,7 +104,7 @@ public boolean hasNext() {
pengzhiwei2018 commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583385132
##
File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java
##
@@ -106,10 +106,13 @@ public String createTable(
throw
n3nash commented on pull request #2606:
URL: https://github.com/apache/hudi/pull/2606#issuecomment-786408716
Verified locally that it works.
This is an automated message from the Apache Git Service.
To respond to the
n3nash opened a new pull request #2606:
URL: https://github.com/apache/hudi/pull/2606
Fixing broken link
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
-
danny0405 commented on a change in pull request #2600:
URL: https://github.com/apache/hudi/pull/2600#discussion_r583369329
##
File path:
hudi-flink/src/main/java/org/apache/hudi/operator/partitioner/BucketAssignFunction.java
##
@@ -136,15 +137,10 @@ public void
hk-lrzy commented on a change in pull request #2600:
URL: https://github.com/apache/hudi/pull/2600#discussion_r583366344
##
File path:
hudi-flink/src/main/java/org/apache/hudi/operator/partitioner/BucketAssignFunction.java
##
@@ -136,15 +137,10 @@ public void
hk-lrzy closed pull request #2604:
URL: https://github.com/apache/hudi/pull/2604
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1f101fe Travis CI build asf-site
1f101fe is
codejoyan commented on issue #2592:
URL: https://github.com/apache/hudi/issues/2592#issuecomment-786379571
This is the spark version of the cluster being used at work so I will have
to use Spark 2.3 until there is an upgrade. Since the documentation says:
**Hudi works with Spark-2.x**, I
This is an automated email from the ASF dual-hosted git repository.
lamberken pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new eeb146a [HUDI 1642] Adding Hudi Learning
lamber-ken merged pull request #2602:
URL: https://github.com/apache/hudi/pull/2602
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
lamber-ken edited a comment on pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#issuecomment-786378892
Thanks @n3nash LGTM
This is an automated message from the Apache Git Service.
To respond to the
lamber-ken commented on pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#issuecomment-786378892
Thanks @n3nash
This is an automated message from the Apache Git Service.
To respond to the message, please
lamber-ken commented on a change in pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#discussion_r583352619
##
File path: content/docs/0.5.3-powered_by.html
##
@@ -462,13 +462,17 @@ Talks
Presentations
codecov-io edited a comment on pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#issuecomment-784717451
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2596?src=pr=h1) Report
> Merging
[#2596](https://codecov.io/gh/apache/hudi/pull/2596?src=pr=desc) (c71fe74)
into
garyli1019 commented on issue #2498:
URL: https://github.com/apache/hudi/issues/2498#issuecomment-786364265
I am seeing the same problem when the compiled spark distribution is
different from the runtime spark distribution. Compile hudi jar against the
runtime spark distribution should
garyli1019 commented on pull request #2584:
URL: https://github.com/apache/hudi/pull/2584#issuecomment-786361769
hi @satishkotha , this PR seems related to #2583 , would you take a look?
This is an automated message from the
pengzhiwei2018 commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583334728
##
File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java
##
@@ -106,10 +106,13 @@ public String createTable(
throw
yanghua commented on a change in pull request #2596:
URL: https://github.com/apache/hudi/pull/2596#discussion_r583313615
##
File path: hudi-cli/src/main/java/org/apache/hudi/cli/commands/TableCommand.java
##
@@ -106,10 +106,13 @@ public String createTable(
throw new
n3nash merged pull request #2565:
URL: https://github.com/apache/hudi/pull/2565
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 022df0d [HUDI-1611] Added a configuration to
This is an automated email from the ASF dual-hosted git repository.
nagarwal pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 9f5e8cc Fixing README for hudi test suite long
n3nash merged pull request #2578:
URL: https://github.com/apache/hudi/pull/2578
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
Nishith Agarwal created HUDI-1642:
-
Summary: Add Links to Uber engineering blog and meet up slides
Key: HUDI-1642
URL: https://issues.apache.org/jira/browse/HUDI-1642
Project: Apache Hudi
n3nash commented on a change in pull request #2602:
URL: https://github.com/apache/hudi/pull/2602#discussion_r583286829
##
File path: content/docs/0.5.3-powered_by.html
##
@@ -462,13 +462,17 @@ Talks
Presentations
afeldman1 closed issue #2399:
URL: https://github.com/apache/hudi/issues/2399
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
afeldman1 commented on issue #2399:
URL: https://github.com/apache/hudi/issues/2399#issuecomment-786204481
Apologies for the delayed response. And thank you to @bvaradar for the
initial hint. The issue turned out to be caused not by the keys but another one
of the configuration
kpurella commented on issue #2240:
URL: https://github.com/apache/hudi/issues/2240#issuecomment-786183675
@vinothchandar Sure ,i will !!
This is an automated message from the Apache Git Service.
To respond to the message,
toninis commented on issue #2149:
URL: https://github.com/apache/hudi/issues/2149#issuecomment-786183618
@vinothchandar
Sorry I took so long to respond . It had worked and compiled successfully .
I probably had missed something at the time .
Thanks for your response at the time
[
https://issues.apache.org/jira/browse/HUDI-1641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
PRASHANT BHOSALE updated HUDI-1641:
---
Description:
I am trying to integrate Hudi with Kafka topic.
teps followed :
# Created Kafka
t0il3ts0ap edited a comment on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-786029402
@satishkotha Ran again on fresh table, still same issue.
SparkSubmit:
```
spark-submit
--master yarn
--packages
t0il3ts0ap commented on issue #2589:
URL: https://github.com/apache/hudi/issues/2589#issuecomment-786029402
Ran again on fresh table, still same issue.
SparkSubmit:
```
spark-submit
--master yarn
--packages
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan resolved HUDI-1269.
---
Fix Version/s: 0.8.0
Resolution: Fixed
> Make whether the failure of connect
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 8c2197a [HUDI-1269] Make whether the failure
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1269:
--
Status: Open (was: New)
> Make whether the failure of connect hive affects hudi ingest
[
https://issues.apache.org/jira/browse/HUDI-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1269:
--
Status: In Progress (was: Open)
> Make whether the failure of connect hive affects
nsivabalan merged pull request #2443:
URL: https://github.com/apache/hudi/pull/2443
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
Rap70r commented on issue #2586:
URL: https://github.com/apache/hudi/issues/2586#issuecomment-785941366
Hi nsivabalan,
Thank you for your reply.
* Incremental updates include both inserts and updates. Mostly updates.
* We can try increasing retention version to a higher
rubenssoto commented on issue #2588:
URL: https://github.com/apache/hudi/issues/2588#issuecomment-785933427
@bvaradar I think it is a hive issue, I'm trying to increase hive heap size,
I hope it helps.
I process the tables in threads, so I have almost 20 hive connections open.
bvaradar commented on issue #2448:
URL: https://github.com/apache/hudi/issues/2448#issuecomment-785932137
@root18039532923 : Please look at
https://hudi.apache.org/blog/async-compaction-deployment-model/ for running
async compactions
bvaradar commented on issue #2555:
URL: https://github.com/apache/hudi/issues/2555#issuecomment-785930358
For bulkinsert, you need to size the parallelism to control. Please see
https://cwiki.apache.org/confluence/display/HUDI/FAQ#FAQ-Whatperformance/ingestlatencycanIexpectforHudiwriting
bvaradar commented on issue #2588:
URL: https://github.com/apache/hudi/issues/2588#issuecomment-785928870
@rubenssoto : The stack-trace does not contain Hudi in it. So, I dont know
how to help in this regard. Regarding high cpu load on hive server, Are you
also running hive queries apart
PRASHANT BHOSALE created HUDI-1641:
--
Summary: Issue for Integrating Hudi with Kafka using Avro Schema
Key: HUDI-1641
URL: https://issues.apache.org/jira/browse/HUDI-1641
Project: Apache Hudi
bvaradar commented on a change in pull request #2520:
URL: https://github.com/apache/hudi/pull/2520#discussion_r582853801
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/bootstrap/index/DefaultBootstrapIndex.java
##
@@ -0,0 +1,82 @@
+/*
+ * Licensed to the
bvaradar commented on issue #2605:
URL: https://github.com/apache/hudi/issues/2605#issuecomment-785906565
Ideally, spark data-source should provide that option (like
optionFromFile(...). Not sure if there is anything like that.
Created :
[
https://issues.apache.org/jira/browse/HUDI-1640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17290922#comment-17290922
]
Balaji Varadarajan commented on HUDI-1640:
--
[~shivnarayan]: Can you vet this and add to the work
Balaji Varadarajan created HUDI-1640:
Summary: Implement Spark Datasource option to read hudi configs
from properties file
Key: HUDI-1640
URL: https://issues.apache.org/jira/browse/HUDI-1640
bvaradar commented on issue #2592:
URL: https://github.com/apache/hudi/issues/2592#issuecomment-785896778
I was unable to setup spark-2.3.0 in my setup. But,with spark-2.4.4, this
works fine as below. Can you use spark-2.4.x version. spark-2.3 seems too old
though ?
`21/02/25
codecov-io edited a comment on pull request #2443:
URL: https://github.com/apache/hudi/pull/2443#issuecomment-760147630
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2443?src=pr=h1) Report
> Merging
[#2443](https://codecov.io/gh/apache/hudi/pull/2443?src=pr=desc) (7baf5de)
into
codecov-io edited a comment on pull request #2378:
URL: https://github.com/apache/hudi/pull/2378#issuecomment-751218636
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2378?src=pr=h1) Report
> Merging
[#2378](https://codecov.io/gh/apache/hudi/pull/2378?src=pr=desc) (ef2107f)
into
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan resolved HUDI-1367.
---
Fix Version/s: 0.8.0
Resolution: Fixed
> Make delastreamer transition from
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan reopened HUDI-1367:
---
> Make delastreamer transition from dfsSouce to kafkasouce
>
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1367:
--
Status: Patch Available (was: In Progress)
> Make delastreamer transition from
[
https://issues.apache.org/jira/browse/HUDI-1367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-1367:
--
Status: Closed (was: Patch Available)
> Make delastreamer transition from dfsSouce to
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 617cc24 [HUDI-1367] Make deltaStreamer
nsivabalan merged pull request #2227:
URL: https://github.com/apache/hudi/pull/2227
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
codecov-io edited a comment on pull request #2519:
URL: https://github.com/apache/hudi/pull/2519#issuecomment-771782258
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2519?src=pr=h1) Report
> Merging
[#2519](https://codecov.io/gh/apache/hudi/pull/2519?src=pr=desc) (6f0fd84)
into
rakeshramakrishnan edited a comment on issue #2439:
URL: https://github.com/apache/hudi/issues/2439#issuecomment-785795722
@nsivabalan : There are no errors, however through hudi, the connection is
made to the local hive metastore (from spark). It doesn't connect to the
external hive
rakeshramakrishnan commented on issue #2439:
URL: https://github.com/apache/hudi/issues/2439#issuecomment-785795722
@nsivabalan : There are no errors, however through hudi, the connection is
made to the local hive metastore (from spark). It doesn't connect to the
external hive metastore.
Xoln commented on a change in pull request #2520:
URL: https://github.com/apache/hudi/pull/2520#discussion_r582717002
##
File path:
hudi-common/src/main/java/org/apache/hudi/common/bootstrap/index/DefaultBootstrapIndex.java
##
@@ -0,0 +1,61 @@
+package
codecov-io commented on pull request #2604:
URL: https://github.com/apache/hudi/pull/2604#issuecomment-785704660
# [Codecov](https://codecov.io/gh/apache/hudi/pull/2604?src=pr=h1) Report
> Merging
[#2604](https://codecov.io/gh/apache/hudi/pull/2604?src=pr=desc) (fed6575)
into
75 matches
Mail list logo
