[
https://issues.apache.org/jira/browse/HUDI-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu closed HUDI-1313.
-
Resolution: Invalid
> Rename hudi-spark-client module to hudi-client-spark
>
[
https://issues.apache.org/jira/browse/HUDI-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu updated HUDI-1313:
--
Status: Open (was: New)
> Rename hudi-spark-client module to hudi-client-spark
>
wangxianghu closed pull request #2139:
URL: https://github.com/apache/hudi/pull/2139
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
wangxianghu commented on pull request #2139:
URL: https://github.com/apache/hudi/pull/2139#issuecomment-703021700
> @wangxianghu I did not end up doing this in my pr because hudi-sync is
alreadynamed in the same way. We can leave this also as-is?
Yes, I named it as
satishkotha commented on a change in pull request #2129:
URL: https://github.com/apache/hudi/pull/2129#discussion_r499101046
##
File path:
hudi-sync/hudi-dla-sync/src/main/java/org/apache/hudi/dla/DLASyncConfig.java
##
@@ -68,6 +68,9 @@
@Parameter(names = {"--help", "-h"},
prashantwason edited a comment on pull request #2064:
URL: https://github.com/apache/hudi/pull/2064#issuecomment-686688968
Remaining work items:
- [x] 1. Support for rollbacks in MOR Table
- [x] 2. Rollback of metadata if commit eventually fails on dataset
- [x] 3. HUDI-CLI
[
https://issues.apache.org/jira/browse/HUDI-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1310:
-
Parent Issue: HUDI-1308 (was: HUDI-1292)
> Corruption Block Handling too slow in S3
>
[
https://issues.apache.org/jira/browse/HUDI-1311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1311:
-
Parent Issue: HUDI-1308 (was: HUDI-1292)
> Writes creating/updating large number of files seeing
[
https://issues.apache.org/jira/browse/HUDI-1309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1309:
-
Parent Issue: HUDI-1292 (was: HUDI-1308)
> Listing Metadata unreadable in S3 as the log block is
[
https://issues.apache.org/jira/browse/HUDI-1310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1310:
-
Parent Issue: HUDI-1292 (was: HUDI-1308)
> Corruption Block Handling too slow in S3
>
[
https://issues.apache.org/jira/browse/HUDI-1312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1312:
-
Parent: HUDI-1292
Issue Type: Sub-task (was: New Feature)
> Query side use of Metadata
[
https://issues.apache.org/jira/browse/HUDI-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1308:
-
Fix Version/s: 0.7.0
> Issues found during testing RFC-15
> --
>
[
https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17206532#comment-17206532
]
Vinoth Chandar commented on HUDI-1307:
--
[~309637554] makes sense to make them consistent. go for it!
[
https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1307:
-
Description:
as spark datasource read hudi table
1、snapshot mode
{code:java}
val readHudi =
[
https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1307:
-
Description:
as spark datasource read hudi table
1、snapshot mode
{code:java}
val readHudi =
[
https://issues.apache.org/jira/browse/HUDI-1307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-1307:
-
Description:
as spark datasource read hudi table
1、snapshot mode
{code:java}
val readHudi =
[
https://issues.apache.org/jira/browse/HUDI-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17206529#comment-17206529
]
Vinoth Chandar commented on HUDI-1297:
--
yes. thats happening as we speak. support for 3.0
>
xushiyan commented on issue #2121:
URL: https://github.com/apache/hudi/issues/2121#issuecomment-702912344
@pratyakshsharma Do you happen to know about supporting array type schema?
This is an automated message from the
vinothchandar commented on pull request #2139:
URL: https://github.com/apache/hudi/pull/2139#issuecomment-702871683
@wangxianghu I did not end up doing this in my pr because hudi-sync is
alreadynamed in the same way. We can leave this also as-is?
vinothchandar commented on issue #2135:
URL: https://github.com/apache/hudi/issues/2135#issuecomment-702868560
@andaag, we would be happy to take a feature request do you mind raising a
jira, with more detailed requirements
bvaradar commented on issue #2131:
URL: https://github.com/apache/hudi/issues/2131#issuecomment-702846845
@tandonraghavs : Thanks for the explanation. I have created a PR to expose
Schema in preCombine : https://github.com/apache/hudi/pull/2141
There is one option for you which is
bvaradar commented on a change in pull request #2141:
URL: https://github.com/apache/hudi/pull/2141#discussion_r498938639
##
File path:
hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/SparkWriteHelper.java
##
@@ -49,21 +52,48 @@ public static
[
https://issues.apache.org/jira/browse/HUDI-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-898:
Labels: pull-request-available (was: )
> Need to add Schema parameter to
hotienvu commented on pull request #2140:
URL: https://github.com/apache/hudi/pull/2140#issuecomment-702843403
Closing this. See https://github.com/apache/hudi/issues/2138 for solution
This is an automated message from the
bvaradar opened a new pull request #2141:
URL: https://github.com/apache/hudi/pull/2141
This is to let users implement custom deduping-merge logic.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of
hotienvu closed pull request #2140:
URL: https://github.com/apache/hudi/pull/2140
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
hotienvu closed issue #2138:
URL: https://github.com/apache/hudi/issues/2138
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the
hotienvu commented on issue #2138:
URL: https://github.com/apache/hudi/issues/2138#issuecomment-702842659
Thanks @bvaradar, it is working now. Closing this and the pr
IMHO, would be great if the doc
[here](https://hudi.apache.org/docs/writing_data.html) have an example for
writing
[
https://issues.apache.org/jira/browse/HUDI-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Balaji Varadarajan updated HUDI-898:
Status: Open (was: New)
> Need to add Schema parameter to HoodieRecordPayload::preCombine
>
[
https://issues.apache.org/jira/browse/HUDI-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Balaji Varadarajan reassigned HUDI-898:
---
Assignee: Balaji Varadarajan
> Need to add Schema parameter to
andaag commented on issue #2135:
URL: https://github.com/apache/hudi/issues/2135#issuecomment-702821679
Yes, but it'd be quite critical to be able to access this from the
apis/programatically.
If we have a job running the gdpr deletion, we'd need that job to know the
times involved
bvaradar commented on issue #2135:
URL: https://github.com/apache/hudi/issues/2135#issuecomment-702799057
@andaag : I think you are referring to "cleaner" here. We expose cleaner
metadata through CLI. "cleans show" (Source code : CleansCommand.java).
Cleaner track what is the
bvaradar commented on issue #2138:
URL: https://github.com/apache/hudi/issues/2138#issuecomment-702772462
@hotienvu : In your code, hive-sync config is configured wrongly
DataSourceWriteOptions.HIVE_PARTITION_FIELDS_OPT_KEY() should be set to
"year,month,day" instead of
bvaradar edited a comment on issue #2138:
URL: https://github.com/apache/hudi/issues/2138#issuecomment-702772462
@hotienvu : In your code, hive-sync config is configured wrongly
DataSourceWriteOptions.HIVE_PARTITION_FIELDS_OPT_KEY() should be set to
"year,month,day" instead of
bvaradar commented on a change in pull request #2093:
URL: https://github.com/apache/hudi/pull/2093#discussion_r498859641
##
File path:
hudi-spark/src/main/java/org/apache/hudi/keygen/CustomKeyGenerator.java
##
@@ -58,6 +59,7 @@
public CustomKeyGenerator(TypedProperties
nsivabalan commented on pull request #2092:
URL: https://github.com/apache/hudi/pull/2092#issuecomment-702767045
cool, sounds good. will wait for you to update the patch then
This is an automated message from the Apache Git
hotienvu opened a new pull request #2140:
URL: https://github.com/apache/hudi/pull/2140
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of the
[
https://issues.apache.org/jira/browse/HUDI-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu resolved HUDI-1089.
---
Resolution: Fixed
> Refactor hudi-client to support multi-engine
>
[
https://issues.apache.org/jira/browse/HUDI-1089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17206149#comment-17206149
]
wangxianghu commented on HUDI-1089:
---
done via master branch : 1f7add92916c37b05be270d9c75a9042134ec506
wangxianghu commented on a change in pull request #1827:
URL: https://github.com/apache/hudi/pull/1827#discussion_r498806514
##
File path: hudi-cli/pom.xml
##
@@ -148,7 +148,14 @@
org.apache.hudi
- hudi-client
+ hudi-client-common
+
[
https://issues.apache.org/jira/browse/HUDI-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-1313:
-
Labels: pull-request-available (was: )
> Rename hudi-spark-client module to hudi-client-spark
>
wangxianghu opened a new pull request #2139:
URL: https://github.com/apache/hudi/pull/2139
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contributing.html before opening a
pull request.*
## What is the purpose of
[
https://issues.apache.org/jira/browse/HUDI-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
wangxianghu reassigned HUDI-1313:
-
Assignee: wangxianghu
> Rename hudi-spark-client module to hudi-client-spark
>
wangxianghu created HUDI-1313:
-
Summary: Rename hudi-spark-client module to hudi-client-spark
Key: HUDI-1313
URL: https://issues.apache.org/jira/browse/HUDI-1313
Project: Apache Hudi
Issue Type:
SteNicholas removed a comment on pull request #2111:
URL: https://github.com/apache/hudi/pull/2111#issuecomment-702550693
@linshan-ma You could use the current commit to check your test case again.
IMO, the current commit has already resolved your problem.
hotienvu opened a new issue #2138:
URL: https://github.com/apache/hudi/issues/2138
**_Tips before filing an issue_**
- Have you gone through our
[FAQs](https://cwiki.apache.org/confluence/display/HUDI/FAQ)?
- Join the mailing list to engage in conversations and get faster
sassai commented on issue #1962:
URL: https://github.com/apache/hudi/issues/1962#issuecomment-702568499
@bvaradar: Sorry for the late reply. I was not able to investigate this
issue further until now.
In the meantime I updated Hudi to 0.6.0 to check if the issue still occurs.
SteNicholas removed a comment on pull request #2111:
URL: https://github.com/apache/hudi/pull/2111#issuecomment-700524082
> According to
this（[https://github.com/apache/hudi/issues/2051）](https://github.com/apache/hudi/issues/2051%EF%BC%89)
test。I can't get the results I want。When we set
SteNicholas commented on pull request #2111:
URL: https://github.com/apache/hudi/pull/2111#issuecomment-702550693
@linshan-ma You could use the current commit to check your test case again.
IMO, the current commit has already resolved your problem.
SteNicholas removed a comment on pull request #2111:
URL: https://github.com/apache/hudi/pull/2111#issuecomment-701890658
> > > According to
this（[https://github.com/apache/hudi/issues/2051）](https://github.com/apache/hudi/issues/2051%EF%BC%89)
test。I can't get the results I want。When we
51 matches
Mail list logo
