[
https://issues.apache.org/jira/browse/HUDI-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711912#comment-17711912
]
Léo Biscassi edited comment on HUDI-5997 at 4/13/23 2:16 PM:
-------------------------------------------------------------
[~codope] I mean, I know the behavior from the user perspective, I use this
feature daily, my question was more related to the behavior of this
{{SchemaProvider}} class in the code and, since the {{--schemaprovider-class}}
is just informed in the HoodieDeltaStreamer class, I'm wondering how would be
the best way to pass it for the cloud object selector, since it doesn't seem to
have a class like the general hudi properties have. The avro schema that I get
from `.getSourceSchema()` and `.getTargetSchema()` seems to be an avro schema,
that doesn't seem to work with the spark reader schema option either, what
would be the best way to get the schema struct to pass for the spark reader?
was (Author: JIRAUSER294377):
[~codope] I mean, I know the behavior from the user perspective, I use this
feature daily, my question was more related to the behavior of this
{{SchemaProvider}} class in the code and, since the {{--schemaprovider-class}}
is just informed in the HoodieDeltaStreamer class, I'm wondering how would be
the best way to pass it for the cloud object selector, since it doesn't seem to
have a class like the general hudi properties have.
> Support DFS Schema Provider with S3/GCS EventsHoodieIncrSource
> --------------------------------------------------------------
>
> Key: HUDI-5997
> URL: https://issues.apache.org/jira/browse/HUDI-5997
> Project: Apache Hudi
> Issue Type: Improvement
> Components: deltastreamer
> Reporter: Sagar Sumit
> Assignee: Léo Biscassi
> Priority: Major
> Fix For: 0.14.0
>
>
> See for more details
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
