Hi Vinoth,
I would like to take it up. Will be sending the PR soon. :)
On Mon, Sep 16, 2019 at 9:27 PM Vinoth Chandar wrote:
> Actually went ahead and created
> https://issues.apache.org/jira/browse/HUDI-253 .
> Question is just about the PR for this now ? :)
>
> On Mon, Sep 16, 2019 at 8:54
Actually went ahead and created
https://issues.apache.org/jira/browse/HUDI-253 .
Question is just about the PR for this now ? :)
On Mon, Sep 16, 2019 at 8:54 AM Vinoth Chandar wrote:
> +1 DeltaStreamer can be much nicer in such cases.. Any interest in opening
> a JIRA/PR for this?
>
> On Mon,
+1 DeltaStreamer can be much nicer in such cases.. Any interest in opening
a JIRA/PR for this?
On Mon, Sep 16, 2019 at 2:02 AM vbal...@apache.org
wrote:
> Yes, It makes sense to add validations with descriptive messages. Please
> open a ticket and send a PR for this.
> Thanks,Balaji.VOn
Yes, It makes sense to add validations with descriptive messages. Please open
a ticket and send a PR for this.
Thanks,Balaji.VOn Monday, September 16, 2019, 01:11:12 AM PDT, Pratyaksh
Sharma wrote:
Hi Balaji,
I get your point. However I feel in such cases, instead of throwing a Null
Hi Balaji,
I get your point. However I feel in such cases, instead of throwing a Null
Pointer, we should handle the case gracefully. The exception should be
thrown with proper user-facing message. Please let me know your thoughts
on this.
On Fri, Sep 13, 2019 at 7:26 PM Balaji Varadarajan
Hi Pratyaksh,
This is expected. You need to pass a schema-provider since you are using Avro
Sources.For RowBased sources, DeltaStreamer can deduce schema from Row type
information available from Spark Dataset.
Balaji.V
On Friday, September 13, 2019, 02:57:37 AM PDT, Pratyaksh Sharma
Hi,
I am trying to build a CDC pipeline using Hudi working on tag hoodie-0.4.7.
Here is the command I used for running DeltaStreamer -
spark-submit --files jaas.conf --conf
'spark.driver.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf'
--conf
