[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814314#comment-16814314
]
Gabor Somogyi commented on SPARK-27409:
---
ping [~pbharaj]
> Micro-batch support for Kafka Source
[
https://issues.apache.org/jira/browse/SPARK-27409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813094#comment-16813094
]
Gabor Somogyi commented on SPARK-27409:
---
It would definitely help if you can provide your
[
https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806659#comment-16806659
]
Gabor Somogyi commented on SPARK-27330:
---
Now I see the point and makes sense from my perspective.
[
https://issues.apache.org/jira/browse/SPARK-27330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806638#comment-16806638
]
Gabor Somogyi commented on SPARK-27330:
---
If processing throws any kind of exception then
[
https://issues.apache.org/jira/browse/SPARK-27294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27294:
--
Description:
Kafka delegation token only supports single cluster at the moment.
I've created
[
https://issues.apache.org/jira/browse/SPARK-27294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802720#comment-16802720
]
Gabor Somogyi commented on SPARK-27294:
---
[~vanzin] [~zsxwing] [~kabhwan] what do you think of the
Gabor Somogyi created SPARK-27294:
-
Summary: Multi-cluster Kafka delegation token support
Key: SPARK-27294
URL: https://issues.apache.org/jira/browse/SPARK-27294
Project: Spark
Issue Type:
Gabor Somogyi created SPARK-27270:
-
Summary: Add Kafka dynamic JAAS authentication debug possibility
Key: SPARK-27270
URL: https://issues.apache.org/jira/browse/SPARK-27270
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800505#comment-16800505
]
Gabor Somogyi commented on SPARK-27218:
---
[~emasab] no problem, the good thing that it has been
[
https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799018#comment-16799018
]
Gabor Somogyi commented on SPARK-27218:
---
Just for the sake of double checking are you sure the
[
https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798988#comment-16798988
]
Gabor Somogyi edited comment on SPARK-27218 at 3/22/19 1:22 PM:
[
https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798988#comment-16798988
]
Gabor Somogyi edited comment on SPARK-27218 at 3/22/19 12:53 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798988#comment-16798988
]
Gabor Somogyi commented on SPARK-27218:
---
[~emasab] Don't fully understand your test code:
* When
[
https://issues.apache.org/jira/browse/SPARK-27206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-27206.
---
Resolution: Invalid
> Using slice method with streaming api's Interval on DStream
>
[
https://issues.apache.org/jira/browse/SPARK-27206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797153#comment-16797153
]
Gabor Somogyi commented on SPARK-27206:
---
[~aarthipa] Can you please write a mail to the dev list?
[
https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794904#comment-16794904
]
Gabor Somogyi commented on SPARK-27124:
---
[~hyukjin.kwon] thanks for your time in the discussion.
[
https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-27124.
---
Resolution: Won't Do
OK, based on the discussion it's won't do. At least users may have
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789786#comment-16789786
]
Gabor Somogyi commented on SPARK-26998:
---
Same understanding, chosen the file approach.
>
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789653#comment-16789653
]
Gabor Somogyi edited comment on SPARK-26998 at 3/11/19 2:47 PM:
Since
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789653#comment-16789653
]
Gabor Somogyi commented on SPARK-26998:
---
Since the first part of the PR solved (http URLs in case
[
https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789591#comment-16789591
]
Gabor Somogyi commented on SPARK-27124:
---
I would mention "SchemaConverters can be used to make
[
https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789494#comment-16789494
]
Gabor Somogyi commented on SPARK-27124:
---
Yeah, the python implementation would use the same what
[
https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789376#comment-16789376
]
Gabor Somogyi commented on SPARK-27124:
---
{quote}This is reachable via Py4J FWIW{quote}
How
[
https://issues.apache.org/jira/browse/SPARK-27124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789356#comment-16789356
]
Gabor Somogyi commented on SPARK-27124:
---
I've already put together a POC but interested in what do
Gabor Somogyi created SPARK-27124:
-
Summary: Expose org.apache.spark.sql.avro.SchemaConverters as
developer API
Key: SPARK-27124
URL: https://issues.apache.org/jira/browse/SPARK-27124
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789341#comment-16789341
]
Gabor Somogyi commented on SPARK-20075:
---
[~kabhwan] cool. I think we both can give a try and share
[
https://issues.apache.org/jira/browse/SPARK-20075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789329#comment-16789329
]
Gabor Somogyi commented on SPARK-20075:
---
[~kabhwan] To continue the discussion started on
[
https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787834#comment-16787834
]
Gabor Somogyi commented on SPARK-27044:
---
Thanks [~herberts] rebuilt shaded jar was my main
[
https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787784#comment-16787784
]
Gabor Somogyi commented on SPARK-27044:
---
I've already started but wanted to double check things
[
https://issues.apache.org/jira/browse/SPARK-27044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787754#comment-16787754
]
Gabor Somogyi commented on SPARK-27044:
---
[~herberts] Could you give an example of {quote}fetch
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787720#comment-16787720
]
Gabor Somogyi commented on SPARK-27027:
---
After compile
{quote}./bin/spark-shell --packages
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787701#comment-16787701
]
Gabor Somogyi commented on SPARK-27027:
---
With spark-shell, in unit test the functionality works.
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787662#comment-16787662
]
Gabor Somogyi commented on SPARK-27027:
---
Please see the comments. The issue fully reproducible.
>
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787662#comment-16787662
]
Gabor Somogyi edited comment on SPARK-27027 at 3/8/19 8:34 AM:
---
Please see
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787626#comment-16787626
]
Gabor Somogyi commented on SPARK-27027:
---
Not sure its avro issue but somehow SQL only shows the
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786978#comment-16786978
]
Gabor Somogyi commented on SPARK-27027:
---
[~dongjoon] [~Gengliang.Wang] do you have any idea what
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783478#comment-16783478
]
Gabor Somogyi edited comment on SPARK-27027 at 3/7/19 4:44 PM:
---
What I've
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786969#comment-16786969
]
Gabor Somogyi commented on SPARK-27027:
---
Hmm, seems like the converted avro binary is exactly the
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783478#comment-16783478
]
Gabor Somogyi edited comment on SPARK-27027 at 3/7/19 4:36 PM:
---
What I've
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786726#comment-16786726
]
Gabor Somogyi commented on SPARK-26998:
---
I've tested the things through and see the issue. I think
[
https://issues.apache.org/jira/browse/SPARK-24621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785583#comment-16785583
]
Gabor Somogyi commented on SPARK-24621:
---
I've analyzed through this issue with the latest master
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784410#comment-16784410
]
Gabor Somogyi commented on SPARK-26998:
---
Ahaaa, I see now. 2 problems tried to be solved in one
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784406#comment-16784406
]
Gabor Somogyi commented on SPARK-26998:
---
{quote}
Can be resolved if below PR is merged:
[[Github]
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784391#comment-16784391
]
Gabor Somogyi commented on SPARK-26998:
---
[~toopt4] thanks for the info. Are you working on this?
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784391#comment-16784391
]
Gabor Somogyi edited comment on SPARK-26998 at 3/5/19 12:51 PM:
[
https://issues.apache.org/jira/browse/SPARK-27055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27055:
--
Description:
Since SPARK-26956 has been merged the Structured Streaming documentation has to
Gabor Somogyi created SPARK-27055:
-
Summary: Update Structured Streaming documentation because of DSv2
changes
Key: SPARK-27055
URL: https://issues.apache.org/jira/browse/SPARK-27055
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi reopened SPARK-27027:
---
> from_avro function does not deserialize the Avro record of a struct column
> type correctly
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783509#comment-16783509
]
Gabor Somogyi commented on SPARK-27027:
---
> Does that imply the bug is in the implementation of
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783505#comment-16783505
]
Gabor Somogyi commented on SPARK-27027:
---
[~hyukjin.kwon] seems like the issue comes only with
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783478#comment-16783478
]
Gabor Somogyi commented on SPARK-27027:
---
What I've found is really interesting.
The following
[
https://issues.apache.org/jira/browse/SPARK-27046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27046:
--
Component/s: Documentation
> Remove SPARK-19185 related references from documentation since
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783416#comment-16783416
]
Gabor Somogyi commented on SPARK-27027:
---
OK, started to dig and write it here when I've found
[
https://issues.apache.org/jira/browse/SPARK-27027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783388#comment-16783388
]
Gabor Somogyi commented on SPARK-27027:
---
[~hyukjin.kwon] excellent. Can you put the commit here
Gabor Somogyi created SPARK-27046:
-
Summary: Remove SPARK-19185 related references from documentation
since its resolved
Key: SPARK-27046
URL: https://issues.apache.org/jira/browse/SPARK-27046
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783337#comment-16783337
]
Gabor Somogyi commented on SPARK-26727:
---
I think the trick is not executing things in a loop but
[
https://issues.apache.org/jira/browse/SPARK-27042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27042:
--
Description: If a task is failing due to a corrupt cached KafkaProducer and
the task is
[
https://issues.apache.org/jira/browse/SPARK-27042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27042:
--
Description: If a task is failing due to a cached corrupted KafkaProducer
and the task is
[
https://issues.apache.org/jira/browse/SPARK-27042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27042:
--
Description: If a task is failing due to a cached Kafka producer and the
task is retried in
Gabor Somogyi created SPARK-27042:
-
Summary: Query fails if task is failing due to corrupt cached
Kafka producer
Key: SPARK-27042
URL: https://issues.apache.org/jira/browse/SPARK-27042
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783074#comment-16783074
]
Gabor Somogyi edited comment on SPARK-26727 at 3/4/19 7:55 AM:
---
[~Udbhav
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16783074#comment-16783074
]
Gabor Somogyi commented on SPARK-26727:
---
I was dealing with "failOnDataLoss=false should not
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782162#comment-16782162
]
Gabor Somogyi edited comment on SPARK-26727 at 3/1/19 10:21 PM:
I've
[
https://issues.apache.org/jira/browse/SPARK-26727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782162#comment-16782162
]
Gabor Somogyi commented on SPARK-26727:
---
I've seen this issue lately when I was dealing with a
[
https://issues.apache.org/jira/browse/SPARK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782135#comment-16782135
]
Gabor Somogyi commented on SPARK-26998:
---
How is this different from
Gabor Somogyi created SPARK-27022:
-
Summary: Kafka delegation token support
Key: SPARK-27022
URL: https://issues.apache.org/jira/browse/SPARK-27022
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779408#comment-16779408
]
Gabor Somogyi commented on SPARK-26783:
---
I've gone through the whole chain on v2.4.0 and it looks
[
https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-26783.
---
Resolution: Not A Bug
> Kafka parameter documentation doesn't match with the reality
[
https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779408#comment-16779408
]
Gabor Somogyi edited comment on SPARK-26783 at 2/27/19 2:56 PM:
I've
[
https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27002:
--
Description:
Lately KAFKA-8004 has been discovered and this triggered me to do further tests
Gabor Somogyi created SPARK-27002:
-
Summary: Latest kafka delegation token not always picked up
Key: SPARK-27002
URL: https://issues.apache.org/jira/browse/SPARK-27002
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-27002:
--
Priority: Critical (was: Major)
> Latest kafka delegation token not always picked up
>
[
https://issues.apache.org/jira/browse/SPARK-26686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-26686.
---
Resolution: Won't Do
> Remove unnecessary KafkaSourceProvider parameter lowercase
[
https://issues.apache.org/jira/browse/SPARK-26686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16771805#comment-16771805
]
Gabor Somogyi commented on SPARK-26686:
---
As the API is not explicitly stating that it provides
[
https://issues.apache.org/jira/browse/SPARK-26888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-26888.
---
Resolution: Duplicate
> Upgrade to Log4j 2.x
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-26888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16769746#comment-16769746
]
Gabor Somogyi commented on SPARK-26888:
---
+1, duplicate.
> Upgrade to Log4j 2.x
>
Gabor Somogyi created SPARK-26889:
-
Summary: Fix timestamp type in Structured Streaming + Kafka
Integration Guide
Key: SPARK-26889
URL: https://issues.apache.org/jira/browse/SPARK-26889
Project:
Gabor Somogyi created SPARK-26888:
-
Summary: Upgrade to Log4j 2.x
Key: SPARK-26888
URL: https://issues.apache.org/jira/browse/SPARK-26888
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-19888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-19888.
---
Resolution: Fixed
Issue solved in SPARK-19185.
> Seeing offsets not resetting even when
[
https://issues.apache.org/jira/browse/SPARK-19888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16768276#comment-16768276
]
Gabor Somogyi commented on SPARK-19888:
---
Please reopen it if appears again.
> Seeing offsets not
[
https://issues.apache.org/jira/browse/SPARK-26866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26866:
--
Target Version/s: (was: 2.3.0)
> Support kinesis checkpoint with subSequenceNumber
>
[
https://issues.apache.org/jira/browse/SPARK-26866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26866:
--
Fix Version/s: (was: 2.3.0)
> Support kinesis checkpoint with subSequenceNumber
>
[
https://issues.apache.org/jira/browse/SPARK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26772:
--
Description: HadoopDelegationTokenProvider has basically the same
functionality just like
[
https://issues.apache.org/jira/browse/SPARK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26772:
--
Description: HadoopDelegationTokenProvider has basically the same
functionality just like
>
[
https://issues.apache.org/jira/browse/SPARK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26772:
--
Summary: Delete ServiceCredentialProvider and make
HadoopDelegationTokenProvider a developer
[
https://issues.apache.org/jira/browse/SPARK-26772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26772:
--
Description: (was: YARNHadoopDelegationTokenManager now loads
ServiceCredentialProviders
[
https://issues.apache.org/jira/browse/SPARK-26856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767120#comment-16767120
]
Gabor Somogyi commented on SPARK-26856:
---
OK, same understanding. Adapt the patch to the things
[
https://issues.apache.org/jira/browse/SPARK-26856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16765977#comment-16765977
]
Gabor Somogyi commented on SPARK-26856:
---
You mean not even having an API but just suggest the
[
https://issues.apache.org/jira/browse/SPARK-26856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764819#comment-16764819
]
Gabor Somogyi commented on SPARK-26856:
---
Until now nothing fancy just added a direct call to the
[
https://issues.apache.org/jira/browse/SPARK-26856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764839#comment-16764839
]
Gabor Somogyi commented on SPARK-26856:
---
What can enhanced here is to add a check whether the JVM
[
https://issues.apache.org/jira/browse/SPARK-26856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764790#comment-16764790
]
Gabor Somogyi commented on SPARK-26856:
---
I've created a patch but hesitant to create a PR because
Gabor Somogyi created SPARK-26856:
-
Summary: Python support for "from_avro" and "to_avro" APIs
Key: SPARK-26856
URL: https://issues.apache.org/jira/browse/SPARK-26856
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-26783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764772#comment-16764772
]
Gabor Somogyi commented on SPARK-26783:
---
[~dongjoon] at the moment waiting on [~sindiri] to report
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764769#comment-16764769
]
Gabor Somogyi edited comment on SPARK-26845 at 2/11/19 8:50 AM:
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764769#comment-16764769
]
Gabor Somogyi commented on SPARK-26845:
---
[~Gengliang.Wang] Thanks for the confirmation! Hope
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi resolved SPARK-26845.
---
Resolution: Not A Problem
> Avro to_avro from_avro roundtrip fails if data type is string
>
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763868#comment-16763868
]
Gabor Somogyi commented on SPARK-26845:
---
I think I've found the reason for the second question:
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763848#comment-16763848
]
Gabor Somogyi commented on SPARK-26845:
---
[~attilapiros] Thanks for the help, this explains why the
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26845:
--
Summary: Avro to_avro from_avro roundtrip fails if data type is string
(was: Avro from_avro
[
https://issues.apache.org/jira/browse/SPARK-26845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gabor Somogyi updated SPARK-26845:
--
Labels: correctness (was: )
> Avro from_avro to_avro roundtrip fails if data type is string
401 - 500 of 685 matches
Mail list logo
