[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15878884#comment-15878884
]
Michael Heuer commented on SPARK-19697:
---
Sorry about all the description edits. Thank you for
[
https://issues.apache.org/jira/browse/SPARK-16617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879431#comment-15879431
]
Michael Heuer commented on SPARK-16617:
---
Any thoughts as to what the Fix Version/s for this should
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Description:
In a downstream project (https://github.com/bigdatagenomics/adam), adding a
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Description:
In a downstream project (https://github.com/bigdatagenomics/adam), adding a
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Description:
In a downstream project (https://github.com/bigdatagenomics/adam), adding a
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Description:
In a downstream project (https://github.com/bigdatagenomics/adam), adding a
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Description:
In a downstream project (https://github.com/bigdatagenomics/adam), adding a
Michael Heuer created SPARK-19697:
-
Summary: NoSuchMethodError: org.apache.avro.Schema.getLogicalType()
Key: SPARK-19697
URL: https://issues.apache.org/jira/browse/SPARK-19697
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Environment: Apache Spark 2.1.0, Scala version 2.11.8, Java HotSpot(TM)
64-Bit Server VM,
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-19697:
--
Description:
In a downstream project (https://github.com/bigdatagenomics/adam), adding a
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15990972#comment-15990972
]
Michael Heuer commented on SPARK-19697:
---
We currently declare our compile time dependency to avro
[
https://issues.apache.org/jira/browse/SPARK-19697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15991022#comment-15991022
]
Michael Heuer commented on SPARK-19697:
---
dongjoon: Wait a minute, if I understand correctly, the
[
https://issues.apache.org/jira/browse/SPARK-24771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16579133#comment-16579133
]
Michael Heuer commented on SPARK-24771:
---
I'm looking forward to testing this with
[
https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641371#comment-16641371
]
Michael Heuer commented on SPARK-25587:
---
[~hyukjin.kwon], I agree that this isn't a Spark SQL or
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638226#comment-16638226
]
Michael Heuer edited comment on SPARK-25588 at 10/8/18 6:16 AM:
>
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642200#comment-16642200
]
Michael Heuer commented on SPARK-25588:
---
I moved the version back to 2.3.2, see
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651080#comment-16651080
]
Michael Heuer commented on SPARK-25588:
---
Created pull request
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659990#comment-16659990
]
Michael Heuer commented on SPARK-25588:
---
> Can you try to downgrade parquet and see if the problem
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400
]
Michael Heuer commented on SPARK-25588:
---
[~Gengliang.Wang] The unit test provided is only an
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400
]
Michael Heuer edited comment on SPARK-25588 at 10/17/18 11:56 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654400#comment-16654400
]
Michael Heuer edited comment on SPARK-25588 at 10/17/18 11:55 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25588:
--
Affects Version/s: 2.4.0
> SchemaParseException: Can't redefine: list when reading from
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642200#comment-16642200
]
Michael Heuer edited comment on SPARK-25588 at 10/10/18 5:18 PM:
-
I
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645294#comment-16645294
]
Michael Heuer commented on SPARK-25588:
---
[~cloud_fan] I'm curious to how this issue should be
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645295#comment-16645295
]
Michael Heuer commented on SPARK-25588:
---
I've reported an issue against Parquet with additional
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646027#comment-16646027
]
Michael Heuer commented on SPARK-25588:
---
Here is a generic unit test that demonstrates the issue.
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25588:
--
Description:
In ADAM, a library downstream of Spark, we use Avro to define a schema,
Michael Heuer created SPARK-25588:
-
Summary: SchemaParseException: Can't redefine: list when reading
from Parquet
Key: SPARK-25588
URL: https://issues.apache.org/jira/browse/SPARK-25588
Project:
[
https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25587:
--
Description:
In an attempt to replicate the following issue in ADAM, a library downstream of
[
https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25587:
--
Description:
In an attempt to replicate the following issue in ADAM, a library downstream of
Michael Heuer created SPARK-25587:
-
Summary: NPE in Dataset when reading from Parquet as Product
Key: SPARK-25587
URL: https://issues.apache.org/jira/browse/SPARK-25587
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25587:
--
Description:
In an attempt to replicate the following issue in ADAM, a library downstream of
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638226#comment-16638226
]
Michael Heuer commented on SPARK-25588:
---
> Looking at the stack trace, it seems like we are using
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25588:
--
Affects Version/s: (was: 2.4.0)
2.3.2
> SchemaParseException:
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-25588:
--
Environment: Spark version 2.3.2 (was: Spark version 2.4.0 (RC2).
{noformat}
$ spark-submit
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782522#comment-16782522
]
Michael Heuer commented on SPARK-26146:
---
It appears that this is a duplicate of SPARK-26583 and
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782519#comment-16782519
]
Michael Heuer commented on SPARK-26146:
---
[~srowen] Hey, wait a minute, the full example from the
[
https://issues.apache.org/jira/browse/SPARK-26146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772054#comment-16772054
]
Michael Heuer commented on SPARK-26146:
---
Another possible reproducing case
[
https://issues.apache.org/jira/browse/SPARK-22128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840940#comment-16840940
]
Michael Heuer commented on SPARK-22128:
---
We've run into this again with the binary distribution
[
https://issues.apache.org/jira/browse/SPARK-25588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850003#comment-16850003
]
Michael Heuer commented on SPARK-25588:
---
Note a fix for this issue has been merged upstream in
Michael Heuer created SPARK-27781:
-
Summary: Tried to access method
org.apache.avro.specific.SpecificData.()V
Key: SPARK-27781
URL: https://issues.apache.org/jira/browse/SPARK-27781
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-27781:
--
Description:
It appears that there is a conflict in avro dependency versions at runtime when
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-27781:
--
Attachment: reproduce.sh
> Tried to access method org.apache.avro.specific.SpecificData.()V
>
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-27781:
--
Description:
It appears that there is a conflict in avro dependency versions at runtime when
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886237#comment-16886237
]
Michael Heuer commented on SPARK-27781:
---
I believe I saw a fix for this specific issue, where the
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886237#comment-16886237
]
Michael Heuer edited comment on SPARK-27781 at 7/16/19 4:19 PM:
I
[
https://issues.apache.org/jira/browse/SPARK-28943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921581#comment-16921581
]
Michael Heuer commented on SPARK-28943:
---
To be honest, I am burned out trying to track down all of
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921700#comment-16921700
]
Michael Heuer commented on SPARK-27781:
---
This is still an issue with the Spark 2.4.4 binary
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-27781:
--
Affects Version/s: 2.4.4
> Tried to access method org.apache.avro.specific.SpecificData.()V
>
Michael Heuer created SPARK-28943:
-
Summary: NoSuchMethodError:
shaded.parquet.org.apache.thrift.EncodingUtils.setBit(BIZ)B
Key: SPARK-28943
URL: https://issues.apache.org/jira/browse/SPARK-28943
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921700#comment-16921700
]
Michael Heuer edited comment on SPARK-27781 at 9/11/19 7:47 PM:
-This is
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer resolved SPARK-27781.
---
Fix Version/s: 2.4.4
Resolution: Fixed
> Tried to access method
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16927953#comment-16927953
]
Michael Heuer commented on SPARK-27781:
---
This issue has been fixed in Spark 2.4.4, and fixed in
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-27781:
--
Affects Version/s: (was: 2.4.4)
> Tried to access method
[
https://issues.apache.org/jira/browse/SPARK-27781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16921700#comment-16921700
]
Michael Heuer edited comment on SPARK-27781 at 9/11/19 7:46 PM:
-This is
[
https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889573#comment-16889573
]
Michael Heuer edited comment on SPARK-28457 at 7/20/19 7:12 PM:
We're
[
https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889573#comment-16889573
]
Michael Heuer edited comment on SPARK-28457 at 7/20/19 7:12 PM:
We're
[
https://issues.apache.org/jira/browse/SPARK-28457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889573#comment-16889573
]
Michael Heuer commented on SPARK-28457:
---
We're also seeing this in [our CI
Michael Heuer created SPARK-30833:
-
Summary: Extract o.a.s.sql.catalyst.util.ParseMode to external
project
Key: SPARK-30833
URL: https://issues.apache.org/jira/browse/SPARK-30833
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Heuer updated SPARK-30833:
--
Description:
In multiple projects downstream of Spark, we use an enum
{code:java}
enum
[
https://issues.apache.org/jira/browse/SPARK-31097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055396#comment-17055396
]
Michael Heuer commented on SPARK-31097:
---
Thank you, [~shaneknapp]!
> Expired SSL cert on Spark
[
https://issues.apache.org/jira/browse/SPARK-31097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055404#comment-17055404
]
Michael Heuer commented on SPARK-31097:
---
Ah, don't worry about it. My comment was only meant to
[
https://issues.apache.org/jira/browse/SPARK-31097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055339#comment-17055339
]
Michael Heuer commented on SPARK-31097:
---
Will do, thank you for your help, [~shaneknapp]
>
[
https://issues.apache.org/jira/browse/SPARK-31097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17055393#comment-17055393
]
Michael Heuer commented on SPARK-31097:
---
Please close as CannotReproduce.
> Expired SSL cert
Michael Heuer created SPARK-31097:
-
Summary: Expired SSL cert on Spark 2.4.5 download
Key: SPARK-31097
URL: https://issues.apache.org/jira/browse/SPARK-31097
Project: Spark
Issue Type: Task
[
https://issues.apache.org/jira/browse/SPARK-27733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17201156#comment-17201156
]
Michael Heuer commented on SPARK-27733:
---
I can also participate in the Parquet sync meeting.
[
https://issues.apache.org/jira/browse/SPARK-34276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17274065#comment-17274065
]
Michael Heuer commented on SPARK-34276:
---
This downstream pull request builds on the recently
67 matches
Mail list logo
