[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248899#comment-17248899 ] Simon edited comment on SPARK-33571 at 12/14/20, 10:51 AM: --- [~

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17248899#comment-17248899 ] Simon commented on SPARK-33571: --- [~maxgekk]OK, all clear. Thanks again for the clarificati

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:14 PM: - [~maxg

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:13 PM: - [~maxg

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:13 PM: - [~maxg

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245969#comment-17245969 ] Simon edited comment on SPARK-33571 at 12/8/20, 4:13 PM: - [~maxg

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17245969#comment-17245969 ] Simon commented on SPARK-33571: --- [~maxgekk] Thanks for taking the time to look into this,

[jira] [Updated] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon updated SPARK-33571: -- Description: The handling of old dates written with older Spark versions (<2.4.6) using the hybrid calendar i

[jira] [Updated] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon updated SPARK-33571: -- Description: The handling of old dates written with older Spark versions (<2.4.6) using the hybrid calendar i

[jira] [Updated] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon updated SPARK-33571: -- Component/s: PySpark > Handling of hybrid to proleptic calendar when reading and writing Parquet > data not w

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239204#comment-17239204 ] Simon commented on SPARK-33571: --- Below the output of the date testscript with the noise re

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239204#comment-17239204 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:16 AM: --- Be

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:11 AM: --- Be

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:11 AM: --- Be

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:07 AM: --- Be

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:06 AM: --- Be

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:06 AM: --- Be

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:05 AM: --- Be

[jira] [Commented] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon commented on SPARK-33571: --- Below the output of the timestamp test script with the no

[jira] [Comment Edited] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

[ https://issues.apache.org/jira/browse/SPARK-33571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17239193#comment-17239193 ] Simon edited comment on SPARK-33571 at 11/26/20, 11:03 AM: --- Be

[jira] [Created] (SPARK-33571) Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly

Simon created SPARK-33571: - Summary: Handling of hybrid to proleptic calendar when reading and writing Parquet data not working correctly Key: SPARK-33571 URL: https://issues.apache.org/jira/browse/SPARK-33571

[jira] [Commented] (SPARK-23663) Spark Streaming Kafka 010 , fails with "java.util.ConcurrentModificationException: KafkaConsumer is not safe for multi-threaded access"

[ https://issues.apache.org/jira/browse/SPARK-23663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16595035#comment-16595035 ] Peter Simon commented on SPARK-23663: - [~gsomogyi] isn't this the same as SPARK-1918

[jira] [Commented] (SPARK-4781) Column values become all NULL after doing ALTER TABLE CHANGE for renaming column names (Parquet external table in HiveContext)

[ https://issues.apache.org/jira/browse/SPARK-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16453861#comment-16453861 ] Peter Simon commented on SPARK-4781: As commented under SPARK-11748,  Possible workar

[jira] [Commented] (SPARK-11748) Result is null after alter column name of table stored as Parquet

[ https://issues.apache.org/jira/browse/SPARK-11748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16453858#comment-16453858 ] Peter Simon commented on SPARK-11748: - Possible workaround can be: {code:java} scala>

[jira] [Updated] (SPARK-4818) Join operation should use iterator/lazy evaluation

[ https://issues.apache.org/jira/browse/SPARK-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Simon updated SPARK-4818: -- Issue Type: Bug (was: Improvement) > Join operation should use iterator/lazy evaluation > -

[jira] [Updated] (SPARK-4818) Join operation should use iterator/lazy evaluation

[ https://issues.apache.org/jira/browse/SPARK-4818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Johannes Simon updated SPARK-4818: -- Priority: Major (was: Minor) > Join operation should use iterator/lazy evaluation > ---

[jira] [Created] (SPARK-4818) Join operation should use iterator/lazy evaluation

Johannes Simon created SPARK-4818: - Summary: Join operation should use iterator/lazy evaluation Key: SPARK-4818 URL: https://issues.apache.org/jira/browse/SPARK-4818 Project: Spark Issue Type