[jira] [Updated] (SPARK-32082) Project Zen: Improving Python usability

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32082: - Summary: Project Zen: Improving Python usability (was: The importance of Python and PySpark

[jira] [Commented] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Smith Cruise (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143579#comment-17143579 ] Smith Cruise commented on SPARK-32068: -- OK, I have uploaded it. > Spark 3 UI task launch time show

[jira] [Updated] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Smith Cruise (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Smith Cruise updated SPARK-32068: - Attachment: incorrect.png correct.png > Spark 3 UI task launch time show in

[jira] [Updated] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Smith Cruise (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Smith Cruise updated SPARK-32068: - Description: For example, In this link: history/app-20200623133209-0015/stages/ , stage submit

[jira] [Updated] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Smith Cruise (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Smith Cruise updated SPARK-32068: - Attachment: (was: 未命名.png) > Spark 3 UI task launch time show in error time zone >

[jira] [Updated] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Smith Cruise (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Smith Cruise updated SPARK-32068: - Attachment: 未命名.png > Spark 3 UI task launch time show in error time zone >

[jira] [Comment Edited] (SPARK-32063) Spark native temporary table

2020-06-24 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143575#comment-17143575 ] Lantao Jin edited comment on SPARK-32063 at 6/24/20, 6:53 AM: -- [~viirya]

[jira] [Commented] (SPARK-32063) Spark native temporary table

2020-06-24 Thread Lantao Jin (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143575#comment-17143575 ] Lantao Jin commented on SPARK-32063: For 1, even RDD cache or table cache can improve performance,

[jira] [Commented] (SPARK-30466) remove dependency on jackson-mapper-asl-1.9.13 and jackson-core-asl-1.9.13

2020-06-24 Thread Prashant Sharma (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143569#comment-17143569 ] Prashant Sharma commented on SPARK-30466: - I just saw, Hadoop 3.2.1 still uses these

[jira] [Resolved] (SPARK-32074) Update AppVeyor R to 4.0.2

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32074. -- Fix Version/s: 3.1.0 Resolution: Fixed Fixed in

[jira] [Commented] (SPARK-25244) [Python] Setting `spark.sql.session.timeZone` only partially respected

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-25244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143566#comment-17143566 ] Hyukjin Kwon commented on SPARK-25244: -- This issue was closed because it marked the affected

[jira] [Commented] (SPARK-31887) Date casting to string is giving wrong value

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143564#comment-17143564 ] Hyukjin Kwon commented on SPARK-31887: -- The changes that fixed this issue is likely about calendar

[jira] [Commented] (SPARK-27281) Wrong latest offsets returned by DirectKafkaInputDStream#latestOffsets

2020-06-24 Thread Yuanyuan Xia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143562#comment-17143562 ] Yuanyuan Xia commented on SPARK-27281: -- In our environment, we encounter the same issue and the

[jira] [Issue Comment Deleted] (SPARK-27281) Wrong latest offsets returned by DirectKafkaInputDStream#latestOffsets

2020-06-24 Thread Yuanyuan Xia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanyuan Xia updated SPARK-27281: - Comment: was deleted (was: In our environment, we encounter the same issue and the cause seems

[jira] [Commented] (SPARK-27281) Wrong latest offsets returned by DirectKafkaInputDStream#latestOffsets

2020-06-24 Thread Yuanyuan Xia (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143561#comment-17143561 ] Yuanyuan Xia commented on SPARK-27281: -- In our environment, we encounter the same issue and the

[jira] [Resolved] (SPARK-32050) GBTClassifier not working with OnevsRest

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32050. -- Resolution: Duplicate > GBTClassifier not working with OnevsRest >

[jira] [Updated] (SPARK-32051) Dataset.foreachPartition returns object

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32051: - Priority: Major (was: Critical) > Dataset.foreachPartition returns object >

[jira] [Resolved] (SPARK-32053) pyspark save of serialized model is failing for windows.

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32053. -- Resolution: Incomplete > pyspark save of serialized model is failing for windows. >

[jira] [Commented] (SPARK-32053) pyspark save of serialized model is failing for windows.

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143557#comment-17143557 ] Hyukjin Kwon commented on SPARK-32053: -- [~kaganesa] Spark 2.3.0 is EOL so we won't be able to land

[jira] [Commented] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143556#comment-17143556 ] Hyukjin Kwon commented on SPARK-32068: -- [~d87904488] can you attach the snapshots? > Spark 3 UI

[jira] [Comment Edited] (SPARK-32068) Spark 3 UI task launch time show in error time zone

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143556#comment-17143556 ] Hyukjin Kwon edited comment on SPARK-32068 at 6/24/20, 6:24 AM:

[jira] [Commented] (SPARK-32081) facing Invalid UTF-32 character v2.4.5 running pyspark

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143554#comment-17143554 ] Hyukjin Kwon commented on SPARK-32081: -- Please just don't copy and paste the errors. The error

[jira] [Resolved] (SPARK-32081) facing Invalid UTF-32 character v2.4.5 running pyspark

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-32081. -- Resolution: Cannot Reproduce > facing Invalid UTF-32 character v2.4.5 running pyspark >

[jira] [Updated] (SPARK-32081) facing Invalid UTF-32 character v2.4.5 running pyspark

2020-06-24 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-32081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-32081: - Priority: Major (was: Blocker) > facing Invalid UTF-32 character v2.4.5 running pyspark >

[jira] [Commented] (SPARK-31998) Change package references for ArrowBuf

2020-06-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143553#comment-17143553 ] Apache Spark commented on SPARK-31998: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-31998) Change package references for ArrowBuf

2020-06-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31998: Assignee: Apache Spark > Change package references for ArrowBuf >

[jira] [Assigned] (SPARK-31998) Change package references for ArrowBuf

2020-06-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-31998: Assignee: (was: Apache Spark) > Change package references for ArrowBuf >

[jira] [Commented] (SPARK-31998) Change package references for ArrowBuf

2020-06-24 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17143551#comment-17143551 ] Apache Spark commented on SPARK-31998: -- User 'BryanCutler' has created a pull request for this

<    1   2