[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031065#comment-17031065
]
Dongjoon Hyun commented on SPARK-30735:
---
Hi, [~tom_tanaka]. Thank you for filing a JIRA and making
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30735:
--
Component/s: (was: Spark Core)
SQL
> Improving writing performance by
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30735:
--
Target Version/s: (was: 3.0.0, 3.1.0)
> Improving writing performance by adding repartition
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30735:
--
Fix Version/s: (was: 3.1.0)
(was: 3.0.0)
> Improving writing
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30735:
--
Flags: (was: Important)
> Improving writing performance by adding repartition based on
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30735:
--
Affects Version/s: (was: 2.4.4)
(was: 2.4.3)
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031065#comment-17031065
]
Dongjoon Hyun edited comment on SPARK-30735 at 2/5/20 9:49 PM:
---
Hi,
[
https://issues.apache.org/jira/browse/SPARK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30721:
-
Assignee: Wenchen Fan
> fix DataFrameAggregateSuite when enabling AQE
>
[
https://issues.apache.org/jira/browse/SPARK-30721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30721.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27451
[
https://issues.apache.org/jira/browse/SPARK-28478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28478:
--
Component/s: (was: Optimizer)
> Optimizer rule to remove unnecessary explicit null checks
[
https://issues.apache.org/jira/browse/SPARK-28880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030974#comment-17030974
]
Xiao Li commented on SPARK-28880:
-
[
https://issues.apache.org/jira/browse/SPARK-30740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nhufas updated SPARK-30740:
---
Description:
months_between not calculating right for February
example
{{select }}
{{
nhufas created SPARK-30740:
--
Summary: months_between wrong calculation
Key: SPARK-30740
URL: https://issues.apache.org/jira/browse/SPARK-30740
Project: Spark
Issue Type: Bug
Components:
[
https://issues.apache.org/jira/browse/SPARK-30741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gary Liu updated SPARK-30741:
-
Attachment: SparkBug.png
> The data returned from SAS using JDBC reader contains column label
>
[
https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030961#comment-17030961
]
Sunitha Kambhampati commented on SPARK-27298:
-
I tried on linux as well with the spark
[
https://issues.apache.org/jira/browse/SPARK-28478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-28478:
--
Affects Version/s: (was: 3.0.0)
3.1.0
> Optimizer rule to remove
[
https://issues.apache.org/jira/browse/SPARK-30636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-30636.
-
Fix Version/s: 3.0.0
Assignee: Cheng Lian (was: Burak Yavuz)
Resolution: Fixed
>
[
https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-20384:
--
Component/s: (was: Optimizer)
> supporting value classes over primitives in DataSets
>
[
https://issues.apache.org/jira/browse/SPARK-30523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30523:
--
Affects Version/s: (was: 3.0.0)
3.1.0
> Collapse back to back
[
https://issues.apache.org/jira/browse/SPARK-30523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30523:
--
Component/s: (was: Optimizer)
SQL
> Collapse back to back aggregations
Gary Liu created SPARK-30741:
Summary: The data returned from SAS using JDBC reader contains
column label
Key: SPARK-30741
URL: https://issues.apache.org/jira/browse/SPARK-30741
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030968#comment-17030968
]
Sunitha Kambhampati commented on SPARK-27298:
-
If you get a chance to repro the issue again,
[
https://issues.apache.org/jira/browse/SPARK-20384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-20384:
--
Affects Version/s: (was: 2.1.0)
3.1.0
> supporting value classes
[
https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30738.
---
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27465
Thomas Graves created SPARK-30742:
-
Summary: Resource discovery should protect against user returing
empty string for address
Key: SPARK-30742
URL: https://issues.apache.org/jira/browse/SPARK-30742
Dongjoon Hyun created SPARK-30743:
-
Summary: Use JRE instead of JDK in K8S integration test
Key: SPARK-30743
URL: https://issues.apache.org/jira/browse/SPARK-30743
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-30746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Viktor Bogdanov updated SPARK-30746:
Description:
Add a configuration parameter to add environment variables to executor and
[
https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30122.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27034
[
https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30122:
--
Affects Version/s: (was: 3.0.0)
3.1.0
> Allow setting
[
https://issues.apache.org/jira/browse/SPARK-30711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031276#comment-17031276
]
Kazuaki Ishizaki commented on SPARK-30711:
--
Now, I am looking at this with master branch at
[
https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031084#comment-17031084
]
Artsiom Yudovin commented on SPARK-30122:
-
(y)
> Allow setting serviceAccountName for executor
[
https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30122:
-
Assignee: Artsiom Yudovin
> Allow setting serviceAccountName for executor pods
>
[
https://issues.apache.org/jira/browse/SPARK-30122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031085#comment-17031085
]
Dongjoon Hyun commented on SPARK-30122:
---
Thank YOU, [~ayudovin].
> Allow setting
[
https://issues.apache.org/jira/browse/SPARK-30735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031099#comment-17031099
]
Tomohiro Tanaka commented on SPARK-30735:
-
Hello, [~dongjoon]! Thanks for your checking this
[
https://issues.apache.org/jira/browse/SPARK-27262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-27262.
--
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-30737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-30737.
--
Fix Version/s: 3.0.0
2.4.5
Resolution: Fixed
Issue resolved by pull
wuyi created SPARK-30744:
Summary: Optimize AnalyzePartitionCommand by calculating location
sizes in parallel
Key: SPARK-30744
URL: https://issues.apache.org/jira/browse/SPARK-30744
Project: Spark
Harneet K created SPARK-30745:
-
Summary: Spark streaming, kafka broker error, "Failed to get
records for spark-executor- after polling for 512"
Key: SPARK-30745
URL:
[
https://issues.apache.org/jira/browse/SPARK-30745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Harneet K updated SPARK-30745:
--
Description:
We have a spark streaming application reading data from Kafka.
Data size: 15 Million
[
https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30743.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27469
[
https://issues.apache.org/jira/browse/SPARK-30743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30743:
-
Assignee: Dongjoon Hyun
> Use JRE instead of JDK in K8S integration test
>
Viktor Bogdanov created SPARK-30746:
---
Summary: support envFrom configMapRef
Key: SPARK-30746
URL: https://issues.apache.org/jira/browse/SPARK-30746
Project: Spark
Issue Type: New Feature
[
https://issues.apache.org/jira/browse/SPARK-28067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16879735#comment-16879735
]
Mark Sirek edited comment on SPARK-28067 at 2/6/20 1:08 AM:
I tried the test
[
https://issues.apache.org/jira/browse/SPARK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30729.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27455
[
https://issues.apache.org/jira/browse/SPARK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30729:
---
Assignee: wuyi
> Eagerly filter out zombie TaskSetManager before offering resources
>
[
https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mahima Khatri updated SPARK-27298:
--
Attachment: Linux-spark-2.4.4_result.txt
Linux-spark-2.3.0_result.txt
>
[
https://issues.apache.org/jira/browse/SPARK-27298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031318#comment-17031318
]
Mahima Khatri commented on SPARK-27298:
---
@Sunita ,We tested the bug with
[
https://issues.apache.org/jira/browse/SPARK-30595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031309#comment-17031309
]
Prashant Sharma commented on SPARK-30595:
-
Resolving this as not a problem, as this was a
[
https://issues.apache.org/jira/browse/SPARK-30595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prashant Sharma resolved SPARK-30595.
-
Resolution: Not A Problem
> Unable to create local temp dir on spark on k8s mode, with
[
https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30612:
---
Assignee: Terry Kim
> can't resolve qualified column name with v2 tables
>
[
https://issues.apache.org/jira/browse/SPARK-30612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30612.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27391
[
https://issues.apache.org/jira/browse/SPARK-20964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030440#comment-17030440
]
Dongjoon Hyun commented on SPARK-20964:
---
Thanks!
> Make some keywords reserved along with the
[
https://issues.apache.org/jira/browse/SPARK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30715:
-
Assignee: Onur Satici
> Upgrade fabric8 to 4.7.1 to support K8s 1.17
>
[
https://issues.apache.org/jira/browse/SPARK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-30715.
---
Fix Version/s: 3.1.0
Resolution: Fixed
Issue resolved by pull request 27443
[
https://issues.apache.org/jira/browse/SPARK-30594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30594:
---
Assignee: wuyi
> Do not post SparkListenerBlockUpdated when updateBlockInfo returns false
[
https://issues.apache.org/jira/browse/SPARK-30594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30594.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27306
[
https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030472#comment-17030472
]
Maxim Gekk commented on SPARK-30730:
[~cloud_fan] [~srowen] [~hyukjin.kwon] Please, have a look at
[
https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30738:
--
Summary: Fix "Launcher client dependencies" test (was: Fix flaky "Launcher
client
[
https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun reassigned SPARK-30738:
-
Target Version/s: 3.0.0
Assignee: Dongjoon Hyun
> Use specific image
[
https://issues.apache.org/jira/browse/SPARK-30722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-30722:
-
Target Version/s: 3.0.0
> Document type hints in pandas UDF
> -
Dongjoon Hyun created SPARK-30738:
-
Summary: Fix flaky "Launcher client dependencies" test
Key: SPARK-30738
URL: https://issues.apache.org/jira/browse/SPARK-30738
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-30506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30506.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27302
[
https://issues.apache.org/jira/browse/SPARK-30506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30506:
---
Assignee: wuyi
> Document general file source options
>
[
https://issues.apache.org/jira/browse/SPARK-30738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-30738:
--
Summary: Use specific image version in "Launcher client dependencies" test
(was: Fix
[
https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-30668.
-
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 27441
[
https://issues.apache.org/jira/browse/SPARK-30668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-30668:
---
Assignee: Maxim Gekk
> to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using
[
https://issues.apache.org/jira/browse/SPARK-30686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030653#comment-17030653
]
Behroz Sikander commented on SPARK-30686:
-
I have pinged. I hope someone can help with the
[
https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030723#comment-17030723
]
Sean R. Owen commented on SPARK-30730:
--
Is it a regression? just asking if it means it must be in
[
https://issues.apache.org/jira/browse/SPARK-30730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030742#comment-17030742
]
Maxim Gekk commented on SPARK-30730:
[~srowen] Since Spark 2.2, CAST uses the session time zone. In
Ohad Raviv created SPARK-30739:
--
Summary: unable to turn off Hadoop's trash feature
Key: SPARK-30739
URL: https://issues.apache.org/jira/browse/SPARK-30739
Project: Spark
Issue Type: Bug
70 matches
Mail list logo