[
https://issues.apache.org/jira/browse/SPARK-25832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25832:
--
Priority: Blocker (was: Major)
> remove newly added map related functions from
[
https://issues.apache.org/jira/browse/SPARK-25832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25832:
Assignee: Apache Spark (was: Wenchen Fan)
> remove newly added map related functions
[
https://issues.apache.org/jira/browse/SPARK-25832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25832:
Assignee: Wenchen Fan (was: Apache Spark)
> remove newly added map related functions
[
https://issues.apache.org/jira/browse/SPARK-25832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663233#comment-16663233
]
Apache Spark commented on SPARK-25832:
--
User 'cloud-fan' has created a pull request for this issue:
Wenchen Fan created SPARK-25832:
---
Summary: remove newly added map related functions from
FunctionRegistry
Key: SPARK-25832
URL: https://issues.apache.org/jira/browse/SPARK-25832
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663230#comment-16663230
]
Dongjoon Hyun commented on SPARK-25829:
---
Thank you for further investigation! Both tasks look not
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663121#comment-16663121
]
Wenchen Fan commented on SPARK-25829:
-
If we decide to follow "later entry wins", the following
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663118#comment-16663118
]
Wenchen Fan commented on SPARK-25829:
-
More investigation on "later entry wins".
If we still allow
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663103#comment-16663103
]
Wenchen Fan edited comment on SPARK-25829 at 10/25/18 2:20 AM:
---
After more
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663103#comment-16663103
]
Wenchen Fan commented on SPARK-25829:
-
After more thoughts, both the map lookup behavior and
[
https://issues.apache.org/jira/browse/SPARK-24917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-24917.
---
Resolution: Won't Fix
Evidently obsoleted by the update to Netty 4.1.30
> Sending a partition over
[
https://issues.apache.org/jira/browse/SPARK-25830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-25830:
Description:
{code}
scala> sql("select map(1,2,1,3)").collect
res14:
[
https://issues.apache.org/jira/browse/SPARK-25831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-25831:
Description:
{code}
scala> sql("CREATE TABLE t AS SELECT map(1,2,1,3) as map")
res11:
Wenchen Fan created SPARK-25831:
---
Summary: should apply "earlier entry wins" in hive map value
converter
Key: SPARK-25831
URL: https://issues.apache.org/jira/browse/SPARK-25831
Project: Spark
Wenchen Fan created SPARK-25830:
---
Summary: should apply "earlier entry wins" in Dataset.collect
Key: SPARK-25830
URL: https://issues.apache.org/jira/browse/SPARK-25830
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-25824:
Issue Type: Sub-task (was: Bug)
Parent: SPARK-25829
> Remove duplicated map entries in
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-25829:
Description:
In Spark SQL, we apply "earlier entry wins" semantic to duplicated map keys.
e.g.
[
https://issues.apache.org/jira/browse/SPARK-25829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-25829:
Description:
In Spark SQL, we apply "earlier entry wins" semantic to duplicated map keys.
e.g.
Wenchen Fan created SPARK-25829:
---
Summary: Duplicated map keys are not handled consistently
Key: SPARK-25829
URL: https://issues.apache.org/jira/browse/SPARK-25829
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663060#comment-16663060
]
Dongjoon Hyun commented on SPARK-25824:
---
According to [~cloud_fan]'s analysis, this one is
[
https://issues.apache.org/jira/browse/SPARK-25824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25824:
--
Issue Type: Bug (was: Improvement)
> Remove duplicated map entries in `showString`
>
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663045#comment-16663045
]
Apache Spark commented on SPARK-25828:
--
User 'ifilonenko' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663043#comment-16663043
]
Apache Spark commented on SPARK-25828:
--
User 'ifilonenko' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25828:
Assignee: Apache Spark
> Bumping Version of kubernetes.client to latest version
>
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25828:
Assignee: (was: Apache Spark)
> Bumping Version of kubernetes.client to latest
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16663033#comment-16663033
]
Stavros Kontopoulos commented on SPARK-25828:
-
Cool [~eje] [~ifilonenko] are you working on
[
https://issues.apache.org/jira/browse/SPARK-23229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-23229.
---
Resolution: Won't Fix
> Dataset.hint should use planWithBarrier logical plan
>
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662978#comment-16662978
]
Erik Erlandson commented on SPARK-25828:
cc [~skonto]
> Bumping Version of kubernetes.client to
[
https://issues.apache.org/jira/browse/SPARK-25828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ilan Filonenko updated SPARK-25828:
---
Description:
Upgrade the Kubernetes client version to at least
Ilan Filonenko created SPARK-25828:
--
Summary: Bumping Version of kubernetes.client to latest version
Key: SPARK-25828
URL: https://issues.apache.org/jira/browse/SPARK-25828
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-24899.
---
Resolution: Won't Fix
> Add example of monotonically_increasing_id standard function to scaladoc
>
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-25490:
-
Assignee: Gengliang Wang
> Refactor KryoBenchmark
> --
>
>
[
https://issues.apache.org/jira/browse/SPARK-25490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25490.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22663
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662899#comment-16662899
]
Dongjoon Hyun commented on SPARK-25823:
---
Right. That one is cosmetic. I send my opinion on dev
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662899#comment-16662899
]
Dongjoon Hyun edited comment on SPARK-25823 at 10/24/18 9:42 PM:
-
Right.
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662891#comment-16662891
]
Sean Owen commented on SPARK-25823:
---
I was referring to your comment at
[
https://issues.apache.org/jira/browse/SPARK-25807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662830#comment-16662830
]
kevin yu commented on SPARK-25807:
--
Thanks Sean, ok, I will leave as it is.
> Mitigate 1-based
[
https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662750#comment-16662750
]
Kevin Grealish edited comment on SPARK-23015 at 10/24/18 8:51 PM:
--
One
[
https://issues.apache.org/jira/browse/SPARK-25827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25827:
Assignee: Apache Spark
> Replicating a block > 2gb with encryption fails
>
[
https://issues.apache.org/jira/browse/SPARK-25827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25827:
Assignee: (was: Apache Spark)
> Replicating a block > 2gb with encryption fails
>
[
https://issues.apache.org/jira/browse/SPARK-25827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662825#comment-16662825
]
Apache Spark commented on SPARK-25827:
--
User 'squito' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25807:
--
Target Version/s: (was: 2.4.0, 2.4.1, 2.5.0, 3.0.0)
> Mitigate 1-based substr() confusion
>
[
https://issues.apache.org/jira/browse/SPARK-25807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662817#comment-16662817
]
Sean Owen commented on SPARK-25807:
---
They are meant to match Hive, SQL. They should not match Java,
Imran Rashid created SPARK-25827:
Summary: Replicating a block > 2gb with encryption fails
Key: SPARK-25827
URL: https://issues.apache.org/jira/browse/SPARK-25827
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662760#comment-16662760
]
Dongjoon Hyun commented on SPARK-25823:
---
For me, this is a `data correctness` issue at
[
https://issues.apache.org/jira/browse/SPARK-25815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662761#comment-16662761
]
Marcelo Vanzin commented on SPARK-25815:
I actually have this working (and also I'm adding
[
https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662750#comment-16662750
]
Kevin Grealish edited comment on SPARK-23015 at 10/24/18 7:47 PM:
--
One
[
https://issues.apache.org/jira/browse/SPARK-25737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25737:
--
Description:
In ancient times in 2013, JavaSparkContext got a superclass
[
https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662750#comment-16662750
]
Kevin Grealish edited comment on SPARK-23015 at 10/24/18 7:45 PM:
--
One
[
https://issues.apache.org/jira/browse/SPARK-25737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25737:
--
Labels: release-notes (was: )
> Remove JavaSparkContextVarargsWorkaround and standardize union()
[
https://issues.apache.org/jira/browse/SPARK-23015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662750#comment-16662750
]
Kevin Grealish commented on SPARK-23015:
One workaround is to create a temp directory in temp
[
https://issues.apache.org/jira/browse/SPARK-25737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25737.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22729
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662743#comment-16662743
]
Dongjoon Hyun commented on SPARK-25823:
---
Sorry, but who says this issue is cosmetic? I think you
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662737#comment-16662737
]
Sean Owen commented on SPARK-25823:
---
Got it, you're saying that's cosmetic. But I understood from here
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662735#comment-16662735
]
Dongjoon Hyun commented on SPARK-25823:
---
[~srowen] and [~cloud_fan]. To be clear,
- This issue
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662726#comment-16662726
]
Dongjoon Hyun edited comment on SPARK-25823 at 10/24/18 7:31 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662726#comment-16662726
]
Dongjoon Hyun commented on SPARK-25823:
---
[~srowen]. I commend on SPARK-25824. Please see there.
>
[
https://issues.apache.org/jira/browse/SPARK-25824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662725#comment-16662725
]
Dongjoon Hyun commented on SPARK-25824:
---
[~srowen]. Please see the description. The string
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662717#comment-16662717
]
Sean Owen commented on SPARK-25823:
---
Hm, another tough one. It's not so much about what these new
[
https://issues.apache.org/jira/browse/SPARK-25826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ilan Filonenko updated SPARK-25826:
---
Description: This is the umbrella issue for all Kerberos related tasks with
relation to
Ilan Filonenko created SPARK-25826:
--
Summary: Kerberos Support in Kubernetes
Key: SPARK-25826
URL: https://issues.apache.org/jira/browse/SPARK-25826
Project: Spark
Issue Type: Umbrella
Ilan Filonenko created SPARK-25825:
--
Summary: Kerberos Support for Long Running Jobs in Kubernetes
Key: SPARK-25825
URL: https://issues.apache.org/jira/browse/SPARK-25825
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25816:
Assignee: Apache Spark
> Functions does not resolve Columns correctly
>
[
https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662688#comment-16662688
]
Apache Spark commented on SPARK-25816:
--
User 'peter-toth' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-25816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25816:
Assignee: (was: Apache Spark)
> Functions does not resolve Columns correctly
>
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662673#comment-16662673
]
Dongjoon Hyun commented on SPARK-25823:
---
Ah, got it. I thought a different one. For mine, I
[
https://issues.apache.org/jira/browse/SPARK-25824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662670#comment-16662670
]
Dongjoon Hyun commented on SPARK-25824:
---
cc [~maropu]
> Remove duplicated map entries in
[
https://issues.apache.org/jira/browse/SPARK-14989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662668#comment-16662668
]
nirav patel commented on SPARK-14989:
-
Any updates on this? Spark 2.2 still uses Jackson 1.9.13!
Dongjoon Hyun created SPARK-25824:
-
Summary: Remove duplicated map entries in `showString`
Key: SPARK-25824
URL: https://issues.apache.org/jira/browse/SPARK-25824
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662666#comment-16662666
]
Wenchen Fan commented on SPARK-25823:
-
Anyway we should make map lookup and toString/collect
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662660#comment-16662660
]
Dongjoon Hyun edited comment on SPARK-25823 at 10/24/18 6:38 PM:
-
Ur, I
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662660#comment-16662660
]
Dongjoon Hyun commented on SPARK-25823:
---
BTW, [~cloud_fan]. I'm looking around this issue. I'll
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662646#comment-16662646
]
Wenchen Fan commented on SPARK-25823:
-
[~dongjoon] good catch! I think we should update collect to
[
https://issues.apache.org/jira/browse/SPARK-25812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25812:
--
Component/s: Tests
> Flaky test: PagedTableSuite.pageNavigation
>
[
https://issues.apache.org/jira/browse/SPARK-23415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-23415:
--
Component/s: Tests
> BufferHolderSparkSubmitSuite is flaky
>
[
https://issues.apache.org/jira/browse/SPARK-25542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25542:
--
Component/s: Tests
> Flaky test: OpenHashMapSuite
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-23622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-23622:
--
Component/s: Tests
> Flaky Test: HiveClientSuites
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-25792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25792:
--
Component/s: Tests
> Flaky test: BarrierStageOnSubmittedSuite."submit a barrier ResultStage
[
https://issues.apache.org/jira/browse/SPARK-24318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24318:
--
Component/s: Tests
> Flaky test: SortShuffleSuite
>
>
>
[
https://issues.apache.org/jira/browse/SPARK-24285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24285:
--
Component/s: Tests
> Flaky test: ContinuousSuite.query without test harness
>
[
https://issues.apache.org/jira/browse/SPARK-24153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24153:
--
Component/s: Tests
> Flaky Test: DirectKafkaStreamSuite
> --
[
https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24239:
--
Component/s: Tests
> Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from
>
[
https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24211:
--
Component/s: Tests
> Flaky test: StreamingOuterJoinSuite
>
[
https://issues.apache.org/jira/browse/SPARK-24173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24173:
--
Component/s: Tests
> Flaky Test: VersionsSuite
> -
>
>
[
https://issues.apache.org/jira/browse/SPARK-24140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662637#comment-16662637
]
Dongjoon Hyun commented on SPARK-24140:
---
Sorry, I don't have new links. You may take a look at the
[
https://issues.apache.org/jira/browse/SPARK-24140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-24140:
--
Component/s: Tests
> Flaky test: KMeansClusterSuite.task size should be small in both
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662618#comment-16662618
]
Dongjoon Hyun edited comment on SPARK-25823 at 10/24/18 5:59 PM:
-
Right.
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662618#comment-16662618
]
Dongjoon Hyun commented on SPARK-25823:
---
Right. This is a long lasting issue when CreateMap added.
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25823:
--
Labels: correctness (was: )
> map_filter can generate incorrect data
>
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662616#comment-16662616
]
Wenchen Fan commented on SPARK-25823:
-
BTW one improvement we can do is to remove duplicated map
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662613#comment-16662613
]
Wenchen Fan commented on SPARK-25823:
-
I did a few experiments
{code}
scala> sql("SELECT
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-25823:
--
Description:
This is not a regression because this occurs in new high-order functions like
[
https://issues.apache.org/jira/browse/SPARK-25823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662583#comment-16662583
]
Dongjoon Hyun commented on SPARK-25823:
---
cc [~cloud_fan], [~srowen], [~smilegator],
[
https://issues.apache.org/jira/browse/SPARK-25822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662582#comment-16662582
]
Apache Spark commented on SPARK-25822:
--
User 'zsxwing' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-25822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25822:
Assignee: Shixiong Zhu (was: Apache Spark)
> Fix a race condition when releasing a
[
https://issues.apache.org/jira/browse/SPARK-25822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25822:
Assignee: Apache Spark (was: Shixiong Zhu)
> Fix a race condition when releasing a
[
https://issues.apache.org/jira/browse/SPARK-25822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16662580#comment-16662580
]
Apache Spark commented on SPARK-25822:
--
User 'zsxwing' has created a pull request for this issue:
Dongjoon Hyun created SPARK-25823:
-
Summary: map_filter can generate incorrect data
Key: SPARK-25823
URL: https://issues.apache.org/jira/browse/SPARK-25823
Project: Spark
Issue Type: Bug
Shixiong Zhu created SPARK-25822:
Summary: Fix a race condition when releasing a Python worker
Key: SPARK-25822
URL: https://issues.apache.org/jira/browse/SPARK-25822
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-25798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bryan Cutler resolved SPARK-25798.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22795
1 - 100 of 134 matches
Mail list logo
