[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22347:
Assignee: (was: Apache Spark)
> UDF is evaluated when 'F.when' condition is false
>
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22347:
Assignee: Apache Spark
> UDF is evaluated when 'F.when' condition is false
>
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221719#comment-16221719
]
Apache Spark commented on SPARK-22347:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221612#comment-16221612
]
Liang-Chi Hsieh edited comment on SPARK-22347 at 10/27/17 5:06 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221612#comment-16221612
]
Liang-Chi Hsieh edited comment on SPARK-22347 at 10/27/17 5:05 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221687#comment-16221687
]
Ilya Matiach commented on SPARK-18755:
--
I've created a PR that adds randomized grid search to
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221612#comment-16221612
]
Liang-Chi Hsieh edited comment on SPARK-22347 at 10/27/17 2:44 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221612#comment-16221612
]
Liang-Chi Hsieh commented on SPARK-22347:
-
Under the current execution mode of Python UDFs, I
[
https://issues.apache.org/jira/browse/SPARK-22355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22355.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
> Dataset.collect is not
[
https://issues.apache.org/jira/browse/SPARK-22356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22356.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
> data source table should
[
https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu resolved SPARK-22366.
--
Resolution: Fixed
Assignee: Jose Torres
Fix Version/s: 2.3.0
> Support
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221460#comment-16221460
]
Hossein Falaki commented on SPARK-22344:
I don't have solid pointer as to why we are creating
[
https://issues.apache.org/jira/browse/SPARK-22305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221432#comment-16221432
]
Shixiong Zhu commented on SPARK-22305:
--
[~Yuval.Itzchakov] how many batches per 1 minute in your
[
https://issues.apache.org/jira/browse/SPARK-22339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22339:
Assignee: (was: Apache Spark)
> Push epoch updates to executors on fetch failure to
[
https://issues.apache.org/jira/browse/SPARK-22339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221423#comment-16221423
]
Apache Spark commented on SPARK-22339:
--
User 'juanrh' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22339:
Assignee: Apache Spark
> Push epoch updates to executors on fetch failure to avoid fetch
[
https://issues.apache.org/jira/browse/SPARK-22131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-22131.
Resolution: Fixed
Assignee: Susan X. Huynh
Fix Version/s: 2.3.0
> Add
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221388#comment-16221388
]
Ilya Matiach commented on SPARK-22357:
--
binaryFiles ignores the number of partitions I want to have,
[
https://issues.apache.org/jira/browse/SPARK-20644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20644:
Assignee: Apache Spark
> Hook up Spark UI to the new key-value store backend
>
[
https://issues.apache.org/jira/browse/SPARK-20644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20644:
Assignee: (was: Apache Spark)
> Hook up Spark UI to the new key-value store backend
>
[
https://issues.apache.org/jira/browse/SPARK-20644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221372#comment-16221372
]
Apache Spark commented on SPARK-20644:
--
User 'vanzin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-22366:
-
Component/s: (was: Spark Core)
SQL
> Support ignoreMissingFiles flag
[
https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shixiong Zhu updated SPARK-22366:
-
Issue Type: Improvement (was: Bug)
> Support ignoreMissingFiles flag parallel to
[
https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221225#comment-16221225
]
Apache Spark commented on SPARK-22366:
--
User 'joseph-torres' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22366:
Assignee: Apache Spark
> Support ignoreMissingFiles flag parallel to ignoreCorruptFiles
>
[
https://issues.apache.org/jira/browse/SPARK-22366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22366:
Assignee: (was: Apache Spark)
> Support ignoreMissingFiles flag parallel to
Jose Torres created SPARK-22366:
---
Summary: Support ignoreMissingFiles flag parallel to
ignoreCorruptFiles
Key: SPARK-22366
URL: https://issues.apache.org/jira/browse/SPARK-22366
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-22328.
-
Resolution: Fixed
Fix Version/s: 2.3.0
2.2.1
Issue resolved by pull
[
https://issues.apache.org/jira/browse/SPARK-22328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-22328:
---
Assignee: Liang-Chi Hsieh
> ClosureCleaner misses referenced superclass fields, gives them
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221078#comment-16221078
]
Bo Meng commented on SPARK-22357:
-
a quick fix could be as follows, correct me if i am wrong.
val
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221025#comment-16221025
]
Cody Koeninger commented on SPARK-20928:
No, it doesn't exist yet as far as I know.
Reason I ask
[
https://issues.apache.org/jira/browse/SPARK-22184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221019#comment-16221019
]
Sergey Zhemzhitsky commented on SPARK-22184:
Hello guys, is there a chance for this issue to
[
https://issues.apache.org/jira/browse/SPARK-22150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221018#comment-16221018
]
Sergey Zhemzhitsky commented on SPARK-22150:
Hello guys, is there a chance for this issue to
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220956#comment-16220956
]
Reynold Xin commented on SPARK-20928:
-
That doesn't yet exist does it? How would that work for
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220884#comment-16220884
]
Shivaram Venkataraman commented on SPARK-22344:
---
Thanks for investigating. Is
[
https://issues.apache.org/jira/browse/SPARK-11334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220881#comment-16220881
]
Apache Spark commented on SPARK-11334:
--
User 'sitalkedia' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220857#comment-16220857
]
Apache Spark commented on SPARK-22312:
--
User 'sitalkedia' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22364.
---
Resolution: Not A Problem
These functions largely mimic Hive on purpose, and I think that's just how
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220734#comment-16220734
]
Andrew Ash commented on SPARK-22042:
Hi I'm seeing this problem as well, thanks for investigating and
[
https://issues.apache.org/jira/browse/SPARK-22364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220697#comment-16220697
]
Matthew Sinton-Hewitt commented on SPARK-22364:
---
Yes I think you're right.
However, it
[
https://issues.apache.org/jira/browse/SPARK-20928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220694#comment-16220694
]
Cody Koeninger commented on SPARK-20928:
Can you clarify how this impacts sinks having access to
[
https://issues.apache.org/jira/browse/SPARK-20643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-20643.
--
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19383
[
https://issues.apache.org/jira/browse/SPARK-20643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid reassigned SPARK-20643:
Assignee: Marcelo Vanzin
> Implement listener for saving application status data in
[
https://issues.apache.org/jira/browse/SPARK-22365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220631#comment-16220631
]
Sean Owen commented on SPARK-22365:
---
Is there no other error following this? a "Caused by" log? if it's
[
https://issues.apache.org/jira/browse/SPARK-22365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220630#comment-16220630
]
Jakub Dubovsky commented on SPARK-22365:
Is there anything I can do to investigate? I am a BE
[
https://issues.apache.org/jira/browse/SPARK-22365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220627#comment-16220627
]
Sean Owen commented on SPARK-22365:
---
This doesn't actually show the underlying error, just reporting
Jakub Dubovsky created SPARK-22365:
--
Summary: Spark UI executors empty list with 500 error
Key: SPARK-22365
URL: https://issues.apache.org/jira/browse/SPARK-22365
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220483#comment-16220483
]
Sean Owen commented on SPARK-22364:
---
Is the problem that this hour doesn't exist in the timezone
[
https://issues.apache.org/jira/browse/SPARK-22364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Sinton-Hewitt updated SPARK-22364:
--
Description:
org.apache.spark.sql.functions.unix_timestamp sets some valid
[
https://issues.apache.org/jira/browse/SPARK-22364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Sinton-Hewitt updated SPARK-22364:
--
Description:
org.apache.spark.sql.functions.unix_timestamp sets some valid
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220469#comment-16220469
]
Sean Owen commented on SPARK-21657:
---
I suspect that something somewhere is doing something that's
Matthew Sinton-Hewitt created SPARK-22364:
-
Summary: unix_timestamp function sets valid dates to null
Key: SPARK-22364
URL: https://issues.apache.org/jira/browse/SPARK-22364
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220450#comment-16220450
]
Ohad Raviv commented on SPARK-21657:
Hi,
Wanted to add that we're facing exactly the same issue. 6
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220431#comment-16220431
]
Saisai Shao commented on SPARK-22357:
-
Yes, I know this parameter is ignored, but I'm not sure is it
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220417#comment-16220417
]
Weichen Xu commented on SPARK-22357:
[~jerryshao] I checked the code, it ignore the `minPartitions`
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220395#comment-16220395
]
Saisai Shao commented on SPARK-22357:
-
bq. In our specific case this was a problem, because we
[
https://issues.apache.org/jira/browse/SPARK-22323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220373#comment-16220373
]
Hyukjin Kwon commented on SPARK-22323:
--
Let me leave a link to the discussion doc -
Jiang Xingbo created SPARK-22363:
Summary: Add unit test for Window spilling
Key: SPARK-22363
URL: https://issues.apache.org/jira/browse/SPARK-22363
Project: Spark
Issue Type: Sub-task
Jiang Xingbo created SPARK-22362:
Summary: Add unit test for Window Aggregate Functions
Key: SPARK-22362
URL: https://issues.apache.org/jira/browse/SPARK-22362
Project: Spark
Issue Type:
Jiang Xingbo created SPARK-22361:
Summary: Add unit test for Window Frames
Key: SPARK-22361
URL: https://issues.apache.org/jira/browse/SPARK-22361
Project: Spark
Issue Type: Sub-task
Jiang Xingbo created SPARK-22360:
Summary: Add unit test for Window Specifications
Key: SPARK-22360
URL: https://issues.apache.org/jira/browse/SPARK-22360
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon reassigned SPARK-17902:
Assignee: Hyukjin Kwon
> collect() ignores stringsAsFactors
>
[
https://issues.apache.org/jira/browse/SPARK-17902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-17902.
--
Resolution: Fixed
Fix Version/s: 2.1.3
2.3.0
2.2.1
Jiang Xingbo created SPARK-22359:
Summary: Improve the test coverage of window functions
Key: SPARK-22359
URL: https://issues.apache.org/jira/browse/SPARK-22359
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220280#comment-16220280
]
Congxian Qiu commented on SPARK-22358:
--
I run the same program many times, got the above error some
[
https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217201#comment-16217201
]
Andriy Kushnir edited comment on SPARK-9686 at 10/26/17 10:18 AM:
--
[
https://issues.apache.org/jira/browse/SPARK-22358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Congxian Qiu closed SPARK-22358.
> ClassNotFoundException at NettyRpcEnv#deserialize when running Spark on
> Yarn-Cluster
>
[
https://issues.apache.org/jira/browse/SPARK-22358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22358.
---
Resolution: Cannot Reproduce
You have some strange corruption in your code or build: RpcAddvess
You
Congxian Qiu created SPARK-22358:
Summary: ClassNotFoundException at NettyRpcEnv#deserialize when
running Spark on Yarn-Cluster
Key: SPARK-22358
URL: https://issues.apache.org/jira/browse/SPARK-22358
[
https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220239#comment-16220239
]
xinzhang commented on SPARK-21725:
--
I tried the spark(version-master) at 21/Aug2017, it still appear
[
https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220228#comment-16220228
]
Marco Gaido commented on SPARK-21725:
-
please try with the master branch, not with Spark 2.1.2. I
[
https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220225#comment-16220225
]
Sean Owen commented on SPARK-21725:
---
[~zhangxin0112zx] there's no reason to expect 2.1.2 was different.
[
https://issues.apache.org/jira/browse/SPARK-21725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220216#comment-16220216
]
xinzhang commented on SPARK-21725:
--
I download spark 2.1.2 .The problem still appear . Could u give me
[
https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220167#comment-16220167
]
Denis Gabaydulin edited comment on SPARK-15905 at 10/26/17 8:48 AM:
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220169#comment-16220169
]
Weichen Xu commented on SPARK-22357:
[~jerryshao] code formatted. This bug is reported from here
[
https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220167#comment-16220167
]
Denis Gabaydulin edited comment on SPARK-15905 at 10/26/17 8:42 AM:
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Weichen Xu updated SPARK-22357:
---
Description:
this is a bug in binaryFiles - even though we give it the partitions,
binaryFiles
[
https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220167#comment-16220167
]
Denis Gabaydulin commented on SPARK-15905:
--
Not sure I've got the same issue. But I have at
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220160#comment-16220160
]
Saisai Shao commented on SPARK-22357:
-
[~WeichenXu123] would you please format the code in JIRA
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220152#comment-16220152
]
Weichen Xu commented on SPARK-22357:
cc [~jerryshao]
> SparkContext.binaryFiles ignore minPartitions
[
https://issues.apache.org/jira/browse/SPARK-22357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220147#comment-16220147
]
Weichen Xu commented on SPARK-22357:
cc [~imatiach] [~liancheng]
> SparkContext.binaryFiles ignore
Weichen Xu created SPARK-22357:
--
Summary: SparkContext.binaryFiles ignore minPartitions parameter
Key: SPARK-22357
URL: https://issues.apache.org/jira/browse/SPARK-22357
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao reassigned SPARK-21840:
---
Assignee: Marcelo Vanzin
> Allow multiple SparkSubmit invocations in same JVM without
[
https://issues.apache.org/jira/browse/SPARK-21840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Saisai Shao resolved SPARK-21840.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19519
[
https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22308.
-
Resolution: Fixed
Assignee: Nathan Kronenfeld
Fix Version/s: 2.3.0
> Support unit tests
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220083#comment-16220083
]
Felix Cheung commented on SPARK-22344:
--
why is hive there when enableHiveSupport should be off?
what
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220080#comment-16220080
]
Felix Cheung edited comment on SPARK-22344 at 10/26/17 7:25 AM:
this is
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220080#comment-16220080
]
Felix Cheung commented on SPARK-22344:
--
this is what I see on a clean machine tracking
88 matches
Mail list logo