Xin Lu created SPARK-22377:
--
Summary: Maven nightly snapshot jenkins jobs are broken on
multiple workers due to lsof
Key: SPARK-22377
URL: https://issues.apache.org/jira/browse/SPARK-22377
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223228#comment-16223228
]
Felix Cheung edited comment on SPARK-22344 at 10/28/17 4:26 AM:
I think
[
https://issues.apache.org/jira/browse/SPARK-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223229#comment-16223229
]
Xin Lu commented on SPARK-22055:
[~holdenk] [~joshrosen] do you guys need help with this?
> Port
[
https://issues.apache.org/jira/browse/SPARK-13085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223227#comment-16223227
]
Xin Lu commented on SPARK-13085:
I think scalastyle-maven-plugin already got upgraded to latest, which is
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223228#comment-16223228
]
Felix Cheung commented on SPARK-22344:
--
I think the PR addresses other cases, but what do we want to
[
https://issues.apache.org/jira/browse/SPARK-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223226#comment-16223226
]
Xin Lu commented on SPARK-8571:
---
still an issue?
> spark streaming hanging processes upon build exit
>
Joel Croteau created SPARK-22376:
Summary: run-tests.py fails at exec-sbt if run with Python 3
Key: SPARK-22376
URL: https://issues.apache.org/jira/browse/SPARK-22376
Project: Spark
Issue
Joel Croteau created SPARK-22375:
Summary: Test script can fail if eggs are installed by setup.py
during test process
Key: SPARK-22375
URL: https://issues.apache.org/jira/browse/SPARK-22375
Project:
[
https://issues.apache.org/jira/browse/SPARK-22181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-22181.
-
Resolution: Fixed
Assignee: Sathiya Kumar
Fix Version/s: 2.3.0
> ReplaceExceptWithFilter
[
https://issues.apache.org/jira/browse/SPARK-22310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-22310:
-
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-16026)
> Refactor join
[
https://issues.apache.org/jira/browse/SPARK-22310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-22310:
-
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-21975
> Refactor join estimation
[
https://issues.apache.org/jira/browse/SPARK-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21984:
Assignee: (was: Apache Spark)
> Use histogram stats in join estimation
>
[
https://issues.apache.org/jira/browse/SPARK-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21984:
Assignee: Apache Spark
> Use histogram stats in join estimation
>
[
https://issues.apache.org/jira/browse/SPARK-21984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223146#comment-16223146
]
Apache Spark commented on SPARK-21984:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223120#comment-16223120
]
Weichen Xu commented on SPARK-12375:
Coordinated with [~yuhaoyan] I take this over. Thanks!
>
[
https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22374:
Assignee: (was: Apache Spark)
> STS ran into OOM in a secure cluster
>
[
https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223092#comment-16223092
]
Apache Spark commented on SPARK-22374:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22374:
Assignee: Apache Spark
> STS ran into OOM in a secure cluster
>
[
https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223073#comment-16223073
]
Henry Robinson commented on SPARK-22211:
I think the optimization proposed works only for a
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223063#comment-16223063
]
Apache Spark commented on SPARK-22347:
--
User 'viirya' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-22374:
--
Attachment: 1.png
2.png
3.png
> STS ran into OOM in a secure
Dongjoon Hyun created SPARK-22374:
-
Summary: STS ran into OOM in a secure cluster
Key: SPARK-22374
URL: https://issues.apache.org/jira/browse/SPARK-22374
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-22305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16223000#comment-16223000
]
Shixiong Zhu commented on SPARK-22305:
--
Why not just delete the whole checkpoint dir? Dropping state
[
https://issues.apache.org/jira/browse/SPARK-11035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222996#comment-16222996
]
Apache Spark commented on SPARK-11035:
--
User 'vanzin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid updated SPARK-22148:
-
Component/s: Scheduler
> TaskSetManager.abortIfCompletelyBlacklisted should not abort when all
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222967#comment-16222967
]
Imran Rashid commented on SPARK-22148:
--
Hi [~juanrh], thanks for filing this and the PR. is this
[
https://issues.apache.org/jira/browse/SPARK-21911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Joseph K. Bradley resolved SPARK-21911.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 19122
Dan Meany created SPARK-22373:
-
Summary: Intermittent NullPointerException in
org.codehaus.janino.IClass.isAssignableFrom
Key: SPARK-22373
URL: https://issues.apache.org/jira/browse/SPARK-22373
Project:
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22148:
Assignee: (was: Apache Spark)
> TaskSetManager.abortIfCompletelyBlacklisted should
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22148:
Assignee: Apache Spark
> TaskSetManager.abortIfCompletelyBlacklisted should not abort
[
https://issues.apache.org/jira/browse/SPARK-22148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222926#comment-16222926
]
Apache Spark commented on SPARK-22148:
--
User 'juanrh' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222829#comment-16222829
]
Marcelo Vanzin commented on SPARK-22372:
I could file a separate bug for that, but
Marcelo Vanzin created SPARK-22372:
--
Summary: Make YARN client extend SparkApplication
Key: SPARK-22372
URL: https://issues.apache.org/jira/browse/SPARK-22372
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-6.
-
Resolution: Fixed
Assignee: Marco Gaido
Fix Version/s: 2.3.0
> splitExpression can
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22344:
Assignee: Apache Spark
> Prevent R CMD check from using /tmp
>
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222701#comment-16222701
]
Apache Spark commented on SPARK-22344:
--
User 'shivaram' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22344:
Assignee: (was: Apache Spark)
> Prevent R CMD check from using /tmp
>
[
https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-22335:
Issue Type: Documentation (was: Bug)
> Union for DataSet uses column order instead of types for union
>
[
https://issues.apache.org/jira/browse/SPARK-12375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222566#comment-16222566
]
Apache Spark commented on SPARK-12375:
--
User 'WeichenXu123' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-22347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221612#comment-16221612
]
Liang-Chi Hsieh edited comment on SPARK-22347 at 10/27/17 2:30 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222346#comment-16222346
]
Sean Owen commented on SPARK-21657:
---
What if you call toArray in your code, and explode that? if it's
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222312#comment-16222312
]
Ohad Raviv edited comment on SPARK-21657 at 10/27/17 12:53 PM:
---
Hi,
Just
[
https://issues.apache.org/jira/browse/SPARK-21657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222312#comment-16222312
]
Ohad Raviv commented on SPARK-21657:
Hi,
Just ran a profiler for this code:
{code:scala}
val BASE =
[
https://issues.apache.org/jira/browse/SPARK-22352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marco Gaido resolved SPARK-22352.
-
Resolution: Duplicate
This is a duplicate of SPARK-6235.
> task failures with
[
https://issues.apache.org/jira/browse/SPARK-15044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1626#comment-1626
]
Soumitra Sulav commented on SPARK-15044:
Facing below issues with respect to same scenario.
[
https://issues.apache.org/jira/browse/SPARK-22371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mayank Agarwal updated SPARK-22371:
---
Attachment: driver-thread-dump-spark2.1.txt
> dag-scheduler-event-loop thread stopped with
Mayank Agarwal created SPARK-22371:
--
Summary: dag-scheduler-event-loop thread stopped with error
Attempted to access garbage collected accumulator 5605982
Key: SPARK-22371
URL:
[
https://issues.apache.org/jira/browse/SPARK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16222120#comment-16222120
]
Adam Kennedy commented on SPARK-21155:
--
It can already get fairly crowded in that run area on large
[
https://issues.apache.org/jira/browse/SPARK-22305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221982#comment-16221982
]
Yuval Itzchakov commented on SPARK-22305:
-
[~zsxwing] A typical query takes ~ 0.5 seconds to
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221976#comment-16221976
]
Takuya Ueshin commented on SPARK-22370:
---
[~srowen] I updated the description. Thanks.
> Config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22370:
--
Description: {{ArrowEvalPythonExec}} and {{FlatMapGroupsInPandasExec}} are
refering config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22370:
--
Description: {{ArrowEvalPythonExec}} and {{FlatMapGroupsInPandasExec}} are
refering config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-22370:
--
Description: {{ArrowEvalPythonExec}} and {{FlatMapGroupsInPandasExec}} are
refering config
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22370:
Assignee: (was: Apache Spark)
> Config values should be captured in Driver.
>
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22370:
Assignee: Apache Spark
> Config values should be captured in Driver.
>
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221962#comment-16221962
]
Apache Spark commented on SPARK-22370:
--
User 'ueshin' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221960#comment-16221960
]
Sean Owen commented on SPARK-22370:
---
What does this mean?
> Config values should be captured in
[
https://issues.apache.org/jira/browse/SPARK-17971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221959#comment-16221959
]
Sean Owen commented on SPARK-17971:
---
A timestamp in the sense of seconds since the epoch has no
Takuya Ueshin created SPARK-22370:
-
Summary: Config values should be captured in Driver.
Key: SPARK-22370
URL: https://issues.apache.org/jira/browse/SPARK-22370
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221948#comment-16221948
]
Yu Wang commented on SPARK-22368:
-
[~sowen] thanks
> spark streaming link kafka in kerberos environment
[
https://issues.apache.org/jira/browse/SPARK-22368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Wang updated SPARK-22368:
Comment: was deleted
(was: thanks [~sowen] but it will success without kerberos)
> spark streaming link
[
https://issues.apache.org/jira/browse/SPARK-17971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221941#comment-16221941
]
Vitaly Gerasimov commented on SPARK-17971:
--
Seems unexpected for me too. I don't understand why
Andreas Maier created SPARK-22369:
-
Summary: PySpark: Document methods of spark.catalog interface
Key: SPARK-22369
URL: https://issues.apache.org/jira/browse/SPARK-22369
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-22368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221935#comment-16221935
]
Yu Wang commented on SPARK-22368:
-
thanks [~sowen] but it will success without kerberos
> spark
[
https://issues.apache.org/jira/browse/SPARK-22368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Wang updated SPARK-22368:
Fix Version/s: (was: 1.6.2)
> spark streaming link kafka in kerberos environment
>
[
https://issues.apache.org/jira/browse/SPARK-22368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-22368.
---
Resolution: Not A Problem
Spark 1 does not support 0.10 at all
> spark streaming link kafka in
[
https://issues.apache.org/jira/browse/SPARK-22368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yu Wang updated SPARK-22368:
Attachment: error.png
> spark streaming link kafka in kerberos environment
>
Yu Wang created SPARK-22368:
---
Summary: spark streaming link kafka in kerberos environment
Key: SPARK-22368
URL: https://issues.apache.org/jira/browse/SPARK-22368
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-22367:
-
Description:
Becuase they are all the same class for an iterator. So there is no need write
[
https://issues.apache.org/jira/browse/SPARK-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22367:
Assignee: (was: Apache Spark)
> Separate the serialization of class and object for
[
https://issues.apache.org/jira/browse/SPARK-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221899#comment-16221899
]
Apache Spark commented on SPARK-22367:
--
User 'ConeyLiu' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-22367:
Assignee: Apache Spark
> Separate the serialization of class and object for iteraor
>
Xianyang Liu created SPARK-22367:
Summary: Separate the serialization of class and object for iteraor
Key: SPARK-22367
URL: https://issues.apache.org/jira/browse/SPARK-22367
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221800#comment-16221800
]
yuhao yang commented on SPARK-18755:
Thanks for sending the update here.
Feel free to send a PR as
[
https://issues.apache.org/jira/browse/SPARK-21375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li resolved SPARK-21375.
-
Resolution: Fixed
Assignee: Bryan Cutler
Fix Version/s: 2.3.0
> Add date and timestamp
75 matches
Mail list logo
