[jira] [Updated] (SPARK-19473) Several DataFrame Methods still fail with dot in column names

2017-02-05 Thread Wayne Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wayne Zhang updated SPARK-19473: Summary: Several DataFrame Methods still fail with dot in column names (was: Several DataFrame

[jira] [Created] (SPARK-19473) Several DataFrame Method still fail with dot in column names

2017-02-05 Thread Wayne Zhang (JIRA)
Wayne Zhang created SPARK-19473: --- Summary: Several DataFrame Method still fail with dot in column names Key: SPARK-19473 URL: https://issues.apache.org/jira/browse/SPARK-19473 Project: Spark

[jira] [Commented] (SPARK-19449) Inconsistent results between ml package RandomForestClassificationModel and mllib package RandomForestModel

2017-02-05 Thread Aseem Bansal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853629#comment-15853629 ] Aseem Bansal commented on SPARK-19449: -- [~sowen] My results are actually deterministic. No matter

[jira] [Commented] (SPARK-17300) ClosedChannelException caused by missing block manager when speculative tasks are killed

2017-02-05 Thread DjvuLee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853630#comment-15853630 ] DjvuLee commented on SPARK-17300: - [~rdblue] Is there any fix for this issue later? >

[jira] [Resolved] (SPARK-19279) Disallow Users to Create a Hive Table With an Empty Schema

2017-02-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19279. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16636

[jira] [Created] (SPARK-19472) [SQL]SQLParser fails to resolve nested CASE WHEN statement with parentheses

2017-02-05 Thread StanZhai (JIRA)
StanZhai created SPARK-19472: Summary: [SQL]SQLParser fails to resolve nested CASE WHEN statement with parentheses Key: SPARK-19472 URL: https://issues.apache.org/jira/browse/SPARK-19472 Project: Spark

[jira] [Created] (SPARK-19471) [SQL]A confusing NullPointerException when creating table

2017-02-05 Thread StanZhai (JIRA)
StanZhai created SPARK-19471: Summary: [SQL]A confusing NullPointerException when creating table Key: SPARK-19471 URL: https://issues.apache.org/jira/browse/SPARK-19471 Project: Spark Issue

[jira] [Created] (SPARK-19470) Spark 1.6.4 in Intellij can't use jetty 8

2017-02-05 Thread Mingda Li (JIRA)
Mingda Li created SPARK-19470: - Summary: Spark 1.6.4 in Intellij can't use jetty 8 Key: SPARK-19470 URL: https://issues.apache.org/jira/browse/SPARK-19470 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2017-02-05 Thread cen yuhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853474#comment-15853474 ] cen yuhai commented on SPARK-16441: --- I don't know, I will use spark 2.1, this may not be a problem. >

[jira] [Commented] (SPARK-19430) Cannot read external tables with VARCHAR columns if they're backed by ORC files written by Hive 1.2.1

2017-02-05 Thread Song Jun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853466#comment-15853466 ] Song Jun commented on SPARK-19430: -- I think this is not a bug. If you want to access the hive table ,you

[jira] [Commented] (SPARK-19447) Fix input metrics for range operator

2017-02-05 Thread Song Jun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853462#comment-15853462 ] Song Jun commented on SPARK-19447: -- spark.range(1,100).show there is some information in the SQL UI

[jira] [Resolved] (SPARK-19421) Remove numClasses and numFeatures methods in LinearSVC

2017-02-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-19421. - Resolution: Fixed Fix Version/s: 2.2.0 Thanks for fixing this, merged in 317fa750 :) > Remove

[jira] [Assigned] (SPARK-19421) Remove numClasses and numFeatures methods in LinearSVC

2017-02-05 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-19421: --- Assignee: zhengruifeng > Remove numClasses and numFeatures methods in LinearSVC >

[jira] [Commented] (SPARK-19451) Long values in Window function

2017-02-05 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853434#comment-15853434 ] Genmao Yu commented on SPARK-19451: --- Good catch! I will dig deeply into code and fix it if it is really

[jira] [Created] (SPARK-19469) PySpark should allow driver process on different machine

2017-02-05 Thread haiyangsea (JIRA)
haiyangsea created SPARK-19469: -- Summary: PySpark should allow driver process on different machine Key: SPARK-19469 URL: https://issues.apache.org/jira/browse/SPARK-19469 Project: Spark Issue

[jira] [Commented] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853431#comment-15853431 ] Apache Spark commented on SPARK-19407: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19407: Assignee: Apache Spark > defaultFS is used FileSystem.get instead of getting it from uri

[jira] [Assigned] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19407: Assignee: (was: Apache Spark) > defaultFS is used FileSystem.get instead of getting

[jira] [Commented] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-05 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853426#comment-15853426 ] Genmao Yu commented on SPARK-19407: --- [~aassudani] Are you still working on this? As this issue is clear

[jira] [Created] (SPARK-19468) Dataset slow because of unnecessary shuffles

2017-02-05 Thread koert kuipers (JIRA)
koert kuipers created SPARK-19468: - Summary: Dataset slow because of unnecessary shuffles Key: SPARK-19468 URL: https://issues.apache.org/jira/browse/SPARK-19468 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-19247) Improve ml word2vec save/load scalability

2017-02-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-19247. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16607

[jira] [Assigned] (SPARK-19247) Improve ml word2vec save/load scalability

2017-02-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-19247: - Assignee: Asher Krim > Improve ml word2vec save/load scalability >

[jira] [Commented] (SPARK-19467) PySpark ML shouldn't use circular imports

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853413#comment-15853413 ] Apache Spark commented on SPARK-19467: -- User 'zero323' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19467) PySpark ML shouldn't use circular imports

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19467: Assignee: (was: Apache Spark) > PySpark ML shouldn't use circular imports >

[jira] [Assigned] (SPARK-19467) PySpark ML shouldn't use circular imports

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19467: Assignee: Apache Spark > PySpark ML shouldn't use circular imports >

[jira] [Created] (SPARK-19467) PySpark ML shouldn't use circular imports

2017-02-05 Thread Maciej Szymkiewicz (JIRA)
Maciej Szymkiewicz created SPARK-19467: -- Summary: PySpark ML shouldn't use circular imports Key: SPARK-19467 URL: https://issues.apache.org/jira/browse/SPARK-19467 Project: Spark Issue

[jira] [Commented] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853408#comment-15853408 ] Ian commented on SPARK-19462: - Note that when spark.sql.adaptive.enabled is set "false" , the exception

[jira] [Assigned] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19466: Assignee: Apache Spark > Improve Fair Scheduler Logging > --

[jira] [Assigned] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19466: Assignee: (was: Apache Spark) > Improve Fair Scheduler Logging >

[jira] [Commented] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853377#comment-15853377 ] Apache Spark commented on SPARK-19466: -- User 'erenavsarogullari' has created a pull request for this

[jira] [Updated] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19466: -- Affects Version/s: (was: 2.2.0) 2.1.0 Priority: Minor (was:

[jira] [Updated] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Eren Avsarogullari (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eren Avsarogullari updated SPARK-19466: --- Description: Fair Scheduler Logging for the following cases can be useful for the

[jira] [Created] (SPARK-19466) Improve Fair Scheduler Logging

2017-02-05 Thread Eren Avsarogullari (JIRA)
Eren Avsarogullari created SPARK-19466: -- Summary: Improve Fair Scheduler Logging Key: SPARK-19466 URL: https://issues.apache.org/jira/browse/SPARK-19466 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19465) Support custom Boolean values in CSV

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853349#comment-15853349 ] Apache Spark commented on SPARK-19465: -- User 'dhunziker' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19465) Support custom Boolean values in CSV

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19465: Assignee: (was: Apache Spark) > Support custom Boolean values in CSV >

[jira] [Assigned] (SPARK-19465) Support custom Boolean values in CSV

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19465: Assignee: Apache Spark > Support custom Boolean values in CSV >

[jira] [Commented] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853344#comment-15853344 ] Apache Spark commented on SPARK-17629: -- User 'Krimit' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17629: Assignee: Apache Spark > Should ml Word2Vec findSynonyms match the mllib implementation?

[jira] [Assigned] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17629: Assignee: (was: Apache Spark) > Should ml Word2Vec findSynonyms match the mllib

[jira] [Reopened] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

2017-02-05 Thread Asher Krim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asher Krim reopened SPARK-17629: [~josephkb] gave his blessing for adding local versions of the synonyms methods in the dev mailing

[jira] [Resolved] (SPARK-19452) Fix bug in the name assignment method in SparkR

2017-02-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-19452. -- Resolution: Fixed Assignee: Wayne Zhang Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-10413) ML models should support prediction on single instances

2017-02-05 Thread Asher Krim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853301#comment-15853301 ] Asher Krim commented on SPARK-10413: I know I'm a little late to this discussion, but I'd like to

[jira] [Commented] (SPARK-16441) Spark application hang when dynamic allocation is enabled

2017-02-05 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853300#comment-15853300 ] Dominic Ricard commented on SPARK-16441: Could this be fixed by either SPARK-16533 or

[jira] [Commented] (SPARK-19465) Support custom Boolean values in CSV

2017-02-05 Thread Dennis Hunziker (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853293#comment-15853293 ] Dennis Hunziker commented on SPARK-19465: - I'll be raising a pull request for this soon. Not

[jira] [Updated] (SPARK-19428) Ability to select first row of groupby

2017-02-05 Thread Koert Kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koert Kuipers updated SPARK-19428: -- if I remember correctly window function is like a canned secondary sort with limited

[jira] [Created] (SPARK-19465) Support custom Boolean values in CSV

2017-02-05 Thread Dennis Hunziker (JIRA)
Dennis Hunziker created SPARK-19465: --- Summary: Support custom Boolean values in CSV Key: SPARK-19465 URL: https://issues.apache.org/jira/browse/SPARK-19465 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19428) Ability to select first row of groupby

2017-02-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853272#comment-15853272 ] Herman van Hovell commented on SPARK-19428: --- You could also use a window function: {noformat}

[jira] [Commented] (SPARK-19457) Support Hive Hooks in Spark thrift server again

2017-02-05 Thread Sungju Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853226#comment-15853226 ] Sungju Jin commented on SPARK-19457: nvmd, now I understand why you were saying a duplicate issue,

[jira] [Commented] (SPARK-19428) Ability to select first row of groupby

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853214#comment-15853214 ] Sean Owen commented on SPARK-19428: --- Yeah, I think it would require a custom aggregator after all as I

[jira] [Assigned] (SPARK-19464) Remove support for Hadoop 2.5 and earlier

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19464: Assignee: Sean Owen (was: Apache Spark) > Remove support for Hadoop 2.5 and earlier >

[jira] [Assigned] (SPARK-19464) Remove support for Hadoop 2.5 and earlier

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19464: Assignee: Apache Spark (was: Sean Owen) > Remove support for Hadoop 2.5 and earlier >

[jira] [Commented] (SPARK-19407) defaultFS is used FileSystem.get instead of getting it from uri scheme

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853213#comment-15853213 ] Sean Owen commented on SPARK-19407: --- [~aassudani] are you making a pull request? > defaultFS is used

[jira] [Commented] (SPARK-19464) Remove support for Hadoop 2.5 and earlier

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853212#comment-15853212 ] Apache Spark commented on SPARK-19464: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-19464) Remove support for Hadoop 2.5 and earlier

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19464: -- Summary: Remove support for Hadoop 2.5 and earlier (was: Remove supports for Hadoop 2.5 and earlier)

[jira] [Created] (SPARK-19464) Remove supports for Hadoop 2.5 and earlier

2017-02-05 Thread Sean Owen (JIRA)
Sean Owen created SPARK-19464: - Summary: Remove supports for Hadoop 2.5 and earlier Key: SPARK-19464 URL: https://issues.apache.org/jira/browse/SPARK-19464 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-19461) Remove some unused imports.

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19461: -- Priority: Trivial (was: Major) Issue Type: Improvement (was: Bug) [~jinxing6...@126.com] this

[jira] [Resolved] (SPARK-19461) Remove some unused imports.

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19461. --- Resolution: Won't Fix > Remove some unused imports. > --- > >

[jira] [Updated] (SPARK-19398) Log in TaskSetManager is not correct

2017-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-19398: -- Affects Version/s: 2.1.0 Priority: Trivial (was: Minor) Issue Type:

[jira] [Assigned] (SPARK-19463) refresh the table cache after InsertIntoHadoopFsRelation

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19463: Assignee: Apache Spark > refresh the table cache after InsertIntoHadoopFsRelation >

[jira] [Assigned] (SPARK-19463) refresh the table cache after InsertIntoHadoopFsRelation

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19463: Assignee: (was: Apache Spark) > refresh the table cache after

[jira] [Commented] (SPARK-19463) refresh the table cache after InsertIntoHadoopFsRelation

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853203#comment-15853203 ] Apache Spark commented on SPARK-19463: -- User 'windpiger' has created a pull request for this issue:

[jira] [Created] (SPARK-19463) refresh the table cache after InsertIntoHadoopFsRelation

2017-02-05 Thread Song Jun (JIRA)
Song Jun created SPARK-19463: Summary: refresh the table cache after InsertIntoHadoopFsRelation Key: SPARK-19463 URL: https://issues.apache.org/jira/browse/SPARK-19463 Project: Spark Issue Type:

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Description: property spark.sql.adaptive.enabled needs to be set "true" for the issue to be reproduced.

[jira] [Comment Edited] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853188#comment-15853188 ] Ian edited comment on SPARK-19462 at 2/5/17 10:33 AM: -- In fact, the "Exchange not

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Summary: when spark.sql.adaptive.enabled is enabled, DF is not resilient to node/container failure (was: when

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, DF is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Summary: when spark.sql.adaptive.enabled is enabled, DF is not resilient to node container failure (was: when

[jira] [Comment Edited] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853188#comment-15853188 ] Ian edited comment on SPARK-19462 at 2/5/17 10:28 AM: -- In fact, the "Exchange not

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Description: property spark.sql.adaptive.enabled needs to be set "true" reproducible steps using spark-shell 0.

[jira] [Issue Comment Deleted] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Comment: was deleted (was: When the RDD lineage contains ShuffledRowRDD, the above mentioned behavior can be

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Description: property spark.sql.adaptive.enabled needs to be set "true" reproducible steps using spark-shell 0.

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled, RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Summary: when spark.sql.adaptive.enabled is enabled, RDD is not resilient to node container failure (was: when

[jira] [Commented] (SPARK-19462) when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853188#comment-15853188 ] Ian commented on SPARK-19462: - In fact, the "Exchange not implemented for UnknownPartitioning(1)" can be

[jira] [Comment Edited] (SPARK-19462) when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853184#comment-15853184 ] Ian edited comment on SPARK-19462 at 2/5/17 10:14 AM: -- When the RDD lineage contains

[jira] [Commented] (SPARK-19462) when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853184#comment-15853184 ] Ian commented on SPARK-19462: - When the RDD lineage contains ShuffledRowRDD, the above mentioned behavior can

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Description: property spark.sql.adaptive.enabled needs to be set "true" reproducible steps using spark-shell 0.

[jira] [Updated] (SPARK-19462) when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-19462: Description: property spark.sql.adaptive.enabled needs to be set "true" reproducible steps using spark-shell 0.

[jira] [Created] (SPARK-19462) when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure

2017-02-05 Thread Ian (JIRA)
Ian created SPARK-19462: --- Summary: when spark.sql.adaptive.enabled is enabled RDD is not resilient to node container failure Key: SPARK-19462 URL: https://issues.apache.org/jira/browse/SPARK-19462 Project:

[jira] [Commented] (SPARK-19461) Remove some unused imports.

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15853182#comment-15853182 ] Apache Spark commented on SPARK-19461: -- User 'jinxing64' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19461) Remove some unused imports.

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19461: Assignee: (was: Apache Spark) > Remove some unused imports. >

[jira] [Assigned] (SPARK-19461) Remove some unused imports.

2017-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19461: Assignee: Apache Spark > Remove some unused imports. > --- > >

[jira] [Created] (SPARK-19461) Remove some unused imports.

2017-02-05 Thread jin xing (JIRA)
jin xing created SPARK-19461: Summary: Remove some unused imports. Key: SPARK-19461 URL: https://issues.apache.org/jira/browse/SPARK-19461 Project: Spark Issue Type: Bug Components: