[jira] [Assigned] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17660: Assignee: (was: Apache Spark) > DESC FORMATTED for VIEW Lacks View Definition >

[jira] [Assigned] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17660: Assignee: Apache Spark > DESC FORMATTED for VIEW Lacks View Definition >

[jira] [Commented] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15520189#comment-15520189 ] Apache Spark commented on SPARK-17660: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-17660) DESC FORMATTED for VIEW Lacks View Definition

2016-09-24 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17660: --- Summary: DESC FORMATTED for VIEW Lacks View Definition Key: SPARK-17660 URL: https://issues.apache.org/jira/browse/SPARK-17660 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15520095#comment-15520095 ] Apache Spark commented on SPARK-17659: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17659: Assignee: Apache Spark > Partitioned View is Not Supported In SHOW CREATE TABLE >

[jira] [Assigned] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17659: Assignee: (was: Apache Spark) > Partitioned View is Not Supported In SHOW CREATE

[jira] [Created] (SPARK-17659) Partitioned View is Not Supported In SHOW CREATE TABLE

2016-09-24 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17659: --- Summary: Partitioned View is Not Supported In SHOW CREATE TABLE Key: SPARK-17659 URL: https://issues.apache.org/jira/browse/SPARK-17659 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-17631) Structured Streaming - Add Http Stream Sink

2016-09-24 Thread zhangxinyu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519970#comment-15519970 ] zhangxinyu commented on SPARK-17631: h4. A short design for this feature h5. Goal Build an http sink

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519953#comment-15519953 ] Xiao Li commented on SPARK-17653: - Yeah. You are right. It does not work. : ) > Optimizer should remove

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519950#comment-15519950 ] Xiao Li commented on SPARK-17653: - I see. After rethinking it, Union is special. My PR is not applicable

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519923#comment-15519923 ] Reynold Xin commented on SPARK-17653: - [~smilegator] - I just took a quick look at #11930. It looks

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519710#comment-15519710 ] Reynold Xin commented on SPARK-17653: - There are different ways to fix this, from fairly general ones

[jira] [Updated] (SPARK-17609) SessionCatalog.tableExists should not check temp view

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17609: Fix Version/s: (was: 2.0.2) 2.0.1 > SessionCatalog.tableExists should not

[jira] [Updated] (SPARK-17640) Avoid using -1 as the default batchId for FileStreamSource.FileEntry

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17640: Fix Version/s: (was: 2.0.2) 2.0.1 > Avoid using -1 as the default batchId

[jira] [Updated] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17502: Fix Version/s: (was: 2.0.2) 2.0.1 > Multiple Bugs in DDL Statements on

[jira] [Updated] (SPARK-17210) sparkr.zip is not distributed to executors when run sparkr in RStudio

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17210: Fix Version/s: (was: 2.0.2) 2.0.1 > sparkr.zip is not distributed to

[jira] [Updated] (SPARK-16240) model loading backward compatibility for ml.clustering.LDA

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16240: Fix Version/s: (was: 2.0.2) 2.0.1 > model loading backward compatibility

[jira] [Updated] (SPARK-17651) Automate Spark version update for documentations

2016-09-24 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17651: Fix Version/s: (was: 2.0.2) 2.0.1 > Automate Spark version update for

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-24 Thread Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15519497#comment-15519497 ] Yan commented on SPARK-17556: - For 2), I think BitTorrent won't help in the case of all-to-all transfers,

[jira] [Updated] (SPARK-17631) Structured Streaming - Add Http Stream Sink

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17631: -- Fix Version/s: (was: 2.0.0) > Structured Streaming - Add Http Stream Sink >

[jira] [Commented] (SPARK-17499) make the default params in sparkR spark.mlp consistent with MultilayerPerceptronClassifier

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518938#comment-15518938 ] Apache Spark commented on SPARK-17499: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17658: Assignee: (was: Apache Spark) > write.df API requires path which is not actually

[jira] [Commented] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518856#comment-15518856 ] Apache Spark commented on SPARK-17658: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17658: Assignee: Apache Spark > write.df API requires path which is not actually always

[jira] [Created] (SPARK-17658) write.df API requires path which is not actually always nessasary in SparkR

2016-09-24 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-17658: Summary: write.df API requires path which is not actually always nessasary in SparkR Key: SPARK-17658 URL: https://issues.apache.org/jira/browse/SPARK-17658 Project:

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518790#comment-15518790 ] Liang-Chi Hsieh commented on SPARK-17556: - For 1). It is true only if your driver is outside of

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-24 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-17556: Attachment: executor-side-broadcast.pdf > Executor side broadcast for broadcast joins >

[jira] [Commented] (SPARK-17556) Executor side broadcast for broadcast joins

2016-09-24 Thread Yan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518598#comment-15518598 ] Yan commented on SPARK-17556: - A few comments of mine are as follows: 1) The "one-executor collection"

[jira] [Resolved] (SPARK-17057) ProbabilisticClassifierModels' thresholds should have at most one 0

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17057. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15149

[jira] [Updated] (SPARK-17057) ProbabilisticClassifierModels' thresholds should have at most one 0

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17057: -- Issue Type: Improvement (was: Bug) Summary: ProbabilisticClassifierModels' thresholds should

[jira] [Updated] (SPARK-17656) Decide on the variant of @scala.annotation.varargs and use consistently

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17656: -- Affects Version/s: (was: 2.0.2) 2.0.0 Priority: Trivial (was:

[jira] [Resolved] (SPARK-10835) Word2Vec should accept non-null string array, in addition to existing null string array

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10835. --- Resolution: Fixed Fix Version/s: 2.1.0 2.0.2 Issue resolved by pull

[jira] [Commented] (SPARK-17653) Optimizer should remove unnecessary distincts (in multiple unions)

2016-09-24 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518577#comment-15518577 ] Xiao Li commented on SPARK-17653: - [~rxin] I submitted a PR https://github.com/apache/spark/pull/11930

[jira] [Updated] (SPARK-10835) Word2Vec should accept non-null string array, in addition to existing null string array

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10835: -- Summary: Word2Vec should accept non-null string array, in addition to existing null string array

[jira] [Updated] (SPARK-10835) [SPARK-10835] [ML] Word2Vec should accept non-null string array, in addition to existing null string array

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10835: -- Summary: [SPARK-10835] [ML] Word2Vec should accept non-null string array, in addition to existing null

[jira] [Updated] (SPARK-10835) Word2Vec should accept non-null string array, in addition to existing null string array

2016-09-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10835: -- Shepherd: Sean Owen (was: Joseph K. Bradley) > Word2Vec should accept non-null string array, in

[jira] [Commented] (SPARK-17657) Disallow Users to Change Table Type

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518556#comment-15518556 ] Apache Spark commented on SPARK-17657: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17657) Disallow Users to Change Table Type

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17657: Assignee: (was: Apache Spark) > Disallow Users to Change Table Type >

[jira] [Assigned] (SPARK-17657) Disallow Users to Change Table Type

2016-09-24 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17657: Assignee: Apache Spark > Disallow Users to Change Table Type >

[jira] [Created] (SPARK-17657) Disallow Users to Change Table Type

2016-09-24 Thread Xiao Li (JIRA)
Xiao Li created SPARK-17657: --- Summary: Disallow Users to Change Table Type Key: SPARK-17657 URL: https://issues.apache.org/jira/browse/SPARK-17657 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-17656) Decide on the variant of @scala.annotation.varargs and use consistently

2016-09-24 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-17656: --- Summary: Decide on the variant of @scala.annotation.varargs and use consistently Key: SPARK-17656 URL: https://issues.apache.org/jira/browse/SPARK-17656

[jira] [Commented] (SPARK-8987) Increase test coverage of DAGScheduler

2016-09-24 Thread OuyangJin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518537#comment-15518537 ] OuyangJin commented on SPARK-8987: -- I'd like to work on this > Increase test coverage of DAGScheduler >

[jira] [Commented] (SPARK-17210) sparkr.zip is not distributed to executors when run sparkr in RStudio

2016-09-24 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518507#comment-15518507 ] Felix Cheung commented on SPARK-17210: -- Got it, sorry about that, I should have noticed. >