[jira] [Commented] (SPARK-13723) YARN - Change behavior of --num-executors when spark.dynamicAllocation.enabled true

2016-03-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187424#comment-15187424 ] Thomas Graves commented on SPARK-13723: --- Warnings going by when spark submit is started are really

[jira] [Updated] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13775: -- Priority: Trivial (was: Major) This contradicts https://issues.apache.org/jira/browse/SPARK-13481

[jira] [Commented] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187539#comment-15187539 ] Apache Spark commented on SPARK-13242: -- User 'davies' has created a pull request for this issue:

[jira] [Commented] (SPARK-5581) When writing sorted map output file, avoid open / close between each partition

2016-03-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187538#comment-15187538 ] Josh Rosen commented on SPARK-5581: --- As long as we're not fsyncing then hopefully the number of

[jira] [Updated] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-09 Thread Erik O'Shaughnessy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik O'Shaughnessy updated SPARK-13776: --- Description: The Apache Spark Web UI fails to become available after starting a

[jira] [Created] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-13775: - Summary: history server sort by completed time by default Key: SPARK-13775 URL: https://issues.apache.org/jira/browse/SPARK-13775 Project: Spark Issue

[jira] [Updated] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13776: -- Priority: Minor (was: Major) I don't think I'd call it major if it only affects 1024 (?) core

[jira] [Commented] (SPARK-13628) Temporary intermediate output file should be renamed before copying to destination filesystem

2016-03-09 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187419#comment-15187419 ] Chen He commented on SPARK-13628: - Really appreciate your reply, Mr. Sean Owen. I am new to Spark and

[jira] [Created] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-09 Thread Erik O'Shaughnessy (JIRA)
Erik O'Shaughnessy created SPARK-13776: -- Summary: Web UI is not available after ./sbin/start-master.sh Key: SPARK-13776 URL: https://issues.apache.org/jira/browse/SPARK-13776 Project: Spark

[jira] [Resolved] (SPARK-13595) Move docker, extras modules into external

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13595. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11523

[jira] [Assigned] (SPARK-13595) Move docker, extras modules into external

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-13595: - Assignee: Sean Owen > Move docker, extras modules into external >

[jira] [Updated] (SPARK-13595) Move docker, extras modules into external

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13595: -- Priority: Minor (was: Major) > Move docker, extras modules into external >

[jira] [Commented] (SPARK-11159) Nested SQL UDF raises java.lang.UnsupportedOperationException: Cannot evaluate expression

2016-03-09 Thread Luca Bruno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187460#comment-15187460 ] Luca Bruno commented on SPARK-11159: Same here with spark 1.6.0 > Nested SQL UDF raises

[jira] [Commented] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-09 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187541#comment-15187541 ] Sunitha Kambhampati commented on SPARK-13774: - I can reproduce the error. I tried with

[jira] [Resolved] (SPARK-13763) Remove Project when its projectList is Empty

2016-03-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13763. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11599

[jira] [Commented] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188208#comment-15188208 ] Shixiong Zhu commented on SPARK-13776: -- [~erik.oshaughnessy] could you test this one:

[jira] [Commented] (SPARK-13767) py4j.protocol.Py4JNetworkError: An error occurred while trying to connect to the Java server

2016-03-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188258#comment-15188258 ] Shixiong Zhu commented on SPARK-13767: -- Could you check the master log and use the spark url in the

[jira] [Assigned] (SPARK-13789) Infer additional constraints from attribute equality

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13789: Assignee: (was: Apache Spark) > Infer additional constraints from attribute equality

[jira] [Assigned] (SPARK-13789) Infer additional constraints from attribute equality

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13789: Assignee: Apache Spark > Infer additional constraints from attribute equality >

[jira] [Commented] (SPARK-13789) Infer additional constraints from attribute equality

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188307#comment-15188307 ] Apache Spark commented on SPARK-13789: -- User 'sameeragarwal' has created a pull request for this

[jira] [Created] (SPARK-13796) Lock release errors occur frequently in executor logs

2016-03-09 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-13796: Summary: Lock release errors occur frequently in executor logs Key: SPARK-13796 URL: https://issues.apache.org/jira/browse/SPARK-13796 Project: Spark Issue

[jira] [Commented] (SPARK-9289) OrcPartitionDiscoverySuite is slow to run

2016-03-09 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188710#comment-15188710 ] Dongjoon Hyun commented on SPARK-9289: -- Oh, it wasn't fast enough. I see. Thank you any way. >

[jira] [Updated] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13798: Description: If the Aggregate does not have any aggregate expression, it is useless. We can replace

[jira] [Created] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13798: --- Summary: Replace Aggregate by Project if no Aggregate Function exists Key: SPARK-13798 URL: https://issues.apache.org/jira/browse/SPARK-13798 Project: Spark Issue

[jira] [Commented] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188660#comment-15188660 ] Apache Spark commented on SPARK-13793: -- User 'tejasapatil' has created a pull request for this

[jira] [Updated] (SPARK-13793) PipedRDD doesn't propagate exceptions while reading parent RDDd

2016-03-09 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tejas Patil updated SPARK-13793: Summary: PipedRDD doesn't propagate exceptions while reading parent RDDd (was: PipeRDD doesn't

[jira] [Assigned] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13793: Assignee: Apache Spark > PipeRDD doesn't propagate exceptions while reading parent RDD >

[jira] [Assigned] (SPARK-13793) PipeRDD doesn't propagate exceptions while reading parent RDD

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13793: Assignee: (was: Apache Spark) > PipeRDD doesn't propagate exceptions while reading

[jira] [Commented] (SPARK-13796) Lock release errors occur frequently in executor logs

2016-03-09 Thread Nishkam Ravi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188762#comment-15188762 ] Nishkam Ravi commented on SPARK-13796: -- Running with master from March 7th

[jira] [Updated] (SPARK-13797) Eliminate Unnecessary Window

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13797: Description: If the Window does not have any window expression, it is useless. It might happen after

[jira] [Created] (SPARK-13797) Eliminate Unnecessary Window

2016-03-09 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13797: --- Summary: Eliminate Unnecessary Window Key: SPARK-13797 URL: https://issues.apache.org/jira/browse/SPARK-13797 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12957) Derive and propagate data constrains in logical plan

2016-03-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188856#comment-15188856 ] Sameer Agarwal commented on SPARK-12957: [~ksunitha] I've attached a copy of the design document

[jira] [Commented] (SPARK-13795) ClassCast Exception while attempting to show() a DataFrame

2016-03-09 Thread Ganesh Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188636#comment-15188636 ] Ganesh Krishnan commented on SPARK-13795: - This is similar to this Scala bug:

[jira] [Commented] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188819#comment-15188819 ] Apache Spark commented on SPARK-13798: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13797) Eliminate Unnecessary Window

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13797: Assignee: (was: Apache Spark) > Eliminate Unnecessary Window >

[jira] [Assigned] (SPARK-13797) Eliminate Unnecessary Window

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13797: Assignee: Apache Spark > Eliminate Unnecessary Window > > >

[jira] [Commented] (SPARK-13134) add 'spark.streaming.kafka.partition.multiplier' into SparkConf

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188834#comment-15188834 ] Sean Owen commented on SPARK-13134: --- I don't understand why there are two JIRAs here, or why you

[jira] [Updated] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13798: Description: If the Aggregate does not have any aggregate expression, it is useless. We can replace

[jira] [Updated] (SPARK-13430) Expose ml summary function in PySpark for classification and regression models

2016-03-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath updated SPARK-13430: --- Assignee: Bryan Cutler > Expose ml summary function in PySpark for classification and

[jira] [Created] (SPARK-13795) ClassCast Exception while attempting to show() a DataFrame

2016-03-09 Thread Ganesh Krishnan (JIRA)
Ganesh Krishnan created SPARK-13795: --- Summary: ClassCast Exception while attempting to show() a DataFrame Key: SPARK-13795 URL: https://issues.apache.org/jira/browse/SPARK-13795 Project: Spark

[jira] [Commented] (SPARK-12626) MLlib 2.0 Roadmap

2016-03-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188774#comment-15188774 ] Nick Pentreath commented on SPARK-12626: [~dbtsai] ok thanks - would like to take a look when

[jira] [Commented] (SPARK-13797) Eliminate Unnecessary Window

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188818#comment-15188818 ] Apache Spark commented on SPARK-13797: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13798: Assignee: Apache Spark > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Assigned] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13798: Assignee: (was: Apache Spark) > Replace Aggregate by Project if no Aggregate Function

[jira] [Resolved] (SPARK-13706) Python Example for Train Validation Split Missing

2016-03-09 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-13706. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11547

[jira] [Reopened] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-13798: - > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Updated] (SPARK-12957) Derive and propagate data constrains in logical plan

2016-03-09 Thread Sameer Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-12957: --- Attachment: ConstraintPropagationinSparkSQL.pdf Design Document > Derive and propagate data

[jira] [Closed] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-13798. --- Resolution: Later > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Updated] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13798: Description: If the Aggregate does not have any aggregate expression, it is useless. We can replace

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-03-09 Thread Praveen Devarao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188761#comment-15188761 ] Praveen Devarao commented on SPARK-12177: - Hi Cody, The last time when I got TopicParition and

[jira] [Updated] (SPARK-13796) Lock release errors occur frequently in executor logs

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13796: -- Priority: Minor (was: Major) Do you have more detail on how to reproduce it? It's good that you think

[jira] [Closed] (SPARK-13798) Replace Aggregate by Project if no Aggregate Function exists

2016-03-09 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-13798. --- Resolution: Invalid > Replace Aggregate by Project if no Aggregate Function exists >

[jira] [Updated] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13774: -- Environment: (was: today's build) Ah, I thought I had the latest build, but it was a couple of

[jira] [Commented] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187707#comment-15187707 ] Thomas Graves commented on SPARK-13775: --- As I stated in the PR, I merged that in because it was

[jira] [Commented] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187736#comment-15187736 ] Apache Spark commented on SPARK-13775: -- User 'zhuoliu' has created a pull request for this issue:

[jira] [Created] (SPARK-13778) Master's ApplicationPage displays wrong application executor state when a worker is lost

2016-03-09 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-13778: Summary: Master's ApplicationPage displays wrong application executor state when a worker is lost Key: SPARK-13778 URL: https://issues.apache.org/jira/browse/SPARK-13778

[jira] [Assigned] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13775: Assignee: (was: Apache Spark) > history server sort by completed time by default >

[jira] [Created] (SPARK-13780) SQL "incremental" build in maven is broken

2016-03-09 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-13780: -- Summary: SQL "incremental" build in maven is broken Key: SPARK-13780 URL: https://issues.apache.org/jira/browse/SPARK-13780 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187820#comment-15187820 ] Thomas Graves commented on SPARK-13775: --- Note those were basically rhetorical questions. You are

[jira] [Commented] (SPARK-13776) Web UI is not available after ./sbin/start-master.sh

2016-03-09 Thread Erik O'Shaughnessy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187693#comment-15187693 ] Erik O'Shaughnessy commented on SPARK-13776: Quite agree, this is a Minor and not Major

[jira] [Commented] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187695#comment-15187695 ] Imran Younus commented on SPARK-13777: -- My solution to this problem is to remove columns and rows

[jira] [Assigned] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13775: Assignee: Apache Spark > history server sort by completed time by default >

[jira] [Resolved] (SPARK-13615) GeneralizedLinearRegression support save/load

2016-03-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-13615. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11465

[jira] [Resolved] (SPARK-13523) Reuse the exchanges in a query

2016-03-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13523. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11403

[jira] [Assigned] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12313: Assignee: Apache Spark (was: Harsh Gupta) > getPartitionsByFilter doesnt handle

[jira] [Commented] (SPARK-12313) getPartitionsByFilter doesnt handle predicates on all / multiple Partition Columns

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187645#comment-15187645 ] Apache Spark commented on SPARK-12313: -- User 'squito' has created a pull request for this issue:

[jira] [Created] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Imran Younus (JIRA)
Imran Younus created SPARK-13777: Summary: Weighted Leaset Squares fails when there are features with identical values. Key: SPARK-13777 URL: https://issues.apache.org/jira/browse/SPARK-13777

[jira] [Updated] (SPARK-13642) Properly handle signal kill of ApplicationMaster

2016-03-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13642: -- Assignee: Saisai Shao > Properly handle signal kill of ApplicationMaster >

[jira] [Commented] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187804#comment-15187804 ] Thomas Graves commented on SPARK-13775: --- why does it really matter? Did the version I merged harm

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-03-09 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187847#comment-15187847 ] Cody Koeninger commented on SPARK-12177: Anybody want to volunteer to fight the good fight with

[jira] [Commented] (SPARK-12626) MLlib 2.0 Roadmap

2016-03-09 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187639#comment-15187639 ] DB Tsai commented on SPARK-12626: - I'm working on it now. Will post it in couple days. Thanks. > MLlib

[jira] [Commented] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187738#comment-15187738 ] Sean Owen commented on SPARK-13775: --- Yes, but you also seemed to already know you favored a different

[jira] [Updated] (SPARK-13615) GeneralizedLinearRegression support save/load

2016-03-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13615: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target

[jira] [Commented] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187853#comment-15187853 ] Sean Owen commented on SPARK-13777: --- Ah that's right, thank you. I should have thought that through. >

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-03-09 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187613#comment-15187613 ] Cody Koeninger commented on SPARK-12177: If anyone wants to take a look at the stuff I'm hacking

[jira] [Commented] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Imran Younus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187791#comment-15187791 ] Imran Younus commented on SPARK-13777: -- My understanding is that the Cholesky decomposition method

[jira] [Assigned] (SPARK-10907) Get rid of pending unroll memory

2016-03-09 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-10907: -- Assignee: Josh Rosen > Get rid of pending unroll memory > >

[jira] [Resolved] (SPARK-13242) Moderately complex `when` expression causes code generation failure

2016-03-09 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13242. Resolution: Fixed Fix Version/s: 1.6.2 2.0.0 Issue resolved by pull

[jira] [Assigned] (SPARK-13778) Master's ApplicationPage displays wrong application executor state when a worker is lost

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13778: Assignee: Shixiong Zhu (was: Apache Spark) > Master's ApplicationPage displays wrong

[jira] [Commented] (SPARK-13778) Master's ApplicationPage displays wrong application executor state when a worker is lost

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187744#comment-15187744 ] Apache Spark commented on SPARK-13778: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13778) Master's ApplicationPage displays wrong application executor state when a worker is lost

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13778: Assignee: Apache Spark (was: Shixiong Zhu) > Master's ApplicationPage displays wrong

[jira] [Updated] (SPARK-13779) YarnAllocator cancels and resubmits container requests with no locality preference

2016-03-09 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Blue updated SPARK-13779: -- Description: SPARK-9817 attempts to improve locality by considering the set of pending container

[jira] [Commented] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187837#comment-15187837 ] Apache Spark commented on SPARK-13777: -- User 'iyounus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13777: Assignee: (was: Apache Spark) > Weighted Leaset Squares fails when there are features

[jira] [Assigned] (SPARK-13777) Weighted Leaset Squares fails when there are features with identical values.

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13777: Assignee: Apache Spark > Weighted Leaset Squares fails when there are features with

[jira] [Commented] (SPARK-13775) history server sort by completed time by default

2016-03-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187835#comment-15187835 ] Sean Owen commented on SPARK-13775: --- In practice, this is tiny no matter what, but in principle: It's

[jira] [Created] (SPARK-13781) Use ExpressionSets in ConstraintPropagationSuite

2016-03-09 Thread Sameer Agarwal (JIRA)
Sameer Agarwal created SPARK-13781: -- Summary: Use ExpressionSets in ConstraintPropagationSuite Key: SPARK-13781 URL: https://issues.apache.org/jira/browse/SPARK-13781 Project: Spark Issue

[jira] [Assigned] (SPARK-13781) Use ExpressionSets in ConstraintPropagationSuite

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13781: Assignee: Apache Spark > Use ExpressionSets in ConstraintPropagationSuite >

[jira] [Assigned] (SPARK-13781) Use ExpressionSets in ConstraintPropagationSuite

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13781: Assignee: (was: Apache Spark) > Use ExpressionSets in ConstraintPropagationSuite >

[jira] [Commented] (SPARK-13781) Use ExpressionSets in ConstraintPropagationSuite

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187891#comment-15187891 ] Apache Spark commented on SPARK-13781: -- User 'sameeragarwal' has created a pull request for this

[jira] [Updated] (SPARK-13527) Prune Filters based on Constraints

2016-03-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13527: - Assignee: Xiao Li > Prune Filters based on Constraints >

[jira] [Assigned] (SPARK-13779) YarnAllocator cancels and resubmits container requests with no locality preference

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13779: Assignee: (was: Apache Spark) > YarnAllocator cancels and resubmits container

[jira] [Commented] (SPARK-13779) YarnAllocator cancels and resubmits container requests with no locality preference

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15187950#comment-15187950 ] Apache Spark commented on SPARK-13779: -- User 'rdblue' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13779) YarnAllocator cancels and resubmits container requests with no locality preference

2016-03-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13779: Assignee: Apache Spark > YarnAllocator cancels and resubmits container requests with no

[jira] [Issue Comment Deleted] (SPARK-13073) creating R like summary for logistic Regression in Spark - Scala

2016-03-09 Thread Mohamed Baddar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohamed Baddar updated SPARK-13073: --- Comment: was deleted (was: [~josephkb] If no body is working on it , can i start working on

[jira] [Updated] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-03-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-13783: -- Issue Type: Sub-task (was: New Feature) Parent: SPARK-6725 > Model

[jira] [Created] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-03-09 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-13783: - Summary: Model export/import for spark.ml: GBTs Key: SPARK-13783 URL: https://issues.apache.org/jira/browse/SPARK-13783 Project: Spark Issue Type:

[jira] [Commented] (SPARK-10691) Make LogisticRegressionModel.evaluate() method public

2016-03-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15188133#comment-15188133 ] Joseph K. Bradley commented on SPARK-10691: --- [~invkrh] Apologies for the inaction on this

[jira] [Updated] (SPARK-10691) Make LogisticRegressionModel.evaluate() method public

2016-03-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10691?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10691: -- Affects Version/s: (was: 1.5.0) Target Version/s: 2.0.0 > Make

[jira] [Resolved] (SPARK-13527) Prune Filters based on Constraints

2016-03-09 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13527. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11406

  1   2   3   >