[jira] [Commented] (SPARK-3727) Trees and ensembles: More prediction functionality

[ https://issues.apache.org/jira/browse/SPARK-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651520#comment-14651520 ] Max Kaznady commented on SPARK-3727: I am currently away from the office and will resp

[jira] [Commented] (SPARK-3727) Trees and ensembles: More prediction functionality

[ https://issues.apache.org/jira/browse/SPARK-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651512#comment-14651512 ] Yanbo Liang commented on SPARK-3727: [~josephkb] 1, What is the definition of "varian

[jira] [Assigned] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9552: --- Assignee: (was: Apache Spark) > Add force control for killExecutors to avoid false killin

[jira] [Commented] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651505#comment-14651505 ] Apache Spark commented on SPARK-9552: - User 'GraceH' has created a pull request for th

[jira] [Assigned] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9552: --- Assignee: Apache Spark > Add force control for killExecutors to avoid false killing for those

[jira] [Created] (SPARK-9552) Add force control for killExecutors to avoid false killing for those busy executors

Jie Huang created SPARK-9552: Summary: Add force control for killExecutors to avoid false killing for those busy executors Key: SPARK-9552 URL: https://issues.apache.org/jira/browse/SPARK-9552 Project: Sp

[jira] [Commented] (SPARK-8839) Thrift Sever will throw `java.util.NoSuchElementException: key not found` exception when many clients connect it

[ https://issues.apache.org/jira/browse/SPARK-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651502#comment-14651502 ] Apache Spark commented on SPARK-8839: - User 'SaintBacchus' has created a pull request

[jira] [Resolved] (SPARK-9413) Support MapType in Tungsten

[ https://issues.apache.org/jira/browse/SPARK-9413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9413. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > Support MapType in Tu

[jira] [Resolved] (SPARK-9542) create unsafe version of map type

[ https://issues.apache.org/jira/browse/SPARK-9542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9542. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > create unsafe version

[jira] [Resolved] (SPARK-9389) Support ArrayType in Tungsten

[ https://issues.apache.org/jira/browse/SPARK-9389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9389. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > Support ArrayType in

[jira] [Resolved] (SPARK-9404) UnsafeArrayData

[ https://issues.apache.org/jira/browse/SPARK-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9404. Resolution: Fixed Fix Version/s: 1.5.0 > UnsafeArrayData > --- > >

[jira] [Resolved] (SPARK-9372) For a join operator, rows with null equal join key expression can be filtered out early

[ https://issues.apache.org/jira/browse/SPARK-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9372. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7768 [https://github.com/

[jira] [Commented] (SPARK-9512) Fix the bug introduced by the pr for SPARK-9251

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651495#comment-14651495 ] Apache Spark commented on SPARK-9512: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9512) Fix the bug introduced by the pr for SPARK-9251

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9512: --- Assignee: (was: Apache Spark) > Fix the bug introduced by the pr for SPARK-9251 > ---

[jira] [Assigned] (SPARK-9512) Fix the bug introduced by the pr for SPARK-9251

[ https://issues.apache.org/jira/browse/SPARK-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9512: --- Assignee: Apache Spark > Fix the bug introduced by the pr for SPARK-9251 > --

[jira] [Updated] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5992: - Affects Version/s: (was: 1.4.0) > Locality Sensitive Hashing (LSH) for MLlib > ---

[jira] [Updated] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5992: - Target Version/s: 1.6.0 (was: 1.5.0) > Locality Sensitive Hashing (LSH) for MLlib > -

[jira] [Commented] (SPARK-7871) Improve the outputPartitioning for HashOuterJoin(full outer join)

[ https://issues.apache.org/jira/browse/SPARK-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651484#comment-14651484 ] Apache Spark commented on SPARK-7871: - User 'yhuai' has created a pull request for thi

[jira] [Resolved] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9537. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7866 [https

[jira] [Resolved] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9538. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7866 [https

[jira] [Resolved] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-9536. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7866 [https

[jira] [Assigned] (SPARK-9551) add copyTo for UnsafeRow to reuse a copy buffer

[ https://issues.apache.org/jira/browse/SPARK-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9551: --- Assignee: (was: Apache Spark) > add copyTo for UnsafeRow to reuse a copy buffer > ---

[jira] [Commented] (SPARK-9499) Possible file handle leak in spilling/sort code

[ https://issues.apache.org/jira/browse/SPARK-9499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651446#comment-14651446 ] Josh Rosen commented on SPARK-9499: --- [~hvanhovell], I think that I may have found and fi

[jira] [Commented] (SPARK-9551) add copyTo for UnsafeRow to reuse a copy buffer

[ https://issues.apache.org/jira/browse/SPARK-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651444#comment-14651444 ] Apache Spark commented on SPARK-9551: - User 'cloud-fan' has created a pull request for

[jira] [Assigned] (SPARK-9551) add copyTo for UnsafeRow to reuse a copy buffer

[ https://issues.apache.org/jira/browse/SPARK-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9551: --- Assignee: Apache Spark > add copyTo for UnsafeRow to reuse a copy buffer > --

[jira] [Created] (SPARK-9551) add copyTo for UnsafeRow to reuse a copy buffer

Wenchen Fan created SPARK-9551: -- Summary: add copyTo for UnsafeRow to reuse a copy buffer Key: SPARK-9551 URL: https://issues.apache.org/jira/browse/SPARK-9551 Project: Spark Issue Type: Improve

[jira] [Commented] (SPARK-8939) YARN EC2 default setting fails with IllegalArgumentException

[ https://issues.apache.org/jira/browse/SPARK-8939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651436#comment-14651436 ] Shivaram Venkataraman commented on SPARK-8939: -- [~andrewor14] I ran into this

[jira] [Created] (SPARK-9550) Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket)

Josh Rosen created SPARK-9550: - Summary: Configuration renaming, defaults changes, and deprecation for 1.5.0 (master ticket) Key: SPARK-9550 URL: https://issues.apache.org/jira/browse/SPARK-9550 Project:

[jira] [Assigned] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7685: --- Assignee: DB Tsai (was: Apache Spark) > Handle high imbalanced data and apply weights to dif

[jira] [Assigned] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7685: --- Assignee: Apache Spark (was: DB Tsai) > Handle high imbalanced data and apply weights to dif

[jira] [Commented] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651413#comment-14651413 ] Apache Spark commented on SPARK-7685: - User 'dbtsai' has created a pull request for th

[jira] [Resolved] (SPARK-2205) Unnecessary exchange operators in a join on multiple tables with the same join key.

[ https://issues.apache.org/jira/browse/SPARK-2205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2205. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7773 [https://github.com/apac

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651367#comment-14651367 ] Hossein Falaki commented on SPARK-9319: --- Yes. I will submit a PR. > Add support for

[jira] [Commented] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651360#comment-14651360 ] Apache Spark commented on SPARK-8505: - User 'yu-iskw' has created a pull request for t

[jira] [Assigned] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8505: --- Assignee: (was: Apache Spark) > Add settings to kick `lint-r` from `./dev/run-test.py` >

[jira] [Assigned] (SPARK-8505) Add settings to kick `lint-r` from `./dev/run-test.py`

[ https://issues.apache.org/jira/browse/SPARK-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8505: --- Assignee: Apache Spark > Add settings to kick `lint-r` from `./dev/run-test.py` > ---

[jira] [Assigned] (SPARK-9549) minor bug fix in expressions

[ https://issues.apache.org/jira/browse/SPARK-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9549: --- Assignee: (was: Apache Spark) > minor bug fix in expressions > --

[jira] [Commented] (SPARK-9549) minor bug fix in expressions

[ https://issues.apache.org/jira/browse/SPARK-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651355#comment-14651355 ] Apache Spark commented on SPARK-9549: - User 'yjshen' has created a pull request for th

[jira] [Assigned] (SPARK-9549) minor bug fix in expressions

[ https://issues.apache.org/jira/browse/SPARK-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9549: --- Assignee: Apache Spark > minor bug fix in expressions > > >

[jira] [Resolved] (SPARK-9546) Centralize orderable data type checking

[ https://issues.apache.org/jira/browse/SPARK-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9546. Resolution: Fixed Fix Version/s: 1.5.0 > Centralize orderable data type checking > --

[jira] [Created] (SPARK-9549) minor bug fix in expressions

Yijie Shen created SPARK-9549: - Summary: minor bug fix in expressions Key: SPARK-9549 URL: https://issues.apache.org/jira/browse/SPARK-9549 Project: Spark Issue Type: Sub-task Reporte

[jira] [Resolved] (SPARK-9535) Modify document for codegen

[ https://issues.apache.org/jira/browse/SPARK-9535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9535. Resolution: Fixed Fix Version/s: 1.5.0 > Modify document for codegen > --

[jira] [Updated] (SPARK-9537) DecisionTreeClassifierModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9537: - Shepherd: Joseph K. Bradley > DecisionTreeClassifierModel support probability prediction f

[jira] [Updated] (SPARK-9538) LogisticRegression support raw and probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9538: - Shepherd: Joseph K. Bradley > LogisticRegression support raw and probability prediction fo

[jira] [Updated] (SPARK-9536) NaiveBayesModel support probability prediction for PySpark.ml

[ https://issues.apache.org/jira/browse/SPARK-9536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9536: - Shepherd: Joseph K. Bradley > NaiveBayesModel support probability prediction for PySpark.m

[jira] [Created] (SPARK-9548) BytesToBytesMap could have a destructive iterator

Josh Rosen created SPARK-9548: - Summary: BytesToBytesMap could have a destructive iterator Key: SPARK-9548 URL: https://issues.apache.org/jira/browse/SPARK-9548 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-8873) Support cleaning up shuffle files when using shuffle service in Mesos

[ https://issues.apache.org/jira/browse/SPARK-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651339#comment-14651339 ] Apache Spark commented on SPARK-8873: - User 'andrewor14' has created a pull request fo

[jira] [Commented] (SPARK-6667) hang while collect in PySpark

[ https://issues.apache.org/jira/browse/SPARK-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651337#comment-14651337 ] Ari Meyer commented on SPARK-6667: -- I was using 1.2.0 and didn't have this problem. I ju

[jira] [Commented] (SPARK-9245) DistributedLDAModel predict top topic per doc-term instance

[ https://issues.apache.org/jira/browse/SPARK-9245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651319#comment-14651319 ] Meihua Wu commented on SPARK-9245: -- [~josephkb]: would like to confirm: (using notation A

[jira] [Resolved] (SPARK-9543) Add randomized testing for UnsafeKVExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9543. Resolution: Fixed Fix Version/s: 1.5.0 > Add randomized testing for UnsafeKVExternalSorter >

[jira] [Updated] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7937: --- Labels: releasenotes (was: ) > Cannot compare Hive named_struct. (when using argmax, argmin) > --

[jira] [Resolved] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7937. Resolution: Fixed Fix Version/s: 1.5.0 > Cannot compare Hive named_struct. (when using argmax

[jira] [Resolved] (SPARK-6683) Handling feature scaling properly for GLMs

[ https://issues.apache.org/jira/browse/SPARK-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6683. -- Resolution: Duplicate Fix Version/s: 1.5.0 > Handling feature scaling properly fo

[jira] [Commented] (SPARK-6683) Handling feature scaling properly for GLMs

[ https://issues.apache.org/jira/browse/SPARK-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651308#comment-14651308 ] Joseph K. Bradley commented on SPARK-6683: -- Sounds good to me. > Handling featur

[jira] [Commented] (SPARK-9546) Centralize orderable data type checking

[ https://issues.apache.org/jira/browse/SPARK-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651282#comment-14651282 ] Apache Spark commented on SPARK-9546: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9546) Centralize orderable data type checking

[ https://issues.apache.org/jira/browse/SPARK-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9546: --- Assignee: Reynold Xin (was: Apache Spark) > Centralize orderable data type checking > --

[jira] [Assigned] (SPARK-9546) Centralize orderable data type checking

[ https://issues.apache.org/jira/browse/SPARK-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9546: --- Assignee: Apache Spark (was: Reynold Xin) > Centralize orderable data type checking > --

[jira] [Commented] (SPARK-6683) Handling feature scaling properly for GLMs

[ https://issues.apache.org/jira/browse/SPARK-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651269#comment-14651269 ] DB Tsai commented on SPARK-6683: I think we can close this one. They are addressed in htt

[jira] [Resolved] (SPARK-7518) Tests for comparing probability and prediction in binary logistic regression against R

[ https://issues.apache.org/jira/browse/SPARK-7518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-7518. Resolution: Won't Fix > Tests for comparing probability and prediction in binary logistic regression > agai

[jira] [Commented] (SPARK-9544) RFormula in Python

[ https://issues.apache.org/jira/browse/SPARK-9544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651263#comment-14651263 ] Apache Spark commented on SPARK-9544: - User 'mengxr' has created a pull request for th

[jira] [Assigned] (SPARK-9544) RFormula in Python

[ https://issues.apache.org/jira/browse/SPARK-9544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9544: --- Assignee: Xiangrui Meng (was: Apache Spark) > RFormula in Python > -- > >

[jira] [Assigned] (SPARK-9544) RFormula in Python

[ https://issues.apache.org/jira/browse/SPARK-9544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9544: --- Assignee: Apache Spark (was: Xiangrui Meng) > RFormula in Python > -- > >

[jira] [Issue Comment Deleted] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

[ https://issues.apache.org/jira/browse/SPARK-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9524: - Comment: was deleted (was: User 'mengxr' has created a pull request for this issue: https://github

[jira] [Commented] (SPARK-9547) Allow testing pull requests with different Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651261#comment-14651261 ] Apache Spark commented on SPARK-9547: - User 'pwendell' has created a pull request for

[jira] [Assigned] (SPARK-9547) Allow testing pull requests with different Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9547: --- Assignee: Apache Spark (was: Patrick Wendell) > Allow testing pull requests with different H

[jira] [Assigned] (SPARK-9547) Allow testing pull requests with different Hadoop versions

[ https://issues.apache.org/jira/browse/SPARK-9547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9547: --- Assignee: Patrick Wendell (was: Apache Spark) > Allow testing pull requests with different H

[jira] [Commented] (SPARK-9524) Latest Spark (8765665015ef47a23e00f7d01d4d280c31bb236d) breaks (pyspark)

[ https://issues.apache.org/jira/browse/SPARK-9524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651259#comment-14651259 ] Apache Spark commented on SPARK-9524: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-9547) Allow testing pull requests with different Hadoop versions

Patrick Wendell created SPARK-9547: -- Summary: Allow testing pull requests with different Hadoop versions Key: SPARK-9547 URL: https://issues.apache.org/jira/browse/SPARK-9547 Project: Spark

[jira] [Assigned] (SPARK-9545) Run Maven tests in pull request builder if title has "[maven-test]" in it

[ https://issues.apache.org/jira/browse/SPARK-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9545: --- Assignee: Patrick Wendell (was: Apache Spark) > Run Maven tests in pull request builder if t

[jira] [Commented] (SPARK-9545) Run Maven tests in pull request builder if title has "[maven-test]" in it

[ https://issues.apache.org/jira/browse/SPARK-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651246#comment-14651246 ] Apache Spark commented on SPARK-9545: - User 'pwendell' has created a pull request for

[jira] [Assigned] (SPARK-9545) Run Maven tests in pull request builder if title has "[maven-test]" in it

[ https://issues.apache.org/jira/browse/SPARK-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9545: --- Assignee: Apache Spark (was: Patrick Wendell) > Run Maven tests in pull request builder if t

[jira] [Created] (SPARK-9546) Centralize orderable data type checking

Reynold Xin created SPARK-9546: -- Summary: Centralize orderable data type checking Key: SPARK-9546 URL: https://issues.apache.org/jira/browse/SPARK-9546 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-9545) Run Maven tests in pull request builder if title has "[maven-test]" in it

[ https://issues.apache.org/jira/browse/SPARK-9545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-9545: --- Issue Type: Improvement (was: Bug) > Run Maven tests in pull request builder if title has "[m

[jira] [Updated] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7937: --- Assignee: Liang-Chi Hsieh > Cannot compare Hive named_struct. (when using argmax, argmin) > --

[jira] [Created] (SPARK-9545) Run Maven tests in pull request builder if title has "[maven-test]" in it

Patrick Wendell created SPARK-9545: -- Summary: Run Maven tests in pull request builder if title has "[maven-test]" in it Key: SPARK-9545 URL: https://issues.apache.org/jira/browse/SPARK-9545 Project:

[jira] [Commented] (SPARK-7937) Cannot compare Hive named_struct. (when using argmax, argmin)

[ https://issues.apache.org/jira/browse/SPARK-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651232#comment-14651232 ] Apache Spark commented on SPARK-7937: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-8064) Upgrade Hive to 1.2

[ https://issues.apache.org/jira/browse/SPARK-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651216#comment-14651216 ] Apache Spark commented on SPARK-8064: - User 'pwendell' has created a pull request for

[jira] [Commented] (SPARK-8601) Add an option to disable feature scaling in Linear Regression

[ https://issues.apache.org/jira/browse/SPARK-8601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651215#comment-14651215 ] Apache Spark commented on SPARK-8601: - User 'dbtsai' has created a pull request for th

[jira] [Assigned] (SPARK-9544) RFormula in Python

[ https://issues.apache.org/jira/browse/SPARK-9544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reassigned SPARK-9544: Assignee: Xiangrui Meng > RFormula in Python > -- > > Key:

[jira] [Created] (SPARK-9544) RFormula in Python

Xiangrui Meng created SPARK-9544: Summary: RFormula in Python Key: SPARK-9544 URL: https://issues.apache.org/jira/browse/SPARK-9544 Project: Spark Issue Type: New Feature Components

[jira] [Assigned] (SPARK-8949) Remove references to preferredNodeLocalityData in javadoc and print warning when used

[ https://issues.apache.org/jira/browse/SPARK-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8949: --- Assignee: Apache Spark > Remove references to preferredNodeLocalityData in javadoc and print

[jira] [Commented] (SPARK-8949) Remove references to preferredNodeLocalityData in javadoc and print warning when used

[ https://issues.apache.org/jira/browse/SPARK-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651200#comment-14651200 ] Apache Spark commented on SPARK-8949: - User 'darkjh' has created a pull request for th

[jira] [Assigned] (SPARK-8949) Remove references to preferredNodeLocalityData in javadoc and print warning when used

[ https://issues.apache.org/jira/browse/SPARK-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8949: --- Assignee: (was: Apache Spark) > Remove references to preferredNodeLocalityData in javadoc

[jira] [Updated] (SPARK-6809) Make numPartitions optional in pairRDD APIs

[ https://issues.apache.org/jira/browse/SPARK-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6809: - Target Version/s: (was: 1.5.0) > Make numPartitions optional in pairRDD APIs > -

[jira] [Commented] (SPARK-6798) Fix Date serialization in SparkR

[ https://issues.apache.org/jira/browse/SPARK-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651199#comment-14651199 ] Shivaram Venkataraman commented on SPARK-6798: -- [~davies] Do you remember if

[jira] [Updated] (SPARK-8684) Update R version in Spark EC2 AMI

[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8684: - Target Version/s: (was: 1.5.0) > Update R version in Spark EC2 AMI > ---

[jira] [Commented] (SPARK-6831) Document how to use external data sources

[ https://issues.apache.org/jira/browse/SPARK-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651198#comment-14651198 ] Shivaram Venkataraman commented on SPARK-6831: -- [~yhuai] Is this something we

[jira] [Updated] (SPARK-6832) Handle partial reads in SparkR JVM to worker communication

[ https://issues.apache.org/jira/browse/SPARK-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6832: - Target Version/s: (was: 1.5.0) > Handle partial reads in SparkR JVM to worker co

[jira] [Updated] (SPARK-6816) Add SparkConf API to configure SparkR

[ https://issues.apache.org/jira/browse/SPARK-6816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6816: - Target Version/s: (was: 1.5.0) > Add SparkConf API to configure SparkR > ---

[jira] [Updated] (SPARK-6821) Refactor SerDe API in SparkR to be more developer friendly

[ https://issues.apache.org/jira/browse/SPARK-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6821: - Target Version/s: (was: 1.5.0) > Refactor SerDe API in SparkR to be more develop

[jira] [Updated] (SPARK-8082) Functionality to Reset DF Schemas/Cast Multiple Columns

[ https://issues.apache.org/jira/browse/SPARK-8082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-8082: - Target Version/s: (was: 1.5.0) > Functionality to Reset DF Schemas/Cast Multiple

[jira] [Updated] (SPARK-6838) Explore using Reference Classes instead of S4 objects

[ https://issues.apache.org/jira/browse/SPARK-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6838: - Target Version/s: (was: 1.5.0) > Explore using Reference Classes instead of S4 o

[jira] [Updated] (SPARK-6815) Support accumulators in R

[ https://issues.apache.org/jira/browse/SPARK-6815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6815: - Target Version/s: (was: 1.5.0) > Support accumulators in R > ---

[jira] [Updated] (SPARK-6810) Performance benchmarks for SparkR

[ https://issues.apache.org/jira/browse/SPARK-6810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6810: - Target Version/s: (was: 1.5.0) > Performance benchmarks for SparkR > ---

[jira] [Updated] (SPARK-6825) Data sources implementation to support `sequenceFile`

[ https://issues.apache.org/jira/browse/SPARK-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6825: - Target Version/s: (was: 1.5.0) > Data sources implementation to support `sequenc

[jira] [Updated] (SPARK-6803) [SparkR] Support SparkR Streaming

[ https://issues.apache.org/jira/browse/SPARK-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-6803: - Target Version/s: (was: 1.5.0) > [SparkR] Support SparkR Streaming > ---

[jira] [Commented] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651196#comment-14651196 ] Shivaram Venkataraman commented on SPARK-6823: -- [~ekhliang] [~mengxr] Is this

[jira] [Commented] (SPARK-9319) Add support for setting column names, types

[ https://issues.apache.org/jira/browse/SPARK-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651193#comment-14651193 ] Shivaram Venkataraman commented on SPARK-9319: -- [~falaki] I believe we alread

[jira] [Updated] (SPARK-9443) Expose sampleByKey in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9443: - Summary: Expose sampleByKey in SparkR (was: Explose sampleByKey in SparkR) > Expo

[jira] [Assigned] (SPARK-9543) Add randomized testing for UnsafeKVExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9543: --- Assignee: Apache Spark (was: Reynold Xin) > Add randomized testing for UnsafeKVExternalSorte

  1   2   >