[jira] [Commented] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085130#comment-15085130 ] somil deshmukh commented on SPARK-12632: I am working on this,will send pull request today >

[jira] [Commented] (SPARK-10383) Sync example code between API doc and user guide

[ https://issues.apache.org/jira/browse/SPARK-10383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085167#comment-15085167 ] Xusen Yin commented on SPARK-10383: --- I think we only (almost) finished the step 1 - moving example

[jira] [Updated] (SPARK-12393) Add read.text and write.text for SparkR

[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12393: -- Assignee: Yanbo Liang > Add read.text and write.text for SparkR >

[jira] [Commented] (SPARK-3872) Rewrite the test for ActorInputStream.

[ https://issues.apache.org/jira/browse/SPARK-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084983#comment-15084983 ] Prashant Sharma commented on SPARK-3872: The reason this exist is, we had the version of typesafe

[jira] [Created] (SPARK-12665) Remove deprecated and unused classes

Kousuke Saruta created SPARK-12665: -- Summary: Remove deprecated and unused classes Key: SPARK-12665 URL: https://issues.apache.org/jira/browse/SPARK-12665 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085005#comment-15085005 ] Brian Pasley commented on SPARK-12662: -- Users' expectation for randomSplit probably doesn't realize

[jira] [Created] (SPARK-12666) spark-shell --packages cannot load artifacts which are publishLocal'd by SBT

Josh Rosen created SPARK-12666: -- Summary: spark-shell --packages cannot load artifacts which are publishLocal'd by SBT Key: SPARK-12666 URL: https://issues.apache.org/jira/browse/SPARK-12666 Project:

[jira] [Updated] (SPARK-12666) spark-shell --packages cannot load artifacts which are publishLocal'd by SBT

[ https://issues.apache.org/jira/browse/SPARK-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12666: --- Description: Symptom: I cloned the latest master of {{spark-redshift}}, then used {{sbt

[jira] [Created] (SPARK-12659) NPE when spill in CartisianProduct

Davies Liu created SPARK-12659: -- Summary: NPE when spill in CartisianProduct Key: SPARK-12659 URL: https://issues.apache.org/jira/browse/SPARK-12659 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12658) Revert SPARK-12511

[ https://issues.apache.org/jira/browse/SPARK-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083946#comment-15083946 ] Sean Owen commented on SPARK-12658: --- This should just be part of updating py4j right? why is this a

[jira] [Comment Edited] (SPARK-12658) Revert SPARK-12511

[ https://issues.apache.org/jira/browse/SPARK-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083950#comment-15083950 ] Shixiong Zhu edited comment on SPARK-12658 at 1/5/16 10:24 PM: --- Just in

[jira] [Commented] (SPARK-12658) Revert SPARK-12511

[ https://issues.apache.org/jira/browse/SPARK-12658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083950#comment-15083950 ] Shixiong Zhu commented on SPARK-12658: -- Just in case I forgot to revert them. > Revert SPARK-12511

[jira] [Resolved] (SPARK-12570) DecisionTreeRegressor: provide variance of prediction: user guide update

[ https://issues.apache.org/jira/browse/SPARK-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12570. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10594

[jira] [Assigned] (SPARK-12379) Copy GBT implementation to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12379: Assignee: (was: Apache Spark) > Copy GBT implementation to spark.ml >

[jira] [Commented] (SPARK-12379) Copy GBT implementation to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083979#comment-15083979 ] Apache Spark commented on SPARK-12379: -- User 'sethah' has created a pull request for this issue:

[jira] [Updated] (SPARK-12368) Better doc for the binary classification evaluator' metricName

[ https://issues.apache.org/jira/browse/SPARK-12368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12368: -- Shepherd: Joseph K. Bradley Assignee: Benjamin Fradet Target

[jira] [Updated] (SPARK-7675) PySpark spark.ml Params type conversions

[ https://issues.apache.org/jira/browse/SPARK-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7675: - Shepherd: Joseph K. Bradley Assignee: holdenk Target Version/s:

[jira] [Updated] (SPARK-10789) spark-submit in cluster mode can't use third-party libraries

[ https://issues.apache.org/jira/browse/SPARK-10789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Kelly updated SPARK-10789: --- Summary: spark-submit in cluster mode can't use third-party libraries (was: Cluster mode

[jira] [Commented] (SPARK-12657) Revert SPARK-12617

[ https://issues.apache.org/jira/browse/SPARK-12657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083948#comment-15083948 ] Sean Owen commented on SPARK-12657: --- Same question as SPARK-12658 -- seems like part of updating py4j

[jira] [Closed] (SPARK-10906) More efficient SparseMatrix.equals

[ https://issues.apache.org/jira/browse/SPARK-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-10906. - Resolution: Won't Fix Target Version/s: (was: ) We'll fix this in Breeze,

[jira] [Created] (SPARK-12660) Rewrite except using anti-join

Reynold Xin created SPARK-12660: --- Summary: Rewrite except using anti-join Key: SPARK-12660 URL: https://issues.apache.org/jira/browse/SPARK-12660 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-12659) NPE when spill in CartisianProduct

[ https://issues.apache.org/jira/browse/SPARK-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12659: Assignee: Davies Liu (was: Apache Spark) > NPE when spill in CartisianProduct >

[jira] [Commented] (SPARK-12659) NPE when spill in CartisianProduct

[ https://issues.apache.org/jira/browse/SPARK-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083975#comment-15083975 ] Apache Spark commented on SPARK-12659: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12659) NPE when spill in CartisianProduct

[ https://issues.apache.org/jira/browse/SPARK-12659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12659: Assignee: Apache Spark (was: Davies Liu) > NPE when spill in CartisianProduct >

[jira] [Assigned] (SPARK-12379) Copy GBT implementation to spark.ml

[ https://issues.apache.org/jira/browse/SPARK-12379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12379: Assignee: Apache Spark > Copy GBT implementation to spark.ml >

[jira] [Commented] (SPARK-11798) Datanucleus jars is missing under lib_managed/jars

[ https://issues.apache.org/jira/browse/SPARK-11798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083640#comment-15083640 ] Josh Rosen commented on SPARK-11798: Datanucleus is only added as a dependency when the Hive build

[jira] [Resolved] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

[ https://issues.apache.org/jira/browse/SPARK-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4343. --- Resolution: Not A Problem > Mima considers protected API methods for exclusion from binary checks. >

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083646#comment-15083646 ] Josh Rosen commented on SPARK-7481: --- Hey, is this task done? I see that we have a {{hadoop2.6}} profile

[jira] [Resolved] (SPARK-1070) Add check for JIRA ticket in the Github pull request title/summary with CI

[ https://issues.apache.org/jira/browse/SPARK-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1070. --- Resolution: Won't Fix Resolving as "Won't Fix." Most contributors now submit PRs with JIRAs, so the

[jira] [Commented] (SPARK-4343) Mima considers protected API methods for exclusion from binary checks.

[ https://issues.apache.org/jira/browse/SPARK-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083651#comment-15083651 ] Josh Rosen commented on SPARK-4343: --- I'm going to resolve as "not an issue." Protected methods _should_

[jira] [Commented] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083663#comment-15083663 ] Thomas Graves commented on SPARK-12654: --- It looks like the version of getConf in HadoopRDD already

[jira] [Assigned] (SPARK-12630) Make Parameter Descriptions Consistent for PySpark MLlib Classification

[ https://issues.apache.org/jira/browse/SPARK-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12630: Assignee: Apache Spark > Make Parameter Descriptions Consistent for PySpark MLlib

[jira] [Assigned] (SPARK-12630) Make Parameter Descriptions Consistent for PySpark MLlib Classification

[ https://issues.apache.org/jira/browse/SPARK-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12630: Assignee: (was: Apache Spark) > Make Parameter Descriptions Consistent for PySpark

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082829#comment-15082829 ] Sean Owen commented on SPARK-12622: --- I don't see details of the actual problem here. Everything so far

[jira] [Commented] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082846#comment-15082846 ] Sean Owen commented on SPARK-12647: --- [~robbinspg] rather than make a new JIRA, you should reopen your

[jira] [Commented] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082847#comment-15082847 ] Apache Spark commented on SPARK-12647: -- User 'robbinspg' has created a pull request for this issue:

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082859#comment-15082859 ] Kazuaki Ishizaki commented on SPARK-3785: - To use CUDA is an intermediate approach to evaluate

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082862#comment-15082862 ] Sean Owen commented on SPARK-12622: --- Oh I see it. Ultimately I assume it's because the JAR isn't found

[jira] [Commented] (SPARK-12634) Make Parameter Descriptions Consistent for PySpark MLlib Tree

[ https://issues.apache.org/jira/browse/SPARK-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082872#comment-15082872 ] Vijay Kiran commented on SPARK-12634: - I'm editing tree.py. > Make Parameter Descriptions Consistent

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082875#comment-15082875 ] Adrian Bridgett commented on SPARK-12622: - Damn - sorry, that's my obfuscation error, so sorry

[jira] [Commented] (SPARK-12634) Make Parameter Descriptions Consistent for PySpark MLlib Tree

[ https://issues.apache.org/jira/browse/SPARK-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082890#comment-15082890 ] Apache Spark commented on SPARK-12634: -- User 'vijaykiran' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12634) Make Parameter Descriptions Consistent for PySpark MLlib Tree

[ https://issues.apache.org/jira/browse/SPARK-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12634: Assignee: (was: Apache Spark) > Make Parameter Descriptions Consistent for PySpark

[jira] [Assigned] (SPARK-12634) Make Parameter Descriptions Consistent for PySpark MLlib Tree

[ https://issues.apache.org/jira/browse/SPARK-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12634: Assignee: Apache Spark > Make Parameter Descriptions Consistent for PySpark MLlib Tree >

[jira] [Resolved] (SPARK-12331) R^2 for regression through the origin

[ https://issues.apache.org/jira/browse/SPARK-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12331. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10384

[jira] [Resolved] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1061. -- Resolution: Won't Fix > allow Hadoop RDDs to be read w/ a partitioner >

[jira] [Commented] (SPARK-12630) Make Parameter Descriptions Consistent for PySpark MLlib Classification

[ https://issues.apache.org/jira/browse/SPARK-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082821#comment-15082821 ] Apache Spark commented on SPARK-12630: -- User 'vijaykiran' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

[ https://issues.apache.org/jira/browse/SPARK-12633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Kiran updated SPARK-12633: Comment: was deleted (was: Opened a PR https://github.com/apache/spark/pull/10600) > Make

[jira] [Assigned] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

[ https://issues.apache.org/jira/browse/SPARK-12633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12633: Assignee: Apache Spark > Make Parameter Descriptions Consistent for PySpark MLlib

[jira] [Commented] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

[ https://issues.apache.org/jira/browse/SPARK-12633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082853#comment-15082853 ] Apache Spark commented on SPARK-12633: -- User 'vijaykiran' has created a pull request for this issue:

[jira] [Commented] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

[ https://issues.apache.org/jira/browse/SPARK-12633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082854#comment-15082854 ] Vijay Kiran commented on SPARK-12633: - Opened a PR https://github.com/apache/spark/pull/10600 >

[jira] [Assigned] (SPARK-12633) Make Parameter Descriptions Consistent for PySpark MLlib Regression

[ https://issues.apache.org/jira/browse/SPARK-12633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12633: Assignee: (was: Apache Spark) > Make Parameter Descriptions Consistent for PySpark

[jira] [Commented] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082879#comment-15082879 ] Pete Robbins commented on SPARK-12647: -- @sowen should I close this and move the PR? > 1.6 branch

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082921#comment-15082921 ] Tristan Reid commented on SPARK-12095: -- The SQL syntax doesn't appear to work at all. `select

[jira] [Created] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

Pete Robbins created SPARK-12647: Summary: 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator Key: SPARK-12647 URL:

[jira] [Assigned] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12647: Assignee: Apache Spark > 1.6 branch test failure >

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082855#comment-15082855 ] Adrian Bridgett commented on SPARK-12622: - The job fails with the ClassNotFound exception, if I

[jira] [Comment Edited] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082879#comment-15082879 ] Pete Robbins edited comment on SPARK-12647 at 1/5/16 11:30 AM: --- [~sowen]

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082881#comment-15082881 ] Kazuaki Ishizaki commented on SPARK-3785: - # You can specify cpu-cores by using conventional Spark

[jira] [Commented] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082889#comment-15082889 ] Sean Owen commented on SPARK-12647: --- *shrug* at this point probably doesn't matter; mostly for next

[jira] [Commented] (SPARK-12621) ArrayIndexOutOfBoundsException when running sqlContext.sql(...)

[ https://issues.apache.org/jira/browse/SPARK-12621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083835#comment-15083835 ] Josh Rosen commented on SPARK-12621: Can you please check whether this issue occurs in Spark 1.5.2?

[jira] [Resolved] (SPARK-3992) Spark 1.1.0 python binding cannot use any collections but list as Accumulators

[ https://issues.apache.org/jira/browse/SPARK-3992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3992. --- Resolution: Won't Fix Resolving as "Won't Fix" since this issue is really old and is targeted at

[jira] [Comment Edited] (SPARK-6883) Fork pyspark's cloudpickle as a separate dependency

[ https://issues.apache.org/jira/browse/SPARK-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083861#comment-15083861 ] Josh Rosen edited comment on SPARK-6883 at 1/5/16 9:39 PM: --- Closing as "Later"

[jira] [Resolved] (SPARK-6883) Fork pyspark's cloudpickle as a separate dependency

[ https://issues.apache.org/jira/browse/SPARK-6883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6883. --- Resolution: Later Closing as "Later" for now. Let's file a separate issue later down the line in

[jira] [Resolved] (SPARK-5616) Add examples for PySpark API

[ https://issues.apache.org/jira/browse/SPARK-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5616. --- Resolution: Won't Fix Resolving as "Won't fix" per discussion on PR. > Add examples for PySpark API

[jira] [Resolved] (SPARK-10499) Improve error message when constructing a hive context in PySpark with non-hive assembly

[ https://issues.apache.org/jira/browse/SPARK-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10499. Resolution: Won't Fix > Improve error message when constructing a hive context in PySpark with >

[jira] [Commented] (SPARK-10499) Improve error message when constructing a hive context in PySpark with non-hive assembly

[ https://issues.apache.org/jira/browse/SPARK-10499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083871#comment-15083871 ] Josh Rosen commented on SPARK-10499: This will no longer be necessary once we remove the need to set

[jira] [Resolved] (SPARK-12511) streaming driver with checkpointing unable to finalize leading to OOM

[ https://issues.apache.org/jira/browse/SPARK-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12511. Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved by pull

[jira] [Commented] (SPARK-9313) Enable a "docker run" invocation in place of PYSPARK_PYTHON

[ https://issues.apache.org/jira/browse/SPARK-9313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083879#comment-15083879 ] Josh Rosen commented on SPARK-9313: --- Just curious: why can't {{PYSPARK_PYTHON}} just point to a bash

[jira] [Resolved] (SPARK-2371) Show locally-running tasks (e.g. from take()) in web UI

[ https://issues.apache.org/jira/browse/SPARK-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2371. --- Resolution: Won't Fix Resolving as "Won't Fix", now that we've fully removed local execution. > Show

[jira] [Resolved] (SPARK-10874) add Search box to History Page

[ https://issues.apache.org/jira/browse/SPARK-10874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10874. Resolution: Duplicate Resolving as a duplicate of SPARK-10775 > add Search box to History Page >

[jira] [Created] (SPARK-12657) Revert SPARK-12617

Shixiong Zhu created SPARK-12657: Summary: Revert SPARK-12617 Key: SPARK-12657 URL: https://issues.apache.org/jira/browse/SPARK-12657 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-2579) Reading from S3 returns an inconsistent number of items with Spark 0.9.1

[ https://issues.apache.org/jira/browse/SPARK-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2579. --- Resolution: Cannot Reproduce Resolving as "cannot reproduce" pending more information. Please comment

[jira] [Resolved] (SPARK-12617) socket descriptor leak killing streaming app

[ https://issues.apache.org/jira/browse/SPARK-12617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12617. Resolution: Fixed Fix Version/s: 1.6.1 1.5.3 2.0.0

[jira] [Resolved] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-12647. -- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10599

[jira] [Updated] (SPARK-12647) 1.6 branch test failure o.a.s.sql.execution.ExchangeCoordinatorSuite.determining the number of reducers: aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-12647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12647: - Assignee: Pete Robbins > 1.6 branch test failure >

[jira] [Updated] (SPARK-12470) Incorrect calculation of row size in o.a.s.sql.catalyst.expressions.codegen.GenerateUnsafeRowJoiner

[ https://issues.apache.org/jira/browse/SPARK-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12470: - Assignee: Pete Robbins > Incorrect calculation of row size in >

[jira] [Resolved] (SPARK-584) Pass slave ip address when starting a cluster

[ https://issues.apache.org/jira/browse/SPARK-584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-584. -- Resolution: Incomplete Resolving as "incomplete." Please submit a PR if this is still an issue. > Pass

[jira] [Resolved] (SPARK-4212) Actor not found

[ https://issues.apache.org/jira/browse/SPARK-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4212. --- Resolution: Cannot Reproduce Resolving as "cannot reproduce" since this is really old. > Actor not

[jira] [Resolved] (SPARK-1835) sbt gen-idea includes both mesos and mesos with shaded-protobuf into dependencies

[ https://issues.apache.org/jira/browse/SPARK-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1835. --- Resolution: Won't Fix Resolving as "Won't Fix." Use the IntelliJ Maven / SBT import instead of

[jira] [Closed] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Irakli Machabeli closed SPARK-12095. Ignore, initially I was testing on windows without hive so HiveContext was not available. >

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083823#comment-15083823 ] Tristan Reid commented on SPARK-12095: -- Ah thanks, I see - I was using SqlContext, not HiveContext.

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083847#comment-15083847 ] Yin Huai commented on SPARK-12095: -- Does the error message that you got when using dataframe API

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083851#comment-15083851 ] Yin Huai commented on SPARK-12095: -- [~imachabeli] where did you find it? > Window function rowsBetween

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083853#comment-15083853 ] Yin Huai commented on SPARK-12095: -- Ah, I found it. It is inside column.py

[jira] [Resolved] (SPARK-6641) Add config or control of accumulator on python

[ https://issues.apache.org/jira/browse/SPARK-6641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6641. --- Resolution: Won't Fix Resolving as "Won't Fix" until there is more detail justifying this feature. >

[jira] [Resolved] (SPARK-9385) Python style check fails at jenkins

[ https://issues.apache.org/jira/browse/SPARK-9385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9385. --- Resolution: Won't Fix Resolving as "Won't Fix" for now. We'll revisit a different form of Python

[jira] [Updated] (SPARK-11815) PySpark DecisionTreeClassifier & DecisionTreeRegressor should support setSeed

[ https://issues.apache.org/jira/browse/SPARK-11815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-11815: -- Assignee: Yanbo Liang Target Version/s: 2.0.0 > PySpark

[jira] [Updated] (SPARK-12041) Add columnSimilarities to IndexedRowMatrix for PySpark

[ https://issues.apache.org/jira/browse/SPARK-12041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12041: -- Target Version/s: 2.0.0 > Add columnSimilarities to IndexedRowMatrix for PySpark >

[jira] [Resolved] (SPARK-5179) Spark UI history job duration is wrong

[ https://issues.apache.org/jira/browse/SPARK-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5179. --- Resolution: Fixed I believe that a duplicate of this issue was fixed for Spark 1.2.1 or 1.3 or

[jira] [Resolved] (SPARK-5076) Don't show "Cores" or "Memory Per Node" columns for completed applications

[ https://issues.apache.org/jira/browse/SPARK-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5076. --- Resolution: Won't Fix Resolving as "won't fix" for now. > Don't show "Cores" or "Memory Per Node"

[jira] [Updated] (SPARK-12657) Revert SPARK-12617

[ https://issues.apache.org/jira/browse/SPARK-12657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-12657: - Target Version/s: 2.0.0 > Revert SPARK-12617 > -- > > Key:

[jira] [Commented] (SPARK-10498) Add requirements file for create dev python tools

[ https://issues.apache.org/jira/browse/SPARK-10498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083778#comment-15083778 ] Josh Rosen commented on SPARK-10498: Agreed. Want to try running the tests in a sandbox to figure out

[jira] [Resolved] (SPARK-6689) MiniYarnCLuster still test failed with hadoop-2.2

[ https://issues.apache.org/jira/browse/SPARK-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6689. --- Resolution: Cannot Reproduce Resolving as "cannot reproduce" for now. > MiniYarnCLuster still test

[jira] [Updated] (SPARK-12570) DecisionTreeRegressor: provide variance of prediction: user guide update

[ https://issues.apache.org/jira/browse/SPARK-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12570: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083813#comment-15083813 ] Yin Huai commented on SPARK-12095: -- Are you using {{sqlContext.sql(yourQuery)}}? Are you using

[jira] [Resolved] (SPARK-1155) Clean up and document use of SparkEnv

[ https://issues.apache.org/jira/browse/SPARK-1155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-1155. --- Resolution: Invalid This issue is no longer relevant now that SparkEnv is no longer a thread-local.

[jira] [Updated] (SPARK-5330) Core | Scala 2.11 | Transitive dependency on com.fasterxml.jackson.core :jackson-core:2.3.1 causes compatibility issues

[ https://issues.apache.org/jira/browse/SPARK-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5330: -- Component/s: (was: Spark Core) Build > Core | Scala 2.11 | Transitive dependency

[jira] [Resolved] (SPARK-2168) History Server renered page not suitable for load balancing

[ https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-2168. --- Resolution: Fixed Fix Version/s: 1.4.2 1.3.2 > History Server renered page

[jira] [Updated] (SPARK-2168) History Server renered page not suitable for load balancing

[ https://issues.apache.org/jira/browse/SPARK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-2168: -- Assignee: Lukasz Jastrzebski > History Server renered page not suitable for load balancing >

[jira] [Commented] (SPARK-12095) Window function rowsBetween throws exception

[ https://issues.apache.org/jira/browse/SPARK-12095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083833#comment-15083833 ] Irakli Machabeli commented on SPARK-12095: -- It is mentioned briefly in API docs "Note Window

<    1   2   3   >