[jira] [Commented] (SPARK-2583) ConnectionManager cannot distinguish whether error occurred or not

[ https://issues.apache.org/jira/browse/SPARK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068240#comment-14068240 ] Patrick Wendell commented on SPARK-2583: Hey [~sarutak] - I'm curious - what is

[jira] [Comment Edited] (SPARK-2583) ConnectionManager cannot distinguish whether error occurred or not

[ https://issues.apache.org/jira/browse/SPARK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068240#comment-14068240 ] Patrick Wendell edited comment on SPARK-2583 at 7/21/14 6:03 AM:

[jira] [Updated] (SPARK-2045) Sort-based shuffle implementation

[ https://issues.apache.org/jira/browse/SPARK-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2045: --- Component/s: Spark Core Sort-based shuffle implementation

[jira] [Commented] (SPARK-1767) Prefer HDFS-cached replicas when scheduling data-local tasks

[ https://issues.apache.org/jira/browse/SPARK-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068242#comment-14068242 ] Patrick Wendell commented on SPARK-1767: I think the solution that [~adav]

[jira] [Updated] (SPARK-2579) Reading from S3 returns an inconsistent number of items with Spark 0.9.1

[ https://issues.apache.org/jira/browse/SPARK-2579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2579: --- Priority: Critical (was: Major) Reading from S3 returns an inconsistent number of items

[jira] [Resolved] (SPARK-2021) External hashing in PySpark

[ https://issues.apache.org/jira/browse/SPARK-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2021. Resolution: Duplicate I think this is a dup of SPARK-2538 - so I'm closing it. Feel free

[jira] [Updated] (SPARK-2380) Support displaying accumulator contents in the web UI

[ https://issues.apache.org/jira/browse/SPARK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2380: --- Priority: Critical (was: Major) Support displaying accumulator contents in the web UI

[jira] [Updated] (SPARK-2312) Spark Actors do not handle unknown messages in their receive methods

[ https://issues.apache.org/jira/browse/SPARK-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2312: --- Priority: Minor (was: Major) Spark Actors do not handle unknown messages in their receive

[jira] [Updated] (SPARK-1630) PythonRDDs don't handle nulls gracefully

[ https://issues.apache.org/jira/browse/SPARK-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1630: --- Component/s: SQL PythonRDDs don't handle nulls gracefully

[jira] [Updated] (SPARK-2546) Configuration object thread safety issue

[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2546: --- Target Version/s: 1.1.0 Configuration object thread safety issue

[jira] [Updated] (SPARK-1630) PythonRDDs don't handle nulls gracefully

[ https://issues.apache.org/jira/browse/SPARK-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1630: --- Target Version/s: 1.1.0 PythonRDDs don't handle nulls gracefully

[jira] [Updated] (SPARK-1630) PythonRDDs don't handle nulls gracefully

[ https://issues.apache.org/jira/browse/SPARK-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1630: --- Fix Version/s: (was: 1.1.0) PythonRDDs don't handle nulls gracefully

[jira] [Commented] (SPARK-2565) Update ShuffleReadMetrics as blocks are fetched

[ https://issues.apache.org/jira/browse/SPARK-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068262#comment-14068262 ] Apache Spark commented on SPARK-2565: - User 'sryza' has created a pull request for

[jira] [Commented] (SPARK-2103) Java + Kafka + Spark Streaming NoSuchMethodError in java.lang.Object.init

[ https://issues.apache.org/jira/browse/SPARK-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068263#comment-14068263 ] Apache Spark commented on SPARK-2103: - User 'jerryshao' has created a pull request for

[jira] [Commented] (SPARK-2599) almostEquals mllib.util.TestingUtils does not behave as expected when comparing against 0.0

[ https://issues.apache.org/jira/browse/SPARK-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068293#comment-14068293 ] Sean Owen commented on SPARK-2599: -- The problem I see with this is that it treats epsilon

[jira] [Resolved] (SPARK-2190) Specialized ColumnType for Timestamp

[ https://issues.apache.org/jira/browse/SPARK-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2190. - Resolution: Fixed Fix Version/s: 1.1.0 Specialized ColumnType for Timestamp

[jira] [Commented] (SPARK-2511) Add TF-IDF featurizer

[ https://issues.apache.org/jira/browse/SPARK-2511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068309#comment-14068309 ] Xiangrui Meng commented on SPARK-2511: -- I'm going to submit this to mllib soon. We

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068324#comment-14068324 ] Michael Armbrust commented on SPARK-2576: - This has been reported as [a regression

[jira] [Commented] (SPARK-2549) Functions defined inside of other functions trigger failures

[ https://issues.apache.org/jira/browse/SPARK-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068329#comment-14068329 ] Prashant Sharma commented on SPARK-2549: Ironically for this snippet: {noformat}

[jira] [Comment Edited] (SPARK-2549) Functions defined inside of other functions trigger failures

[ https://issues.apache.org/jira/browse/SPARK-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068329#comment-14068329 ] Prashant Sharma edited comment on SPARK-2549 at 7/21/14 9:11 AM:

[jira] [Comment Edited] (SPARK-2549) Functions defined inside of other functions trigger failures

[ https://issues.apache.org/jira/browse/SPARK-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068329#comment-14068329 ] Prashant Sharma edited comment on SPARK-2549 at 7/21/14 9:16 AM:

[jira] [Commented] (SPARK-2549) Functions defined inside of other functions trigger failures

[ https://issues.apache.org/jira/browse/SPARK-2549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068368#comment-14068368 ] Apache Spark commented on SPARK-2549: - User 'ScrapCodes' has created a pull request

[jira] [Created] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

Twinkle Sachdeva created SPARK-2604: --- Summary: Spark Application hangs on yarn in edge case scenario of executor memory requirement Key: SPARK-2604 URL: https://issues.apache.org/jira/browse/SPARK-2604

[jira] [Commented] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068391#comment-14068391 ] Twinkle Sachdeva commented on SPARK-2604: - Please assign this issue to me. Spark

[jira] [Updated] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Twinkle Sachdeva updated SPARK-2604: Description: In yarn environment, let's say : MaxAM = Maximum allocatable memory ExecMem -

[jira] [Commented] (SPARK-2434) Generate runtime warnings for naive implementations

[ https://issues.apache.org/jira/browse/SPARK-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068464#comment-14068464 ] Michael Yannakopoulos commented on SPARK-2434: -- Hi Burak, Are you working on

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068481#comment-14068481 ] Michael Yannakopoulos commented on SPARK-2550: -- I can work on this task!

[jira] [Commented] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068528#comment-14068528 ] Thomas Graves commented on SPARK-2604: -- Just to clarify, are you referring to the max

[jira] [Assigned] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-2604: Assignee: Thomas Graves Spark Application hangs on yarn in edge case scenario of executor

[jira] [Updated] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-2604: - Assignee: (was: Thomas Graves) Spark Application hangs on yarn in edge case scenario of

[jira] [Commented] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068531#comment-14068531 ] Thomas Graves commented on SPARK-2604: -- Also note that it shouldn't hang, it should

[jira] [Created] (SPARK-2605) Drop Hive Table If Exists Throw out Error by Spark

Haimei Li created SPARK-2605: Summary: Drop Hive Table If Exists Throw out Error by Spark Key: SPARK-2605 URL: https://issues.apache.org/jira/browse/SPARK-2605 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-1831) add the security guide to the More drop down menu

[ https://issues.apache.org/jira/browse/SPARK-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-1831. -- Resolution: Invalid looks like this is already got fixed. add the security guide to the More

[jira] [Created] (SPARK-2606) In some cases, pages display incorrect in spark UI

Guoqiang Li created SPARK-2606: -- Summary: In some cases, pages display incorrect in spark UI Key: SPARK-2606 URL: https://issues.apache.org/jira/browse/SPARK-2606 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2606) In some cases, pages display incorrect in spark UI

[ https://issues.apache.org/jira/browse/SPARK-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068544#comment-14068544 ] Guoqiang Li commented on SPARK-2606: PR: https://github.com/apache/spark/pull/1501

[jira] [Commented] (SPARK-2447) Add common solution for sending upsert actions to HBase (put, deletes, and increment)

[ https://issues.apache.org/jira/browse/SPARK-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068549#comment-14068549 ] Ted Malaska commented on SPARK-2447: Over the weekend I got the following done: 1.

[jira] [Commented] (SPARK-1680) Clean up use of setExecutorEnvs in SparkConf

[ https://issues.apache.org/jira/browse/SPARK-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068581#comment-14068581 ] Thomas Graves commented on SPARK-1680: -- https://github.com/apache/spark/pull/1512

[jira] [Assigned] (SPARK-1680) Clean up use of setExecutorEnvs in SparkConf

[ https://issues.apache.org/jira/browse/SPARK-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-1680: Assignee: Thomas Graves Clean up use of setExecutorEnvs in SparkConf

[jira] [Commented] (SPARK-1680) Clean up use of setExecutorEnvs in SparkConf

[ https://issues.apache.org/jira/browse/SPARK-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068584#comment-14068584 ] Apache Spark commented on SPARK-1680: - User 'tgravescs' has created a pull request for

[jira] [Comment Edited] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068648#comment-14068648 ] Twinkle Sachdeva edited comment on SPARK-2604 at 7/21/14 3:44 PM:

[jira] [Commented] (SPARK-2604) Spark Application hangs on yarn in edge case scenario of executor memory requirement

[ https://issues.apache.org/jira/browse/SPARK-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068648#comment-14068648 ] Twinkle Sachdeva commented on SPARK-2604: - For Executors, In

[jira] [Created] (SPARK-2607) SchemaRDD unionall prevents caching

Thierry Herrmann created SPARK-2607: --- Summary: SchemaRDD unionall prevents caching Key: SPARK-2607 URL: https://issues.apache.org/jira/browse/SPARK-2607 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-2608) scheduler backend create executor launch command not correctly

wangfei created SPARK-2608: -- Summary: scheduler backend create executor launch command not correctly Key: SPARK-2608 URL: https://issues.apache.org/jira/browse/SPARK-2608 Project: Spark Issue

[jira] [Commented] (SPARK-2608) scheduler backend create executor launch command not correctly

[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068710#comment-14068710 ] Apache Spark commented on SPARK-2608: - User 'scwf' has created a pull request for this

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068807#comment-14068807 ] Yin Huai commented on SPARK-2576: - Forgot to mention, I used a local cluster and spark

[jira] [Commented] (SPARK-2583) ConnectionManager cannot distinguish whether error occurred or not

[ https://issues.apache.org/jira/browse/SPARK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068814#comment-14068814 ] Kousuke Saruta commented on SPARK-2583: --- Hi [~pwendell], When I simulate disk fault

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068852#comment-14068852 ] Svend Vanderveken commented on SPARK-2576: -- Great Yin! I confirm this workaround

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068881#comment-14068881 ] Svend Vanderveken commented on SPARK-2576: -- Maybe this tuto should be updated

[jira] [Updated] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2576: Assignee: Yin Huai slave node throws NoClassDefFoundError $line11.$read$ when executing a

[jira] [Commented] (SPARK-2434) Generate runtime warnings for naive implementations

[ https://issues.apache.org/jira/browse/SPARK-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069010#comment-14069010 ] Apache Spark commented on SPARK-2434: - User 'brkyvz' has created a pull request for

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069008#comment-14069008 ] Yin Huai commented on SPARK-2576: - I tried a standalone application

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069002#comment-14069002 ] Yin Huai commented on SPARK-2576: - [~svend] Let me see what I can do about the 1.0.1 doc.

[jira] [Commented] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069038#comment-14069038 ] Patrick Wendell commented on SPARK-1199: Just a note, I've reverted this fix in

[jira] [Updated] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1199: --- Description: *NOTE: This issue was fixed in 1.0.1, but the fix was reverted in Spark 1.0.2

[jira] [Updated] (SPARK-1199) Type mismatch in Spark shell when using case class defined in shell

[ https://issues.apache.org/jira/browse/SPARK-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1199: --- Description: NOTE: This issue was fixed in 1.0.1, but the fix was reverted in Spark 1.0.2

[jira] [Updated] (SPARK-2494) Hash of None is different cross machines in CPython

[ https://issues.apache.org/jira/browse/SPARK-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2494: - Priority: Major (was: Blocker) Hash of None is different cross machines in CPython

[jira] [Updated] (SPARK-2494) Hash of None is different cross machines in CPython

[ https://issues.apache.org/jira/browse/SPARK-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2494: - Affects Version/s: 0.9.2 0.9.0 0.9.1 Hash of None

[jira] [Updated] (SPARK-2494) Hash of None is different cross machines in CPython

[ https://issues.apache.org/jira/browse/SPARK-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2494: - Fix Version/s: (was: 1.0.1) (was: 1.0.0) 0.9.3

[jira] [Updated] (SPARK-2494) Hash of None is different cross machines in CPython

[ https://issues.apache.org/jira/browse/SPARK-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2494: - Target Version/s: 1.1.0, 1.0.2, 0.9.3 (was: 1.1.0, 1.0.2) Hash of None is different cross

[jira] [Updated] (SPARK-2494) Hash of None is different cross machines in CPython

[ https://issues.apache.org/jira/browse/SPARK-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-2494: - Assignee: Davies Liu Hash of None is different cross machines in CPython

[jira] [Commented] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069107#comment-14069107 ] Xiangrui Meng commented on SPARK-2550: -- Great! Please feel free to submit a PR.

[jira] [Updated] (SPARK-2550) Support regularization and intercept in pyspark's linear methods

[ https://issues.apache.org/jira/browse/SPARK-2550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2550: - Assignee: Michael Yannakopoulos Support regularization and intercept in pyspark's linear

[jira] [Comment Edited] (SPARK-1767) Prefer HDFS-cached replicas when scheduling data-local tasks

[ https://issues.apache.org/jira/browse/SPARK-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997761#comment-13997761 ] Aaron Davidson edited comment on SPARK-1767 at 7/21/14 7:46 PM:

[jira] [Commented] (SPARK-2576) slave node throws NoClassDefFoundError $line11.$read$ when executing a Spark QL query on HDFS CSV file

[ https://issues.apache.org/jira/browse/SPARK-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069248#comment-14069248 ] Yin Huai commented on SPARK-2576: - After SPARK-1199 has been reverted, my test works now

[jira] [Commented] (SPARK-2605) Drop Hive Table If Exists Throw out Error by Spark

[ https://issues.apache.org/jira/browse/SPARK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069275#comment-14069275 ] Yin Huai commented on SPARK-2605: - It is log entry because hivetesting does not exist in

[jira] [Resolved] (SPARK-2605) Drop Hive Table If Exists Throw out Error by Spark

[ https://issues.apache.org/jira/browse/SPARK-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-2605. - Resolution: Not a Problem I am marking this as Not a Problem. Drop Hive Table If Exists Throw out

[jira] [Updated] (SPARK-2583) ConnectionManager cannot distinguish whether error occurred or not

[ https://issues.apache.org/jira/browse/SPARK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2583: --- Component/s: Spark Core ConnectionManager cannot distinguish whether error occurred or not

[jira] [Updated] (SPARK-2099) Report TaskMetrics for running tasks

[ https://issues.apache.org/jira/browse/SPARK-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2099: --- Component/s: Spark Core Report TaskMetrics for running tasks

[jira] [Updated] (SPARK-2585) Remove special handling of Hadoop JobConf

[ https://issues.apache.org/jira/browse/SPARK-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2585: --- Component/s: Spark Core Remove special handling of Hadoop JobConf

[jira] [Updated] (SPARK-2584) Do not mutate block storage level on the UI

[ https://issues.apache.org/jira/browse/SPARK-2584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2584: - Affects Version/s: (was: 1.1.0) 1.0.1 Do not mutate block storage level on

[jira] [Created] (SPARK-2609) Log thread ID when spilling ExternalAppendOnlyMap

Andrew Or created SPARK-2609: Summary: Log thread ID when spilling ExternalAppendOnlyMap Key: SPARK-2609 URL: https://issues.apache.org/jira/browse/SPARK-2609 Project: Spark Issue Type:

[jira] [Updated] (SPARK-2530) Relax incorrect assumption of one ExternalAppendOnlyMap per thread

[ https://issues.apache.org/jira/browse/SPARK-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2530: - Affects Version/s: (was: 1.1.0) 1.0.1 Relax incorrect assumption of one

[jira] [Updated] (SPARK-2300) PySpark shell hides stderr output

[ https://issues.apache.org/jira/browse/SPARK-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2300: - Affects Version/s: (was: 1.1.0) 1.0.0 PySpark shell hides stderr output

[jira] [Updated] (SPARK-2307) SparkUI Storage page cached statuses incorrect

[ https://issues.apache.org/jira/browse/SPARK-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2307: - Affects Version/s: (was: 1.0.1) 1.0.0 SparkUI Storage page cached statuses

[jira] [Updated] (SPARK-2350) Master throws NPE

[ https://issues.apache.org/jira/browse/SPARK-2350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2350: - Affects Version/s: (was: 1.1.0) 1.0.0 Master throws NPE -

[jira] [Updated] (SPARK-2423) Clean up SparkSubmit for readability

[ https://issues.apache.org/jira/browse/SPARK-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2423: - Affects Version/s: (was: 1.1.0) 1.0.1 Clean up SparkSubmit for readability

[jira] [Updated] (SPARK-2454) Separate driver spark home from executor spark home

[ https://issues.apache.org/jira/browse/SPARK-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2454: - Affects Version/s: (was: 1.1.0) 1.0.1 Separate driver spark home from

[jira] [Commented] (SPARK-2567) Resubmitted stage sometimes remains as active stage in the web UI

[ https://issues.apache.org/jira/browse/SPARK-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069311#comment-14069311 ] Apache Spark commented on SPARK-2567: - User 'tsudukim' has created a pull request for

[jira] [Updated] (SPARK-2340) Resolve paths properly for event logging / history server

[ https://issues.apache.org/jira/browse/SPARK-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2340: - Affects Version/s: (was: 1.0.0) 1.0.1 Resolve paths properly for event

[jira] [Updated] (SPARK-2435) Add shutdown hook to bin/pyspark

[ https://issues.apache.org/jira/browse/SPARK-2435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2435: - Affects Version/s: (was: 1.1.0) 1.0.1 Add shutdown hook to bin/pyspark

[jira] [Updated] (SPARK-2392) Executors should not start their own HTTP servers

[ https://issues.apache.org/jira/browse/SPARK-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2392: - Affects Version/s: (was: 1.1.0) 1.0.0 Executors should not start their own

[jira] [Updated] (SPARK-2258) Worker UI displays zombie executors

[ https://issues.apache.org/jira/browse/SPARK-2258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2258: - Affects Version/s: (was: 1.1.0) 1.0.0 Worker UI displays zombie executors

[jira] [Updated] (SPARK-2260) Spark submit standalone-cluster mode is broken

[ https://issues.apache.org/jira/browse/SPARK-2260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2260: - Affects Version/s: (was: 1.1.0) 1.0.1 Spark submit standalone-cluster mode

[jira] [Updated] (SPARK-2266) Log page on Worker UI displays Some(app-id)

[ https://issues.apache.org/jira/browse/SPARK-2266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2266: - Affects Version/s: (was: 1.1.0) 1.0.0 Log page on Worker UI displays

[jira] [Updated] (SPARK-2259) Spark submit documentation for --deploy-mode is highly misleading

[ https://issues.apache.org/jira/browse/SPARK-2259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2259: - Affects Version/s: (was: 1.1.0) 1.0.1 Spark submit documentation for

[jira] [Commented] (SPARK-2609) Log thread ID when spilling ExternalAppendOnlyMap

[ https://issues.apache.org/jira/browse/SPARK-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069327#comment-14069327 ] Apache Spark commented on SPARK-2609: - User 'andrewor14' has created a pull request

[jira] [Created] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing sqlContext.createSchemaRDD causes multiple spark applications creations

Yin Huai created SPARK-2610: --- Summary: When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing sqlContext.createSchemaRDD causes multiple spark applications creations Key: SPARK-2610

[jira] [Commented] (SPARK-2505) Weighted Regularizer

[ https://issues.apache.org/jira/browse/SPARK-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069354#comment-14069354 ] Apache Spark commented on SPARK-2505: - User 'dbtsai' has created a pull request for

[jira] [Commented] (SPARK-2602) sbt/sbt test steals window focus on OS X

[ https://issues.apache.org/jira/browse/SPARK-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069404#comment-14069404 ] Nicholas Chammas commented on SPARK-2602: - I upgraded to Java 7 and that resolved

[jira] [Updated] (SPARK-2420) Change Spark build to minimize library conflicts

[ https://issues.apache.org/jira/browse/SPARK-2420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2420: --- Target Version/s: 1.1.0 Change Spark build to minimize library conflicts

[jira] [Commented] (SPARK-2454) Separate driver spark home from executor spark home

[ https://issues.apache.org/jira/browse/SPARK-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069479#comment-14069479 ] Nan Zhu commented on SPARK-2454: there is a related issue and fix

[jira] [Updated] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method causes multiple spark applications creations

[ https://issues.apache.org/jira/browse/SPARK-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2610: Summary: When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method

[jira] [Commented] (SPARK-2022) Spark 1.0.0 is failing if mesos.coarse set to true

[ https://issues.apache.org/jira/browse/SPARK-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069508#comment-14069508 ] Timothy Chen commented on SPARK-2022: - this seems duplicate of SPARK-2020 Spark

[jira] [Updated] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method causes multiple spark applications creations

[ https://issues.apache.org/jira/browse/SPARK-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2610: Description: To reproduce, set {code} spark.serializerorg.apache.spark.serializer.KryoSerializer

[jira] [Commented] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method causes multiple spark applications creations

[ https://issues.apache.org/jira/browse/SPARK-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069510#comment-14069510 ] Yin Huai commented on SPARK-2610: - Thanks [~ilikerps] for helping me narrowing down the

[jira] [Commented] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method causes multiple spark applications creations

[ https://issues.apache.org/jira/browse/SPARK-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069513#comment-14069513 ] Yin Huai commented on SPARK-2610: - For JavaSerializer... {code} class X() {

[jira] [Updated] (SPARK-2610) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer, importing a method causes multiple spark applications creations

[ https://issues.apache.org/jira/browse/SPARK-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-2610: Priority: Minor (was: Major) When spark.serializer is set as org.apache.spark.serializer.KryoSerializer,

[jira] [Resolved] (SPARK-2434) Generate runtime warnings for naive implementations

[ https://issues.apache.org/jira/browse/SPARK-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-2434. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1515

[jira] [Closed] (SPARK-2599) almostEquals mllib.util.TestingUtils does not behave as expected when comparing against 0.0

[ https://issues.apache.org/jira/browse/SPARK-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doris Xin closed SPARK-2599. Resolution: Duplicate Refer to this issue: https://issues.apache.org/jira/browse/SPARK-2479 almostEquals

[jira] [Updated] (SPARK-2479) Comparing floating-point numbers using relative error in UnitTests

[ https://issues.apache.org/jira/browse/SPARK-2479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2479: - Assignee: DB Tsai Comparing floating-point numbers using relative error in UnitTests

  1   2   >