[jira] [Created] (SPARK-2427) Fix some of the Scala examples

Constantin Ahlmann created SPARK-2427: - Summary: Fix some of the Scala examples Key: SPARK-2427 URL: https://issues.apache.org/jira/browse/SPARK-2427 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-2409) Make SQLConf thread safe

[ https://issues.apache.org/jira/browse/SPARK-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2409. Resolution: Fixed Fix Version/s: 1.1.0 Make SQLConf thread safe

[jira] [Updated] (SPARK-2360) CSV import to SchemaRDDs

[ https://issues.apache.org/jira/browse/SPARK-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2360: --- Issue Type: New Feature (was: Bug) CSV import to SchemaRDDs

[jira] [Resolved] (SPARK-2115) Stage kill link is too close to stage details link

[ https://issues.apache.org/jira/browse/SPARK-2115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2115. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Masayoshi TSUZUKI Stage kill

[jira] [Commented] (SPARK-2418) Custom checkpointing with an external function as parameter

[ https://issues.apache.org/jira/browse/SPARK-2418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057361#comment-14057361 ] András Barják commented on SPARK-2418: -- A pull request for a simple implementation

[jira] [Created] (SPARK-2428) Add except and intersect methods to SchemaRDD.

Takuya Ueshin created SPARK-2428: Summary: Add except and intersect methods to SchemaRDD. Key: SPARK-2428 URL: https://issues.apache.org/jira/browse/SPARK-2428 Project: Spark Issue Type:

[jira] [Created] (SPARK-2429) Hierarchical Implementation of KMeans

RJ Nowling created SPARK-2429: - Summary: Hierarchical Implementation of KMeans Key: SPARK-2429 URL: https://issues.apache.org/jira/browse/SPARK-2429 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-2430) Standarized Clustering Algorithm API and Framework

RJ Nowling created SPARK-2430: - Summary: Standarized Clustering Algorithm API and Framework Key: SPARK-2430 URL: https://issues.apache.org/jira/browse/SPARK-2430 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-911) Support map pruning on sorted (K, V) RDD's

[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057508#comment-14057508 ] Aaron commented on SPARK-911: - I was just wondering about this when answering

[jira] [Commented] (SPARK-1807) Modify SPARK_EXECUTOR_URI to allow for script execution in Mesos.

[ https://issues.apache.org/jira/browse/SPARK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057511#comment-14057511 ] jay vyas commented on SPARK-1807: - Question: Are you saying the {{SPARK_EXECUTOR_URI}}

[jira] [Commented] (SPARK-2308) Add KMeans MiniBatch clustering algorithm to MLlib

[ https://issues.apache.org/jira/browse/SPARK-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057513#comment-14057513 ] RJ Nowling commented on SPARK-2308: --- That sounds like a good idea for a test. I'll

[jira] [Updated] (SPARK-2390) Files in .sparkStaging on HDFS cannot be deleted and wastes the space of HDFS

[ https://issues.apache.org/jira/browse/SPARK-2390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-2390: -- Summary: Files in .sparkStaging on HDFS cannot be deleted and wastes the space of HDFS (was:

[jira] [Commented] (SPARK-1807) Modify SPARK_EXECUTOR_URI to allow for script execution in Mesos.

[ https://issues.apache.org/jira/browse/SPARK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057592#comment-14057592 ] Timothy St. Clair commented on SPARK-1807: -- I'm saying that the URI should *only*

[jira] [Comment Edited] (SPARK-1807) Modify SPARK_EXECUTOR_URI to allow for script execution in Mesos.

[ https://issues.apache.org/jira/browse/SPARK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057592#comment-14057592 ] Timothy St. Clair edited comment on SPARK-1807 at 7/10/14 3:40 PM:

[jira] [Comment Edited] (SPARK-1807) Modify SPARK_EXECUTOR_URI to allow for script execution in Mesos.

[ https://issues.apache.org/jira/browse/SPARK-1807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057592#comment-14057592 ] Timothy St. Clair edited comment on SPARK-1807 at 7/10/14 3:40 PM:

[jira] [Commented] (SPARK-2431) Refine StringComparison and related codes.

[ https://issues.apache.org/jira/browse/SPARK-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057640#comment-14057640 ] Takuya Ueshin commented on SPARK-2431: -- PRed:

[jira] [Commented] (SPARK-2432) Apriori algorithm for frequent itemset mining

[ https://issues.apache.org/jira/browse/SPARK-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057647#comment-14057647 ] Denis LUKOVNIKOV commented on SPARK-2432: - Can I have this assigned to me please?

[jira] [Created] (SPARK-2433) The MLlib implementation for Naive Bayes in Spark 0.9.1 is having a implementation bug.

Rahul K Bhojwani created SPARK-2433: --- Summary: The MLlib implementation for Naive Bayes in Spark 0.9.1 is having a implementation bug. Key: SPARK-2433 URL: https://issues.apache.org/jira/browse/SPARK-2433

[jira] [Updated] (SPARK-2433) The MLlib implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rahul K Bhojwani updated SPARK-2433: Summary: The MLlib implementation for Naive Bayes in Spark 0.9.1 is having an

[jira] [Updated] (SPARK-2434) Generate runtime warnings for naive implementations

[ https://issues.apache.org/jira/browse/SPARK-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-2434: - Summary: Generate runtime warnings for naive implementations (was: Mark MLlib examples)

[jira] [Commented] (SPARK-2407) Implement SQL SUBSTR() directly in Catalyst

[ https://issues.apache.org/jira/browse/SPARK-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057725#comment-14057725 ] William Benton commented on SPARK-2407: --- Here's the PR:

[jira] [Created] (SPARK-2435) Add shutdown hook to bin/pyspark

Andrew Or created SPARK-2435: Summary: Add shutdown hook to bin/pyspark Key: SPARK-2435 URL: https://issues.apache.org/jira/browse/SPARK-2435 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057746#comment-14057746 ] Sean Owen commented on SPARK-2433: -- Your earlier implementation is identical to new

[jira] [Resolved] (SPARK-1776) Have Spark's SBT build read dependencies from Maven

[ https://issues.apache.org/jira/browse/SPARK-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1776. Resolution: Fixed Issue resolved by pull request 772

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057763#comment-14057763 ] Jonathan Kelly commented on SPARK-1981: --- I work for Amazon, but unfortunately I

[jira] [Commented] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057801#comment-14057801 ] Bertrand Dechoux commented on SPARK-2433: - A Jira ticket is the first step, the

[jira] [Comment Edited] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057801#comment-14057801 ] Bertrand Dechoux edited comment on SPARK-2433 at 7/10/14 6:47 PM:

[jira] [Comment Edited] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057801#comment-14057801 ] Bertrand Dechoux edited comment on SPARK-2433 at 7/10/14 6:50 PM:

[jira] [Comment Edited] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057801#comment-14057801 ] Bertrand Dechoux edited comment on SPARK-2433 at 7/10/14 6:52 PM:

[jira] [Created] (SPARK-2436) Apply size-based optimization to planning BroadcastNestedLoopJoin

Zongheng Yang created SPARK-2436: Summary: Apply size-based optimization to planning BroadcastNestedLoopJoin Key: SPARK-2436 URL: https://issues.apache.org/jira/browse/SPARK-2436 Project: Spark

[jira] [Comment Edited] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057801#comment-14057801 ] Bertrand Dechoux edited comment on SPARK-2433 at 7/10/14 6:57 PM:

[jira] [Commented] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057815#comment-14057815 ] Rahul K Bhojwani commented on SPARK-2433: - Okay fine. I will take care of the

[jira] [Commented] (SPARK-2433) In MLlib, implementation for Naive Bayes in Spark 0.9.1 is having an implementation bug.

[ https://issues.apache.org/jira/browse/SPARK-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057814#comment-14057814 ] Rahul K Bhojwani commented on SPARK-2433: - Sorry my mistake. By earlier

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057824#comment-14057824 ] Tathagata Das commented on SPARK-2345: -- I must be missing something. If you want to

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057847#comment-14057847 ] Chris Fregly commented on SPARK-1981: - hey guys- i'm in the final phases of cleanup.

[jira] [Commented] (SPARK-1458) Expose sc.version in PySpark

[ https://issues.apache.org/jira/browse/SPARK-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057857#comment-14057857 ] Patrick Wendell commented on SPARK-1458: [~nchammas] I updated the JIRA title to

[jira] [Updated] (SPARK-1458) Add programmatic way to determine Spark version

[ https://issues.apache.org/jira/browse/SPARK-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1458: --- Fix Version/s: (was: 1.0.0) Add programmatic way to determine Spark version

[jira] [Updated] (SPARK-1458) Add programmatic way to determine Spark version

[ https://issues.apache.org/jira/browse/SPARK-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1458: --- Target Version/s: 1.1.0 Add programmatic way to determine Spark version

[jira] [Commented] (SPARK-1981) Add AWS Kinesis streaming support

[ https://issues.apache.org/jira/browse/SPARK-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057872#comment-14057872 ] Urban Škudnik commented on SPARK-1981: -- Excellent, looking forward already! :) I'm

[jira] [Commented] (SPARK-1642) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-2083

[ https://issues.apache.org/jira/browse/SPARK-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057894#comment-14057894 ] Tathagata Das commented on SPARK-1642: -- 1478 is merged. Do you have this ready?

[jira] [Commented] (SPARK-1478) Upgrade FlumeInputDStream's FlumeReceiver to support FLUME-1915

[ https://issues.apache.org/jira/browse/SPARK-1478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057897#comment-14057897 ] Tathagata Das commented on SPARK-1478: -- After much hoops, this was the PR that merged

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the

[jira] [Created] (SPARK-2437) Rename MAVEN_PROFILES to SBT_MAVEN_PROFILES and add SBT_MAVEN_PROPERTIES

Patrick Wendell created SPARK-2437: -- Summary: Rename MAVEN_PROFILES to SBT_MAVEN_PROFILES and add SBT_MAVEN_PROPERTIES Key: SPARK-2437 URL: https://issues.apache.org/jira/browse/SPARK-2437 Project:

[jira] [Closed] (SPARK-1785) Streaming requires receivers to be serializable

[ https://issues.apache.org/jira/browse/SPARK-1785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-1785. Resolution: Fixed Streaming requires receivers to be serializable

[jira] [Updated] (SPARK-2157) Can't write tight firewall rules for Spark

[ https://issues.apache.org/jira/browse/SPARK-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2157: --- Assignee: Andrew Ash Can't write tight firewall rules for Spark

[jira] [Updated] (SPARK-2157) Can't write tight firewall rules for Spark

[ https://issues.apache.org/jira/browse/SPARK-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2157: --- Target Version/s: 1.1.0 Can't write tight firewall rules for Spark

[jira] [Created] (SPARK-2438) Streaming + MLLib

Jeremy Freeman created SPARK-2438: - Summary: Streaming + MLLib Key: SPARK-2438 URL: https://issues.apache.org/jira/browse/SPARK-2438 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057954#comment-14057954 ] Hari Shreedharan commented on SPARK-2345: - If I have to write the data out as say

[jira] [Created] (SPARK-2439) Actually close FileSystem in Master

Andrew Or created SPARK-2439: Summary: Actually close FileSystem in Master Key: SPARK-2439 URL: https://issues.apache.org/jira/browse/SPARK-2439 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2411) Standalone Master - direct users to turn on event logs

[ https://issues.apache.org/jira/browse/SPARK-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2411: - Attachment: (was: Screen Shot 2014-07-08 at 4.23.51 PM.png) Standalone Master - direct users to

[jira] [Updated] (SPARK-2411) Standalone Master - direct users to turn on event logs

[ https://issues.apache.org/jira/browse/SPARK-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2411: - Attachment: Master event logs.png Standalone Master - direct users to turn on event logs

[jira] [Created] (SPARK-2440) Enable HistoryServer to display lots of Application History

Kousuke Saruta created SPARK-2440: - Summary: Enable HistoryServer to display lots of Application History Key: SPARK-2440 URL: https://issues.apache.org/jira/browse/SPARK-2440 Project: Spark

[jira] [Updated] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-944: Assignee: Ted Malaska (was: Tathagata Das) Give example of writing to HBase from Spark Streaming

[jira] [Issue Comment Deleted] (SPARK-1667) Jobs never finish successfully once bucket file missing occurred

[ https://issues.apache.org/jira/browse/SPARK-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-1667: -- Comment: was deleted (was: Now I'm trying to address this issue.) Jobs never finish

[jira] [Updated] (SPARK-1667) Jobs never finish successfully once bucket file missing occurred

[ https://issues.apache.org/jira/browse/SPARK-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-1667: -- Description: If jobs execute shuffle, bucket files are created in a temporary directory

[jira] [Resolved] (SPARK-2427) Fix some of the Scala examples

[ https://issues.apache.org/jira/browse/SPARK-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2427. Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 Fix some of the Scala

[jira] [Commented] (SPARK-1341) Ability to control the data rate in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058091#comment-14058091 ] Tathagata Das commented on SPARK-1341: -- Thanks Isaac. This has been merged, as is

[jira] [Comment Edited] (SPARK-1341) Ability to control the data rate in Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058091#comment-14058091 ] Tathagata Das edited comment on SPARK-1341 at 7/10/14 11:05 PM:

[jira] [Created] (SPARK-2442) Add a Hadoop Writable serializer

Hari Shreedharan created SPARK-2442: --- Summary: Add a Hadoop Writable serializer Key: SPARK-2442 URL: https://issues.apache.org/jira/browse/SPARK-2442 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058151#comment-14058151 ] Mubarak Seyed commented on SPARK-1853: -- [~tdas] Seems like some bug in

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058159#comment-14058159 ] Tathagata Das commented on SPARK-1853: -- I dont think it is a bug in that. This is an

[jira] [Comment Edited] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057824#comment-14057824 ] Tathagata Das edited comment on SPARK-2345 at 7/11/14 12:39 AM:

[jira] [Comment Edited] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058165#comment-14058165 ] Tathagata Das edited comment on SPARK-2345 at 7/11/14 12:44 AM:

[jira] [Commented] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058165#comment-14058165 ] Tathagata Das commented on SPARK-2345: -- Then what I suggested earlier makes sense,

[jira] [Comment Edited] (SPARK-2345) ForEachDStream should have an option of running the foreachfunc on Spark

[ https://issues.apache.org/jira/browse/SPARK-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058165#comment-14058165 ] Tathagata Das edited comment on SPARK-2345 at 7/11/14 12:45 AM:

[jira] [Updated] (SPARK-2443) Reading from Partitioned Tables is Slow

[ https://issues.apache.org/jira/browse/SPARK-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2443: Description: Here are some numbers, all queries return ~20million: {code} SELECT COUNT(*)

[jira] [Commented] (SPARK-2298) Show stage attempt in UI

[ https://issues.apache.org/jira/browse/SPARK-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058177#comment-14058177 ] Masayoshi TSUZUKI commented on SPARK-2298: -- Thank you for your reply. Yes, I'm

[jira] [Commented] (SPARK-944) Give example of writing to HBase from Spark Streaming

[ https://issues.apache.org/jira/browse/SPARK-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058184#comment-14058184 ] Ted Malaska commented on SPARK-944: --- Thank you for the assign. I will start working on

[jira] [Commented] (SPARK-1853) Show Streaming application code context (file, line number) in Spark Stages UI

[ https://issues.apache.org/jira/browse/SPARK-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058195#comment-14058195 ] Mubarak Seyed commented on SPARK-1853: -- I just added _streaming.dstream_ in regex and

[jira] [Created] (SPARK-2444) Make spark.yarn.executor.memoryOverhead a first class citizen

Nishkam Ravi created SPARK-2444: --- Summary: Make spark.yarn.executor.memoryOverhead a first class citizen Key: SPARK-2444 URL: https://issues.apache.org/jira/browse/SPARK-2444 Project: Spark

[jira] [Resolved] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

[ https://issues.apache.org/jira/browse/SPARK-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2415. - Resolution: Fixed Fix Version/s: 1.0.2 1.1.0 RowWriteSupport

[jira] [Resolved] (SPARK-2428) Add except and intersect methods to SchemaRDD.

[ https://issues.apache.org/jira/browse/SPARK-2428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2428. - Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Takuya Ueshin Add

[jira] [Comment Edited] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058298#comment-14058298 ] Guoqiang Li edited comment on SPARK-2398 at 7/11/14 3:16 AM: -

[jira] [Commented] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058298#comment-14058298 ] Guoqiang Li commented on SPARK-2398: Q1. {{-Xmx}} is only the heap space, {{native

[jira] [Comment Edited] (SPARK-2398) Trouble running Spark 1.0 on Yarn

[ https://issues.apache.org/jira/browse/SPARK-2398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058298#comment-14058298 ] Guoqiang Li edited comment on SPARK-2398 at 7/11/14 3:17 AM: -

[jira] [Comment Edited] (SPARK-911) Support map pruning on sorted (K, V) RDD's

[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058322#comment-14058322 ] Aaron edited comment on SPARK-911 at 7/11/14 3:50 AM: -- I decided to

[jira] [Commented] (SPARK-911) Support map pruning on sorted (K, V) RDD's

[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058322#comment-14058322 ] Aaron commented on SPARK-911: - I decided to take a look at this myself (disclaimer haven't

[jira] [Resolved] (SPARK-2358) Add an option to include native BLAS/LAPACK loader in the build

[ https://issues.apache.org/jira/browse/SPARK-2358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-2358. Resolution: Fixed Fix Version/s: 1.1.0 Add an option to include native BLAS/LAPACK loader

[jira] [Commented] (SPARK-2150) Provide direct link to finished application UI in yarn resource manager UI

[ https://issues.apache.org/jira/browse/SPARK-2150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058397#comment-14058397 ] Masayoshi TSUZUKI commented on SPARK-2150: -- Is someone working on this ticket?