[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178291#comment-14178291 ] jeanlyn commented on SPARK-3967: I think you this pull request also can be referenced: htt

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178292#comment-14178292 ] Jeroen van Wilgenburg commented on SPARK-3955: -- Is it possible to include the

[jira] [Commented] (SPARK-4032) Deprecate YARN alpha support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178272#comment-14178272 ] Apache Spark commented on SPARK-4032: - User 'ScrapCodes' has created a pull request fo

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178242#comment-14178242 ] Apache Spark commented on SPARK-4034: - User 'baishuo' has created a pull request for t

[jira] [Commented] (SPARK-4002) JavaKafkaStreamSuite.testKafkaStream fails on OSX

[ https://issues.apache.org/jira/browse/SPARK-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178239#comment-14178239 ] Sean Owen commented on SPARK-4002: -- This passes for me right now in {{master}}: mvn -Pya

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178224#comment-14178224 ] baishuo commented on SPARK-4034: After click maven->reimport for spark project in idea,

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178221#comment-14178221 ] jeanlyn commented on SPARK-3967: This issue also hapens to me.but i want to know why this

[jira] [Commented] (SPARK-4035) Wrong format specifier in BlockerManager.scala

[ https://issues.apache.org/jira/browse/SPARK-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178220#comment-14178220 ] Apache Spark commented on SPARK-4035: - User 'zsxwing' has created a pull request for t

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178219#comment-14178219 ] Sean Owen commented on SPARK-4034: -- You get this when you do what? This is a Guava class.

[jira] [Created] (SPARK-4035) Wrong format specifier in BlockerManager.scala

Shixiong Zhu created SPARK-4035: --- Summary: Wrong format specifier in BlockerManager.scala Key: SPARK-4035 URL: https://issues.apache.org/jira/browse/SPARK-4035 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

baishuo created SPARK-4034: -- Summary: get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea Key: SPARK-4034 URL: https://issues.apache.org/jira/browse/SPARK-4034

[jira] [Updated] (SPARK-4032) Deprecate YARN alpha support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4032: - Summary: Deprecate YARN alpha support in Spark 1.2 (was: Deprecate YARN support in Spark 1.2) > Deprecat

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178200#comment-14178200 ] Jacky Li commented on SPARK-4001: - I accidentally use wangfei (my college) 's account to

[jira] [Issue Comment Deleted] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-4001: --- Comment: was deleted (was: .) > Add Apriori algorithm to Spark MLlib > >

[jira] [Comment Edited] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178183#comment-14178183 ] wangfei edited comment on SPARK-4001 at 10/21/14 9:38 AM: -- . wa

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178183#comment-14178183 ] wangfei commented on SPARK-4001: Thanks Sean Owen for explaining! Frequent itemset algor

[jira] [Commented] (SPARK-4033) Input of the SparkPi too big causes the emption exception

[ https://issues.apache.org/jira/browse/SPARK-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178176#comment-14178176 ] Apache Spark commented on SPARK-4033: - User 'SaintBacchus' has created a pull request

[jira] [Created] (SPARK-4033) Input of the SparkPi too big causes the emption exception

hzw created SPARK-4033: -- Summary: Input of the SparkPi too big causes the emption exception Key: SPARK-4033 URL: https://issues.apache.org/jira/browse/SPARK-4033 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178162#comment-14178162 ] Mridul Muralidharan commented on SPARK-4030: We have also needed to use destro

[jira] [Resolved] (SPARK-3999) meet wrong number of arguments for pattern error when compile spark in idea

[ https://issues.apache.org/jira/browse/SPARK-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] baishuo resolved SPARK-3999. Resolution: Not a Problem just need to: right click the project and click maven->reimport > meet wrong

[jira] [Comment Edited] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178108#comment-14178108 ] XiaoJing wang edited comment on SPARK-3940 at 10/21/14 8:05 AM:

[jira] [Comment Edited] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178108#comment-14178108 ] XiaoJing wang edited comment on SPARK-3940 at 10/21/14 8:04 AM:

[jira] [Commented] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178108#comment-14178108 ] XiaoJing wang commented on SPARK-3940: -- Hi Patrick Wendell ,thank for your reminder,i

[jira] [Resolved] (SPARK-909) add task serialization footprint (time and size) into TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-909. --- Resolution: Fixed This has already been fixed. > add task serialization footprint (time and si

[jira] [Resolved] (SPARK-566) Replace polling+sleeping with semaphores in broadcast and shuffle

[ https://issues.apache.org/jira/browse/SPARK-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-566. --- Resolution: Fixed Thew shuffle and broadcast implementations have been re-written at least twic

[jira] [Resolved] (SPARK-566) Replace polling+sleeping with semaphores in broadcast and shuffle

[ https://issues.apache.org/jira/browse/SPARK-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-566. --- Resolution: Not a Problem > Replace polling+sleeping with semaphores in broadcast and shuffle >

[jira] [Reopened] (SPARK-566) Replace polling+sleeping with semaphores in broadcast and shuffle

[ https://issues.apache.org/jira/browse/SPARK-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-566: --- > Replace polling+sleeping with semaphores in broadcast and shuffle > -

[jira] [Resolved] (SPARK-735) memory leak in KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-735. --- Resolution: Fixed I think this was fixed a long time ago. > memory leak in KryoSerializer > --

[jira] [Resolved] (SPARK-916) Better Support for Flat/Tabular RDD's

[ https://issues.apache.org/jira/browse/SPARK-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-916. --- Resolution: Fixed Turned out [~marmbrus] did all of this and more in SparkSQL (which btw also

[jira] [Resolved] (SPARK-890) Allow multiple parallel commands in spark-shell

[ https://issues.apache.org/jira/browse/SPARK-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-890. --- Resolution: Fixed Spark context was made thread-safe a long time ago. > Allow multiple parall

[jira] [Resolved] (SPARK-773) Add fair scheduler pool information UI similar with hadoop

[ https://issues.apache.org/jira/browse/SPARK-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-773. --- Resolution: Fixed This has existing in Spark for a while - it is a stale issue. > Add fair sch

[jira] [Resolved] (SPARK-547) Provide a means to package Spark's executor into a tgz

[ https://issues.apache.org/jira/browse/SPARK-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-547. --- Resolution: Fixed This was fixed a long time ago. > Provide a means to package Spark's executo

[jira] [Updated] (SPARK-4032) Deprecate YARN support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4032: --- Priority: Blocker (was: Major) > Deprecate YARN support in Spark 1.2 > --

[jira] [Updated] (SPARK-4032) Deprecate YARN support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4032: --- Description: When someone builds for yarn alpha, we should just display a warning like {code}

[jira] [Created] (SPARK-4032) Deprecate YARN support in Spark 1.2

Patrick Wendell created SPARK-4032: -- Summary: Deprecate YARN support in Spark 1.2 Key: SPARK-4032 URL: https://issues.apache.org/jira/browse/SPARK-4032 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178073#comment-14178073 ] Patrick Wendell commented on SPARK-3940: Hey [~wangxj8] can you add a first and la

[jira] [Updated] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3940: --- Assignee: wangxj > SQL console prints error messages three times > ---

[jira] [Commented] (SPARK-3945) Write properties of hive-site.xml to HiveContext when initilize session state In SparkSQLEnv.scala

[ https://issues.apache.org/jira/browse/SPARK-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178070#comment-14178070 ] Patrick Wendell commented on SPARK-3945: Hey @luogankun would you mind adding a fi

[jira] [Updated] (SPARK-3945) Write properties of hive-site.xml to HiveContext when initilize session state In SparkSQLEnv.scala

[ https://issues.apache.org/jira/browse/SPARK-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3945: --- Assignee: luogankun > Write properties of hive-site.xml to HiveContext when initilize session

[jira] [Comment Edited] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178068#comment-14178068 ] Patrick Wendell edited comment on SPARK-4030 at 10/21/14 7:17 AM: --

[jira] [Comment Edited] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178068#comment-14178068 ] Patrick Wendell edited comment on SPARK-4030 at 10/21/14 7:17 AM: --

[jira] [Updated] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4030: --- Issue Type: Improvement (was: Bug) > `destroy` method in Broadcast should be public > ---

[jira] [Commented] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178068#comment-14178068 ] Patrick Wendell commented on SPARK-4030: Hey Shivaram - IIRC we made this private

[jira] [Commented] (SPARK-4019) Repartitioning with more than 2000 partitions may drop all data when partitions are mostly empty.

[ https://issues.apache.org/jira/browse/SPARK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178056#comment-14178056 ] Patrick Wendell commented on SPARK-4019: Great work getting to the root cause of t

[jira] [Commented] (SPARK-4014) TaskContext.attemptId returns taskId

[ https://issues.apache.org/jira/browse/SPARK-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14178053#comment-14178053 ] Patrick Wendell commented on SPARK-4014: [~joshrosen] what do you think about rena

<    1   2