[jira] [Commented] (SPARK-1997) Update breeze to version 0.9

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178002#comment-14178002 ] Xiangrui Meng commented on SPARK-1997: -- [~yuu.ishik...@gmail.com] We already updated

[jira] [Commented] (SPARK-1997) Update breeze to version 0.9

[ https://issues.apache.org/jira/browse/SPARK-1997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178006#comment-14178006 ] Yu Ishikawa commented on SPARK-1997: Oh, I'm verry very sorry. I only viewed the

[jira] [Commented] (SPARK-3405) EC2 cluster creation on VPC

[ https://issues.apache.org/jira/browse/SPARK-3405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178024#comment-14178024 ] Apache Spark commented on SPARK-3405: - User 'mvj101' has created a pull request for

[jira] [Commented] (SPARK-3466) Limit size of results that a driver collects for each action

[ https://issues.apache.org/jira/browse/SPARK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178025#comment-14178025 ] Matei Zaharia commented on SPARK-3466: -- Ah, I see, that concern makes sense if the

[jira] [Updated] (SPARK-4021) Issues observed after upgrading Jenkins to JDK7u71

[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4021: --- Assignee: shane knapp Issues observed after upgrading Jenkins to JDK7u71

[jira] [Resolved] (SPARK-1042) spark cleans all java broadcast variables when it hits the spark.cleaner.ttl

[ https://issues.apache.org/jira/browse/SPARK-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1042. Resolution: Fixed Fix Version/s: 0.9.2 I think this was fixed back in 0.9.2 spark

[jira] [Updated] (SPARK-4003) Add {Big Decimal, Timestamp, Date} types to Java SqlContext

[ https://issues.apache.org/jira/browse/SPARK-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4003: --- Summary: Add {Big Decimal, Timestamp, Date} types to Java SqlContext (was: Add 3 types for

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4006: --- Priority: Critical (was: Blocker) Target Version/s: 1.2.0 Spark Driver crashes

[jira] [Updated] (SPARK-4006) Spark Driver crashes whenever an Executor is registered twice

[ https://issues.apache.org/jira/browse/SPARK-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4006: --- Priority: Blocker (was: Critical) Spark Driver crashes whenever an Executor is registered

[jira] [Updated] (SPARK-3948) Sort-based shuffle can lead to assorted stream-corruption exceptions

[ https://issues.apache.org/jira/browse/SPARK-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3948: --- Priority: Blocker (was: Major) Sort-based shuffle can lead to assorted stream-corruption

[jira] [Commented] (SPARK-4014) TaskContext.attemptId returns taskId

[ https://issues.apache.org/jira/browse/SPARK-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178053#comment-14178053 ] Patrick Wendell commented on SPARK-4014: [~joshrosen] what do you think about

[jira] [Commented] (SPARK-4019) Repartitioning with more than 2000 partitions may drop all data when partitions are mostly empty.

[ https://issues.apache.org/jira/browse/SPARK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178056#comment-14178056 ] Patrick Wendell commented on SPARK-4019: Great work getting to the root cause of

[jira] [Commented] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178068#comment-14178068 ] Patrick Wendell commented on SPARK-4030: Hey Shivaram - IIRC we made this private

[jira] [Updated] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4030: --- Issue Type: Improvement (was: Bug) `destroy` method in Broadcast should be public

[jira] [Comment Edited] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178068#comment-14178068 ] Patrick Wendell edited comment on SPARK-4030 at 10/21/14 7:17 AM:

[jira] [Comment Edited] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178068#comment-14178068 ] Patrick Wendell edited comment on SPARK-4030 at 10/21/14 7:17 AM:

[jira] [Updated] (SPARK-3945) Write properties of hive-site.xml to HiveContext when initilize session state In SparkSQLEnv.scala

[ https://issues.apache.org/jira/browse/SPARK-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3945: --- Assignee: luogankun Write properties of hive-site.xml to HiveContext when initilize session

[jira] [Commented] (SPARK-3945) Write properties of hive-site.xml to HiveContext when initilize session state In SparkSQLEnv.scala

[ https://issues.apache.org/jira/browse/SPARK-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178070#comment-14178070 ] Patrick Wendell commented on SPARK-3945: Hey @luogankun would you mind adding a

[jira] [Updated] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3940: --- Assignee: wangxj SQL console prints error messages three times

[jira] [Commented] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178073#comment-14178073 ] Patrick Wendell commented on SPARK-3940: Hey [~wangxj8] can you add a first and

[jira] [Updated] (SPARK-4032) Deprecate YARN support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4032: --- Description: When someone builds for yarn alpha, we should just display a warning like

[jira] [Created] (SPARK-4032) Deprecate YARN support in Spark 1.2

Patrick Wendell created SPARK-4032: -- Summary: Deprecate YARN support in Spark 1.2 Key: SPARK-4032 URL: https://issues.apache.org/jira/browse/SPARK-4032 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-4032) Deprecate YARN support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4032: --- Priority: Blocker (was: Major) Deprecate YARN support in Spark 1.2

[jira] [Resolved] (SPARK-547) Provide a means to package Spark's executor into a tgz

[ https://issues.apache.org/jira/browse/SPARK-547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-547. --- Resolution: Fixed This was fixed a long time ago. Provide a means to package Spark's

[jira] [Resolved] (SPARK-773) Add fair scheduler pool information UI similar with hadoop

[ https://issues.apache.org/jira/browse/SPARK-773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-773. --- Resolution: Fixed This has existing in Spark for a while - it is a stale issue. Add fair

[jira] [Resolved] (SPARK-890) Allow multiple parallel commands in spark-shell

[ https://issues.apache.org/jira/browse/SPARK-890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-890. --- Resolution: Fixed Spark context was made thread-safe a long time ago. Allow multiple

[jira] [Resolved] (SPARK-916) Better Support for Flat/Tabular RDD's

[ https://issues.apache.org/jira/browse/SPARK-916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-916. --- Resolution: Fixed Turned out [~marmbrus] did all of this and more in SparkSQL (which btw also

[jira] [Resolved] (SPARK-735) memory leak in KryoSerializer

[ https://issues.apache.org/jira/browse/SPARK-735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-735. --- Resolution: Fixed I think this was fixed a long time ago. memory leak in KryoSerializer

[jira] [Reopened] (SPARK-566) Replace polling+sleeping with semaphores in broadcast and shuffle

[ https://issues.apache.org/jira/browse/SPARK-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-566: --- Replace polling+sleeping with semaphores in broadcast and shuffle

[jira] [Resolved] (SPARK-566) Replace polling+sleeping with semaphores in broadcast and shuffle

[ https://issues.apache.org/jira/browse/SPARK-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-566. --- Resolution: Not a Problem Replace polling+sleeping with semaphores in broadcast and shuffle

[jira] [Resolved] (SPARK-566) Replace polling+sleeping with semaphores in broadcast and shuffle

[ https://issues.apache.org/jira/browse/SPARK-566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-566. --- Resolution: Fixed Thew shuffle and broadcast implementations have been re-written at least

[jira] [Resolved] (SPARK-909) add task serialization footprint (time and size) into TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-909. --- Resolution: Fixed This has already been fixed. add task serialization footprint (time and

[jira] [Commented] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178108#comment-14178108 ] XiaoJing wang commented on SPARK-3940: -- Hi Patrick Wendell ,thank for your reminder,i

[jira] [Comment Edited] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178108#comment-14178108 ] XiaoJing wang edited comment on SPARK-3940 at 10/21/14 8:04 AM:

[jira] [Comment Edited] (SPARK-3940) SQL console prints error messages three times

[ https://issues.apache.org/jira/browse/SPARK-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178108#comment-14178108 ] XiaoJing wang edited comment on SPARK-3940 at 10/21/14 8:05 AM:

[jira] [Resolved] (SPARK-3999) meet wrong number of arguments for pattern error when compile spark in idea

[ https://issues.apache.org/jira/browse/SPARK-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] baishuo resolved SPARK-3999. Resolution: Not a Problem just need to: right click the project and click maven-reimport meet wrong

[jira] [Commented] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178162#comment-14178162 ] Mridul Muralidharan commented on SPARK-4030: We have also needed to use

[jira] [Created] (SPARK-4033) Input of the SparkPi too big causes the emption exception

hzw created SPARK-4033: -- Summary: Input of the SparkPi too big causes the emption exception Key: SPARK-4033 URL: https://issues.apache.org/jira/browse/SPARK-4033 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4033) Input of the SparkPi too big causes the emption exception

[ https://issues.apache.org/jira/browse/SPARK-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178176#comment-14178176 ] Apache Spark commented on SPARK-4033: - User 'SaintBacchus' has created a pull request

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178183#comment-14178183 ] wangfei commented on SPARK-4001: Thanks Sean Owen for explaining! Frequent itemset

[jira] [Comment Edited] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178183#comment-14178183 ] wangfei edited comment on SPARK-4001 at 10/21/14 9:38 AM: -- .

[jira] [Issue Comment Deleted] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-4001: --- Comment: was deleted (was: .) Add Apriori algorithm to Spark MLlib

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178200#comment-14178200 ] Jacky Li commented on SPARK-4001: - I accidentally use wangfei (my college) 's account to

[jira] [Updated] (SPARK-4032) Deprecate YARN alpha support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4032: - Summary: Deprecate YARN alpha support in Spark 1.2 (was: Deprecate YARN support in Spark 1.2)

[jira] [Created] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

baishuo created SPARK-4034: -- Summary: get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea Key: SPARK-4034 URL: https://issues.apache.org/jira/browse/SPARK-4034

[jira] [Created] (SPARK-4035) Wrong format specifier in BlockerManager.scala

Shixiong Zhu created SPARK-4035: --- Summary: Wrong format specifier in BlockerManager.scala Key: SPARK-4035 URL: https://issues.apache.org/jira/browse/SPARK-4035 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178219#comment-14178219 ] Sean Owen commented on SPARK-4034: -- You get this when you do what? This is a Guava class.

[jira] [Commented] (SPARK-4035) Wrong format specifier in BlockerManager.scala

[ https://issues.apache.org/jira/browse/SPARK-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178220#comment-14178220 ] Apache Spark commented on SPARK-4035: - User 'zsxwing' has created a pull request for

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178221#comment-14178221 ] jeanlyn commented on SPARK-3967: This issue also hapens to me.but i want to know why this

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178224#comment-14178224 ] baishuo commented on SPARK-4034: After click maven-reimport for spark project in idea,

[jira] [Commented] (SPARK-4002) JavaKafkaStreamSuite.testKafkaStream fails on OSX

[ https://issues.apache.org/jira/browse/SPARK-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178239#comment-14178239 ] Sean Owen commented on SPARK-4002: -- This passes for me right now in {{master}}: mvn

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178242#comment-14178242 ] Apache Spark commented on SPARK-4034: - User 'baishuo' has created a pull request for

[jira] [Commented] (SPARK-4032) Deprecate YARN alpha support in Spark 1.2

[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178272#comment-14178272 ] Apache Spark commented on SPARK-4032: - User 'ScrapCodes' has created a pull request

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178292#comment-14178292 ] Jeroen van Wilgenburg commented on SPARK-3955: -- Is it possible to include the

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178291#comment-14178291 ] jeanlyn commented on SPARK-3967: I think you this pull request also can be referenced:

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178294#comment-14178294 ] Sean Owen commented on SPARK-3955: -- I think the issue is matching the version used by

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178313#comment-14178313 ] Jeroen van Wilgenburg commented on SPARK-3955: -- Is is indeed a dependency

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178316#comment-14178316 ] Prashant Sharma commented on SPARK-3359: I guess this will happen along with scala

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178350#comment-14178350 ] Iulian Dragos commented on SPARK-2075: -- The name of the missing class is

[jira] [Created] (SPARK-4036) Conditional Random Fields (CRF) atop of spark in MLlib

Guoqiang Li created SPARK-4036: -- Summary: Conditional Random Fields (CRF) atop of spark in MLlib Key: SPARK-4036 URL: https://issues.apache.org/jira/browse/SPARK-4036 Project: Spark Issue Type:

[jira] [Commented] (SPARK-4030) `destroy` method in Broadcast should be public

[ https://issues.apache.org/jira/browse/SPARK-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178532#comment-14178532 ] Shivaram Venkataraman commented on SPARK-4030: -- Yes - there is a bunch of

[jira] [Commented] (SPARK-3174) Provide elastic scaling within a Spark application

[ https://issues.apache.org/jira/browse/SPARK-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178554#comment-14178554 ] Dag Liodden commented on SPARK-3174: Hey guys, glad to see some progress on this! I

[jira] [Commented] (SPARK-3299) [SQL] Public API in SQLContext to list tables

[ https://issues.apache.org/jira/browse/SPARK-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178572#comment-14178572 ] Bill Bejeck commented on SPARK-3299: This change is a little more involved as it

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178583#comment-14178583 ] Sean Owen commented on SPARK-3359: -- Sure, but it can be fixed right now too. I tried to

[jira] [Resolved] (SPARK-4023) PySpark's stat.Statistics is broken

[ https://issues.apache.org/jira/browse/SPARK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-4023. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2870

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178688#comment-14178688 ] Pat Ferrel commented on SPARK-2075: --- Oops, right. But the function name is being

[jira] [Resolved] (SPARK-4035) Wrong format specifier in BlockerManager.scala

[ https://issues.apache.org/jira/browse/SPARK-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4035. --- Resolution: Fixed Fix Version/s: (was: 1.1.1) Issue resolved by pull request 2875

[jira] [Created] (SPARK-4037) NPE in JDBC server when calling SET

Michael Armbrust created SPARK-4037: --- Summary: NPE in JDBC server when calling SET Key: SPARK-4037 URL: https://issues.apache.org/jira/browse/SPARK-4037 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3717) DecisionTree, RandomForest: Partition by feature

[ https://issues.apache.org/jira/browse/SPARK-3717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178798#comment-14178798 ] Joseph K. Bradley commented on SPARK-3717: -- Hi Sumanth, it would be great to get

[jira] [Assigned] (SPARK-3740) Use a compressed bitmap to track zero sized blocks in HighlyCompressedMapStatus

[ https://issues.apache.org/jira/browse/SPARK-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-3740: - Assignee: Josh Rosen (was: Liquan Pei) Use a compressed bitmap to track zero sized blocks in

[jira] [Commented] (SPARK-3740) Use a compressed bitmap to track zero sized blocks in HighlyCompressedMapStatus

[ https://issues.apache.org/jira/browse/SPARK-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178807#comment-14178807 ] Josh Rosen commented on SPARK-3740: --- This isn't just an optimization; it's required for

[jira] [Commented] (SPARK-3254) Streaming K-Means

[ https://issues.apache.org/jira/browse/SPARK-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178825#comment-14178825 ] Reza Zadeh commented on SPARK-3254: --- Will this make it to 1.2? Streaming K-Means

[jira] [Resolved] (SPARK-4020) Failed executor not properly removed if it has not run tasks

[ https://issues.apache.org/jira/browse/SPARK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout resolved SPARK-4020. --- Resolution: Fixed Failed executor not properly removed if it has not run tasks

[jira] [Updated] (SPARK-4020) Failed executor not properly removed if it has not run tasks

[ https://issues.apache.org/jira/browse/SPARK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kay Ousterhout updated SPARK-4020: -- Fix Version/s: 1.2.0 Fixed by

[jira] [Commented] (SPARK-2075) Anonymous classes are missing from Spark distribution

[ https://issues.apache.org/jira/browse/SPARK-2075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178852#comment-14178852 ] Pat Ferrel commented on SPARK-2075: --- OK solved. The WAG worked. Instead of 'mvn package

[jira] [Updated] (SPARK-3466) Limit size of results that a driver collects for each action

[ https://issues.apache.org/jira/browse/SPARK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3466: --- Assignee: Davies Liu (was: Matthew Cheah) Limit size of results that a driver collects for

[jira] [Commented] (SPARK-3466) Limit size of results that a driver collects for each action

[ https://issues.apache.org/jira/browse/SPARK-3466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178857#comment-14178857 ] Patrick Wendell commented on SPARK-3466: I spoke with Matt today and I'm

[jira] [Commented] (SPARK-2292) NullPointerException in JavaPairRDD.mapToPair

[ https://issues.apache.org/jira/browse/SPARK-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178879#comment-14178879 ] Pat Ferrel commented on SPARK-2292: --- If this is related to SPARK-2075 the answer is: If

[jira] [Comment Edited] (SPARK-2292) NullPointerException in JavaPairRDD.mapToPair

[ https://issues.apache.org/jira/browse/SPARK-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178879#comment-14178879 ] Pat Ferrel edited comment on SPARK-2292 at 10/21/14 7:21 PM: -

[jira] [Created] (SPARK-4038) Outlier Detection Algorithm for MLlib

Ashutosh Trivedi created SPARK-4038: --- Summary: Outlier Detection Algorithm for MLlib Key: SPARK-4038 URL: https://issues.apache.org/jira/browse/SPARK-4038 Project: Spark Issue Type: New

[jira] [Created] (SPARK-4039) KMeans support HashingTF vectors

Antoine Amend created SPARK-4039: Summary: KMeans support HashingTF vectors Key: SPARK-4039 URL: https://issues.apache.org/jira/browse/SPARK-4039 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-4026) Write ahead log to synchronously write received data to HDFS and recover on driver failure

[ https://issues.apache.org/jira/browse/SPARK-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178967#comment-14178967 ] Apache Spark commented on SPARK-4026: - User 'tdas' has created a pull request for this

[jira] [Closed] (SPARK-3994) countByKey / countByValue do not go through Aggregator

[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-3994. Resolution: Fixed Fix Version/s: 1.2.0 Target Version/s: 1.2.0 countByKey / countByValue

[jira] [Updated] (SPARK-3994) countByKey / countByValue do not go through Aggregator

[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3994: - Affects Version/s: (was: 1.1.0) 1.0.0 countByKey / countByValue do not go

[jira] [Updated] (SPARK-3994) countByKey / countByValue do not go through Aggregator

[ https://issues.apache.org/jira/browse/SPARK-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3994: - Affects Version/s: 1.1.0 countByKey / countByValue do not go through Aggregator

[jira] [Updated] (SPARK-4026) Write ahead log management

[ https://issues.apache.org/jira/browse/SPARK-4026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-4026: - Summary: Write ahead log management (was: Write ahead log to synchronously write received data

[jira] [Commented] (SPARK-4021) Issues observed after upgrading Jenkins to JDK7u71

[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179072#comment-14179072 ] shane knapp commented on SPARK-4021: ok, so i was able to recreate what happened

[jira] [Created] (SPARK-4040) calling count() on RDD's emitted from a DStream blocks forEachRDD progress.

jay vyas created SPARK-4040: --- Summary: calling count() on RDD's emitted from a DStream blocks forEachRDD progress. Key: SPARK-4040 URL: https://issues.apache.org/jira/browse/SPARK-4040 Project: Spark

[jira] [Updated] (SPARK-4040) calling count() on RDD's emitted from a DStream blocks forEachRDD progress.

[ https://issues.apache.org/jira/browse/SPARK-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jay vyas updated SPARK-4040: Description: CC [~rnowling] [~willbenton] It appears that in a DStream context, a call to

[jira] [Created] (SPARK-4041) convert attributes names in table scan lowercase when compare with relation attributes

wangfei created SPARK-4041: -- Summary: convert attributes names in table scan lowercase when compare with relation attributes Key: SPARK-4041 URL: https://issues.apache.org/jira/browse/SPARK-4041 Project:

[jira] [Commented] (SPARK-4041) convert attributes names in table scan lowercase when compare with relation attributes

[ https://issues.apache.org/jira/browse/SPARK-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179122#comment-14179122 ] Apache Spark commented on SPARK-4041: - User 'scwf' has created a pull request for this

[jira] [Updated] (SPARK-3770) The userFeatures RDD from MatrixFactorizationModel isn't accessible from the python bindings

[ https://issues.apache.org/jira/browse/SPARK-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3770: - Assignee: Michelangelo D'Agostino The userFeatures RDD from MatrixFactorizationModel isn't

[jira] [Resolved] (SPARK-3770) The userFeatures RDD from MatrixFactorizationModel isn't accessible from the python bindings

[ https://issues.apache.org/jira/browse/SPARK-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3770. -- Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 2636

[jira] [Created] (SPARK-4042) append columns ids and names before broadcast

wangfei created SPARK-4042: -- Summary: append columns ids and names before broadcast Key: SPARK-4042 URL: https://issues.apache.org/jira/browse/SPARK-4042 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-4042) append columns ids and names before broadcast

[ https://issues.apache.org/jira/browse/SPARK-4042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179133#comment-14179133 ] Apache Spark commented on SPARK-4042: - User 'scwf' has created a pull request for this

[jira] [Commented] (SPARK-4021) Issues observed after upgrading Jenkins to JDK7u71

[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179143#comment-14179143 ] shane knapp commented on SPARK-4021: oh yeah, in steps 0 and 2 (from above), JAVA_HOME

[jira] [Commented] (SPARK-3740) Use a compressed bitmap to track zero sized blocks in HighlyCompressedMapStatus

[ https://issues.apache.org/jira/browse/SPARK-3740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179176#comment-14179176 ] Apache Spark commented on SPARK-3740: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-4021) Issues observed after upgrading Jenkins to JDK7u71

[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179272#comment-14179272 ] shane knapp commented on SPARK-4021: take a look at this:

[jira] [Closed] (SPARK-4021) Issues observed after upgrading Jenkins to JDK7u71

[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shane knapp closed SPARK-4021. -- Resolution: Not a Problem Issues observed after upgrading Jenkins to JDK7u71

[jira] [Closed] (SPARK-3819) Jenkins should compile Spark against multiple versions of Hadoop

[ https://issues.apache.org/jira/browse/SPARK-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Cheah closed SPARK-3819. - Resolution: Won't Fix Not much activity for awhile. Doesn't seem that important anyways, the cases when

  1   2   >