[jira] [Created] (SPARK-3811) More robust / standard Utils.deleteRecursively, Utils.createTempDir

2014-10-06 Thread Sean Owen (JIRA)
Sean Owen created SPARK-3811: Summary: More robust / standard Utils.deleteRecursively, Utils.createTempDir Key: SPARK-3811 URL: https://issues.apache.org/jira/browse/SPARK-3811 Project: Spark

[jira] [Commented] (SPARK-3828) Spark returns inconsistent results when building with different Hadoop version

2014-10-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14161552#comment-14161552 ] Sean Owen commented on SPARK-3828: -- (Agree, although there's an interesting point in here

[jira] [Commented] (SPARK-3785) Support off-loading computations to a GPU

2014-10-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163125#comment-14163125 ] Sean Owen commented on SPARK-3785: -- Sure, but a GPU isn't going to be good at general

[jira] [Commented] (SPARK-3895) Scala style: Indentation of method

2014-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14166415#comment-14166415 ] Sean Owen commented on SPARK-3895: -- To be clear, the second is correct because of line

[jira] [Commented] (SPARK-3894) Scala style: line length increase to 160

2014-10-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14166417#comment-14166417 ] Sean Owen commented on SPARK-3894: -- This is an ancient religious war. At Google, it was

[jira] [Commented] (SPARK-3445) Deprecate and later remove YARN alpha support

2014-10-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168577#comment-14168577 ] Sean Owen commented on SPARK-3445: -- YARN alpha is not deprecated or removed yet; this

[jira] [Commented] (SPARK-3926) result of JavaRDD collectAsMap() is not serializable

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169383#comment-14169383 ] Sean Owen commented on SPARK-3926: -- Yeah, seems fine to just let {{MapWrapper}} implement

[jira] [Resolved] (SPARK-3897) Scala style: format example code

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3897. -- Resolution: Won't Fix Given recent discussion, and consensus to not make sweeping style changes, I

[jira] [Resolved] (SPARK-3895) Scala style: Indentation of method

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3895. -- Resolution: Won't Fix Given recent discussion, and consensus to not make sweeping style changes, I

[jira] [Resolved] (SPARK-3781) code style format

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3781. -- Resolution: Won't Fix Given recent discussion, and consensus to not make sweeping style changes, I

[jira] [Commented] (SPARK-3890) remove redundant spark.executor.memory in doc

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169405#comment-14169405 ] Sean Owen commented on SPARK-3890: -- For some reason the PR was not linked:

[jira] [Commented] (SPARK-3896) checkSpeculatableTasks fask quit loop, invoking checkSpeculatableTasks is expensive

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169409#comment-14169409 ] Sean Owen commented on SPARK-3896: -- Oops, my bad. I just realized that some PRs didn't

[jira] [Commented] (SPARK-3662) Importing pandas breaks included pi.py example

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169424#comment-14169424 ] Sean Owen commented on SPARK-3662: -- [~esamanas] Do you have a suggested change here,

[jira] [Resolved] (SPARK-3506) 1.1.0-SNAPSHOT in docs for 1.1.0 under docs/latest

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3506. -- Resolution: Fixed Fix Version/s: 1.1.1 Looks like the site has been updated, and I see no

[jira] [Commented] (SPARK-3251) Clarify learning interfaces

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169449#comment-14169449 ] Sean Owen commented on SPARK-3251: -- Is this a subset of / duplicate of SPARK-3702 now,

[jira] [Commented] (SPARK-3480) Throws out Not a valid command 'yarn-alpha/scalastyle' in dev/scalastyle for sbt build tool during 'Running Scala style checks'

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169472#comment-14169472 ] Sean Owen commented on SPARK-3480: -- Given the discussion I suggest this is

[jira] [Commented] (SPARK-3924) Upgrade to Akka version 2.3.6

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169504#comment-14169504 ] Sean Owen commented on SPARK-3924: -- I think this is a duplicate of SPARK-2707 and

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169509#comment-14169509 ] Sean Owen commented on SPARK-2707: -- Can this be considered a duplicate of SPARK-2805,

[jira] [Resolved] (SPARK-1834) NoSuchMethodError when invoking JavaPairRDD.reduce() in Java

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1834. -- Resolution: Duplicate On another look, I'm almost sure this is the same issue as in SPARK-3266, which

[jira] [Commented] (SPARK-2493) SBT gen-idea doesn't generate correct Intellij project

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169527#comment-14169527 ] Sean Owen commented on SPARK-2493: -- Is this still an issue [~dbtsai] ? For IntelliJ, I

[jira] [Resolved] (SPARK-2198) Partition the scala build file so that it is easier to maintain

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2198. -- Resolution: Won't Fix Sounds like a WontFix Partition the scala build file so that it is easier to

[jira] [Commented] (SPARK-1849) Broken UTF-8 encoded data gets character replacements and thus can't be fixed

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169549#comment-14169549 ] Sean Owen commented on SPARK-1849: -- Yes, I think there isn't a 'fix' here short of a

[jira] [Resolved] (SPARK-1787) Build failure on JDK8 :: SBT fails to load build configuration file

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1787. -- Resolution: Duplicate FWIW SBT + Java 8 has worked fine for me on master for a long while, so assume

[jira] [Resolved] (SPARK-1738) Is spark-debugger still available?

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1738. -- Resolution: Fixed That document was since deleted at some point anyway, and I assume the answer is

[jira] [Resolved] (SPARK-1605) Improve mllib.linalg.Vector

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1605. -- Resolution: Won't Fix Another WontFix then? Improve mllib.linalg.Vector ---

[jira] [Resolved] (SPARK-1573) slight modification with regards to sbt/sbt test

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1573. -- Resolution: Won't Fix This has been resolved insofar as the main README.md no longer has this text.

[jira] [Resolved] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1479. -- Resolution: Won't Fix Given discussion in SPARK-3445, I doubt anything more will be done for YARN

[jira] [Commented] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169589#comment-14169589 ] Sean Owen commented on SPARK-1409: -- Since this test was removed with SPARK-2805, safe to

[jira] [Resolved] (SPARK-1398) Remove FindBugs jsr305 dependency

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1398. -- Resolution: Won't Fix From the PR discussion, this had to be reverted because of some build problems,

[jira] [Resolved] (SPARK-1339) Build error: org.eclipse.paho:mqtt-client

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1339. -- Resolution: Not a Problem Build error: org.eclipse.paho:mqtt-client

[jira] [Commented] (SPARK-1317) sbt doesn't work for building Spark programs

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169629#comment-14169629 ] Sean Owen commented on SPARK-1317: -- PS if you're still interested in this, I am pretty

[jira] [Resolved] (SPARK-1243) spark compilation error

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1243. -- Resolution: Fixed This appears to be long since resolved by something else, perhaps a subsequent

[jira] [Resolved] (SPARK-1306) no instructions provided for sbt assembly with Hadoop 2.2

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1306. -- Resolution: Fixed I think this was obviated by subsequent changes to this documentation. SBT is no

[jira] [Resolved] (SPARK-1234) clean up typos and grammar issues in Spark on YARN page

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1234. -- Resolution: Won't Fix Given the discussion in https://github.com/apache/spark/pull/130 , this was

[jira] [Commented] (SPARK-1192) Around 30 parameters in Spark are used but undocumented and some are having confusing name

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169649#comment-14169649 ] Sean Owen commented on SPARK-1192: -- PR is actually at

[jira] [Resolved] (SPARK-1149) Bad partitioners can cause Spark to hang

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1149. -- Resolution: Fixed Looks like Patrick merged this into master in March. It might have been fixed for

[jira] [Resolved] (SPARK-1083) Build fail

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1083. -- Resolution: Cannot Reproduce This looks like a git error, and is ancient at this point. I presume that

[jira] [Resolved] (SPARK-1017) Set the permgen even if we are calling the users sbt (via SBT_OPTS)

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1017. -- Resolution: Won't Fix As I understand, only {{sbt/sbt}} is supported for building Spark with SBT,

[jira] [Commented] (SPARK-1463) cleanup unnecessary dependency jars in the spark assembly jars

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169709#comment-14169709 ] Sean Owen commented on SPARK-1463: -- FWIW I do not see these packages in the final

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169724#comment-14169724 ] Sean Owen commented on SPARK-1010: -- Yes, lots of usage in tests still. A lot looks

[jira] [Commented] (SPARK-1209) SparkHadoopUtil should not use package org.apache.hadoop

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169835#comment-14169835 ] Sean Owen commented on SPARK-1209: -- Yes, I wonder too, does SparkHadoopMapRedUtil and

[jira] [Commented] (SPARK-3934) RandomForest bug in sanity check in DTStatsAggregator

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170220#comment-14170220 ] Sean Owen commented on SPARK-3934: -- Yep that fixes the issue I was seeing. Thanks! I can

[jira] [Commented] (SPARK-3895) Scala style: Indentation of method

2014-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170609#comment-14170609 ] Sean Owen commented on SPARK-3895: -- The rule is already in style guide. There seems to be

[jira] [Commented] (SPARK-1209) SparkHadoopUtil should not use package org.apache.hadoop

2014-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170617#comment-14170617 ] Sean Owen commented on SPARK-1209: -- Hm, it's {{private[apache]}} though. Couldn't this

[jira] [Resolved] (SPARK-3480) Throws out Not a valid command 'yarn-alpha/scalastyle' in dev/scalastyle for sbt build tool during 'Running Scala style checks'

2014-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3480. -- Resolution: Cannot Reproduce Throws out Not a valid command 'yarn-alpha/scalastyle' in dev/scalastyle

[jira] [Commented] (SPARK-3926) result of JavaRDD collectAsMap() is not serializable

2014-10-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14171418#comment-14171418 ] Sean Owen commented on SPARK-3926: -- Oops, embarrassed to say I didn't realize

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

2014-10-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172148#comment-14172148 ] Sean Owen commented on SPARK-3955: -- Looks like Jackson is managed to version 1.8.8 for

[jira] [Commented] (SPARK-1209) SparkHadoopUtil should not use package org.apache.hadoop

2014-10-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172571#comment-14172571 ] Sean Owen commented on SPARK-1209: -- ... and why wouldn't you, that's the title of the

[jira] [Commented] (SPARK-3431) Parallelize execution of tests

2014-10-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14173618#comment-14173618 ] Sean Owen commented on SPARK-3431: -- Yes that should be what scalatest does. It is a fork

[jira] [Commented] (SPARK-2426) Quadratic Minimization for MLlib ALS

2014-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175377#comment-14175377 ] Sean Owen commented on SPARK-2426: -- Regarding licensing, if the code is BSD licensed then

[jira] [Commented] (SPARK-3967) Spark applications fail in yarn-cluster mode when the directories configured in yarn.nodemanager.local-dirs are located on different disks/partitions

2014-10-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175748#comment-14175748 ] Sean Owen commented on SPARK-3967: -- You guys should make PRs for these. I am also not

[jira] [Commented] (SPARK-4007) EOF exception to load an JavaRDD from HDFS

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176824#comment-14176824 ] Sean Owen commented on SPARK-4007: -- Is this going to have any information associated to

[jira] [Commented] (SPARK-4002) JavaKafkaStreamSuite.testKafkaStream fails on OSX

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14176995#comment-14176995 ] Sean Owen commented on SPARK-4002: -- FWIW It doesn't fail for me from master right now if

[jira] [Commented] (SPARK-4018) RDD.reduce failing with java.lang.ClassCastException: org.apache.spark.SparkContext$$anonfun$26 cannot be cast to scala.Function2

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177592#comment-14177592 ] Sean Owen commented on SPARK-4018: -- Your sample code is Java, but the error seems to

[jira] [Commented] (SPARK-4001) Add Apriori algorithm to Spark MLlib

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177707#comment-14177707 ] Sean Owen commented on SPARK-4001: -- FWIW I do perceive Apriori to be *the* basic frequent

[jira] [Commented] (SPARK-4021) Kinesis code can cause compile failures with newer JDK's

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177725#comment-14177725 ] Sean Owen commented on SPARK-4021: -- This code is just fine though. The error is the kind

[jira] [Commented] (SPARK-4022) Replace colt dependency (LGPL) with commons-math

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177759#comment-14177759 ] Sean Owen commented on SPARK-4022: -- Yeah, looks like it is only in examples at least, so

[jira] [Commented] (SPARK-4018) RDD.reduce failing with java.lang.ClassCastException: org.apache.spark.SparkContext$$anonfun$26 cannot be cast to scala.Function2

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177766#comment-14177766 ] Sean Owen commented on SPARK-4018: -- Hm, I mean I suppose it goes without saying that the

[jira] [Commented] (SPARK-4022) Replace colt dependency (LGPL) with commons-math

2014-10-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1416#comment-1416 ] Sean Owen commented on SPARK-4022: -- Ah right there is Jet too, not just Colt. The LGPL

[jira] [Updated] (SPARK-4032) Deprecate YARN alpha support in Spark 1.2

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4032: - Summary: Deprecate YARN alpha support in Spark 1.2 (was: Deprecate YARN support in Spark 1.2)

[jira] [Commented] (SPARK-4034) get java.lang.NoClassDefFoundError: com/google/common/util/concurrent/ThreadFactoryBuilder in idea

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178219#comment-14178219 ] Sean Owen commented on SPARK-4034: -- You get this when you do what? This is a Guava class.

[jira] [Commented] (SPARK-4002) JavaKafkaStreamSuite.testKafkaStream fails on OSX

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178239#comment-14178239 ] Sean Owen commented on SPARK-4002: -- This passes for me right now in {{master}}: mvn

[jira] [Commented] (SPARK-3955) Different versions between jackson-mapper-asl and jackson-core-asl

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178294#comment-14178294 ] Sean Owen commented on SPARK-3955: -- I think the issue is matching the version used by

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178583#comment-14178583 ] Sean Owen commented on SPARK-3359: -- Sure, but it can be fixed right now too. I tried to

[jira] [Commented] (SPARK-4021) Issues observed after upgrading Jenkins to JDK7u71

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179283#comment-14179283 ] Sean Owen commented on SPARK-4021: -- [~shaneknapp] I don't think this can have anything to

[jira] [Resolved] (SPARK-4018) RDD.reduce failing with java.lang.ClassCastException: org.apache.spark.SparkContext$$anonfun$26 cannot be cast to scala.Function2

2014-10-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4018. -- Resolution: Not a Problem RDD.reduce failing with java.lang.ClassCastException:

[jira] [Commented] (SPARK-4044) Thriftserver fails to start when JAVA_HOME points to JRE instead of JDK

2014-10-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179620#comment-14179620 ] Sean Owen commented on SPARK-4044: -- How about using {{unzip -l}} to probe the contents of

[jira] [Updated] (SPARK-4046) Incorrect Java example on site

2014-10-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4046: - Priority: Minor (was: Critical) Affects Version/s: 1.1.0 Summary: Incorrect

[jira] [Commented] (SPARK-3359) `sbt/sbt unidoc` doesn't work with Java 8

2014-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181503#comment-14181503 ] Sean Owen commented on SPARK-3359: -- I inquired about these with the plugin project:

[jira] [Commented] (SPARK-4022) Replace colt dependency (LGPL) with commons-math

2014-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181524#comment-14181524 ] Sean Owen commented on SPARK-4022: -- I have begun work on this. You can see the base

[jira] [Commented] (SPARK-4063) Add the ability to send messages to Kafka in the stream

2014-10-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181526#comment-14181526 ] Sean Owen commented on SPARK-4063: -- Is this like a streaming operation that saves an RDD

[jira] [Commented] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182658#comment-14182658 ] Sean Owen commented on SPARK-4066: -- Does this work? -Dscalastyle.failOnViolation was

[jira] [Commented] (SPARK-4022) Replace colt dependency (LGPL) with commons-math

2014-10-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182781#comment-14182781 ] Sean Owen commented on SPARK-4022: -- [~mengxr] [~josephkb] Great, most of this is resolved

[jira] [Commented] (SPARK-4066) Make whether maven builds fails on scalastyle violation configurable

2014-10-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183340#comment-14183340 ] Sean Owen commented on SPARK-4066: -- Yeah, it's another flag to add to the build, but it's

[jira] [Commented] (SPARK-4111) [MLlib] Implement regression model evaluation metrics

2014-10-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186496#comment-14186496 ] Sean Owen commented on SPARK-4111: -- Is this more than just MAE / RMSE / R2? It might be

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187475#comment-14187475 ] Sean Owen commented on SPARK-4121: -- Yeah I was seeing this locally, but not on the

[jira] [Resolved] (SPARK-4132) Spark uses incompatible HDFS API

2014-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4132. -- Resolution: Duplicate I'm all but certain you're describing the same thing as SPARK-4078 Spark uses

[jira] [Commented] (SPARK-683) Spark 0.7 with Hadoop 1.0 does not work with current AMI's HDFS installation

2014-10-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188160#comment-14188160 ] Sean Owen commented on SPARK-683: - PS I think this also turns out to be the same as

[jira] [Commented] (SPARK-4147) Remove log4j dependency

2014-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189739#comment-14189739 ] Sean Owen commented on SPARK-4147: -- Yes, slf4j does not let you actually control logging

[jira] [Commented] (SPARK-4121) Master build failures after shading commons-math3

2014-10-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190708#comment-14190708 ] Sean Owen commented on SPARK-4121: -- Sorry I have been traveling without internet. When I

[jira] [Resolved] (SPARK-4162) Make scripts symlinkable

2014-10-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4162. -- Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/SPARK-3482 and

[jira] [Created] (SPARK-4170) Closure problems when running Scala app that extends App

2014-10-31 Thread Sean Owen (JIRA)
Sean Owen created SPARK-4170: Summary: Closure problems when running Scala app that extends App Key: SPARK-4170 URL: https://issues.apache.org/jira/browse/SPARK-4170 Project: Spark Issue Type:

[jira] [Created] (SPARK-4196) Streaming + checkpointing yields NotSerializableException for Hadoop Configuration from saveAsNewAPIHadoopFiles ?

2014-11-02 Thread Sean Owen (JIRA)
Sean Owen created SPARK-4196: Summary: Streaming + checkpointing yields NotSerializableException for Hadoop Configuration from saveAsNewAPIHadoopFiles ? Key: SPARK-4196 URL:

[jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib

2014-11-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194315#comment-14194315 ] Sean Owen commented on SPARK-1406: -- I put some comments on the PR. Thanks for starting on

[jira] [Commented] (SPARK-4206) BlockManager warnings in local mode: Block $blockId already exists on this machine; not re-adding it

2014-11-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194550#comment-14194550 ] Sean Owen commented on SPARK-4206: -- I think there was a discussion about this and the

[jira] [Resolved] (SPARK-2432) Apriori algorithm for frequent itemset mining

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2432. -- Resolution: Duplicate Resolving as duplicate of the later issue with more discussion. Apriori

[jira] [Commented] (SPARK-3954) source code optimization

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195956#comment-14195956 ] Sean Owen commented on SPARK-3954: -- source code optimization is not a good JIRA title.

[jira] [Updated] (SPARK-3954) Optimization to FileInputDStream

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-3954: - Summary: Optimization to FileInputDStream (was: source code optimization) Optimization to

[jira] [Resolved] (SPARK-4220) Spark New Feature

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4220. -- Resolution: Invalid Given two empty JIRAs were opened, I assume these were accidental. Spark New

[jira] [Resolved] (SPARK-4219) Spark New Feature

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4219. -- Resolution: Invalid Given two empty JIRAs were opened, I assume these were accidental. Spark New

[jira] [Commented] (SPARK-4196) Streaming + checkpointing yields NotSerializableException for Hadoop Configuration from saveAsNewAPIHadoopFiles ?

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196762#comment-14196762 ] Sean Owen commented on SPARK-4196: -- Same problem I'm afraid. The serialization error

[jira] [Commented] (SPARK-4237) add Manifest File for Maven building

2014-11-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197698#comment-14197698 ] Sean Owen commented on SPARK-4237: -- How does the PR address this? the manifest file is

[jira] [Commented] (SPARK-1297) Upgrade HBase dependency to 0.98.0

2014-11-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198514#comment-14198514 ] Sean Owen commented on SPARK-1297: -- Ted are you updating a pull request? patches aren't

[jira] [Resolved] (SPARK-4271) jetty Server can't tryport+1

2014-11-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4271. -- Resolution: Duplicate Well here's a good example. I'm sure this is duplicate of

[jira] [Commented] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2014-11-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200396#comment-14200396 ] Sean Owen commented on SPARK-4231: -- So this method basically computes where each test

[jira] [Commented] (SPARK-4231) Add RankingMetrics to examples.MovieLensALS

2014-11-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200470#comment-14200470 ] Sean Owen commented on SPARK-4231: -- Yes I'm mostly questioning implementing this in

[jira] [Commented] (SPARK-4276) Spark streaming requires at least two working thread

2014-11-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14200539#comment-14200539 ] Sean Owen commented on SPARK-4276: -- This is basically the same concern addressed already

[jira] [Commented] (SPARK-4289) Creating an instance of Hadoop Job fails in the Spark shell when toString() is called on the instance.

2014-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201827#comment-14201827 ] Sean Owen commented on SPARK-4289: -- This is a Hadoop issue, right? I don't know if Spark

[jira] [Updated] (SPARK-4288) Add Sparse Autoencoder algorithm to MLlib

2014-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4288: - Description: Are you proposing an implementation? Is it related to the neural network JIRA?

[jira] [Commented] (SPARK-4283) Spark source code does not correctly import into eclipse

2014-11-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201853#comment-14201853 ] Sean Owen commented on SPARK-4283: -- This is really an Eclipse problem. I don't personally

<    1   2   3   4   5   6   7   8   9   10   >