[jira] [Created] (SPARK-1387) Update build plugins, avoid plugin version warning, centralize versions

2014-04-01 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1387: Summary: Update build plugins, avoid plugin version warning, centralize versions Key: SPARK-1387 URL: https://issues.apache.org/jira/browse/SPARK-1387 Project: Spark

[jira] [Commented] (SPARK-1355) Switch website to the Apache CMS

2014-04-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957113#comment-13957113 ] Sean Owen commented on SPARK-1355: -- April Fools, apparently. Though this was opened on 30

[jira] [Commented] (SPARK-1388) ConcurrentModificationException in hadoop_common exposed by Spark

2014-04-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957330#comment-13957330 ] Sean Owen commented on SPARK-1388: -- Yes this should be resolved as a duplicate instead.

[jira] [Commented] (SPARK-1097) ConcurrentModificationException

2014-04-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957355#comment-13957355 ] Sean Owen commented on SPARK-1097: -- I agree, but, we can't patch Hadoop from here. I'm

[jira] [Commented] (SPARK-1391) BlockManager cannot transfer blocks larger than 2G in size

2014-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957450#comment-13957450 ] Sean Owen commented on SPARK-1391: -- Oops yes I mean offset of course. Good investigation

[jira] [Commented] (SPARK-1391) BlockManager cannot transfer blocks larger than 2G in size

2014-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13957949#comment-13957949 ] Sean Owen commented on SPARK-1391: -- Of course! Hardly my issue. Well, you could try my

[jira] [Commented] (SPARK-1398) FindBugs 1 -- FindBugs 2

2014-04-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13958262#comment-13958262 ] Sean Owen commented on SPARK-1398: -- +1 I would also volunteer to run it and propose fixes

[jira] [Commented] (SPARK-1433) Upgrade Mesos dependency to 0.17.0

2014-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13962006#comment-13962006 ] Sean Owen commented on SPARK-1433: -- You mean Mesos? Upgrade Mesos dependency to 0.17.0

[jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib

2014-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13962133#comment-13962133 ] Sean Owen commented on SPARK-1406: -- PMML is the de facto serialization, so certainly the

[jira] [Updated] (SPARK-1437) Jenkins should build with Java 6

2014-04-07 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1437: - Attachment: Screen Shot 2014-04-07 at 22.53.56.png Jenkins should build with Java 6

[jira] [Commented] (SPARK-1441) Compile Spark Core error with Hadoop 0.23.x

2014-04-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963016#comment-13963016 ] Sean Owen commented on SPARK-1441: -- I see, I had taken the yarn-alpha profile to be the

[jira] [Commented] (SPARK-1357) [MLLIB] Annotate developer and experimental API's

2014-04-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963999#comment-13963999 ] Sean Owen commented on SPARK-1357: -- I know I'm late to this party, but I just had a look

[jira] [Commented] (SPARK-1406) PMML model evaluation support via MLib

2014-04-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13964638#comment-13964638 ] Sean Owen commented on SPARK-1406: -- Yes I understand transformations can be described in

[jira] [Commented] (SPARK-1357) [MLLIB] Annotate developer and experimental API's

2014-04-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13964649#comment-13964649 ] Sean Owen commented on SPARK-1357: -- Yeah I think it's reasonable to say that the core ALS

[jira] [Commented] (SPARK-1437) Jenkins should build with Java 6

2014-04-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967522#comment-13967522 ] Sean Owen commented on SPARK-1437: -- Pardon my boldness in pushing this onto your plate

[jira] [Commented] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967784#comment-13967784 ] Sean Owen commented on SPARK-1479: -- yarn is the slightly more appropriate profile, but,

[jira] [Created] (SPARK-1488) Resolve scalac feature warnings during build

2014-04-14 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1488: Summary: Resolve scalac feature warnings during build Key: SPARK-1488 URL: https://issues.apache.org/jira/browse/SPARK-1488 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1439) Aggregate Scaladocs across projects

2014-04-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13971662#comment-13971662 ] Sean Owen commented on SPARK-1439: -- I had a run at this today. First I tried Maven-based

[jira] [Commented] (SPARK-1464) Update MLLib Examples to Use Breeze

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13972342#comment-13972342 ] Sean Owen commented on SPARK-1464: -- This is a duplicate of

[jira] [Commented] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13972397#comment-13972397 ] Sean Owen commented on SPARK-1520: -- Madness. One wild guess is that the breeze .jar files

[jira] [Commented] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13972523#comment-13972523 ] Sean Owen commented on SPARK-1520: -- Regarding large numbers of files: are there INDEX.LST

[jira] [Commented] (SPARK-1520) Inclusion of breeze corrupts assembly when compiled with JDK7 and run on JDK6

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13972819#comment-13972819 ] Sean Owen commented on SPARK-1520: -- Java 6 had a limit of 65536 files per jar in total,

[jira] [Commented] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973067#comment-13973067 ] Sean Owen commented on SPARK-1527: -- {{toString()}} returns {{getPath()}} which may still

[jira] [Commented] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973091#comment-13973091 ] Sean Owen commented on SPARK-1527: -- If the paths are only used locally, then an absolute

[jira] [Commented] (SPARK-1527) rootDirs in DiskBlockManagerSuite doesn't get full path from rootDir0, rootDir1

2014-04-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973148#comment-13973148 ] Sean Owen commented on SPARK-1527: -- There are a number of other uses of File.getName(),

[jira] [Commented] (SPARK-1556) jets3t dependency is outdated

2014-04-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975957#comment-13975957 ] Sean Owen commented on SPARK-1556: -- Actually, why does Spark have a direct dependency on

[jira] [Commented] (SPARK-1556) jets3t dependency is outdated

2014-04-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975967#comment-13975967 ] Sean Owen commented on SPARK-1556: -- OK, I partly eat my words. jets3t isn't included by

[jira] [Commented] (SPARK-1605) Improve mllib.linalg.Vector

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979380#comment-13979380 ] Sean Owen commented on SPARK-1605: -- I think this was on purpose, to try to hide breeze as

[jira] [Commented] (SPARK-1590) Recommend to use FindBugs

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979383#comment-13979383 ] Sean Owen commented on SPARK-1590: -- I love static analysis, and like FindBugs. I've

[jira] [Created] (SPARK-1607) Remove use of octal literals, deprecated in Scala 2.10 / removed in 2.11

2014-04-24 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1607: Summary: Remove use of octal literals, deprecated in Scala 2.10 / removed in 2.11 Key: SPARK-1607 URL: https://issues.apache.org/jira/browse/SPARK-1607 Project: Spark

[jira] [Commented] (SPARK-1604) YARN cluster mode broken

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979564#comment-13979564 ] Sean Owen commented on SPARK-1604: -- I would not be surprised if this is the same issue as

[jira] [Commented] (SPARK-1573) slight modification with regards to sbt/sbt test

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979569#comment-13979569 ] Sean Owen commented on SPARK-1573: -- I think it's to be expected that you have to run

[jira] [Commented] (SPARK-1575) failing tests with master branch

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979570#comment-13979570 ] Sean Owen commented on SPARK-1575: -- I get the same result. Here are the key parts of the

[jira] [Commented] (SPARK-1609) Executor fails to start when Command.extraJavaOptions contains multiple Java options

2014-04-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980719#comment-13980719 ] Sean Owen commented on SPARK-1609: -- Yeah you got it, that is the problem: {code}-Xss2m

[jira] [Commented] (SPARK-1590) Recommend to use FindBugs

2014-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980855#comment-13980855 ] Sean Owen commented on SPARK-1590: -- To enable in IntelliJ, go to Preferences Inspections

[jira] [Commented] (SPARK-1629) Spark Core missing commons-lang dependence

2014-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980878#comment-13980878 ] Sean Owen commented on SPARK-1629: -- I don't see any usage of Commons Lang in the whole

[jira] [Commented] (SPARK-1629) Spark Core missing commons-lang dependence

2014-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980893#comment-13980893 ] Sean Owen commented on SPARK-1629: -- Oh I see, that was added yesterday and I hadn't

[jira] [Commented] (SPARK-1638) Executors fail to come up if spark.executor.extraJavaOptions is set

2014-04-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983156#comment-13983156 ] Sean Owen commented on SPARK-1638: -- Almost certainly a duplicate of

[jira] [Created] (SPARK-1663) Spark Streaming docs code has several small errors

2014-04-29 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1663: Summary: Spark Streaming docs code has several small errors Key: SPARK-1663 URL: https://issues.apache.org/jira/browse/SPARK-1663 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-1663) Spark Streaming docs code has several small errors

2014-04-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13984466#comment-13984466 ] Sean Owen commented on SPARK-1663: -- PR: https://github.com/apache/spark/pull/589 Spark

[jira] [Commented] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-04-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985770#comment-13985770 ] Sean Owen commented on SPARK-1684: -- (Can I be pedantic and suggest standardizing to

[jira] [Comment Edited] (SPARK-1684) Merge script should standardize SPARK-XXX prefix

2014-04-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985770#comment-13985770 ] Sean Owen edited comment on SPARK-1684 at 4/30/14 5:21 PM: --- (Can

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986471#comment-13986471 ] Sean Owen commented on SPARK-1693: -- I suspect this occurs because two copies of the

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986490#comment-13986490 ] Sean Owen commented on SPARK-1693: -- I think this is traceable to a case of jar conflict.

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986494#comment-13986494 ] Sean Owen commented on SPARK-1693: -- Ah didn't even see that! Yeah that's my #1, which you

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986507#comment-13986507 ] Sean Owen commented on SPARK-1693: -- Correct. I thought you had tried option #1 since you

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986523#comment-13986523 ] Sean Owen commented on SPARK-1693: -- No, that's exactly the problem as far as I can tell.

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986631#comment-13986631 ] Sean Owen commented on SPARK-1693: -- Yes looks very close to what I had in mind; I have

[jira] [Commented] (SPARK-1693) Most of the tests throw a java.lang.SecurityException when spark built for hadoop 2.3.0 , 2.4.0

2014-05-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986643#comment-13986643 ] Sean Owen commented on SPARK-1693: -- Huh! you're right. Yes I agree with what you have

[jira] [Commented] (SPARK-1698) Improve spark integration

2014-05-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13987686#comment-13987686 ] Sean Owen commented on SPARK-1698: -- (Copying an earlier comment that went to the mailing

[jira] [Commented] (SPARK-1698) Improve spark integration

2014-05-02 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13987698#comment-13987698 ] Sean Owen commented on SPARK-1698: -- What is the suggested change in this particular JIRA?

[jira] [Issue Comment Deleted] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

2014-05-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1556: - Comment: was deleted (was: Actually, why does Spark have a direct dependency on jets3t at all? it is

[jira] [Issue Comment Deleted] (SPARK-1556) jets3t dep doesn't update properly with newer Hadoop versions

2014-05-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1556: - Comment: was deleted (was: OK, I partly eat my words. jets3t isn't included by the Hadoop client

[jira] [Commented] (SPARK-1520) Assembly Jar with more than 65536 files won't work when compiled on JDK7 and run on JDK6

2014-05-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989098#comment-13989098 ] Sean Owen commented on SPARK-1520: -- [~pwendell] On this note, I wonder if it's also best

[jira] [Commented] (SPARK-1718) pyspark doesn't work with assembly jar containing over 65536 files/dirs built on redhat

2014-05-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989666#comment-13989666 ] Sean Owen commented on SPARK-1718: -- Yeah, but it seems like it could well be that the JDK

[jira] [Commented] (SPARK-1718) pyspark doesn't work with assembly jar containing over 65536 files/dirs built on redhat

2014-05-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13989906#comment-13989906 ] Sean Owen commented on SPARK-1718: -- Yeah I may not be adding anything here. I suppose I

[jira] [Created] (SPARK-1727) Correct small compile errors, typos, and markdown issues in (primarly) MLlib docs

2014-05-05 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1727: Summary: Correct small compile errors, typos, and markdown issues in (primarly) MLlib docs Key: SPARK-1727 URL: https://issues.apache.org/jira/browse/SPARK-1727 Project:

[jira] [Created] (SPARK-1798) Tests should clean up temp files

2014-05-11 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1798: Summary: Tests should clean up temp files Key: SPARK-1798 URL: https://issues.apache.org/jira/browse/SPARK-1798 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

2014-05-11 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1789: Summary: Multiple versions of Netty dependencies cause FlumeStreamSuite failure Key: SPARK-1789 URL: https://issues.apache.org/jira/browse/SPARK-1789 Project: Spark

[jira] [Commented] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13994990#comment-13994990 ] Sean Owen commented on SPARK-1802: -- [~pwendell] You can see my start on it here:

[jira] [Updated] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1802: - Attachment: hive-exec-jar-problems.txt Audit dependency graph when Spark is built with -Phive

[jira] [Commented] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995815#comment-13995815 ] Sean Owen commented on SPARK-1802: -- I looked further into just what might go wrong by

[jira] [Commented] (SPARK-1760) mvn -Dsuites=* test throw an ClassNotFoundException

2014-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993493#comment-13993493 ] Sean Owen commented on SPARK-1760: -- If `wildcardSuites` lets you invoke specific suites

[jira] [Comment Edited] (SPARK-1802) Audit dependency graph when Spark is built with -Phive

2014-05-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995815#comment-13995815 ] Sean Owen edited comment on SPARK-1802 at 5/13/14 11:27 AM:

[jira] [Commented] (SPARK-1789) Multiple versions of Netty dependencies cause FlumeStreamSuite failure

2014-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997317#comment-13997317 ] Sean Owen commented on SPARK-1789: -- I don't have any info either way on that. Later is

[jira] [Commented] (SPARK-1827) LICENSE and NOTICE files need a refresh to contain transitive dependency info

2014-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13997458#comment-13997458 ] Sean Owen commented on SPARK-1827: -- LICENSE and NOTICE policy is explained here:

[jira] [Created] (SPARK-1827) LICENSE and NOTICE files need a refresh to contain transitive dependency info

2014-05-14 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1827: Summary: LICENSE and NOTICE files need a refresh to contain transitive dependency info Key: SPARK-1827 URL: https://issues.apache.org/jira/browse/SPARK-1827 Project: Spark

[jira] [Commented] (SPARK-1760) mvn -Dsuites=* test throw an ClassNotFoundException

2014-05-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992837#comment-13992837 ] Sean Owen commented on SPARK-1760: -- Yeah I think you would have to run this from the

[jira] [Commented] (SPARK-1575) failing tests with master branch

2014-05-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996955#comment-13996955 ] Sean Owen commented on SPARK-1575: -- For what it's worth, I no longer see this failure I

[jira] [Commented] (SPARK-1787) Build failure on JDK8 :: SBT fails to load build configuration file

2014-05-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998492#comment-13998492 ] Sean Owen commented on SPARK-1787: -- Duplicate of

[jira] [Commented] (SPARK-1473) Feature selection for high dimensional datasets

2014-05-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998494#comment-13998494 ] Sean Owen commented on SPARK-1473: -- I believe these types of thing were more the goals of

[jira] [Commented] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001418#comment-14001418 ] Sean Owen commented on SPARK-1875: -- Here's my recap of what I understand: - All the

[jira] [Commented] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001424#comment-14001424 ] Sean Owen commented on SPARK-1875: -- (That's correct that commons-lang and commons-lang3

[jira] [Commented] (SPARK-1875) NoClassDefFoundError: StringUtils when building against Hadoop 1

2014-05-19 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14001458#comment-14001458 ] Sean Owen commented on SPARK-1875: -- Yeah, my experience in the trenches suggests that

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007339#comment-14007339 ] Sean Owen commented on SPARK-1867: -- Yes, the 'mr1' artifacts are for when you are *not*

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-24 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008077#comment-14008077 ] Sean Owen commented on SPARK-1867: -- I could be way wrong here, partly as a function of

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008329#comment-14008329 ] Sean Owen commented on SPARK-1867: -- Well, for example, MapReduce classes are from one of

[jira] [Commented] (SPARK-1935) Explicitly add commons-codec 1.4 as a dependency

2014-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009472#comment-14009472 ] Sean Owen commented on SPARK-1935: -- Yeah, I think this is a matter of Maven's

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010294#comment-14010294 ] Sean Owen commented on SPARK-1518: -- 0.20.x stopped in early 2010. It is ancient. Spark

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-27 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010322#comment-14010322 ] Sean Owen commented on SPARK-1518: -- RE: Hadoop versions, in my reckoning of the twisted

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010937#comment-14010937 ] Sean Owen commented on SPARK-1518: -- Re: versioning one more time, really supporting a

[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA

2014-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011134#comment-14011134 ] Sean Owen commented on SPARK-1948: -- This is likely a scalac or IntelliJ problem, indeed.

[jira] [Commented] (SPARK-1951) spark on yarn can't start

2014-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011327#comment-14011327 ] Sean Owen commented on SPARK-1951: -- Yes, you should prefix HDFS file locations with

[jira] [Commented] (SPARK-1950) spark on yarn can't start

2014-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011330#comment-14011330 ] Sean Owen commented on SPARK-1950: -- (Looks like you opened this twice?

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14011897#comment-14011897 ] Sean Owen commented on SPARK-1518: -- they write their app against the Spark API's in Maven

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012301#comment-14012301 ] Sean Owen commented on SPARK-1518: -- Yes Matei that's what I'm getting at. Spark is a

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012309#comment-14012309 ] Sean Owen commented on SPARK-1867: -- There is no hadoop-io module. Modules are

[jira] [Commented] (SPARK-1948) Scalac crashes when building Spark in IntelliJ IDEA

2014-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012369#comment-14012369 ] Sean Owen commented on SPARK-1948: -- OK, maybe you can resolve this, if it's not a Spark

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2014-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012434#comment-14012434 ] Sean Owen commented on SPARK-1867: -- Something else is up; those are equivalent in Java

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14012552#comment-14012552 ] Sean Owen commented on SPARK-1518: -- Heh, I think the essence is: at least one more

[jira] [Created] (SPARK-1973) Add randomSplit to JavaRDD (with tests, and tidy Java tests)

2014-05-30 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1973: Summary: Add randomSplit to JavaRDD (with tests, and tidy Java tests) Key: SPARK-1973 URL: https://issues.apache.org/jira/browse/SPARK-1973 Project: Spark Issue

[jira] [Commented] (SPARK-1518) Spark master doesn't compile against hadoop-common trunk

2014-05-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14013591#comment-14013591 ] Sean Owen commented on SPARK-1518: -- Sorry for one more message here to reply to Matei --

[jira] [Created] (SPARK-1974) Most examples fail at startup because spark.master is not set

2014-05-30 Thread Sean Owen (JIRA)
Sean Owen created SPARK-1974: Summary: Most examples fail at startup because spark.master is not set Key: SPARK-1974 URL: https://issues.apache.org/jira/browse/SPARK-1974 Project: Spark Issue

[jira] [Commented] (SPARK-1954) Make it easier to get Spark on YARN code to compile in IntelliJ

2014-05-31 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14014592#comment-14014592 ] Sean Owen commented on SPARK-1954: -- How about the profiles just set a default Hadoop /

[jira] [Commented] (SPARK-1998) SparkFlumeEvent with body bigger than 1020 bytes are not read properly

2014-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016327#comment-14016327 ] Sean Owen commented on SPARK-1998: -- (Can you make a pull request versus a patch here?

[jira] [Resolved] (SPARK-1974) Most examples fail at startup because spark.master is not set

2014-06-03 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1974. -- Resolution: Not a Problem Fix Version/s: (was: 1.0.1) Decision was to not modify examples,

[jira] [Commented] (SPARK-2018) Big-Endian (IBM Power7) Spark Serialization issue

2014-06-04 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14017528#comment-14017528 ] Sean Owen commented on SPARK-2018: -- The meaning of the error is that Java thinks two

[jira] [Commented] (SPARK-2026) Maven hadoop* Profiles Should Set the expected Hadoop Version.

2014-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018512#comment-14018512 ] Sean Owen commented on SPARK-2026: -- A few people have mentioned and asked for this,

[jira] [Created] (SPARK-2034) KafkaInputDStream doesn't close resources and may prevent JVM shutdown

2014-06-05 Thread Sean Owen (JIRA)
Sean Owen created SPARK-2034: Summary: KafkaInputDStream doesn't close resources and may prevent JVM shutdown Key: SPARK-2034 URL: https://issues.apache.org/jira/browse/SPARK-2034 Project: Spark

[jira] [Commented] (SPARK-2019) Spark workers die/disappear when job fails for nearly any reason

2014-06-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018760#comment-14018760 ] Sean Owen commented on SPARK-2019: -- I believe that's coming with 5.1 but I don't know

  1   2   3   4   5   6   7   8   9   10   >