[jira] [Comment Edited] (SPARK-3838) Python code example for Word2Vec in user guide

2014-10-13 Thread Anant Daksh Asthana (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168989#comment-14168989 ] Anant Daksh Asthana edited comment on SPARK-3838 at 10/13/14 6:22 AM:

[jira] [Commented] (SPARK-3334) Spark causes mesos-master memory leak

2014-10-13 Thread Iven Hsu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168999#comment-14168999 ] Iven Hsu commented on SPARK-3334: - With spark 1.1.0, {{akkaFrameSize}} is same as other

[jira] [Resolved] (SPARK-3899) wrong links in streaming doc

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3899. --- Resolution: Fixed Fix Version/s: 1.1.1 1.2.0 Issue resolved by pull request

[jira] [Updated] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

2014-10-13 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Davidson updated SPARK-3921: -- Description: As of [this

[jira] [Updated] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

2014-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3921: - Target Version/s: 1.2.0 Affects Version/s: 1.2.0 WorkerWatcher in Standalone mode fail to come up

[jira] [Commented] (SPARK-3905) The keys for sorting the columns of Executor page ,Stage page Storage page are incorrect

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169043#comment-14169043 ] Apache Spark commented on SPARK-3905: - User 'witgo' has created a pull request for

[jira] [Commented] (SPARK-3923) All Standalone Mode services time out with each other

2014-10-13 Thread Aaron Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169044#comment-14169044 ] Aaron Davidson commented on SPARK-3923: --- I did a little digging hoping to find some

[jira] [Reopened] (SPARK-3598) cast to timestamp should be the same as hive

2014-10-13 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang reopened SPARK-3598: reopen to change assignee... cast to timestamp should be the same as hive

[jira] [Resolved] (SPARK-3598) cast to timestamp should be the same as hive

2014-10-13 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang resolved SPARK-3598. Resolution: Fixed cast to timestamp should be the same as hive

[jira] [Resolved] (SPARK-3222) cross join support in HiveQl

2014-10-13 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang resolved SPARK-3222. Resolution: Fixed cross join support in HiveQl

[jira] [Reopened] (SPARK-3222) cross join support in HiveQl

2014-10-13 Thread Adrian Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adrian Wang reopened SPARK-3222: reopen to change assignee to myself cross join support in HiveQl

[jira] [Created] (SPARK-3924) Upgrade to Akka version 2.3.6

2014-10-13 Thread Helena Edelson (JIRA)
Helena Edelson created SPARK-3924: - Summary: Upgrade to Akka version 2.3.6 Key: SPARK-3924 URL: https://issues.apache.org/jira/browse/SPARK-3924 Project: Spark Issue Type: Dependency upgrade

[jira] [Comment Edited] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-10-13 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169208#comment-14169208 ] Helena Edelson edited comment on SPARK-2593 at 10/13/14 11:55 AM:

[jira] [Commented] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-10-13 Thread Helena Edelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169208#comment-14169208 ] Helena Edelson commented on SPARK-2593: --- [~matei] [~pwendell] Yes I see the pain

[jira] [Commented] (SPARK-1138) Spark 0.9.0 does not work with Hadoop / HDFS

2014-10-13 Thread Sunil Prabhakara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169254#comment-14169254 ] Sunil Prabhakara commented on SPARK-1138: - I am using Cloudera Version 4.2.1,

[jira] [Comment Edited] (SPARK-1138) Spark 0.9.0 does not work with Hadoop / HDFS

2014-10-13 Thread Sunil Prabhakara (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169254#comment-14169254 ] Sunil Prabhakara edited comment on SPARK-1138 at 10/13/14 1:01 PM:

[jira] [Commented] (SPARK-3586) Support nested directories in Spark Streaming

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169276#comment-14169276 ] Apache Spark commented on SPARK-3586: - User 'wangxiaojing' has created a pull request

[jira] [Commented] (SPARK-2863) Emulate Hive type coercion in native reimplementations of Hive functions

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169306#comment-14169306 ] Apache Spark commented on SPARK-2863: - User 'willb' has created a pull request for

[jira] [Created] (SPARK-3925) Considering the ordering of qualifiers when comparison

2014-10-13 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-3925: -- Summary: Considering the ordering of qualifiers when comparison Key: SPARK-3925 URL: https://issues.apache.org/jira/browse/SPARK-3925 Project: Spark

[jira] [Updated] (SPARK-3925) Considering the ordering of qualifiers during comparison

2014-10-13 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-3925: --- Summary: Considering the ordering of qualifiers during comparison (was: Considering the

[jira] [Commented] (SPARK-3925) Considering the ordering of qualifiers when comparison

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169311#comment-14169311 ] Apache Spark commented on SPARK-3925: - User 'viirya' has created a pull request for

[jira] [Updated] (SPARK-3925) Do not consider the ordering of qualifiers during comparison

2014-10-13 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-3925: --- Description: The qualifiers orderings should not be considered during the comparison between

[jira] [Updated] (SPARK-3925) Do not considering the ordering of qualifiers during comparison

2014-10-13 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-3925: --- Summary: Do not considering the ordering of qualifiers during comparison (was: Considering

[jira] [Updated] (SPARK-3925) Do not consider the ordering of qualifiers during comparison

2014-10-13 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-3925: --- Summary: Do not consider the ordering of qualifiers during comparison (was: Do not

[jira] [Commented] (SPARK-3869) ./bin/spark-class miss Java version with _JAVA_OPTIONS set

2014-10-13 Thread cocoatomo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169329#comment-14169329 ] cocoatomo commented on SPARK-3869: -- Hi [~pwendell], thank you for informing me. Is it OK

[jira] [Commented] (SPARK-922) Update Spark AMI to Python 2.7

2014-10-13 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169331#comment-14169331 ] Nicholas Chammas commented on SPARK-922: [~joshrosen] - Do you mean [this

[jira] [Comment Edited] (SPARK-922) Update Spark AMI to Python 2.7

2014-10-13 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169331#comment-14169331 ] Nicholas Chammas edited comment on SPARK-922 at 10/13/14 2:19 PM:

[jira] [Created] (SPARK-3926) result of JavaRDD collectAsMap() is not serializable

2014-10-13 Thread Antoine Amend (JIRA)
Antoine Amend created SPARK-3926: Summary: result of JavaRDD collectAsMap() is not serializable Key: SPARK-3926 URL: https://issues.apache.org/jira/browse/SPARK-3926 Project: Spark Issue

[jira] [Commented] (SPARK-922) Update Spark AMI to Python 2.7

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169380#comment-14169380 ] Josh Rosen commented on SPARK-922: -- [~nchammas] - I don't think that there's an urgent

[jira] [Commented] (SPARK-3926) result of JavaRDD collectAsMap() is not serializable

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169383#comment-14169383 ] Sean Owen commented on SPARK-3926: -- Yeah, seems fine to just let {{MapWrapper}} implement

[jira] [Resolved] (SPARK-3897) Scala style: format example code

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3897. -- Resolution: Won't Fix Given recent discussion, and consensus to not make sweeping style changes, I

[jira] [Resolved] (SPARK-3895) Scala style: Indentation of method

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3895. -- Resolution: Won't Fix Given recent discussion, and consensus to not make sweeping style changes, I

[jira] [Resolved] (SPARK-3781) code style format

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3781. -- Resolution: Won't Fix Given recent discussion, and consensus to not make sweeping style changes, I

[jira] [Commented] (SPARK-3896) checkSpeculatableTasks fask quit loop, invoking checkSpeculatableTasks is expensive

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169406#comment-14169406 ] Josh Rosen commented on SPARK-3896: --- [~srowen] There actually IS a PR; it looks like the

[jira] [Commented] (SPARK-3890) remove redundant spark.executor.memory in doc

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169405#comment-14169405 ] Sean Owen commented on SPARK-3890: -- For some reason the PR was not linked:

[jira] [Commented] (SPARK-3896) checkSpeculatableTasks fask quit loop, invoking checkSpeculatableTasks is expensive

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169409#comment-14169409 ] Sean Owen commented on SPARK-3896: -- Oops, my bad. I just realized that some PRs didn't

[jira] [Commented] (SPARK-3896) checkSpeculatableTasks fask quit loop, invoking checkSpeculatableTasks is expensive

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169412#comment-14169412 ] Josh Rosen commented on SPARK-3896: --- I moved the automatic linking code from Jenkins to

[jira] [Commented] (SPARK-3662) Importing pandas breaks included pi.py example

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169424#comment-14169424 ] Sean Owen commented on SPARK-3662: -- [~esamanas] Do you have a suggested change here,

[jira] [Resolved] (SPARK-3506) 1.1.0-SNAPSHOT in docs for 1.1.0 under docs/latest

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3506. -- Resolution: Fixed Fix Version/s: 1.1.1 Looks like the site has been updated, and I see no

[jira] [Created] (SPARK-3927) Extends SPARK-2577 to fix secondary resources

2014-10-13 Thread Ian O Connell (JIRA)
Ian O Connell created SPARK-3927: Summary: Extends SPARK-2577 to fix secondary resources Key: SPARK-3927 URL: https://issues.apache.org/jira/browse/SPARK-3927 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3251) Clarify learning interfaces

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169449#comment-14169449 ] Sean Owen commented on SPARK-3251: -- Is this a subset of / duplicate of SPARK-3702 now,

[jira] [Commented] (SPARK-3897) Scala style: format example code

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169451#comment-14169451 ] Apache Spark commented on SPARK-3897: - User 'shijinkui' has created a pull request for

[jira] [Commented] (SPARK-3883) Provide SSL support for Akka and HttpServer based connections

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169458#comment-14169458 ] Apache Spark commented on SPARK-3883: - User 'jacek-lewandowski' has created a pull

[jira] [Commented] (SPARK-3890) remove redundant spark.executor.memory in doc

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169466#comment-14169466 ] Apache Spark commented on SPARK-3890: - User 'WangTaoTheTonic' has created a pull

[jira] [Issue Comment Deleted] (SPARK-3921) WorkerWatcher in Standalone mode fail to come up due to invalid workerUrl

2014-10-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-3921: - Comment: was deleted (was: https://github.com/apache/spark/pull/2779) WorkerWatcher in Standalone mode

[jira] [Commented] (SPARK-3480) Throws out Not a valid command 'yarn-alpha/scalastyle' in dev/scalastyle for sbt build tool during 'Running Scala style checks'

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169472#comment-14169472 ] Sean Owen commented on SPARK-3480: -- Given the discussion I suggest this is

[jira] [Commented] (SPARK-3257) Enable :cp to add JARs in spark-shell (Scala 2.11)

2014-10-13 Thread Heather Miller (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169479#comment-14169479 ] Heather Miller commented on SPARK-3257: --- FYI to Typesafers, I'm about to PR this to

[jira] [Commented] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169499#comment-14169499 ] Josh Rosen commented on SPARK-2633: --- I've opened a pull request to add a stable

[jira] [Commented] (SPARK-3902) Stabilize AsyncRDDActions and expose its methods in Java API

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169505#comment-14169505 ] Apache Spark commented on SPARK-3902: - User 'JoshRosen' has created a pull request for

[jira] [Commented] (SPARK-3590) Expose async APIs in the Java API

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169507#comment-14169507 ] Josh Rosen commented on SPARK-3590: --- I've opened a pull request to add these Java APIs:

[jira] [Commented] (SPARK-3924) Upgrade to Akka version 2.3.6

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169504#comment-14169504 ] Sean Owen commented on SPARK-3924: -- I think this is a duplicate of SPARK-2707 and

[jira] [Commented] (SPARK-2707) Upgrade to Akka 2.3

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169509#comment-14169509 ] Sean Owen commented on SPARK-2707: -- Can this be considered a duplicate of SPARK-2805,

[jira] [Commented] (SPARK-3590) Expose async APIs in the Java API

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169506#comment-14169506 ] Apache Spark commented on SPARK-3590: - User 'JoshRosen' has created a pull request for

[jira] [Resolved] (SPARK-1834) NoSuchMethodError when invoking JavaPairRDD.reduce() in Java

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1834. -- Resolution: Duplicate On another look, I'm almost sure this is the same issue as in SPARK-3266, which

[jira] [Commented] (SPARK-2493) SBT gen-idea doesn't generate correct Intellij project

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169527#comment-14169527 ] Sean Owen commented on SPARK-2493: -- Is this still an issue [~dbtsai] ? For IntelliJ, I

[jira] [Resolved] (SPARK-2198) Partition the scala build file so that it is easier to maintain

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2198. -- Resolution: Won't Fix Sounds like a WontFix Partition the scala build file so that it is easier to

[jira] [Commented] (SPARK-2593) Add ability to pass an existing Akka ActorSystem into Spark

2014-10-13 Thread Evan Chan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169545#comment-14169545 ] Evan Chan commented on SPARK-2593: -- Hmmm :( I believe Spark already uses a

[jira] [Commented] (SPARK-1849) Broken UTF-8 encoded data gets character replacements and thus can't be fixed

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169549#comment-14169549 ] Sean Owen commented on SPARK-1849: -- Yes, I think there isn't a 'fix' here short of a

[jira] [Resolved] (SPARK-1787) Build failure on JDK8 :: SBT fails to load build configuration file

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1787. -- Resolution: Duplicate FWIW SBT + Java 8 has worked fine for me on master for a long while, so assume

[jira] [Resolved] (SPARK-1738) Is spark-debugger still available?

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1738. -- Resolution: Fixed That document was since deleted at some point anyway, and I assume the answer is

[jira] [Resolved] (SPARK-1605) Improve mllib.linalg.Vector

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1605. -- Resolution: Won't Fix Another WontFix then? Improve mllib.linalg.Vector ---

[jira] [Resolved] (SPARK-1573) slight modification with regards to sbt/sbt test

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1573. -- Resolution: Won't Fix This has been resolved insofar as the main README.md no longer has this text.

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169572#comment-14169572 ] Apache Spark commented on SPARK-3873: - User 'vanzin' has created a pull request for

[jira] [Created] (SPARK-3928) Support wildcard matches on Parquet files

2014-10-13 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-3928: --- Summary: Support wildcard matches on Parquet files Key: SPARK-3928 URL: https://issues.apache.org/jira/browse/SPARK-3928 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-1479) building spark on 2.0.0-cdh4.4.0 failed

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1479. -- Resolution: Won't Fix Given discussion in SPARK-3445, I doubt anything more will be done for YARN

[jira] [Commented] (SPARK-3928) Support wildcard matches on Parquet files

2014-10-13 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169580#comment-14169580 ] Nicholas Chammas commented on SPARK-3928: - cc [~marmbrus] Support wildcard

[jira] [Commented] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169589#comment-14169589 ] Sean Owen commented on SPARK-1409: -- Since this test was removed with SPARK-2805, safe to

[jira] [Resolved] (SPARK-1398) Remove FindBugs jsr305 dependency

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1398. -- Resolution: Won't Fix From the PR discussion, this had to be reverted because of some build problems,

[jira] [Resolved] (SPARK-1339) Build error: org.eclipse.paho:mqtt-client

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1339. -- Resolution: Not a Problem Build error: org.eclipse.paho:mqtt-client

[jira] [Commented] (SPARK-1317) sbt doesn't work for building Spark programs

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169629#comment-14169629 ] Sean Owen commented on SPARK-1317: -- PS if you're still interested in this, I am pretty

[jira] [Created] (SPARK-3929) Support for fixed-precision decimal

2014-10-13 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-3929: Summary: Support for fixed-precision decimal Key: SPARK-3929 URL: https://issues.apache.org/jira/browse/SPARK-3929 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-3930) Add precision and scale to Spark SQL's Decimal type

2014-10-13 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-3930: Summary: Add precision and scale to Spark SQL's Decimal type Key: SPARK-3930 URL: https://issues.apache.org/jira/browse/SPARK-3930 Project: Spark Issue

[jira] [Updated] (SPARK-3929) Support for fixed-precision decimal

2014-10-13 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3929: - Description: Spark SQL should support fixed-precision decimals, which are available in Hive 0.13

[jira] [Created] (SPARK-3931) Support reading fixed-precision decimals from Parquet

2014-10-13 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-3931: Summary: Support reading fixed-precision decimals from Parquet Key: SPARK-3931 URL: https://issues.apache.org/jira/browse/SPARK-3931 Project: Spark Issue

[jira] [Created] (SPARK-3932) Support reading fixed-precision decimals from Hive 0.13

2014-10-13 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-3932: Summary: Support reading fixed-precision decimals from Hive 0.13 Key: SPARK-3932 URL: https://issues.apache.org/jira/browse/SPARK-3932 Project: Spark Issue

[jira] [Resolved] (SPARK-1243) spark compilation error

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1243. -- Resolution: Fixed This appears to be long since resolved by something else, perhaps a subsequent

[jira] [Updated] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3266: -- Affects Version/s: 1.2.0 JavaDoubleRDD doesn't contain max() ---

[jira] [Created] (SPARK-3933) Optimize decimal type in Spark SQL for those with small precision

2014-10-13 Thread Matei Zaharia (JIRA)
Matei Zaharia created SPARK-3933: Summary: Optimize decimal type in Spark SQL for those with small precision Key: SPARK-3933 URL: https://issues.apache.org/jira/browse/SPARK-3933 Project: Spark

[jira] [Updated] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2014-10-13 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-3266: -- Target Version/s: 1.1.1, 1.2.0 JavaDoubleRDD doesn't contain max()

[jira] [Resolved] (SPARK-1306) no instructions provided for sbt assembly with Hadoop 2.2

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1306. -- Resolution: Fixed I think this was obviated by subsequent changes to this documentation. SBT is no

[jira] [Resolved] (SPARK-1234) clean up typos and grammar issues in Spark on YARN page

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1234. -- Resolution: Won't Fix Given the discussion in https://github.com/apache/spark/pull/130 , this was

[jira] [Commented] (SPARK-1192) Around 30 parameters in Spark are used but undocumented and some are having confusing name

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169649#comment-14169649 ] Sean Owen commented on SPARK-1192: -- PR is actually at

[jira] [Commented] (SPARK-1192) Around 30 parameters in Spark are used but undocumented and some are having confusing name

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169658#comment-14169658 ] Apache Spark commented on SPARK-1192: - User 'CodingCat' has created a pull request for

[jira] [Commented] (SPARK-3251) Clarify learning interfaces

2014-10-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169659#comment-14169659 ] Joseph K. Bradley commented on SPARK-3251: -- I agree it's hard to say. Based on

[jira] [Resolved] (SPARK-1149) Bad partitioners can cause Spark to hang

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1149. -- Resolution: Fixed Looks like Patrick merged this into master in March. It might have been fixed for

[jira] [Commented] (SPARK-1192) Around 30 parameters in Spark are used but undocumented and some are having confusing name

2014-10-13 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169663#comment-14169663 ] Nan Zhu commented on SPARK-1192: yes, I resubmitted

[jira] [Resolved] (SPARK-1083) Build fail

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1083. -- Resolution: Cannot Reproduce This looks like a git error, and is ancient at this point. I presume that

[jira] [Resolved] (SPARK-1017) Set the permgen even if we are calling the users sbt (via SBT_OPTS)

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1017. -- Resolution: Won't Fix As I understand, only {{sbt/sbt}} is supported for building Spark with SBT,

[jira] [Commented] (SPARK-3923) All Standalone Mode services time out with each other

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169692#comment-14169692 ] Apache Spark commented on SPARK-3923: - User 'aarondav' has created a pull request for

[jira] [Resolved] (SPARK-1409) Flaky Test: actor input stream test in org.apache.spark.streaming.InputStreamsSuite

2014-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-1409. - Resolution: Won't Fix Flaky Test: actor input stream test in

[jira] [Commented] (SPARK-1463) cleanup unnecessary dependency jars in the spark assembly jars

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169709#comment-14169709 ] Sean Owen commented on SPARK-1463: -- FWIW I do not see these packages in the final

[jira] [Commented] (SPARK-1010) Update all unit tests to use SparkConf instead of system properties

2014-10-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169724#comment-14169724 ] Sean Owen commented on SPARK-1010: -- Yes, lots of usage in tests still. A lot looks

[jira] [Created] (SPARK-3934) RandomForest bug in sanity check in DTStatsAggregator

2014-10-13 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-3934: Summary: RandomForest bug in sanity check in DTStatsAggregator Key: SPARK-3934 URL: https://issues.apache.org/jira/browse/SPARK-3934 Project: Spark

[jira] [Commented] (SPARK-3934) RandomForest bug in sanity check in DTStatsAggregator

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169752#comment-14169752 ] Apache Spark commented on SPARK-3934: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-3918) Forget Unpersist in RandomForest.scala(train Method)

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169753#comment-14169753 ] Apache Spark commented on SPARK-3918: - User 'jkbradley' has created a pull request for

[jira] [Commented] (SPARK-3913) Spark Yarn Client API change to expose Yarn Resource Capacity, Yarn Application Listener and killApplication() API

2014-10-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14169760#comment-14169760 ] Apache Spark commented on SPARK-3913: - User 'chesterxgchen' has created a pull request

[jira] [Updated] (SPARK-3654) Implement all extended HiveQL statements/commands with a separate parser combinator

2014-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3654: Assignee: Ravindra Pesala Implement all extended HiveQL statements/commands with a

[jira] [Updated] (SPARK-3813) Support case when conditional functions in Spark SQL

2014-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3813: Assignee: Ravindra Pesala Support case when conditional functions in Spark SQL

[jira] [Updated] (SPARK-2594) Add CACHE TABLE name AS SELECT ...

2014-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2594: Assignee: Ravindra Pesala Add CACHE TABLE name AS SELECT ...

[jira] [Updated] (SPARK-3371) Spark SQL: Renaming a function expression with group by gives error

2014-10-13 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-3371: Assignee: Ravindra Pesala Spark SQL: Renaming a function expression with group by gives

  1   2   >