[jira] [Commented] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-03-14 Thread Kannan Rajah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361978#comment-14361978 ] Kannan Rajah commented on SPARK-1529: - Can someone assign this bug to me? I am working

[jira] [Commented] (SPARK-6333) saveAsObjectFile support for compression codec

2015-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362059#comment-14362059 ] Apache Spark commented on SPARK-6333: - User 'deenar' has created a pull request for

[jira] [Commented] (SPARK-6044) RDD.aggregate() should not use the closure serializer on the zero value

2015-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361967#comment-14361967 ] Apache Spark commented on SPARK-6044: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

2015-03-14 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361981#comment-14361981 ] Debasish Das commented on SPARK-6323: - By the way I can close the JIRA if it is not

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1529: - Assignee: Kannan Rajah (was: Cheng Lian) Support setting spark.local.dirs to a hadoop FileSystem

[jira] [Created] (SPARK-6339) Support creating temporary tables with DDL

2015-03-14 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-6339: - Summary: Support creating temporary tables with DDL Key: SPARK-6339 URL: https://issues.apache.org/jira/browse/SPARK-6339 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-704) ConnectionManager sometimes cannot detect loss of sending connections

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-704: Assignee: (was: Henry Saputra) ConnectionManager sometimes cannot detect loss of sending connections

[jira] [Resolved] (SPARK-704) ConnectionManager sometimes cannot detect loss of sending connections

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-704. - Resolution: Cannot Reproduce ConnectionManager sometimes cannot detect loss of sending connections

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362085#comment-14362085 ] Joseph K. Bradley commented on SPARK-6334: -- I'm not sure about that. [~mengxr] ?

[jira] [Commented] (SPARK-6338) Use standard temp dir mechanisms in tests to avoid orphaned temp files

2015-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362035#comment-14362035 ] Apache Spark commented on SPARK-6338: - User 'srowen' has created a pull request for

[jira] [Comment Edited] (SPARK-4086) Fold-style aggregation for VertexRDD

2015-03-14 Thread Brennon York (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362106#comment-14362106 ] Brennon York edited comment on SPARK-4086 at 3/14/15 11:52 PM:

[jira] [Resolved] (SPARK-3621) Provide a way to broadcast an RDD (instead of just a variable made of the RDD) so that a job can access

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3621. -- Resolution: Not a Problem Provide a way to broadcast an RDD (instead of just a variable made of the

[jira] [Commented] (SPARK-3266) JavaDoubleRDD doesn't contain max()

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362052#comment-14362052 ] Sean Owen commented on SPARK-3266: -- Related note to self for the future: the histogram()

[jira] [Commented] (SPARK-6332) compute calibration curve for binary classifiers

2015-03-14 Thread Robert Dodier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362114#comment-14362114 ] Robert Dodier commented on SPARK-6332: -- Thanks for your interest. I'll try to answer

[jira] [Created] (SPARK-6338) Use standard temp dir mechanisms in tests to avoid orphaned temp files

2015-03-14 Thread Sean Owen (JIRA)
Sean Owen created SPARK-6338: Summary: Use standard temp dir mechanisms in tests to avoid orphaned temp files Key: SPARK-6338 URL: https://issues.apache.org/jira/browse/SPARK-6338 Project: Spark

[jira] [Updated] (SPARK-6337) Spark 1.3 doc fixes

2015-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6337: - Description: I'll try to track doc issues to be fixed for the 1.3.1 release in this JIRA.

[jira] [Commented] (SPARK-4086) Fold-style aggregation for VertexRDD

2015-03-14 Thread Brennon York (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362106#comment-14362106 ] Brennon York commented on SPARK-4086: - Hey [~ankurd] could you go into a little more

[jira] [Commented] (SPARK-4086) Fold-style aggregation for VertexRDD

2015-03-14 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362203#comment-14362203 ] Ankur Dave commented on SPARK-4086: --- Thanks! Yeah, I was thinking about adding a new

[jira] [Updated] (SPARK-4086) Fold-style aggregation for VertexRDD

2015-03-14 Thread Ankur Dave (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ankur Dave updated SPARK-4086: -- Assignee: (was: Ankur Dave) Fold-style aggregation for VertexRDD

[jira] [Created] (SPARK-6340) mllib.IDF for LabelPoints

2015-03-14 Thread Kian Ho (JIRA)
Kian Ho created SPARK-6340: -- Summary: mllib.IDF for LabelPoints Key: SPARK-6340 URL: https://issues.apache.org/jira/browse/SPARK-6340 Project: Spark Issue Type: Improvement Components:

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-14 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362219#comment-14362219 ] Yu Ishikawa commented on SPARK-2429: I didn't change the algorithms very much. The new

[jira] [Commented] (SPARK-5790) Add tests for: VertexRDD's won't zip properly for `diff` capability

2015-03-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362232#comment-14362232 ] Takeshi Yamamuro commented on SPARK-5790: - Thanks, If your patch merged, I'll add

[jira] [Commented] (SPARK-2429) Hierarchical Implementation of KMeans

2015-03-14 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362223#comment-14362223 ] Yu Ishikawa commented on SPARK-2429: Hi [~freeman-lab], Thank you for commenting.

[jira] [Updated] (SPARK-6340) mllib.IDF for LabelPoints

2015-03-14 Thread Kian Ho (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kian Ho updated SPARK-6340: --- Description: as per:

[jira] [Commented] (SPARK-4086) Fold-style aggregation for VertexRDD

2015-03-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14362192#comment-14362192 ] Takeshi Yamamuro commented on SPARK-4086: - ISTM, VertexRDD has to comply with

[jira] [Updated] (SPARK-6154) Support Kafka, JDBC in Scala 2.11

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6154: - Issue Type: Improvement (was: Bug) Summary: Support Kafka, JDBC in Scala 2.11 (was: Build error

[jira] [Resolved] (SPARK-2221) Spark fails on windows YARN (HortonWorks 2.4)

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-2221. -- Resolution: Duplicate Same issue -- quoting and Windows shell. Resolving in favor of the other since

[jira] [Updated] (SPARK-1346) Backport SPARK-1210 into 0.9 branch

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1346: - Labels: (was: backport-needed) Backport SPARK-1210 into 0.9 branch

[jira] [Updated] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-6334: --- Attachment: als-diskusage.png this is the disk usage pattern during ALS - 90% is when YARN kills the

[jira] [Issue Comment Deleted] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-6334: --- Comment: was deleted (was: this is the disk usage pattern during ALS - 90% is when YARN kills the

[jira] [Resolved] (SPARK-6301) Unable to load external jars while submitting Spark Job

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6301. -- Resolution: Duplicate Unable to load external jars while submitting Spark Job

[jira] [Updated] (SPARK-6029) Unshaded clearspring classpath leakage + excluded fastutil interferes with apps using clearspring

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6029: - Priority: Minor (was: Major) Summary: Unshaded clearspring classpath leakage + excluded fastutil

[jira] [Commented] (SPARK-6301) Unable to load external jars while submitting Spark Job

2015-03-14 Thread Baswaraj (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361651#comment-14361651 ] Baswaraj commented on SPARK-6301: - I think our problem is exactly as reported in

[jira] [Commented] (SPARK-6312) ChiSqTest should check for too few counts

2015-03-14 Thread Chunnan Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361650#comment-14361650 ] Chunnan Yao commented on SPARK-6312: According to

[jira] [Commented] (SPARK-5953) NoSuchMethodException with a Kafka input stream and custom decoder in Scala

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361657#comment-14361657 ] Sean Owen commented on SPARK-5953: -- Looking at this again, aren't you simply missing the

[jira] [Updated] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-6334: --- Description: when running bigger ALS training spark spills loads of temp data into the local-dir (in

[jira] [Updated] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antony Mayi updated SPARK-6334: --- Description: when running bigger ALS training spark spills loads of temp data into the local-dir (in

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361706#comment-14361706 ] Sean Owen commented on SPARK-6334: -- Do you have 12TB of disk available to the YARN local

[jira] [Updated] (SPARK-6269) Using a different implementation of java array reflection for size estimation

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6269: - Issue Type: Improvement (was: Bug) Using a different implementation of java array reflection for size

[jira] [Updated] (SPARK-6312) ChiSqTest should check for too few counts

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6312: - Priority: Minor (was: Major) ChiSqTest should check for too few counts

[jira] [Updated] (SPARK-5271) PySpark History Web UI issues

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5271: - Component/s: PySpark Description: After successful run of PySpark app via spark-submit in yarn-client

[jira] [Resolved] (SPARK-1346) Backport SPARK-1210 into 0.9 branch

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1346. -- Resolution: Fixed Fix Version/s: 0.9.3 Assignee: Sean Owen (was: Tathagata Das)

[jira] [Created] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
Antony Mayi created SPARK-6334: -- Summary: spark-local dir not getting cleared during ALS Key: SPARK-6334 URL: https://issues.apache.org/jira/browse/SPARK-6334 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5921) Task/Stage always in pending on foreachPartition in UI

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5921. -- Resolution: Cannot Reproduce ... until there's a more reliable reproduction. Task/Stage always in

[jira] [Commented] (SPARK-5134) Bump default Hadoop version to 2+

2015-03-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361673#comment-14361673 ] Apache Spark commented on SPARK-5134: - User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-6333) saveAsObjectFile support for compression codec

2015-03-14 Thread Andrey Zagrebin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361753#comment-14361753 ] Andrey Zagrebin commented on SPARK-6333: I would work on this feature and have a

[jira] [Comment Edited] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361715#comment-14361715 ] Antony Mayi edited comment on SPARK-6334 at 3/14/15 11:11 AM: --

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361715#comment-14361715 ] Antony Mayi commented on SPARK-6334: bq. What are the files that are filling up the

[jira] [Resolved] (SPARK-6195) Specialized in-memory column type for decimal

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6195. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 4938

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361712#comment-14361712 ] Antony Mayi commented on SPARK-6334: it is 12TB combined across all nodes available to

[jira] [Commented] (SPARK-6333) saveAsObjectFile support for compression codec

2015-03-14 Thread Deenar Toraskar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361797#comment-14361797 ] Deenar Toraskar commented on SPARK-6333: Hey Andrey I already have a fix, will

[jira] [Commented] (SPARK-6335) REPL :reset command also removes refs to SparkContext and SQLContext

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361904#comment-14361904 ] Sean Owen commented on SPARK-6335: -- I think the current behavior is right, or at least

[jira] [Commented] (SPARK-6333) saveAsObjectFile support for compression codec

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361910#comment-14361910 ] Sean Owen commented on SPARK-6333: -- The codec support you see is really Hadoop-specific.

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361912#comment-14361912 ] Sean Owen commented on SPARK-6334: -- Hm, is this a case where it's necessary to cut the

[jira] [Created] (SPARK-6336) LBFGS should document what convergenceTol means

2015-03-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6336: Summary: LBFGS should document what convergenceTol means Key: SPARK-6336 URL: https://issues.apache.org/jira/browse/SPARK-6336 Project: Spark Issue

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361914#comment-14361914 ] Joseph K. Bradley commented on SPARK-6334: -- I don't think persist() will

[jira] [Updated] (SPARK-6329) Minor doc changes for Mesos and TOC

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6329: - Assignee: Brennon York Minor doc changes for Mesos and TOC ---

[jira] [Resolved] (SPARK-6329) Minor doc changes for Mesos and TOC

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6329. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5022

[jira] [Commented] (SPARK-6332) compute calibration curve for binary classifiers

2015-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361918#comment-14361918 ] Joseph K. Bradley commented on SPARK-6332: -- Could you please add a few

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

2015-03-14 Thread Clive Cox (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361921#comment-14361921 ] Clive Cox commented on SPARK-5281: -- I have this isssue with Eclipse Luna and spark 1.3.0

[jira] [Updated] (SPARK-5790) Add tests for: VertexRDD's won't zip properly for `diff` capability

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5790: - Component/s: Tests Priority: Minor (was: Major) Issue Type: Improvement (was: Bug)

[jira] [Resolved] (SPARK-5790) VertexRDD's won't zip properly for `diff` capability

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5790. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5023

[jira] [Updated] (SPARK-1529) Support setting spark.local.dirs to a hadoop FileSystem

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1529: - Issue Type: Improvement (was: Bug) Support setting spark.local.dirs to a hadoop FileSystem

[jira] [Resolved] (SPARK-3203) ClassNotFoundException in spark-shell with Cassandra

2015-03-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3203. -- Resolution: Duplicate Looks the same as SPARK-6299, and not specific to Cassandra. Both have to do

[jira] [Closed] (SPARK-6147) Move JDBC data source integration tests to the Spark integration tests project

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian closed SPARK-6147. - Resolution: Won't Fix No actions need to be taken for this ticket from the perspective of the Spark

[jira] [Updated] (SPARK-5084) HiveQuerySuite throws when using MySQL as Hive metastore storage

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5084: -- Summary: HiveQuerySuite throws when using MySQL as Hive metastore storage (was: when mysql is used as

[jira] [Created] (SPARK-6335) REPL :reset command also removes refs to SparkContext and SQLContext

2015-03-14 Thread Marko Bonaci (JIRA)
Marko Bonaci created SPARK-6335: --- Summary: REPL :reset command also removes refs to SparkContext and SQLContext Key: SPARK-6335 URL: https://issues.apache.org/jira/browse/SPARK-6335 Project: Spark

[jira] [Commented] (SPARK-6147) Move JDBC data source integration tests to the Spark integration tests project

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361888#comment-14361888 ] Cheng Lian commented on SPARK-6147: --- Makes sense. Created [a GitHub

[jira] [Updated] (SPARK-5084) HiveQuerySuite throws when using MySQL as Hive metastore storage

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5084: -- Description: Exception: {noformat} from org.apache.hadoop.hive.ql.exec.DDLTask. Database default

[jira] [Updated] (SPARK-5084) HiveQuerySuite throws when using MySQL as Hive metastore storage

2015-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-5084: -- Description: Exception: {noformat} from org.apache.hadoop.hive.ql.exec.DDLTask. Database default

[jira] [Created] (SPARK-6337) Spark 1.3 doc fixes

2015-03-14 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-6337: Summary: Spark 1.3 doc fixes Key: SPARK-6337 URL: https://issues.apache.org/jira/browse/SPARK-6337 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-6337) Spark 1.3 doc fixes

2015-03-14 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6337: - Description: I'll try to track doc issues to be fixed for the 1.3.1 release in this JIRA.

[jira] [Commented] (SPARK-6333) saveAsObjectFile support for compression codec

2015-03-14 Thread Deenar Toraskar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361939#comment-14361939 ] Deenar Toraskar commented on SPARK-6333: that's what i have done, thanks Sean

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361947#comment-14361947 ] Antony Mayi commented on SPARK-6334: I had to increase the partitioning up to this

[jira] [Commented] (SPARK-6334) spark-local dir not getting cleared during ALS

2015-03-14 Thread Antony Mayi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361951#comment-14361951 ] Antony Mayi commented on SPARK-6334: btw. I see based on the sourcecode checkpointing