[jira] [Comment Edited] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

2015-02-05 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306688#comment-14306688 ] Manoj Kumar edited comment on SPARK-5016 at 2/5/15 8:09 AM: Hi

[jira] [Commented] (SPARK-5604) Remove setCheckpointDir from LDA and tree Strategy

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306810#comment-14306810 ] Apache Spark commented on SPARK-5604: - User 'mengxr' has created a pull request for th

[jira] [Created] (SPARK-5615) Fix testPackage in StreamingContextSuite

2015-02-05 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-5615: -- Summary: Fix testPackage in StreamingContextSuite Key: SPARK-5615 URL: https://issues.apache.org/jira/browse/SPARK-5615 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-5615) Fix testPackage in StreamingContextSuite

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306875#comment-14306875 ] Apache Spark commented on SPARK-5615: - User 'viirya' has created a pull request for th

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-05 Thread Dale Richardson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306899#comment-14306899 ] Dale Richardson commented on SPARK-5388: Heh Andrew, definitely starting to look a

[jira] [Commented] (SPARK-5613) YarnClientSchedulerBackend fails to get application report when yarn restarts

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306903#comment-14306903 ] Apache Spark commented on SPARK-5613: - User 'kasjain' has created a pull request for t

[jira] [Created] (SPARK-5616) Add examples for PySpark API

2015-02-05 Thread dongxu (JIRA)
dongxu created SPARK-5616: - Summary: Add examples for PySpark API Key: SPARK-5616 URL: https://issues.apache.org/jira/browse/SPARK-5616 Project: Spark Issue Type: Improvement Components: Py

[jira] [Commented] (SPARK-5614) Predicate pushdown through Generate

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307073#comment-14307073 ] Apache Spark commented on SPARK-5614: - User 'ianluyan' has created a pull request for

[jira] [Created] (SPARK-5617) test failure of SQLQuerySuite

2015-02-05 Thread wangfei (JIRA)
wangfei created SPARK-5617: -- Summary: test failure of SQLQuerySuite Key: SPARK-5617 URL: https://issues.apache.org/jira/browse/SPARK-5617 Project: Spark Issue Type: Bug Components: SQL

[jira] [Commented] (SPARK-5617) test failure of SQLQuerySuite

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307084#comment-14307084 ] Apache Spark commented on SPARK-5617: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-5618) Optimise utility code.

2015-02-05 Thread Makoto Fukuhara (JIRA)
Makoto Fukuhara created SPARK-5618: -- Summary: Optimise utility code. Key: SPARK-5618 URL: https://issues.apache.org/jira/browse/SPARK-5618 Project: Spark Issue Type: Improvement Co

[jira] [Commented] (SPARK-5618) Optimise utility code.

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307101#comment-14307101 ] Apache Spark commented on SPARK-5618: - User 'fukuo33' has created a pull request for t

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Fix Version/s: (was: 1.3.0) > Support 'show roles' in HiveContext > --

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Fix Version/s: 1.3.0 > Support 'show roles' in HiveContext > --- > >

[jira] [Created] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-5619: Summary: Support 'show roles' in HiveContext Key: SPARK-5619 URL: https://issues.apache.org/jira/browse/SPARK-5619 Project: Spark Issue Type: Bug Component

[jira] [Updated] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-5619: - Affects Version/s: 1.2.0 > Support 'show roles' in HiveContext > --- > >

[jira] [Commented] (SPARK-5619) Support 'show roles' in HiveContext

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307106#comment-14307106 ] Apache Spark commented on SPARK-5619: - User 'watermen' has created a pull request for

[jira] [Commented] (SPARK-5021) GaussianMixtureEM should be faster for SparseVector input

2015-02-05 Thread Travis Galoppo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307196#comment-14307196 ] Travis Galoppo commented on SPARK-5021: --- [~MechCoder] It is probably better to get s

[jira] [Commented] (SPARK-2808) update kafka to version 0.8.2

2015-02-05 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307254#comment-14307254 ] koert kuipers commented on SPARK-2808: -- what is the motivation for this upgrade? > u

[jira] [Comment Edited] (SPARK-2808) update kafka to version 0.8.2

2015-02-05 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307254#comment-14307254 ] koert kuipers edited comment on SPARK-2808 at 2/5/15 2:28 PM: --

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-02-05 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307289#comment-14307289 ] Takeshi Yamamuro commented on SPARK-5480: - These codes didn't throw such exception

[jira] [Commented] (SPARK-4705) Driver retries in yarn-cluster mode always fail if event logging is enabled

2015-02-05 Thread Twinkle Sachdeva (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307406#comment-14307406 ] Twinkle Sachdeva commented on SPARK-4705: - Hi [~vanzin], Regarding adding that fo

[jira] [Updated] (SPARK-4897) Python 3 support

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4897: -- Target Version/s: 1.4.0 (was: 1.3.0) > Python 3 support > > > Key: SPA

[jira] [Commented] (SPARK-4897) Python 3 support

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307463#comment-14307463 ] Josh Rosen commented on SPARK-4897: --- Hi [~ianozsvald], Until now, the main motivation f

[jira] [Commented] (SPARK-4897) Python 3 support

2015-02-05 Thread thom neale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307474#comment-14307474 ] thom neale commented on SPARK-4897: --- I'm still very interested in helping with the 3.4 p

[jira] [Commented] (SPARK-4897) Python 3 support

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307482#comment-14307482 ] Josh Rosen commented on SPARK-4897: --- By the way, it might be nice to see if we can figur

[jira] [Commented] (SPARK-2827) Add DegreeDist function support

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307499#comment-14307499 ] Apache Spark commented on SPARK-2827: - User 'maropu' has created a pull request for th

[jira] [Created] (SPARK-5620) Group methods in generated unidoc

2015-02-05 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-5620: Summary: Group methods in generated unidoc Key: SPARK-5620 URL: https://issues.apache.org/jira/browse/SPARK-5620 Project: Spark Issue Type: Documentation

[jira] [Created] (SPARK-5621) Cannot fetch dependencies for mllib

2015-02-05 Thread Luca Venturini (JIRA)
Luca Venturini created SPARK-5621: - Summary: Cannot fetch dependencies for mllib Key: SPARK-5621 URL: https://issues.apache.org/jira/browse/SPARK-5621 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5621) Cannot fetch dependencies for mllib

2015-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5621. -- Resolution: Not a Problem It certainly exists : http://search.maven.org/#artifactdetails%7Ccom.github.f

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2015-02-05 Thread Philippe Girolami (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307580#comment-14307580 ] Philippe Girolami commented on SPARK-1867: -- Has anyone figured this out ? I'm see

[jira] [Commented] (SPARK-5081) Shuffle write increases

2015-02-05 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307584#comment-14307584 ] Kostas Sakellis commented on SPARK-5081: Can you add a sample of the code too? >

[jira] [Commented] (SPARK-5610) Generate Java docs without package private classes and methods

2015-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307599#comment-14307599 ] Sean Owen commented on SPARK-5610: -- >From looking at the Javadoc 8 + unidoc issue, I reca

[jira] [Created] (SPARK-5622) Add connector/handler hive configuration settings to hive-thrift-server

2015-02-05 Thread Alex Liu (JIRA)
Alex Liu created SPARK-5622: --- Summary: Add connector/handler hive configuration settings to hive-thrift-server Key: SPARK-5622 URL: https://issues.apache.org/jira/browse/SPARK-5622 Project: Spark

[jira] [Created] (SPARK-5623) Replace an obsolete mapReduceTriplets with a new aggregateMessages in GraphSuite

2015-02-05 Thread Takeshi Yamamuro (JIRA)
Takeshi Yamamuro created SPARK-5623: --- Summary: Replace an obsolete mapReduceTriplets with a new aggregateMessages in GraphSuite Key: SPARK-5623 URL: https://issues.apache.org/jira/browse/SPARK-5623

[jira] [Commented] (SPARK-5013) User guide for Gaussian Mixture Model

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307605#comment-14307605 ] Apache Spark commented on SPARK-5013: - User 'tgaloppo' has created a pull request for

[jira] [Commented] (SPARK-5623) Replace an obsolete mapReduceTriplets with a new aggregateMessages in GraphSuite

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307609#comment-14307609 ] Apache Spark commented on SPARK-5623: - User 'maropu' has created a pull request for th

[jira] [Created] (SPARK-5624) Can't find new column

2015-02-05 Thread Alex Liu (JIRA)
Alex Liu created SPARK-5624: --- Summary: Can't find new column Key: SPARK-5624 URL: https://issues.apache.org/jira/browse/SPARK-5624 Project: Spark Issue Type: Bug Components: SQL Affe

[jira] [Resolved] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2015-02-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1867. -- Resolution: Not a Problem I think there are a number of manifestations of the same basic problem here:

[jira] [Commented] (SPARK-5480) GraphX pageRank: java.lang.ArrayIndexOutOfBoundsException:

2015-02-05 Thread Stephane Maarek (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307628#comment-14307628 ] Stephane Maarek commented on SPARK-5480: It happened once after one of my server f

[jira] [Resolved] (SPARK-4687) SparkContext#addFile doesn't keep file folder information

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4687. --- Resolution: Fixed Fix Version/s: 1.4.0 1.3.0 Issue resolved by pull request

[jira] [Updated] (SPARK-4687) SparkContext#addFile doesn't keep file folder information

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-4687: -- Assignee: Sandy Ryza > SparkContext#addFile doesn't keep file folder information > -

[jira] [Reopened] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-4105: --- I'm re-opening this issue because I've seen another recent occurrence of this error in Spark 1.2.0+. >Fr

[jira] [Commented] (SPARK-1867) Spark Documentation Error causes java.lang.IllegalStateException: unread block data

2015-02-05 Thread Philippe Girolami (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307719#comment-14307719 ] Philippe Girolami commented on SPARK-1867: -- [~srowen] I'm unfortunately reporting

[jira] [Created] (SPARK-5625) Spark binaries do not incude Spark Core

2015-02-05 Thread DeepakVohra (JIRA)
DeepakVohra created SPARK-5625: -- Summary: Spark binaries do not incude Spark Core Key: SPARK-5625 URL: https://issues.apache.org/jira/browse/SPARK-5625 Project: Spark Issue Type: Bug C

[jira] [Resolved] (SPARK-4133) PARSING_ERROR(2) when upgrading issues from 1.0.2 to 1.1.0

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4133. --- Resolution: Fixed I'm going to close this issue for now, since I think this was caused by multiple Sp

[jira] [Resolved] (SPARK-5608) Improve SEO of Spark documentation site to let Google find latest docs

2015-02-05 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia resolved SPARK-5608. -- Resolution: Fixed Fix Version/s: 1.3.0 > Improve SEO of Spark documentation site to let G

[jira] [Created] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-02-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5626: - Summary: Spurious test failures due to NullPointerException in EasyMock test code Key: SPARK-5626 URL: https://issues.apache.org/jira/browse/SPARK-5626 Project: Spark

[jira] [Resolved] (SPARK-5548) Flaky test: org.apache.spark.util.AkkaUtilsSuite.remote fetch ssl on - untrusted server

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5548. Resolution: Fixed Fix Version/s: 1.3.0 > Flaky test: org.apache.spark.util.AkkaUtilsS

[jira] [Updated] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-02-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5626: -- Attachment: consoleText.txt I've uploaded a copy of the full Jenkins log so that we don't lose it after

[jira] [Commented] (SPARK-5610) Generate Java docs without package private classes and methods

2015-02-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307888#comment-14307888 ] Xiangrui Meng commented on SPARK-5610: -- Thanks for the reminder! I will try it with J

[jira] [Resolved] (SPARK-5474) curl should support URL redirection in build/mvn

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5474. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Guoqiang Li > curl should s

[jira] [Commented] (SPARK-5403) Ignore UserKnownHostsFile in SSH calls

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307904#comment-14307904 ] Nicholas Chammas commented on SPARK-5403: - I believe this issue duplicates an earl

[jira] [Created] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

2015-02-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5627: --- Summary: Enhance spark-ec2 for some programmatic use cases Key: SPARK-5627 URL: https://issues.apache.org/jira/browse/SPARK-5627 Project: Spark Issue T

[jira] [Created] (SPARK-5628) Add option to return spark-ec2 version

2015-02-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5628: --- Summary: Add option to return spark-ec2 version Key: SPARK-5628 URL: https://issues.apache.org/jira/browse/SPARK-5628 Project: Spark Issue Type: Improv

[jira] [Updated] (SPARK-5629) Add spark-ec2 option to return info about cluster for programmatic consumption

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Description: If someone is programmatically launching a cluster with {{spark-ec2}}, they mi

[jira] [Created] (SPARK-5629) Add spark-ec2 option to return info about cluster for programmatic consumption

2015-02-05 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5629: --- Summary: Add spark-ec2 option to return info about cluster for programmatic consumption Key: SPARK-5629 URL: https://issues.apache.org/jira/browse/SPARK-5629 Pr

[jira] [Created] (SPARK-5630) Open a little bit metrics API

2015-02-05 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-5630: Summary: Open a little bit metrics API Key: SPARK-5630 URL: https://issues.apache.org/jira/browse/SPARK-5630 Project: Spark Issue Type: Wish

[jira] [Created] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

2015-02-05 Thread DeepakVohra (JIRA)
DeepakVohra created SPARK-5631: -- Summary: Server IPC version 7 cannot communicate with client version 4 Key: SPARK-5631 URL: https://issues.apache.org/jira/browse/SPARK-5631 Project: Spark

[jira] [Resolved] (SPARK-5135) Add support for describe [extended] table to DDL in SQLContext

2015-02-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5135. Resolution: Fixed > Add support for describe [extended] table to DDL in SQLContext > ---

[jira] [Commented] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

2015-02-05 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308005#comment-14308005 ] DeepakVohra commented on SPARK-5631: The error is due to a different version of CDH4 a

[jira] [Commented] (SPARK-5631) Server IPC version 7 cannot communicate with client version 4

2015-02-05 Thread DeepakVohra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308011#comment-14308011 ] DeepakVohra commented on SPARK-5631: Which CDH4 version and MR version is used for spa

[jira] [Created] (SPARK-5632) not able to resolve dot('.') in field name

2015-02-05 Thread Lishu Liu (JIRA)
Lishu Liu created SPARK-5632: Summary: not able to resolve dot('.') in field name Key: SPARK-5632 URL: https://issues.apache.org/jira/browse/SPARK-5632 Project: Spark Issue Type: Bug Co

[jira] [Created] (SPARK-5633) pyspark saveAsTextFile support for compression codec

2015-02-05 Thread Vladimir Vladimirov (JIRA)
Vladimir Vladimirov created SPARK-5633: -- Summary: pyspark saveAsTextFile support for compression codec Key: SPARK-5633 URL: https://issues.apache.org/jira/browse/SPARK-5633 Project: Spark

[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec

2015-02-05 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308077#comment-14308077 ] Vladimir Vladimirov commented on SPARK-5633: Here is pull request that adds me

[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308078#comment-14308078 ] Apache Spark commented on SPARK-5633: - User 'smartkiwi' has created a pull request for

[jira] [Commented] (SPARK-5620) Group methods in generated unidoc

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308084#comment-14308084 ] Apache Spark commented on SPARK-5620: - User 'mengxr' has created a pull request for th

[jira] [Updated] (SPARK-5632) not able to resolve dot('.') in field name

2015-02-05 Thread Lishu Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lishu Liu updated SPARK-5632: - Description: My cassandra table task_trace has a field sm.result which contains dot in the name. So SQL t

[jira] [Created] (SPARK-5634) History server shows misleading message when there are no incomplete apps

2015-02-05 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-5634: - Summary: History server shows misleading message when there are no incomplete apps Key: SPARK-5634 URL: https://issues.apache.org/jira/browse/SPARK-5634 Project: Sp

[jira] [Commented] (SPARK-5633) pyspark saveAsTextFile support for compression codec

2015-02-05 Thread Vladimir Vladimirov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308128#comment-14308128 ] Vladimir Vladimirov commented on SPARK-5633: Here is a workaround before propo

[jira] [Commented] (SPARK-5493) Support proxy users under kerberos

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308131#comment-14308131 ] Apache Spark commented on SPARK-5493: - User 'vanzin' has created a pull request for th

[jira] [Commented] (SPARK-5335) Destroying cluster in VPC with "--delete-groups" fails to remove security groups

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133 ] Nicholas Chammas commented on SPARK-5335: - For the record: [AWS says|https://foru

[jira] [Commented] (SPARK-5622) Add connector/handler hive configuration settings to hive-thrift-server

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308141#comment-14308141 ] Apache Spark commented on SPARK-5622: - User 'alexliu68' has created a pull request for

[jira] [Commented] (SPARK-5604) Remove setCheckpointDir from LDA and tree Strategy

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308166#comment-14308166 ] Apache Spark commented on SPARK-5604: - User 'mengxr' has created a pull request for th

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-02-05 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308184#comment-14308184 ] Imran Rashid commented on SPARK-3454: - I just realized one potential issue with the ro

[jira] [Resolved] (SPARK-5460) RandomForest should catch exceptions when removing checkpoint files

2015-02-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5460. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4347 [https://githu

[jira] [Updated] (SPARK-5460) RandomForest should catch exceptions when removing checkpoint files

2015-02-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5460: - Assignee: Yuri Saito > RandomForest should catch exceptions when removing checkpoint files > -

[jira] [Resolved] (SPARK-5604) Remove setCheckpointDir from LDA and tree Strategy

2015-02-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-5604. -- Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4390 [https://githu

[jira] [Resolved] (SPARK-5528) Support schema merging while reading Parquet files

2015-02-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5528. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Resolved] (SPARK-5509) EqualTo operator doesn't handle binary type properly

2015-02-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5509. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Created] (SPARK-5635) Allow users to run .scala files directly from spark-submit

2015-02-05 Thread Grant Henke (JIRA)
Grant Henke created SPARK-5635: -- Summary: Allow users to run .scala files directly from spark-submit Key: SPARK-5635 URL: https://issues.apache.org/jira/browse/SPARK-5635 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-5182) Partitioning support for tables created by the data source API

2015-02-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5182. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Resolved] (SPARK-3575) Hive Schema is ignored when using convertMetastoreParquet

2015-02-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3575. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 4308 [https:/

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308260#comment-14308260 ] Marcelo Vanzin commented on SPARK-5388: --- Hi [~andrewor14], Thanks for updating the

[jira] [Commented] (SPARK-5624) Can't find new column

2015-02-05 Thread Alex Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308261#comment-14308261 ] Alex Liu commented on SPARK-5624: - Test it on the latest master branch it doesn't have thi

[jira] [Commented] (SPARK-5388) Provide a stable application submission gateway in standalone cluster mode

2015-02-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308263#comment-14308263 ] Marcelo Vanzin commented on SPARK-5388: --- Also, a fun fact about the Jersey dependenc

[jira] [Created] (SPARK-5636) Lower dynamic allocation add interval

2015-02-05 Thread Andrew Or (JIRA)
Andrew Or created SPARK-5636: Summary: Lower dynamic allocation add interval Key: SPARK-5636 URL: https://issues.apache.org/jira/browse/SPARK-5636 Project: Spark Issue Type: Bug Compone

[jira] [Created] (SPARK-5638) Add a config flag to disable eager analysis of DataFrames

2015-02-05 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5638: -- Summary: Add a config flag to disable eager analysis of DataFrames Key: SPARK-5638 URL: https://issues.apache.org/jira/browse/SPARK-5638 Project: Spark Issue Typ

[jira] [Created] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-05 Thread Alex Rothberg (JIRA)
Alex Rothberg created SPARK-5637: Summary: Expose spark_ec2 as as StarCluster Plugin Key: SPARK-5637 URL: https://issues.apache.org/jira/browse/SPARK-5637 Project: Spark Issue Type: Improveme

[jira] [Commented] (SPARK-5638) Add a config flag to disable eager analysis of DataFrames

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308286#comment-14308286 ] Apache Spark commented on SPARK-5638: - User 'rxin' has created a pull request for this

[jira] [Commented] (SPARK-5636) Lower dynamic allocation add interval

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308288#comment-14308288 ] Apache Spark commented on SPARK-5636: - User 'andrewor14' has created a pull request fo

[jira] [Created] (SPARK-5639) Support DataFrame.renameColumn

2015-02-05 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5639: -- Summary: Support DataFrame.renameColumn Key: SPARK-5639 URL: https://issues.apache.org/jira/browse/SPARK-5639 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-02-05 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308324#comment-14308324 ] Marcelo Vanzin commented on SPARK-3454: --- Hi [~imranr], There are two ways I can see

[jira] [Commented] (SPARK-5639) Support DataFrame.renameColumn

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308328#comment-14308328 ] Apache Spark commented on SPARK-5639: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-5620) Group methods in generated unidoc

2015-02-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5620. Resolution: Fixed Fix Version/s: 1.3.0 > Group methods in generated unidoc >

[jira] [Commented] (SPARK-5557) spark-shell failed to start

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308346#comment-14308346 ] Patrick Wendell commented on SPARK-5557: I can send a fix for this shortly. It als

[jira] [Updated] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5557: --- Summary: Servlet API classes now missing after jetty shading (was: spark-shell failed to star

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Kostas Sakellis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308374#comment-14308374 ] Kostas Sakellis commented on SPARK-5557: [~pwendell] recommended this which did th

[jira] [Updated] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-05 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5637: Component/s: EC2 > Expose spark_ec2 as as StarCluster Plugin > -

[jira] [Commented] (SPARK-5557) Servlet API classes now missing after jetty shading

2015-02-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308378#comment-14308378 ] Apache Spark commented on SPARK-5557: - User 'pwendell' has created a pull request for

  1   2   >