[jira] [Closed] (SPARK-13108) Encoding not working with non-ascii compatible encodings (UTF-16/32 etc.)

2016-05-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-13108. --- Resolution: Later Closing as later. For more information, see https://github.com/apache/spark/pull/1

[jira] [Assigned] (SPARK-15529) Replace SQLContext and HiveContext with SparkSession in Test

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15529: Assignee: (was: Apache Spark) > Replace SQLContext and HiveContext with SparkSession i

[jira] [Assigned] (SPARK-15529) Replace SQLContext and HiveContext with SparkSession in Test

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15529: Assignee: Apache Spark > Replace SQLContext and HiveContext with SparkSession in Test > --

[jira] [Commented] (SPARK-15529) Replace SQLContext and HiveContext with SparkSession in Test

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303086#comment-15303086 ] Apache Spark commented on SPARK-15529: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-15584) Abstract duplicate code: "spark.sql.sources." properties

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303054#comment-15303054 ] Andrew Or commented on SPARK-15584: --- [~dongjoon] would you like to work on this? > Abs

[jira] [Created] (SPARK-15584) Abstract duplicate code: "spark.sql.sources." properties

2016-05-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15584: - Summary: Abstract duplicate code: "spark.sql.sources." properties Key: SPARK-15584 URL: https://issues.apache.org/jira/browse/SPARK-15584 Project: Spark Issue Type

[jira] [Updated] (SPARK-15584) Abstract duplicate code: "spark.sql.sources." properties

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15584: -- Issue Type: Improvement (was: Bug) > Abstract duplicate code: "spark.sql.sources." properties > --

[jira] [Updated] (SPARK-15584) Abstract duplicate code: "spark.sql.sources." properties

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15584: -- Assignee: (was: Andrew Or) > Abstract duplicate code: "spark.sql.sources." properties > ---

[jira] [Updated] (SPARK-15584) Abstract duplicate code: "spark.sql.sources." properties

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15584: -- Priority: Minor (was: Major) > Abstract duplicate code: "spark.sql.sources." properties >

[jira] [Comment Edited] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303030#comment-15303030 ] Catalin Alexandru Zamfir edited comment on SPARK-15582 at 5/26/16 10:08 PM: ---

[jira] [Comment Edited] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303030#comment-15303030 ] Catalin Alexandru Zamfir edited comment on SPARK-15582 at 5/26/16 10:04 PM: ---

[jira] [Commented] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303030#comment-15303030 ] Catalin Alexandru Zamfir commented on SPARK-15582: -- Nope. Well, I'm tryi

[jira] [Updated] (SPARK-15532) SQLContext/HiveContext's public constructors should use SparkSession.build.getOrCreate

2016-05-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15532: - Description: SQLContext/HiveContext's public constructors should use SparkSession.build.getOrCreate and w

[jira] [Updated] (SPARK-15532) SQLContext/HiveContext's public constructors should use SparkSession.build.getOrCreate

2016-05-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-15532: - Summary: SQLContext/HiveContext's public constructors should use SparkSession.build.getOrCreate (was: Ad

[jira] [Assigned] (SPARK-15532) SQLContext/HiveContext's public constructors should use SparkSession.build.getOrCreate

2016-05-26 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai reassigned SPARK-15532: Assignee: Yin Huai > SQLContext/HiveContext's public constructors should use > SparkSession.build

[jira] [Resolved] (SPARK-13445) Selecting "data" with window function does not work unless aliased (using PARTITION BY)

2016-05-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13445. - Resolution: Fixed Assignee: Sean Zhong Fix Version/s: 2.0.0 > Selecting "data" wi

[jira] [Created] (SPARK-15583) Relax ALTER TABLE properties restriction for data source tables

2016-05-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15583: - Summary: Relax ALTER TABLE properties restriction for data source tables Key: SPARK-15583 URL: https://issues.apache.org/jira/browse/SPARK-15583 Project: Spark Is

[jira] [Commented] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15303003#comment-15303003 ] Steve Loughran commented on SPARK-15582: To clarify: have you ever got groovy clo

[jira] [Commented] (SPARK-15465) AnalysisException: cannot cast StructType to VectorUDT

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302983#comment-15302983 ] Joseph K. Bradley commented on SPARK-15465: --- This looks like it's caused by an

[jira] [Comment Edited] (SPARK-13599) Groovy-all ends up in spark-assembly if hive profile set

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302921#comment-15302921 ] Catalin Alexandru Zamfir edited comment on SPARK-13599 at 5/26/16 9:21 PM:

[jira] [Commented] (SPARK-13599) Groovy-all ends up in spark-assembly if hive profile set

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302953#comment-15302953 ] Catalin Alexandru Zamfir commented on SPARK-13599: -- Created SPARK-15582

[jira] [Updated] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated SPARK-15582: - Description: After fixing SPARK-13599 and running one of our jobs against

[jira] [Updated] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated SPARK-15582: - Affects Version/s: 1.6.2 > Support for Groovy closures >

[jira] [Updated] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated SPARK-15582: - Description: After fixing SPARK-13599 and running one of our jobs against

[jira] [Updated] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Catalin Alexandru Zamfir updated SPARK-15582: - Affects Version/s: 2.0.0 > Support for Groovy closures >

[jira] [Created] (SPARK-15582) Support for Groovy closures

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
Catalin Alexandru Zamfir created SPARK-15582: Summary: Support for Groovy closures Key: SPARK-15582 URL: https://issues.apache.org/jira/browse/SPARK-15582 Project: Spark Issue Typ

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-26 Thread Xin Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302932#comment-15302932 ] Xin Ren commented on SPARK-15509: - Sure I'll try to finish by end of this week, thanks Jo

[jira] [Commented] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302927#comment-15302927 ] Joseph K. Bradley commented on SPARK-15509: --- Sure, but it may be a week or so b

[jira] [Commented] (SPARK-15579) SparkUI: Storage page is empty even if things are cached

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302930#comment-15302930 ] Andrew Or commented on SPARK-15579: --- I tried this on 0f61d6efb45b9ee94fa663f67c4489fbda

[jira] [Updated] (SPARK-15509) R MLlib algorithms should support input columns "features" and "label"

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15509: -- Affects Version/s: (was: 2.0.0) > R MLlib algorithms should support input columns "

[jira] [Commented] (SPARK-13599) Groovy-all ends up in spark-assembly if hive profile set

2016-05-26 Thread Catalin Alexandru Zamfir (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302921#comment-15302921 ] Catalin Alexandru Zamfir commented on SPARK-13599: -- Nope. The executors

[jira] [Updated] (SPARK-15449) MLlib NaiveBayes example in Java uses wrong data format

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15449: -- Summary: MLlib NaiveBayes example in Java uses wrong data format (was: Wrong Data Form

[jira] [Updated] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

2016-05-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8428: --- Target Version/s: 1.6.2, 2.0.0 > TimSort Comparison method violates its general contract with CLUSTER

[jira] [Updated] (SPARK-13850) TimSort Comparison method violates its general contract

2016-05-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13850: Assignee: Sameer Agarwal Target Version/s: 1.6.2, 2.0.0 > TimSort Comparison method vio

[jira] [Updated] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

2016-05-26 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8428: --- Assignee: Sameer Agarwal > TimSort Comparison method violates its general contract with CLUSTER BY > -

[jira] [Commented] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302891#comment-15302891 ] Apache Spark commented on SPARK-8428: - User 'sameeragarwal' has created a pull request

[jira] [Commented] (SPARK-13850) TimSort Comparison method violates its general contract

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302892#comment-15302892 ] Apache Spark commented on SPARK-13850: -- User 'sameeragarwal' has created a pull requ

[jira] [Assigned] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8428: --- Assignee: Apache Spark > TimSort Comparison method violates its general contract with CLUSTER

[jira] [Assigned] (SPARK-8428) TimSort Comparison method violates its general contract with CLUSTER BY

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8428: --- Assignee: (was: Apache Spark) > TimSort Comparison method violates its general contract w

[jira] [Commented] (SPARK-7481) Add spark-cloud module to pull in aws+azure object store FS accessors; test integration

2016-05-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302881#comment-15302881 ] Steve Loughran commented on SPARK-7481: --- SPARK-11343 sets the Joda time version in S

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302880#comment-15302880 ] Joseph K. Bradley commented on SPARK-15581: --- I took the liberty of adding many

[jira] [Commented] (SPARK-11413) Java 8 build has problem with joda-time and s3 request, should bump joda-time version

2016-05-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302873#comment-15302873 ] Steve Loughran commented on SPARK-11413: Note that joda-time is only explicitly p

[jira] [Commented] (SPARK-15579) SparkUI: Storage page is empty even if things are cached

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302869#comment-15302869 ] Sean Owen commented on SPARK-15579: --- I just tried this on a build from master today and

[jira] [Assigned] (SPARK-15580) Add ContinuousQueryInfo to make ContinuousQueryListener events serializable

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15580: Assignee: Apache Spark (was: Shixiong Zhu) > Add ContinuousQueryInfo to make ContinuousQu

[jira] [Commented] (SPARK-15580) Add ContinuousQueryInfo to make ContinuousQueryListener events serializable

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302870#comment-15302870 ] Apache Spark commented on SPARK-15580: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-15580) Add ContinuousQueryInfo to make ContinuousQueryListener events serializable

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15580: Assignee: Shixiong Zhu (was: Apache Spark) > Add ContinuousQueryInfo to make ContinuousQu

[jira] [Created] (SPARK-15581) MLlib 2.1 Roadmap

2016-05-26 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15581: - Summary: MLlib 2.1 Roadmap Key: SPARK-15581 URL: https://issues.apache.org/jira/browse/SPARK-15581 Project: Spark Issue Type: Umbrella Co

[jira] [Created] (SPARK-15580) Add ContinuousQueryInfo to make ContinuousQueryListener events serializable

2016-05-26 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-15580: Summary: Add ContinuousQueryInfo to make ContinuousQueryListener events serializable Key: SPARK-15580 URL: https://issues.apache.org/jira/browse/SPARK-15580 Project:

[jira] [Updated] (SPARK-15579) SparkUI: Storage page is empty even if things are cached

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15579: -- Description: scala> sc.parallelize(1 to 1, 5000).cache().count() SparkUI storage page is empty. >

[jira] [Created] (SPARK-15579) SparkUI: Storage page is empty even if things are cached

2016-05-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15579: - Summary: SparkUI: Storage page is empty even if things are cached Key: SPARK-15579 URL: https://issues.apache.org/jira/browse/SPARK-15579 Project: Spark Issue Type

[jira] [Resolved] (SPARK-15558) Deadlock when retreiving shuffled cached data

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15558. --- Resolution: Duplicate Fix Version/s: (was: 2.0.0) Closing as duplicate since I am reasonab

[jira] [Reopened] (SPARK-15558) Deadlock when retreiving shuffled cached data

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-15558: --- > Deadlock when retreiving shuffled cached data > - > >

[jira] [Closed] (SPARK-15558) Deadlock when retreiving shuffled cached data

2016-05-26 Thread Fabiano Francesconi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabiano Francesconi closed SPARK-15558. --- Resolution: Cannot Reproduce Fix Version/s: 2.0.0 > Deadlock when retreiving s

[jira] [Closed] (SPARK-15558) Deadlock when retreiving shuffled cached data

2016-05-26 Thread Fabiano Francesconi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabiano Francesconi closed SPARK-15558. --- Resolution: Fixed Tried with Spark-2.0.0 compiled from the 2.x branch and this proble

[jira] [Reopened] (SPARK-15558) Deadlock when retreiving shuffled cached data

2016-05-26 Thread Fabiano Francesconi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabiano Francesconi reopened SPARK-15558: - > Deadlock when retreiving shuffled cached data > ---

[jira] [Created] (SPARK-15578) Run Spark jobs in Mesos sequentially

2016-05-26 Thread Yogesh Nath (JIRA)
Yogesh Nath created SPARK-15578: --- Summary: Run Spark jobs in Mesos sequentially Key: SPARK-15578 URL: https://issues.apache.org/jira/browse/SPARK-15578 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-15552) Remove unnecessary private[sql] methods in SparkSession

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15552. --- Resolution: Fixed Fix Version/s: 2.0.0 > Remove unnecessary private[sql] methods in SparkSessi

[jira] [Reopened] (SPARK-15563) Packages specification

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-15563: --- > Packages specification > -- > > Key: SPARK-15563 >

[jira] [Resolved] (SPARK-15563) Packages specification

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-15563. --- Resolution: Not A Problem > Packages specification > -- > > Key:

[jira] [Commented] (SPARK-15564) App name is the main class name in Spark streaming jobs

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302830#comment-15302830 ] Sean Owen commented on SPARK-15564: --- Seems reasonable -- make a PR? > App name is the

[jira] [Updated] (SPARK-15564) App name is the main class name in Spark streaming jobs

2016-05-26 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-15564: -- Priority: Minor (was: Major) > App name is the main class name in Spark streaming jobs > -

[jira] [Assigned] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15576: Assignee: (was: Apache Spark) > Add back hive tests blacklisted by SPARK-15539 > -

[jira] [Commented] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302776#comment-15302776 ] Apache Spark commented on SPARK-15576: -- User 'techaddict' has created a pull request

[jira] [Commented] (SPARK-15539) DROP TABLE should throw exceptions, not logError

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302777#comment-15302777 ] Apache Spark commented on SPARK-15539: -- User 'techaddict' has created a pull request

[jira] [Assigned] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15576: Assignee: Apache Spark > Add back hive tests blacklisted by SPARK-15539 >

[jira] [Commented] (SPARK-13599) Groovy-all ends up in spark-assembly if hive profile set

2016-05-26 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302756#comment-15302756 ] Steve Loughran commented on SPARK-13599: presumably, now that groovy,jar isn't in

[jira] [Updated] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15576: -- Assignee: (was: Andrew Or) > Add back hive tests blacklisted by SPARK-15539 > -

[jira] [Created] (SPARK-15577) Java can't import DataFrame type alias

2016-05-26 Thread holdenk (JIRA)
holdenk created SPARK-15577: --- Summary: Java can't import DataFrame type alias Key: SPARK-15577 URL: https://issues.apache.org/jira/browse/SPARK-15577 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-15520: -- Assignee: Eric Liang > SparkSession builder in python should also allow overriding confs of existing >

[jira] [Resolved] (SPARK-15520) SparkSession builder in python should also allow overriding confs of existing sessions

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15520. --- Resolution: Fixed Fix Version/s: 2.0.0 > SparkSession builder in python should also allow over

[jira] [Resolved] (SPARK-15539) DROP TABLE should throw exceptions, not logError

2016-05-26 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-15539. --- Resolution: Fixed Fix Version/s: 2.0.0 > DROP TABLE should throw exceptions, not logError > --

[jira] [Created] (SPARK-15576) Add back hive tests blacklisted by SPARK-15539

2016-05-26 Thread Andrew Or (JIRA)
Andrew Or created SPARK-15576: - Summary: Add back hive tests blacklisted by SPARK-15539 Key: SPARK-15576 URL: https://issues.apache.org/jira/browse/SPARK-15576 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13445) Selecting "data" with window function does not work unless aliased (using PARTITION BY)

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13445: Assignee: Apache Spark > Selecting "data" with window function does not work unless aliase

[jira] [Assigned] (SPARK-13445) Selecting "data" with window function does not work unless aliased (using PARTITION BY)

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13445: Assignee: (was: Apache Spark) > Selecting "data" with window function does not work un

[jira] [Commented] (SPARK-13445) Selecting "data" with window function does not work unless aliased (using PARTITION BY)

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302702#comment-15302702 ] Apache Spark commented on SPARK-13445: -- User 'clockfly' has created a pull request f

[jira] [Commented] (SPARK-15069) GSoC 2016: Exposing more R and Python APIs for MLlib

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302699#comment-15302699 ] Joseph K. Bradley commented on SPARK-15069: --- h3. 5/23/2016 - Week 1 Initial ite

[jira] [Commented] (SPARK-13148) document zero-keytab Oozie application launch; add diagnostics

2016-05-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302687#comment-15302687 ] Thomas Graves commented on SPARK-13148: --- note we changed this to just document what

[jira] [Resolved] (SPARK-13148) document zero-keytab Oozie application launch; add diagnostics

2016-05-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-13148. --- Resolution: Fixed Fix Version/s: 2.0.0 > document zero-keytab Oozie application launch

[jira] [Updated] (SPARK-13148) document zero-keytab Oozie application launch; add diagnostics

2016-05-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13148: -- Assignee: Steve Loughran > document zero-keytab Oozie application launch; add diagnostics > ---

[jira] [Assigned] (SPARK-15569) Executors spending significant time in DiskObjectWriter.updateBytesWritten function

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15569: Assignee: (was: Apache Spark) > Executors spending significant time in DiskObjectWrite

[jira] [Commented] (SPARK-15569) Executors spending significant time in DiskObjectWriter.updateBytesWritten function

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302691#comment-15302691 ] Apache Spark commented on SPARK-15569: -- User 'sitalkedia' has created a pull request

[jira] [Assigned] (SPARK-15569) Executors spending significant time in DiskObjectWriter.updateBytesWritten function

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15569: Assignee: Apache Spark > Executors spending significant time in DiskObjectWriter.updateByt

[jira] [Updated] (SPARK-13148) document zero-keytab Oozie application launch; add diagnostics

2016-05-26 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-13148: -- Summary: document zero-keytab Oozie application launch; add diagnostics (was: support zero-key

[jira] [Updated] (SPARK-15575) Remove breeze from dependencies

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15575: -- Description: This JIRA is for discussing whether we should remove Breeze from the depe

[jira] [Updated] (SPARK-15575) Remove breeze from dependencies

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15575: -- Description: This JIRA is for discussing whether we should remove Breeze from the depe

[jira] [Updated] (SPARK-15575) Remove breeze from dependencies?

2016-05-26 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15575: -- Summary: Remove breeze from dependencies? (was: Remove breeze from dependencies) > Re

[jira] [Resolved] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2016-05-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-10903. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request

[jira] [Updated] (SPARK-10903) Simplify SQLContext method signatures and use a singleton

2016-05-26 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-10903: -- Assignee: Felix Cheung > Simplify SQLContext method signatures and use a single

[jira] [Created] (SPARK-15575) Remove breeze from dependencies

2016-05-26 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15575: - Summary: Remove breeze from dependencies Key: SPARK-15575 URL: https://issues.apache.org/jira/browse/SPARK-15575 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-15574) Python meta-algorithms in Scala

2016-05-26 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15574: - Summary: Python meta-algorithms in Scala Key: SPARK-15574 URL: https://issues.apache.org/jira/browse/SPARK-15574 Project: Spark Issue Type: Improve

[jira] [Created] (SPARK-15573) Backwards-compatible persistence for spark.ml

2016-05-26 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15573: - Summary: Backwards-compatible persistence for spark.ml Key: SPARK-15573 URL: https://issues.apache.org/jira/browse/SPARK-15573 Project: Spark Issue

[jira] [Created] (SPARK-15572) MLlib in R format: compatibility with other languages

2016-05-26 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15572: - Summary: MLlib in R format: compatibility with other languages Key: SPARK-15572 URL: https://issues.apache.org/jira/browse/SPARK-15572 Project: Spark

[jira] [Created] (SPARK-15571) Pipeline unit test improvements for 2.1

2016-05-26 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-15571: - Summary: Pipeline unit test improvements for 2.1 Key: SPARK-15571 URL: https://issues.apache.org/jira/browse/SPARK-15571 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-15550) Dataset.show() doesn't disply inner nested structs properly

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15550: Assignee: Apache Spark (was: Cheng Lian) > Dataset.show() doesn't disply inner nested str

[jira] [Commented] (SPARK-15550) Dataset.show() doesn't disply inner nested structs properly

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15302600#comment-15302600 ] Apache Spark commented on SPARK-15550: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-15550) Dataset.show() doesn't disply inner nested structs properly

2016-05-26 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15550: Assignee: Cheng Lian (was: Apache Spark) > Dataset.show() doesn't disply inner nested str

[jira] [Created] (SPARK-15570) Pregel functions fail when run multiple times in the same jvm using sequence of graphs

2016-05-26 Thread Shishir Kharel (JIRA)
Shishir Kharel created SPARK-15570: -- Summary: Pregel functions fail when run multiple times in the same jvm using sequence of graphs Key: SPARK-15570 URL: https://issues.apache.org/jira/browse/SPARK-15570

[jira] [Created] (SPARK-15569) Executors spending significant time in DiskObjectWriter.updateBytesWritten function

2016-05-26 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-15569: --- Summary: Executors spending significant time in DiskObjectWriter.updateBytesWritten function Key: SPARK-15569 URL: https://issues.apache.org/jira/browse/SPARK-15569 Pro

[jira] [Updated] (SPARK-15568) TimSort and RadixSort can't support more than 1 billions elements

2016-05-26 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-15568: --- Summary: TimSort and RadixSort can't support more than 1 billions elements (was: TimSort and RadixSo

[jira] [Created] (SPARK-15568) TimSort and RadixSort can't support more than 2 billions elements

2016-05-26 Thread Davies Liu (JIRA)
Davies Liu created SPARK-15568: -- Summary: TimSort and RadixSort can't support more than 2 billions elements Key: SPARK-15568 URL: https://issues.apache.org/jira/browse/SPARK-15568 Project: Spark

<    1   2   3   4   >