[jira] [Created] (SPARK-7821) Hide private SQL JDBC classes from Javadoc

2015-05-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-7821: - Summary: Hide private SQL JDBC classes from Javadoc Key: SPARK-7821 URL: https://issues.apache.org/jira/browse/SPARK-7821 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-7221) Expose the current processed file name of FileInputDStream to the users

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555668#comment-14555668 ] Apache Spark commented on SPARK-7221: - User 'animeshbaranawal' has created a pull

[jira] [Assigned] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7788: --- Assignee: Apache Spark (was: Tathagata Das) Streaming | Kinesis | KinesisReceiver blocks

[jira] [Commented] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555711#comment-14555711 ] Apache Spark commented on SPARK-7788: - User 'tdas' has created a pull request for this

[jira] [Assigned] (SPARK-7788) Streaming | Kinesis | KinesisReceiver blocks in onStart

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7788: --- Assignee: Tathagata Das (was: Apache Spark) Streaming | Kinesis | KinesisReceiver blocks

[jira] [Updated] (SPARK-7813) Push code generation into expression definition

2015-05-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7813: --- Description: Right now we define all expression code generation in a single file. If we want to do

[jira] [Commented] (SPARK-7807) High-Availablity:: SparkHadoopUtil.scala should support hadoopConfiguration.addResource()

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555769#comment-14555769 ] Sean Owen commented on SPARK-7807: -- I don't think we should build a brand new mechanism

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555784#comment-14555784 ] Saisai Shao commented on SPARK-7820: I checked the command line, it actually uses

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555852#comment-14555852 ] Saisai Shao commented on SPARK-7820: I think it is the limitation of SBT, I tried

[jira] [Updated] (SPARK-7824) Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7824: -- Description: SQL: {noformat} select * from tableA join tableB on (a 3 and b = d) or (a 3 and

[jira] [Updated] (SPARK-7824) Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongshuai Pei updated SPARK-7824: -- Description: SQL: {noformat} select * from tableA join tableB on (a 3 and b = d) or (a 3 and

[jira] [Resolved] (SPARK-7817) Intellij Idea cannot find symbol when import scala object

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7817. -- Resolution: Not A Problem Target Version/s: (was: 1.3.1) You must have accidentally edited

[jira] [Commented] (SPARK-7818) Java 8 test suite compile error under SBT

2015-05-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555758#comment-14555758 ] Saisai Shao commented on SPARK-7818: Sorry about it. Java 8 test suite compile error

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555745#comment-14555745 ] Sean Owen commented on SPARK-7819: -- Shutting down the SparkContext doesn't affect other

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555764#comment-14555764 ] Sean Owen commented on SPARK-7820: -- I meant your test fails because your command line has

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555792#comment-14555792 ] Sean Owen commented on SPARK-7820: -- This still can't be your command line as it doesn't

[jira] [Commented] (SPARK-7322) Window function support in Scala/Java DataFrame DSL

2015-05-22 Thread Olivier Girardot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555811#comment-14555811 ] Olivier Girardot commented on SPARK-7322: - Thank you, that's great news ! Window

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555823#comment-14555823 ] Sean Owen commented on SPARK-7820: -- Yeah, the Maven build is correct and works. Is this

[jira] [Updated] (SPARK-7823) [SQL] Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

2015-05-22 Thread Edoardo Vacchi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edoardo Vacchi updated SPARK-7823: -- Summary: [SQL] Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

[jira] [Assigned] (SPARK-7823) [SQL] Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7823: --- Assignee: Apache Spark [SQL] Batch, FixedPoint, Strategy should not be inner classes of

[jira] [Updated] (SPARK-7825) Poor performance in Cross Product due to no combine operations for small files.

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7825: - Issue Type: Improvement (was: Bug) Poor performance in Cross Product due to no combine operations for

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555861#comment-14555861 ] Sean Owen commented on SPARK-7820: -- Test code shouldn't go into {{src/main}} just to work

[jira] [Commented] (SPARK-7820) Java 8 test suite compile error under SBT

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555750#comment-14555750 ] Sean Owen commented on SPARK-7820: -- You have a typo: java8-test - java8-tests Java 8

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-22 Thread Guillaume E.B. (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555807#comment-14555807 ] Guillaume E.B. commented on SPARK-4105: --- Ok, my bad, I tried to reproduce the bug

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-22 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555806#comment-14555806 ] holdenk commented on SPARK-7780: Rad :) Yay for long weekends :) The intercept in

[jira] [Updated] (SPARK-7322) Window function support in Scala/Java DataFrame DSL

2015-05-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7322: --- Summary: Window function support in Scala/Java DataFrame DSL (was: Add DataFrame DSL for window

[jira] [Updated] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7822: --- Labels: DataFrame (was: ) Window function support in Python DataFrame DSL

[jira] [Assigned] (SPARK-7605) Python API for ElementwiseProduct

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7605: --- Assignee: Apache Spark Python API for ElementwiseProduct -

[jira] [Assigned] (SPARK-7221) Expose the current processed file name of FileInputDStream to the users

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7221: --- Assignee: (was: Apache Spark) Expose the current processed file name of

[jira] [Assigned] (SPARK-7221) Expose the current processed file name of FileInputDStream to the users

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7221: --- Assignee: Apache Spark Expose the current processed file name of FileInputDStream to the

[jira] [Assigned] (SPARK-7605) Python API for ElementwiseProduct

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7605: --- Assignee: (was: Apache Spark) Python API for ElementwiseProduct

[jira] [Commented] (SPARK-7605) Python API for ElementwiseProduct

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555669#comment-14555669 ] Apache Spark commented on SPARK-7605: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-7699) Config spark.dynamicAllocation.initialExecutors has no effect

2015-05-22 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555837#comment-14555837 ] Sandy Ryza commented on SPARK-7699: --- Sorry for the delay here. The desired behavior is

[jira] [Updated] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7804: -- Flags: (was: Important) Labels: (was: JDBCRDD sql) Incorrect results from JDBCRDD -- one

[jira] [Comment Edited] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554629#comment-14554629 ] Xiangrui Meng edited comment on SPARK-7535 at 5/22/15 6:17 AM:

[jira] [Resolved] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7804. --- Resolution: Invalid Incorrect results from JDBCRDD -- one record repeatly

[jira] [Commented] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555647#comment-14555647 ] Josh Rosen commented on SPARK-7804: --- If possible, we should be hiding the internal

[jira] [Commented] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-22 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555680#comment-14555680 ] Paul Wu commented on SPARK-7804: Unfortunately, JdbcRDD was poorly designed since the

[jira] [Commented] (SPARK-7699) Config spark.dynamicAllocation.initialExecutors has no effect

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555788#comment-14555788 ] Sean Owen commented on SPARK-7699: -- [~sandyr] can you comment on the intended behavior?

[jira] [Updated] (SPARK-7322) Add DataFrame DSL for window function support in Scala/Java

2015-05-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7322: --- Summary: Add DataFrame DSL for window function support in Scala/Java (was: Add DataFrame DSL for

[jira] [Commented] (SPARK-7782) A small problem on history server webpage

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555799#comment-14555799 ] Sean Owen commented on SPARK-7782: -- Seems OK, do you want to submit a PR? A small

[jira] [Created] (SPARK-7823) Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

2015-05-22 Thread Edoardo Vacchi (JIRA)
Edoardo Vacchi created SPARK-7823: - Summary: Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor Key: SPARK-7823 URL: https://issues.apache.org/jira/browse/SPARK-7823

[jira] [Created] (SPARK-7825) Poor performance in Cross Product due to no combine operations for small files.

2015-05-22 Thread Tang Yan (JIRA)
Tang Yan created SPARK-7825: --- Summary: Poor performance in Cross Product due to no combine operations for small files. Key: SPARK-7825 URL: https://issues.apache.org/jira/browse/SPARK-7825 Project: Spark

[jira] [Updated] (SPARK-7823) [SQL] Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7823: - Issue Type: Improvement (was: Bug) [SQL] Batch, FixedPoint, Strategy should not be inner classes of

[jira] [Commented] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555796#comment-14555796 ] Saisai Shao commented on SPARK-7820: Sorry for not mentioning so clearly, I just run

[jira] [Updated] (SPARK-7811) Fix typo on slf4j configuration on metrics.properties.template

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7811: - Component/s: Spark Core Priority: Trivial (was: Minor) That's fine, do you want to make a PR?

[jira] [Resolved] (SPARK-7818) Java 8 test suite compile error under SBT

2015-05-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7818. -- Resolution: Duplicate [~jerryshao] Please watch out for submitting issues twice. Java 8 test suite

[jira] [Updated] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-7820: --- Summary: Java8-tests suite compile error under SBT (was: Java 8 test suite compile error under SBT)

[jira] [Updated] (SPARK-7820) Java8-tests suite compile error under SBT

2015-05-22 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-7820: --- Description: Lots of compilation error is shown when java 8 test suite is enabled in SBT:

[jira] [Created] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-22 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7822: -- Summary: Window function support in Python DataFrame DSL Key: SPARK-7822 URL: https://issues.apache.org/jira/browse/SPARK-7822 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-7322) Add DataFrame DSL for window function support in Scala/Java

2015-05-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7322. Resolution: Fixed Fix Version/s: 1.4.0 Add DataFrame DSL for window function support in

[jira] [Assigned] (SPARK-7823) [SQL] Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7823: --- Assignee: (was: Apache Spark) [SQL] Batch, FixedPoint, Strategy should not be inner

[jira] [Commented] (SPARK-7823) [SQL] Batch, FixedPoint, Strategy should not be inner classes of class RuleExecutor

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555836#comment-14555836 ] Apache Spark commented on SPARK-7823: - User 'evacchi' has created a pull request for

[jira] [Created] (SPARK-7824) Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side.

2015-05-22 Thread Zhongshuai Pei (JIRA)
Zhongshuai Pei created SPARK-7824: - Summary: Extracting 'and/or' condition optimizer and put it before PushPredicateThroughJoin to push down the single side. Key: SPARK-7824 URL:

[jira] [Resolved] (SPARK-7766) KryoSerializerInstance reuse is not safe when auto-reset is disabled

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7766. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6293

[jira] [Updated] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-7563: -- Labels: backport-needed (was: ) OutputCommitCoordinator.stop() should only be executed in driver

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556826#comment-14556826 ] Joseph K. Bradley commented on SPARK-7780: -- That sounds reasonable to me. The

[jira] [Assigned] (SPARK-7834) Better error for unresolved window functions.

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7834: --- Assignee: Apache Spark (was: Michael Armbrust) Better error for unresolved window

[jira] [Commented] (SPARK-7834) Better error for unresolved window functions.

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556857#comment-14556857 ] Apache Spark commented on SPARK-7834: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7836: --- Assignee: Davies Liu (was: Apache Spark) DataFrame.ntile() should only accept Int as

[jira] [Assigned] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7822: --- Assignee: Apache Spark (was: Davies Liu) Window function support in Python DataFrame DSL

[jira] [Assigned] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7822: --- Assignee: Davies Liu (was: Apache Spark) Window function support in Python DataFrame DSL

[jira] [Commented] (SPARK-7822) Window function support in Python DataFrame DSL

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556903#comment-14556903 ] Apache Spark commented on SPARK-7822: - User 'davies' has created a pull request for

[jira] [Commented] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556902#comment-14556902 ] Apache Spark commented on SPARK-7836: - User 'davies' has created a pull request for

[jira] [Assigned] (SPARK-7833) Add python wrapper for RegressionEvaluator

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7833: --- Assignee: Apache Spark (was: Ram Sriharsha) Add python wrapper for RegressionEvaluator

[jira] [Commented] (SPARK-7833) Add python wrapper for RegressionEvaluator

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556925#comment-14556925 ] Apache Spark commented on SPARK-7833: - User 'harsha2010' has created a pull request

[jira] [Assigned] (SPARK-7833) Add python wrapper for RegressionEvaluator

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7833: --- Assignee: Ram Sriharsha (was: Apache Spark) Add python wrapper for RegressionEvaluator

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556970#comment-14556970 ] Joseph K. Bradley commented on SPARK-7780: -- Linked related issue on correctness

[jira] [Assigned] (SPARK-7835) Refactor HeartbeatReceiverSuite for coverage and clean up

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7835: --- Assignee: Andrew Or (was: Apache Spark) Refactor HeartbeatReceiverSuite for coverage and

[jira] [Created] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-22 Thread Davies Liu (JIRA)
Davies Liu created SPARK-7836: - Summary: DataFrame.ntile() should only accept Int as parameter Key: SPARK-7836 URL: https://issues.apache.org/jira/browse/SPARK-7836 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-7835) Refactor HeartbeatReceiverSuite for coverage and clean up

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7835: --- Assignee: Apache Spark (was: Andrew Or) Refactor HeartbeatReceiverSuite for coverage and

[jira] [Created] (SPARK-7835) Refactor HeartbeatReceiverSuite for coverage and clean up

2015-05-22 Thread Andrew Or (JIRA)
Andrew Or created SPARK-7835: Summary: Refactor HeartbeatReceiverSuite for coverage and clean up Key: SPARK-7835 URL: https://issues.apache.org/jira/browse/SPARK-7835 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7835) Refactor HeartbeatReceiverSuite for coverage and clean up

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556895#comment-14556895 ] Apache Spark commented on SPARK-7835: - User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-7836) DataFrame.ntile() should only accept Int as parameter

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7836: --- Assignee: Apache Spark (was: Davies Liu) DataFrame.ntile() should only accept Int as

[jira] [Updated] (SPARK-7807) High-Availablity:: SparkHadoopUtil.scala should support hadoopConfiguration.addResource()

2015-05-22 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7807: --- Component/s: Spark Core High-Availablity:: SparkHadoopUtil.scala should support

[jira] [Updated] (SPARK-7830) Add logistic regression to the list of Multiclass Classification Supported Methods in the MLlib Classification and Regression documentation, and fix related broken link.

2015-05-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7830: - Priority: Trivial (was: Minor) Add logistic regression to the list of Multiclass

[jira] [Updated] (SPARK-7830) Add logistic regression to the list of Multiclass Classification Supported Methods in the MLlib Classification and Regression documentation, and fix related broken link.

2015-05-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7830: - Target Version/s: 1.4.0 Assignee: Mike Dusenberry Add logistic regression to

[jira] [Resolved] (SPARK-7760) Master Worker json endpoints missing

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7760. --- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6284

[jira] [Resolved] (SPARK-7574) User guide update for OneVsRest

2015-05-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7574. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6296

[jira] [Resolved] (SPARK-677) PySpark should not collect results through local filesystem

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-677. -- Resolution: Fixed Fix Version/s: 1.2.2 1.3.1

[jira] [Updated] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7758: Assignee: Tao Wang (was: Cheng Lian) Failed to start thrift server when metastore is

[jira] [Resolved] (SPARK-7758) Failed to start thrift server when metastore is postgre sql

2015-05-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7758. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6314

[jira] [Updated] (SPARK-7724) Add support for Intersect and Except in Catalyst DSL

2015-05-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7724: Fix Version/s: 1.4.0 Add support for Intersect and Except in Catalyst DSL

[jira] [Updated] (SPARK-7724) Add support for Intersect and Except in Catalyst DSL

2015-05-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7724: Assignee: Santiago M. Mola Add support for Intersect and Except in Catalyst DSL

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-22 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556823#comment-14556823 ] holdenk commented on SPARK-7780: I was thinking that since the user could override this

[jira] [Commented] (SPARK-7505) Update PySpark DataFrame docs: encourage __getitem__, mark as experimental, etc.

2015-05-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556860#comment-14556860 ] Nicholas Chammas commented on SPARK-7505: - cc [~davies] - I think the most

[jira] [Updated] (SPARK-5915) Spillable should check every N bytes rather than every 32 elements

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5915: -- Component/s: Shuffle Spillable should check every N bytes rather than every 32 elements

[jira] [Commented] (SPARK-4629) Spark SQL uses Hadoop Configuration in a thread-unsafe manner when writing Parquet files

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556792#comment-14556792 ] Josh Rosen commented on SPARK-4629: --- This is possibly related to

[jira] [Resolved] (SPARK-7343) C4 instance types need to be added to spark_ec2.py

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7343. --- Resolution: Fixed Fix Version/s: 1.4.0 This was fixed for 1.4.0 by

[jira] [Commented] (SPARK-7780) The intercept in LogisticRegressionWithLBFGS should not be regularized

2015-05-22 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556828#comment-14556828 ] DB Tsai commented on SPARK-7780: ++1 Although I don't think there are many users

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2015-05-22 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556913#comment-14556913 ] DB Tsai commented on SPARK-7674: I implemented the stats for ML models when I was Alpine,

[jira] [Commented] (SPARK-7674) R-like stats for ML models

2015-05-22 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556937#comment-14556937 ] Joseph K. Bradley commented on SPARK-7674: -- That would be great; thanks! R-like

[jira] [Assigned] (SPARK-7811) Fix typo on slf4j configuration on metrics.properties.template

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7811: --- Assignee: (was: Apache Spark) Fix typo on slf4j configuration on

[jira] [Assigned] (SPARK-7811) Fix typo on slf4j configuration on metrics.properties.template

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7811: --- Assignee: Apache Spark Fix typo on slf4j configuration on metrics.properties.template

[jira] [Commented] (SPARK-7811) Fix typo on slf4j configuration on metrics.properties.template

2015-05-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556752#comment-14556752 ] Apache Spark commented on SPARK-7811: - User 'judynash' has created a pull request for

[jira] [Resolved] (SPARK-7608) Memory leak in RDDOperationGraphListener

2015-05-22 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7608. --- Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Andrew Or Whoops, looks like we

[jira] [Resolved] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-22 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-7624. --- Resolution: Fixed Fix Version/s: 1.3.2 Task scheduler delay is increasing time over time in

[jira] [Commented] (SPARK-7624) Task scheduler delay is increasing time over time in spark local mode

2015-05-22 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556962#comment-14556962 ] Davies Liu commented on SPARK-7624: --- Had merged into 1.3 branch. Task scheduler delay

[jira] [Updated] (SPARK-7834) Better error for unresolved window functions.

2015-05-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7834: --- Issue Type: Sub-task (was: Bug) Parent: SPARK-6116 Better error for unresolved window

[jira] [Resolved] (SPARK-7270) StringType dynamic partition cast to DecimalType in Spark Sql Hive

2015-05-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-7270. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5864

  1   2   3   >