[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555310#comment-14555310 ] Xiangrui Meng commented on SPARK-7785: -- In PySpark, we should delegate all local

[jira] [Created] (SPARK-7809) MultivariateOnlineSummarizer should allow users to configure what to compute

2015-05-21 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7809: Summary: MultivariateOnlineSummarizer should allow users to configure what to compute Key: SPARK-7809 URL: https://issues.apache.org/jira/browse/SPARK-7809 Project:

[jira] [Updated] (SPARK-7684) TestHive.reset complains Database does not exist: default

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7684: Assignee: Cheng Lian TestHive.reset complains Database does not exist: default

[jira] [Created] (SPARK-7810) rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used

2015-05-21 Thread Ai He (JIRA)
Ai He created SPARK-7810: Summary: rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used Key: SPARK-7810 URL: https://issues.apache.org/jira/browse/SPARK-7810 Project: Spark

[jira] [Resolved] (SPARK-7783) Add rollup and cube support to DataFrame Python DSL

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7783. Resolution: Fixed Fix Version/s: 1.4.0 Add rollup and cube support to DataFrame Python DSL

[jira] [Created] (SPARK-7811) Fix typo on slf4j configuration on metrics.properties.template

2015-05-21 Thread Judy Nash (JIRA)
Judy Nash created SPARK-7811: Summary: Fix typo on slf4j configuration on metrics.properties.template Key: SPARK-7811 URL: https://issues.apache.org/jira/browse/SPARK-7811 Project: Spark Issue

[jira] [Updated] (SPARK-7813) Push code generation into expression definition

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7813: --- Labels: codegen (was: ) Push code generation into expression definition

[jira] [Updated] (SPARK-7813) Push code generation into expression definition

2015-05-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7813: --- Summary: Push code generation into expression definition (was: Push code generation into expression

[jira] [Created] (SPARK-7813) Push code generation into expression definition themselves

2015-05-21 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7813: -- Summary: Push code generation into expression definition themselves Key: SPARK-7813 URL: https://issues.apache.org/jira/browse/SPARK-7813 Project: Spark Issue

[jira] [Comment Edited] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554629#comment-14554629 ] Xiangrui Meng edited comment on SPARK-7535 at 5/22/15 1:21 AM:

[jira] [Created] (SPARK-7816) Mark params, getters, and user-facing classes final

2015-05-21 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-7816: Summary: Mark params, getters, and user-facing classes final Key: SPARK-7816 URL: https://issues.apache.org/jira/browse/SPARK-7816 Project: Spark Issue

[jira] [Updated] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-7785: --- Summary: Add pretty printing to pyspark.mllib.linalg.Matrices (was: Add missing items to

[jira] [Assigned] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7785: --- Assignee: (was: Apache Spark) Add pretty printing to pyspark.mllib.linalg.Matrices

[jira] [Commented] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555436#comment-14555436 ] Apache Spark commented on SPARK-7785: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555438#comment-14555438 ] Manoj Kumar commented on SPARK-7785: Sounds great. In the Pull Request, I just added

[jira] [Assigned] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7785: --- Assignee: Apache Spark Add pretty printing to pyspark.mllib.linalg.Matrices

[jira] [Commented] (SPARK-7322) Add DataFrame DSL for window function support

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555462#comment-14555462 ] Apache Spark commented on SPARK-7322: - User 'rxin' has created a pull request for this

[jira] [Resolved] (SPARK-5494) SparkSqlSerializer Ignores KryoRegistrators

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5494. - Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Michael Armbrust

[jira] [Resolved] (SPARK-3184) Allow user to specify num tasks to use for a table

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3184. - Resolution: Won't Fix Allow user to specify num tasks to use for a table

[jira] [Resolved] (SPARK-2178) createSchemaRDD is not thread safe

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2178. - Resolution: Later This has been a problem since Spark SQL 1.0 and we haven't heard a lot

[jira] [Updated] (SPARK-7810) rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used

2015-05-21 Thread Ai He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ai He updated SPARK-7810: - External issue URL: (was: https://github.com/apache/spark/pull/6338) rdd.py _load_from_socket cannot load data

[jira] [Updated] (SPARK-7810) rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used

2015-05-21 Thread Ai He (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ai He updated SPARK-7810: - External issue URL: https://github.com/apache/spark/pull/6338 rdd.py _load_from_socket cannot load data from jvm

[jira] [Commented] (SPARK-7810) rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555361#comment-14555361 ] Apache Spark commented on SPARK-7810: - User 'AiHe' has created a pull request for this

[jira] [Assigned] (SPARK-7810) rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7810: --- Assignee: (was: Apache Spark) rdd.py _load_from_socket cannot load data from jvm socket

[jira] [Resolved] (SPARK-7776) Add shutdown hook to stop StreamingContext

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-7776. -- Resolution: Fixed Fix Version/s: 1.4.0 Add shutdown hook to stop StreamingContext

[jira] [Resolved] (SPARK-7794) Update RegexTokenizer default settings.

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7794. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6330

[jira] [Resolved] (SPARK-7219) HashingTF should output ML attributes

2015-05-21 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7219. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6308

[jira] [Created] (SPARK-7812) Speed up SQL code generation

2015-05-21 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7812: -- Summary: Speed up SQL code generation Key: SPARK-7812 URL: https://issues.apache.org/jira/browse/SPARK-7812 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-21 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid reassigned SPARK-7657: --- Assignee: Imran Rashid [YARN] Show driver link in Spark UI

[jira] [Resolved] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-21 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid resolved SPARK-7657. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6166

[jira] [Updated] (SPARK-7657) [YARN] Show driver link in Spark UI

2015-05-21 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-7657: Assignee: Hari Shreedharan (was: Imran Rashid) [YARN] Show driver link in Spark UI

[jira] [Commented] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555435#comment-14555435 ] meiyoula commented on SPARK-7789: - I also used hive 0.13 and Kerberos. [~deanchen]Has you

[jira] [Updated] (SPARK-7680) Add a fake Receiver that generates random strings, useful for prototyping

2015-05-21 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-7680: - Target Version/s: (was: 1.4.0) Add a fake Receiver that generates random strings, useful for

[jira] [Commented] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555440#comment-14555440 ] Burak Yavuz commented on SPARK-7785: For operations with BlockMatrix, you will need

[jira] [Updated] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-7785: --- Description: Add __str__ and __repr__ to matrices. (was: For DenseMatrices. Class Methods __str__,

[jira] [Updated] (SPARK-7785) Add pretty printing to pyspark.mllib.linalg.Matrices

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated SPARK-7785: --- Priority: Minor (was: Major) Add pretty printing to pyspark.mllib.linalg.Matrices

[jira] [Commented] (SPARK-7605) Python API for ElementwiseProduct

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555475#comment-14555475 ] Manoj Kumar commented on SPARK-7605: Hi, Can this be assigned to me? Python API for

[jira] [Resolved] (SPARK-6387) HTTP mode of HiveThriftServer2 doesn't work when built with Hive 0.12.0

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-6387. - Resolution: Won't Fix We aren't building with Hive 12 anymore. HTTP mode of

[jira] [Assigned] (SPARK-7810) rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is used

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7810: --- Assignee: Apache Spark rdd.py _load_from_socket cannot load data from jvm socket if ipv6 is

[jira] [Created] (SPARK-7815) Move UTF8String into Unsafe java package, and have it work against memory address directly

2015-05-21 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7815: -- Summary: Move UTF8String into Unsafe java package, and have it work against memory address directly Key: SPARK-7815 URL: https://issues.apache.org/jira/browse/SPARK-7815

[jira] [Created] (SPARK-7814) Turn code generation on by default

2015-05-21 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-7814: -- Summary: Turn code generation on by default Key: SPARK-7814 URL: https://issues.apache.org/jira/browse/SPARK-7814 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-7446) Inverse transform for StringIndexer

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7446: --- Assignee: holdenk (was: Apache Spark) Inverse transform for StringIndexer

[jira] [Commented] (SPARK-7446) Inverse transform for StringIndexer

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555420#comment-14555420 ] Apache Spark commented on SPARK-7446: - User 'holdenk' has created a pull request for

[jira] [Assigned] (SPARK-7446) Inverse transform for StringIndexer

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7446: --- Assignee: Apache Spark (was: holdenk) Inverse transform for StringIndexer

[jira] [Commented] (SPARK-7042) Spark version of akka-actor_2.11 is not compatible with the official akka-actor_2.11 2.3.x

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555423#comment-14555423 ] Apache Spark commented on SPARK-7042: - User 'kostya-sh' has created a pull request for

[jira] [Comment Edited] (SPARK-7789) sql on security hbase:Token generation only allowed for Kerberos authenticated clients

2015-05-21 Thread meiyoula (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555435#comment-14555435 ] meiyoula edited comment on SPARK-7789 at 5/22/15 1:51 AM: -- I also

[jira] [Created] (SPARK-7817) Intellij Idea cannot find symbol when import scala object

2015-05-21 Thread bofei.xiao (JIRA)
bofei.xiao created SPARK-7817: - Summary: Intellij Idea cannot find symbol when import scala object Key: SPARK-7817 URL: https://issues.apache.org/jira/browse/SPARK-7817 Project: Spark Issue

[jira] [Commented] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

2015-05-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555482#comment-14555482 ] Nicholas Chammas commented on SPARK-7507: - Since {{Row}} seems most analogous to a

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fi updated SPARK-7819: -- Attachment: stacktrace.txt test.py Isolated Hive Client Loader appears to cause Native Library

[jira] [Commented] (SPARK-7404) Add RegressionEvaluator to spark.ml

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1422#comment-1422 ] Apache Spark commented on SPARK-7404: - User 'harsha2010' has created a pull request

[jira] [Assigned] (SPARK-7404) Add RegressionEvaluator to spark.ml

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7404: --- Assignee: Apache Spark (was: Ram Sriharsha) Add RegressionEvaluator to spark.ml

[jira] [Assigned] (SPARK-7404) Add RegressionEvaluator to spark.ml

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7404: --- Assignee: Ram Sriharsha (was: Apache Spark) Add RegressionEvaluator to spark.ml

[jira] [Commented] (SPARK-7536) Audit MLlib Python API for 1.4

2015-05-21 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1459#comment-1459 ] Manoj Kumar commented on SPARK-7536: Should all of this be done before the 1.4

[jira] [Created] (SPARK-7818) Java 8 test suite compile error under SBT

2015-05-21 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-7818: -- Summary: Java 8 test suite compile error under SBT Key: SPARK-7818 URL: https://issues.apache.org/jira/browse/SPARK-7818 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Fi (JIRA)
Fi created SPARK-7819: - Summary: Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error Key: SPARK-7819 URL:

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fi updated SPARK-7819: -- Attachment: (was: stacktrace.txt) Isolated Hive Client Loader appears to cause Native Library

[jira] [Created] (SPARK-7820) Java 8 test suite compile error under SBT

2015-05-21 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-7820: -- Summary: Java 8 test suite compile error under SBT Key: SPARK-7820 URL: https://issues.apache.org/jira/browse/SPARK-7820 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fi updated SPARK-7819: -- Attachment: stacktrace.txt Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so

[jira] [Commented] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Fi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1487#comment-1487 ] Fi commented on SPARK-7819: --- FYI, I believe I have worked around the problem for now by

[jira] [Updated] (SPARK-7820) Java 8 test suite compile error under SBT

2015-05-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-7820: --- Component/s: Streaming Java 8 test suite compile error under SBT

[jira] [Commented] (SPARK-7804) Incorrect results from JDBCRDD -- one record repeatly

2015-05-21 Thread Paul Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555602#comment-14555602 ] Paul Wu commented on SPARK-7804: Thanks -- you are right. The cache() was a problem and

[jira] [Updated] (SPARK-7820) Java 8 test suite compile error under SBT

2015-05-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-7820: --- Priority: Minor (was: Major) Java 8 test suite compile error under SBT

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7819: Affects Version/s: (was: 1.4.1) 1.4.0 Isolated Hive Client

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7819: Target Version/s: 1.4.0 Isolated Hive Client Loader appears to cause Native Library

[jira] [Updated] (SPARK-7819) Isolated Hive Client Loader appears to cause Native Library libMapRClient.4.0.2-mapr.so already loaded in another classloader error

2015-05-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7819: Priority: Critical (was: Major) Isolated Hive Client Loader appears to cause Native

[jira] [Updated] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-7712: Fix Version/s: (was: 1.5.0) Native Spark Window Functions Performance Improvements

[jira] [Created] (SPARK-7803) Update MIMA for Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7803: -- Summary: Update MIMA for Spark 1.5.0 Key: SPARK-7803 URL: https://issues.apache.org/jira/browse/SPARK-7803 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7801) Upgrade master versions to Spark 1.5.0

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554926#comment-14554926 ] Apache Spark commented on SPARK-7801: - User 'pwendell' has created a pull request for

[jira] [Assigned] (SPARK-7801) Upgrade master versions to Spark 1.5.0

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7801: --- Assignee: Patrick Wendell (was: Apache Spark) Upgrade master versions to Spark 1.5.0

[jira] [Commented] (SPARK-6416) RDD.fold() requires the operator to be commutative

2015-05-21 Thread Mark Hamstra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554871#comment-14554871 ] Mark Hamstra commented on SPARK-6416: - Why remove it? It's very useful when used

[jira] [Deleted] (SPARK-7802) Update pom versioning to 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell deleted SPARK-7802: --- Update pom versioning to 1.5.0 -- Key:

[jira] [Deleted] (SPARK-7803) Update MIMA for Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell deleted SPARK-7803: --- Update MIMA for Spark 1.5.0 --- Key: SPARK-7803

[jira] [Resolved] (SPARK-7775) YARN AM tried to sleep negative milliseconds

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7775. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6305

[jira] [Commented] (SPARK-7754) [SQL] Use PartialFunction literals instead of objects in Catalyst

2015-05-21 Thread Santiago M. Mola (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554935#comment-14554935 ] Santiago M. Mola commented on SPARK-7754: - Not all rules use transform. Some use

[jira] [Updated] (SPARK-7797) Remove actorSystem from SparkEnv

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7797: - Fix Version/s: (was: 1.5.0) Remove actorSystem from SparkEnv --

[jira] [Updated] (SPARK-7796) Use the new RPC implementation by default

2015-05-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-7796: Target Version/s: 1.6.0 Use the new RPC implementation by default

[jira] [Updated] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Herman van Hovell tot Westerflier (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell tot Westerflier updated SPARK-7712: - Description: Hi All, After playing with the current

[jira] [Commented] (SPARK-6416) RDD.fold() requires the operator to be commutative

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554839#comment-14554839 ] Sean Owen commented on SPARK-6416: -- The documentation update is done. Possibly worth

[jira] [Commented] (SPARK-7708) Incorrect task serialization with Kryo closure serializer

2015-05-21 Thread Akshat Aranya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554857#comment-14554857 ] Akshat Aranya commented on SPARK-7708: -- I don't have the numbers with me right now,

[jira] [Resolved] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7793. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6321

[jira] [Updated] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7793: - Assignee: Shuo Xiang Use getOrElse for getting the threshold of SVM model

[jira] [Commented] (SPARK-6416) RDD.fold() requires the operator to be commutative

2015-05-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554891#comment-14554891 ] Sean Owen commented on SPARK-6416: -- I think the argument was that it is just a different

[jira] [Assigned] (SPARK-7801) Upgrade master versions to Spark 1.5.0

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7801: --- Assignee: Apache Spark (was: Patrick Wendell) Upgrade master versions to Spark 1.5.0

[jira] [Updated] (SPARK-7308) Should there be multiple concurrent attempts for one stage?

2015-05-21 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-7308: Attachment: SPARK-7308_discussion.pdf problem description and proposed solution, with discussion of

[jira] [Created] (SPARK-7801) Upgrade master versions to Spark 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7801: -- Summary: Upgrade master versions to Spark 1.5.0 Key: SPARK-7801 URL: https://issues.apache.org/jira/browse/SPARK-7801 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-7802) Update pom versioning to 1.5.0

2015-05-21 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7802: -- Summary: Update pom versioning to 1.5.0 Key: SPARK-7802 URL: https://issues.apache.org/jira/browse/SPARK-7802 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7792) HiveContext registerTempTable not thread safe

2015-05-21 Thread Yana Kadiyska (JIRA)
Yana Kadiyska created SPARK-7792: Summary: HiveContext registerTempTable not thread safe Key: SPARK-7792 URL: https://issues.apache.org/jira/browse/SPARK-7792 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-7507) pyspark.sql.types.StructType and Row should implement __iter__()

2015-05-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554550#comment-14554550 ] Nicholas Chammas commented on SPARK-7507: - Related: A Stack Overflow question

[jira] [Updated] (SPARK-7792) HiveContext registerTempTable not thread safe

2015-05-21 Thread Yana Kadiyska (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-7792: - Description: {code:java} public class ThreadRepro { public static void main(String[] args)

[jira] [Commented] (SPARK-7712) Native Spark Window Functions Performance Improvements

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554642#comment-14554642 ] Yin Huai commented on SPARK-7712: - It will be great if you can explain your design in more

[jira] [Comment Edited] (SPARK-7535) Audit Pipeline APIs for 1.4

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554629#comment-14554629 ] Xiangrui Meng edited comment on SPARK-7535 at 5/21/15 4:56 PM:

[jira] [Updated] (SPARK-7498) Params.setDefault should keep varargs annotation

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7498: - Summary: Params.setDefault should keep varargs annotation (was: Params.setDefault should not use

[jira] [Commented] (SPARK-7498) Params.setDefault should not use varargs annotation

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554655#comment-14554655 ] Apache Spark commented on SPARK-7498: - User 'mengxr' has created a pull request for

[jira] [Resolved] (SPARK-7565) Broken maps in jsonRDD

2015-05-21 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7565. - Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 6299

[jira] [Commented] (SPARK-7498) Params.setDefault should keep varargs annotation

2015-05-21 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554657#comment-14554657 ] Xiangrui Meng commented on SPARK-7498: -- I renamed to JIRA title to `keep varargs`.

[jira] [Created] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Shuo Xiang (JIRA)
Shuo Xiang created SPARK-7793: - Summary: Use getOrElse for getting the threshold of SVM model Key: SPARK-7793 URL: https://issues.apache.org/jira/browse/SPARK-7793 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-7793) Use getOrElse for getting the threshold of SVM model

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7793: --- Assignee: (was: Apache Spark) Use getOrElse for getting the threshold of SVM model

[jira] [Commented] (SPARK-6189) Pandas to DataFrame conversion should check field names for periods

2015-05-21 Thread natalya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554609#comment-14554609 ] natalya commented on SPARK-6189: Figuring out what is wrong is not the difficulty. The

[jira] [Assigned] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7616: --- Assignee: Apache Spark (was: Cheng Lian) Column order can be corrupted when saving

[jira] [Commented] (SPARK-7616) Column order can be corrupted when saving DataFrame as a partitioned table

2015-05-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14554622#comment-14554622 ] Apache Spark commented on SPARK-7616: - User 'liancheng' has created a pull request for

<    1   2   3   4   >