[jira] [Assigned] (SPARK-6941) Provide a better error message to explain that tables created from RDDs are immutable

[ https://issues.apache.org/jira/browse/SPARK-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6941: --- Assignee: Yijie Shen (was: Apache Spark) Provide a better error message to explain that

[jira] [Assigned] (SPARK-6941) Provide a better error message to explain that tables created from RDDs are immutable

[ https://issues.apache.org/jira/browse/SPARK-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6941: --- Assignee: Apache Spark (was: Yijie Shen) Provide a better error message to explain that

[jira] [Commented] (SPARK-8951) support CJK characters in collect()

[ https://issues.apache.org/jira/browse/SPARK-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621834#comment-14621834 ] Jaehong Choi commented on SPARK-8951: - Thanks for your advice. You're right. This is

[jira] [Commented] (SPARK-8923) Add @since tags to mllib.fpm

[ https://issues.apache.org/jira/browse/SPARK-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621821#comment-14621821 ] Apache Spark commented on SPARK-8923: - User 'rahulpalamuttam' has created a pull

[jira] [Assigned] (SPARK-8923) Add @since tags to mllib.fpm

[ https://issues.apache.org/jira/browse/SPARK-8923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8923: --- Assignee: (was: Apache Spark) Add @since tags to mllib.fpm

[jira] [Commented] (SPARK-7736) Exception not failing Python applications (in yarn cluster mode)

[ https://issues.apache.org/jira/browse/SPARK-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621832#comment-14621832 ] Shay Rojansky commented on SPARK-7736: -- Neelesh, not sure I understood what you're

[jira] [Created] (SPARK-8973) Spark Executor usage Cpu 100+%

Xu Chen created SPARK-8973: -- Summary: Spark Executor usage Cpu 100+% Key: SPARK-8973 URL: https://issues.apache.org/jira/browse/SPARK-8973 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6941) Provide a better error message to explain that tables created from RDDs are immutable

[ https://issues.apache.org/jira/browse/SPARK-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621827#comment-14621827 ] Apache Spark commented on SPARK-6941: - User 'yijieshen' has created a pull request for

[jira] [Commented] (SPARK-7008) An implementation of Factorization Machine (LibFM)

[ https://issues.apache.org/jira/browse/SPARK-7008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621830#comment-14621830 ] zhengruifeng commented on SPARK-7008: - Yes, LBFGS provide a faster convergence rate.

[jira] [Comment Edited] (SPARK-7751) Add @since to stable and experimental methods in MLlib

[ https://issues.apache.org/jira/browse/SPARK-7751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14620486#comment-14620486 ] Patrick Baier edited comment on SPARK-7751 at 7/10/15 7:19 AM:

[jira] [Resolved] (SPARK-6051) Add an option for DirectKafkaInputDStream to commit the offsets into ZK

[ https://issues.apache.org/jira/browse/SPARK-6051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6051. -- Resolution: Won't Fix Add an option for DirectKafkaInputDStream to commit the offsets into ZK

[jira] [Resolved] (SPARK-3219) K-Means clusterer should support Bregman distance functions

[ https://issues.apache.org/jira/browse/SPARK-3219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3219. -- Resolution: Won't Fix K-Means clusterer should support Bregman distance functions

[jira] [Assigned] (SPARK-8972) Incorrect result for rollup

[ https://issues.apache.org/jira/browse/SPARK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8972: --- Assignee: Apache Spark Incorrect result for rollup ---

[jira] [Resolved] (SPARK-8973) Spark Executor usage Cpu 100+%

[ https://issues.apache.org/jira/browse/SPARK-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8973. -- Resolution: Not A Problem Target Version/s: (was: 1.4.0) Please read

[jira] [Commented] (SPARK-8972) Incorrect result for rollup

[ https://issues.apache.org/jira/browse/SPARK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621929#comment-14621929 ] Apache Spark commented on SPARK-8972: - User 'chenghao-intel' has created a pull

[jira] [Updated] (SPARK-8968) dynamic partitioning in spark sql performance issue due to the high GC overhead

[ https://issues.apache.org/jira/browse/SPARK-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fei Wang updated SPARK-8968: Summary: dynamic partitioning in spark sql performance issue due to the high GC overhead (was: shuffled by

[jira] [Commented] (SPARK-7018) Refactor dev/run-tests-jenkins into Python

[ https://issues.apache.org/jira/browse/SPARK-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621885#comment-14621885 ] Josh Rosen commented on SPARK-7018: --- Hey [~boyork], any updates on this refactoring? If

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621900#comment-14621900 ] Ma Xiaoyu commented on SPARK-6882: -- Can you try add in spark-env.sh's classpath and make

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621899#comment-14621899 ] Ma Xiaoyu commented on SPARK-6882: -- Can you try add in spark-env.sh's classpath and make

[jira] [Commented] (SPARK-8968) shuffled by the partition clomns when dynamic partitioning to optimize the memory overhead

[ https://issues.apache.org/jira/browse/SPARK-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621923#comment-14621923 ] Sean Owen commented on SPARK-8968: -- [~scwf] can you reword this? I can't make out what

[jira] [Assigned] (SPARK-8972) Incorrect result for rollup

[ https://issues.apache.org/jira/browse/SPARK-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8972: --- Assignee: (was: Apache Spark) Incorrect result for rollup ---

[jira] [Updated] (SPARK-8839) Thrift Sever will throw `java.util.NoSuchElementException: key not found` exception when many clients connect it

[ https://issues.apache.org/jira/browse/SPARK-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8839: - Assignee: SaintBacchus Thrift Sever will throw `java.util.NoSuchElementException: key not found`

[jira] [Commented] (SPARK-8968) dynamic partitioning in spark sql performance issue due to the high GC overhead

[ https://issues.apache.org/jira/browse/SPARK-8968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621935#comment-14621935 ] Fei Wang commented on SPARK-8968: - changed, how about this? dynamic partitioning in

[jira] [Updated] (SPARK-8940) Don't overwrite given schema if it is not null for createDataFrame in SparkR

[ https://issues.apache.org/jira/browse/SPARK-8940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8940: - Assignee: Liang-Chi Hsieh Don't overwrite given schema if it is not null for createDataFrame in SparkR

[jira] [Updated] (SPARK-8830) levenshtein directly on top of UTF8String

[ https://issues.apache.org/jira/browse/SPARK-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8830: - Assignee: Tarek Auel levenshtein directly on top of UTF8String

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622041#comment-14622041 ] Walter Petersen commented on SPARK-3155: Hi all, I'm new out there. Please tell

[jira] [Created] (SPARK-8974) The spark-dynamic-executor-allocation may be not supported

KaiXinXIaoLei created SPARK-8974: Summary: The spark-dynamic-executor-allocation may be not supported Key: SPARK-8974 URL: https://issues.apache.org/jira/browse/SPARK-8974 Project: Spark

[jira] [Updated] (SPARK-8974) The spark-dynamic-executor-allocation may be not supported

[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KaiXinXIaoLei updated SPARK-8974: - Description: In yarn-client mode and config option spark.dynamicAllocation.enabled is true, when

[jira] [Commented] (SPARK-8843) DStream transform function receives null instead of RDD

[ https://issues.apache.org/jira/browse/SPARK-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622071#comment-14622071 ] Vincent Debergue commented on SPARK-8843: - Fine for me, I'll use the emptyRDD

[jira] [Updated] (SPARK-8820) Add a configuration to set the checkpoint directory for convenience.

[ https://issues.apache.org/jira/browse/SPARK-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8820: - Affects Version/s: (was: 1.5.0) Priority: Minor (was: Major) Add a configuration to

[jira] [Resolved] (SPARK-7977) Disallow println

[ https://issues.apache.org/jira/browse/SPARK-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7977. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7093

[jira] [Commented] (SPARK-8960) Style cleanup of spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622147#comment-14622147 ] Sean Owen commented on SPARK-8960: -- [~shivaram] [~nchammas] are you generally in favor of

[jira] [Resolved] (SPARK-8815) illegal java package names in jar

[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8815. -- Resolution: Not A Problem illegal java package names in jar -

[jira] [Resolved] (SPARK-8825) Spark build fails

[ https://issues.apache.org/jira/browse/SPARK-8825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8825. -- Resolution: Duplicate Spark build fails - Key: SPARK-8825

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1466#comment-1466 ] Daniel Darabos commented on SPARK-4879: --- I wonder if this issue is serious enough to

[jira] [Updated] (SPARK-8974) The spark-dynamic-executor-allocation may be not supported

[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8974: - Target Version/s: (was: 1.4.0) Fix Version/s: (was: 1.4.1) [~KaiXinXIaoLei] I'd ask again

[jira] [Comment Edited] (SPARK-4879) Missing output partitions after job completes with speculative execution

[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1466#comment-1466 ] Daniel Darabos edited comment on SPARK-4879 at 7/10/15 12:25 PM:

[jira] [Assigned] (SPARK-8995) Cast date strings with date, date and time and just time information to DateType and TimestampTzpe

[ https://issues.apache.org/jira/browse/SPARK-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8995: --- Assignee: (was: Apache Spark) Cast date strings with date, date and time and just time

[jira] [Updated] (SPARK-7735) Raise Exception on non-zero exit from pyspark pipe commands

[ https://issues.apache.org/jira/browse/SPARK-7735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-7735: -- Assignee: (was: Davies Liu) Raise Exception on non-zero exit from pyspark pipe commands

[jira] [Assigned] (SPARK-8995) Cast date strings with date, date and time and just time information to DateType and TimestampTzpe

[ https://issues.apache.org/jira/browse/SPARK-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8995: --- Assignee: Apache Spark Cast date strings with date, date and time and just time information

[jira] [Updated] (SPARK-8995) Cast date strings with date, date and time and just time information to DateType and TimestampTzpe

[ https://issues.apache.org/jira/browse/SPARK-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarek Auel updated SPARK-8995: -- Description: Tests of https://github.com/apache/spark/pull/6981 fail, because we can not cast strings

[jira] [Created] (SPARK-8998) Collect enough frequent prefixes before projection in PrefixSpan

Xiangrui Meng created SPARK-8998: Summary: Collect enough frequent prefixes before projection in PrefixSpan Key: SPARK-8998 URL: https://issues.apache.org/jira/browse/SPARK-8998 Project: Spark

[jira] [Assigned] (SPARK-8974) The spark-dynamic-executor-allocation may be not supported

[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8974: --- Assignee: (was: Apache Spark) The spark-dynamic-executor-allocation may be not

[jira] [Resolved] (SPARK-8598) Implementation of 1-sample, two-sided, Kolmogorov Smirnov Test for RDDs

[ https://issues.apache.org/jira/browse/SPARK-8598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8598. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6994

[jira] [Created] (SPARK-8997) Improve LocalPrefixSpan performance

Xiangrui Meng created SPARK-8997: Summary: Improve LocalPrefixSpan performance Key: SPARK-8997 URL: https://issues.apache.org/jira/browse/SPARK-8997 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6487) Add sequential pattern mining algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623218#comment-14623218 ] Xiangrui Meng commented on SPARK-6487: -- Please check linked JIRAs for follow-up work.

[jira] [Updated] (SPARK-8999) Support non-temporal sequence in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8999: - Description: In SPARK-6487, we assume that all items are ordered. However, we should support

[jira] [Updated] (SPARK-8999) Support non-temporal sequence in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-8999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8999: - Description: In SPARK-6487, we assume that all items are ordered. However, we should support

[jira] [Created] (SPARK-8999) Support non-temporal sequence in PrefixSpan

Xiangrui Meng created SPARK-8999: Summary: Support non-temporal sequence in PrefixSpan Key: SPARK-8999 URL: https://issues.apache.org/jira/browse/SPARK-8999 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-8962) Disallow Class.forName

[ https://issues.apache.org/jira/browse/SPARK-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8962: --- Assignee: (was: Apache Spark) Disallow Class.forName --

[jira] [Commented] (SPARK-8962) Disallow Class.forName

[ https://issues.apache.org/jira/browse/SPARK-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623067#comment-14623067 ] Apache Spark commented on SPARK-8962: - User 'JoshRosen' has created a pull request for

[jira] [Closed] (SPARK-8834) Throttle DStreams dynamically through back-pressure information

[ https://issues.apache.org/jira/browse/SPARK-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot closed SPARK-8834. Resolution: Duplicate Throttle DStreams dynamically through back-pressure information

[jira] [Resolved] (SPARK-6487) Add sequential pattern mining algorithm to Spark MLlib

[ https://issues.apache.org/jira/browse/SPARK-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6487. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7258

[jira] [Resolved] (SPARK-8994) Tiny cleanups to Params, Pipeline

[ https://issues.apache.org/jira/browse/SPARK-8994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8994. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7349

[jira] [Comment Edited] (SPARK-8941) Standalone cluster worker does not accept multiple masters on launch

[ https://issues.apache.org/jira/browse/SPARK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623226#comment-14623226 ] Jesper Lundgren edited comment on SPARK-8941 at 7/11/15 4:31 AM:

[jira] [Comment Edited] (SPARK-8941) Standalone cluster worker does not accept multiple masters on launch

[ https://issues.apache.org/jira/browse/SPARK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623226#comment-14623226 ] Jesper Lundgren edited comment on SPARK-8941 at 7/11/15 4:31 AM:

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623230#comment-14623230 ] Andrew Lee commented on SPARK-6882: --- I don't think updating spark-env.sh

[jira] [Comment Edited] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623230#comment-14623230 ] Andrew Lee edited comment on SPARK-6882 at 7/11/15 4:35 AM: I

[jira] [Created] (SPARK-9000) Support generic item type in PrefixSpan

Xiangrui Meng created SPARK-9000: Summary: Support generic item type in PrefixSpan Key: SPARK-9000 URL: https://issues.apache.org/jira/browse/SPARK-9000 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9000) Support generic item type in PrefixSpan

[ https://issues.apache.org/jira/browse/SPARK-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9000: - Description: In SPARK-6487, we only support Int type. It requires users to encode other types

[jira] [Updated] (SPARK-8835) Provide pluggable Congestion Strategies to deal with Streaming load

[ https://issues.apache.org/jira/browse/SPARK-8835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-8835: - Description: Second part of [SPARK-7398|https://issues.apache.org/jira/browse/SPARK-7398]

[jira] [Commented] (SPARK-8986) GaussianMixture should take smoothing param

[ https://issues.apache.org/jira/browse/SPARK-8986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623071#comment-14623071 ] Joseph K. Bradley commented on SPARK-8986: -- Thanks for looking around some! I

[jira] [Created] (SPARK-8996) Add Python API for Kolmogorov-Smirnov Test

Xiangrui Meng created SPARK-8996: Summary: Add Python API for Kolmogorov-Smirnov Test Key: SPARK-8996 URL: https://issues.apache.org/jira/browse/SPARK-8996 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-8941) Standalone cluster worker does not accept multiple masters on launch

[ https://issues.apache.org/jira/browse/SPARK-8941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623226#comment-14623226 ] Jesper Lundgren commented on SPARK-8941: Maybe it is better to close this issue

[jira] [Assigned] (SPARK-8962) Disallow Class.forName

[ https://issues.apache.org/jira/browse/SPARK-8962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8962: --- Assignee: Apache Spark Disallow Class.forName --

[jira] [Commented] (SPARK-6684) Add checkpointing to GradientBoostedTrees

[ https://issues.apache.org/jira/browse/SPARK-6684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14623095#comment-14623095 ] Joseph K. Bradley commented on SPARK-6684: -- I have heard this may be an issue for

[jira] [Created] (SPARK-8977) Define the RateEstimator interface, and implement the ReceiverRateController

Iulian Dragos created SPARK-8977: Summary: Define the RateEstimator interface, and implement the ReceiverRateController Key: SPARK-8977 URL: https://issues.apache.org/jira/browse/SPARK-8977 Project:

[jira] [Resolved] (SPARK-8013) Get JDBC server working with Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-8013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8013. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6903

[jira] [Created] (SPARK-8980) Setup cluster with spark-ec2 scripts as non-root user

Mathieu DESPRIEE created SPARK-8980: --- Summary: Setup cluster with spark-ec2 scripts as non-root user Key: SPARK-8980 URL: https://issues.apache.org/jira/browse/SPARK-8980 Project: Spark

[jira] [Resolved] (SPARK-6154) Support Kafka, JDBC in Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-6154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6154. -- Resolution: Fixed Assignee: Iulian Dragos Fix Version/s: 1.5.0 I think this is resolved

[jira] [Commented] (SPARK-8976) Python 3 crash: ValueError: invalid mode 'a+' (only r, w, b allowed)

[ https://issues.apache.org/jira/browse/SPARK-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622466#comment-14622466 ] Olivier Delalleau commented on SPARK-8976: -- NB: I fixed the issue replacing l.

[jira] [Updated] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7944: - Assignee: Iulian Dragos Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

[jira] [Commented] (SPARK-8980) Setup cluster with spark-ec2 scripts as non-root user

[ https://issues.apache.org/jira/browse/SPARK-8980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622482#comment-14622482 ] Sean Owen commented on SPARK-8980: -- Wasn't the conclusion from the thread that this isn't

[jira] [Resolved] (SPARK-7944) Spark-Shell 2.11 1.4.0-RC-03 does not add jars to class path

[ https://issues.apache.org/jira/browse/SPARK-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7944. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6903

[jira] [Commented] (SPARK-5281) Registering table on RDD is giving MissingRequirementError

[ https://issues.apache.org/jira/browse/SPARK-5281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622510#comment-14622510 ] Iulian Dragos commented on SPARK-5281: -- Thanks for pointing them out. Glad it wasn't

[jira] [Commented] (SPARK-8974) The spark-dynamic-executor-allocation may be not supported

[ https://issues.apache.org/jira/browse/SPARK-8974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622101#comment-14622101 ] Sean Owen commented on SPARK-8974: -- Why do you say this means it's not supported? it

[jira] [Updated] (SPARK-7977) Disallow println

[ https://issues.apache.org/jira/browse/SPARK-7977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7977: - Assignee: Jon Alter Disallow println Key: SPARK-7977

[jira] [Commented] (SPARK-8815) illegal java package names in jar

[ https://issues.apache.org/jira/browse/SPARK-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622211#comment-14622211 ] Sam Halliday commented on SPARK-8815: - Interesting. BTW, I see you're at ScalaX in

[jira] [Created] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

Iulian Dragos created SPARK-8975: Summary: Implement a mechanism to send a new rate from the driver to the block generator Key: SPARK-8975 URL: https://issues.apache.org/jira/browse/SPARK-8975

[jira] [Commented] (SPARK-3644) REST API for Spark application info (jobs / stages / tasks / storage info)

[ https://issues.apache.org/jira/browse/SPARK-3644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622342#comment-14622342 ] RJ Nowling commented on SPARK-3644: --- [~joshrosen] Thanks for pointing to the new JIRA!

[jira] [Created] (SPARK-8976) Python 3 crash: ValueError: invalid mode 'a+' (only r, w, b allowed)

Olivier Delalleau created SPARK-8976: Summary: Python 3 crash: ValueError: invalid mode 'a+' (only r, w, b allowed) Key: SPARK-8976 URL: https://issues.apache.org/jira/browse/SPARK-8976 Project:

[jira] [Created] (SPARK-8982) Worker hostnames not showing in Master web ui when launched with start-slaves.sh

Ben Zimmer created SPARK-8982: - Summary: Worker hostnames not showing in Master web ui when launched with start-slaves.sh Key: SPARK-8982 URL: https://issues.apache.org/jira/browse/SPARK-8982 Project:

[jira] [Commented] (SPARK-8982) Worker hostnames not showing in Master web ui when launched with start-slaves.sh

[ https://issues.apache.org/jira/browse/SPARK-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622688#comment-14622688 ] Apache Spark commented on SPARK-8982: - User 'bdzimmer' has created a pull request for

[jira] [Assigned] (SPARK-8982) Worker hostnames not showing in Master web ui when launched with start-slaves.sh

[ https://issues.apache.org/jira/browse/SPARK-8982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8982: --- Assignee: Apache Spark Worker hostnames not showing in Master web ui when launched with

[jira] [Resolved] (SPARK-6447) Add quick-links to StagePage to jump to Accumulator/Task tables

[ https://issues.apache.org/jira/browse/SPARK-6447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Williams resolved SPARK-6447. -- Resolution: Duplicate Add quick-links to StagePage to jump to Accumulator/Task tables

[jira] [Created] (SPARK-8986) GaussianMixture should take smoothing param

Joseph K. Bradley created SPARK-8986: Summary: GaussianMixture should take smoothing param Key: SPARK-8986 URL: https://issues.apache.org/jira/browse/SPARK-8986 Project: Spark Issue

[jira] [Commented] (SPARK-7263) Add new shuffle manager which stores shuffle blocks in Parquet

[ https://issues.apache.org/jira/browse/SPARK-7263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622704#comment-14622704 ] Matt Massie commented on SPARK-7263: [~rxin] What are your thoughts? I'd like to keep

[jira] [Created] (SPARK-8983) ML Tuning Cross-Validation Improvements

Feynman Liang created SPARK-8983: Summary: ML Tuning Cross-Validation Improvements Key: SPARK-8983 URL: https://issues.apache.org/jira/browse/SPARK-8983 Project: Spark Issue Type: Umbrella

[jira] [Assigned] (SPARK-1301) Add UI elements to collapse Aggregated Metrics by Executor pane on stage page

[ https://issues.apache.org/jira/browse/SPARK-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1301: --- Assignee: (was: Apache Spark) Add UI elements to collapse Aggregated Metrics by

[jira] [Updated] (SPARK-8069) Add support for cutoff to RandomForestClassifier

[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8069: - Description: Consider adding support for cutoffs similar to

[jira] [Created] (SPARK-8985) Create a test harness to improve Spark's combinatorial test coverage of non-default configuration

Josh Rosen created SPARK-8985: - Summary: Create a test harness to improve Spark's combinatorial test coverage of non-default configuration Key: SPARK-8985 URL: https://issues.apache.org/jira/browse/SPARK-8985

[jira] [Commented] (SPARK-7210) Test matrix decompositions for speed vs. numerical stability for Gaussians

[ https://issues.apache.org/jira/browse/SPARK-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622737#comment-14622737 ] Joseph K. Bradley commented on SPARK-7210: -- More thoughts from Reza: We should

[jira] [Commented] (SPARK-8976) Python 3 crash: ValueError: invalid mode 'a+' (only r, w, b allowed)

[ https://issues.apache.org/jira/browse/SPARK-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622623#comment-14622623 ] Josh Rosen commented on SPARK-8976: --- I think that this problem is Windows-specific. The

[jira] [Commented] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622666#comment-14622666 ] Paweł Kopiczko commented on SPARK-8981: --- Sure. I believe that when executor is

[jira] [Comment Edited] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622666#comment-14622666 ] Paweł Kopiczko edited comment on SPARK-8981 at 7/10/15 6:00 PM:

[jira] [Comment Edited] (SPARK-8981) Set applicationId and appName in log4j MDC

[ https://issues.apache.org/jira/browse/SPARK-8981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622666#comment-14622666 ] Paweł Kopiczko edited comment on SPARK-8981 at 7/10/15 6:04 PM:

[jira] [Assigned] (SPARK-1301) Add UI elements to collapse Aggregated Metrics by Executor pane on stage page

[ https://issues.apache.org/jira/browse/SPARK-1301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-1301: --- Assignee: Apache Spark Add UI elements to collapse Aggregated Metrics by Executor pane on

[jira] [Updated] (SPARK-8069) Add support for cutoff to RandomForestClassifier

[ https://issues.apache.org/jira/browse/SPARK-8069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8069: - Assignee: holdenk Add support for cutoff to RandomForestClassifier

[jira] [Commented] (SPARK-8984) Developer documentation for ML Pipelines

[ https://issues.apache.org/jira/browse/SPARK-8984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622745#comment-14622745 ] Joseph K. Bradley commented on SPARK-8984: -- Linked attribute doc JIRA since

[jira] [Commented] (SPARK-3155) Support DecisionTree pruning

[ https://issues.apache.org/jira/browse/SPARK-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622529#comment-14622529 ] Joseph K. Bradley commented on SPARK-3155: -- I don't know if there is a nice paper

  1   2   >