[jira] [Updated] (SPARK-6391) Update Tachyon version compatibility documentation

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6391: - Target Version/s: 1.4.0 Fix Version/s: (was: 1.4.0) [~haoyuan] we set Fix Version when the

[jira] [Updated] (SPARK-6391) Update Tachyon version compatibility documentation

2015-03-28 Thread Haoyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haoyuan Li updated SPARK-6391: -- Fix Version/s: 1.4.0 Update Tachyon version compatibility documentation

[jira] [Commented] (SPARK-6299) ClassNotFoundException in standalone mode when running groupByKey with class defined in REPL.

2015-03-28 Thread Chip Senkbeil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385516#comment-14385516 ] Chip Senkbeil commented on SPARK-6299: -- FYI, we had the same issue on Mesos for 1.2.1

[jira] [Commented] (SPARK-6391) Update Tachyon version compatibility documentation

2015-03-28 Thread Haoyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385584#comment-14385584 ] Haoyuan Li commented on SPARK-6391: --- Thanks [~sowen]. Update Tachyon version

[jira] [Created] (SPARK-6589) SQLUserDefinedType failed in spark-shell

2015-03-28 Thread Benyi Wang (JIRA)
Benyi Wang created SPARK-6589: - Summary: SQLUserDefinedType failed in spark-shell Key: SPARK-6589 URL: https://issues.apache.org/jira/browse/SPARK-6589 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-5124) Standardize internal RPC interface

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5124: --- Assignee: Shixiong Zhu (was: Apache Spark) Standardize internal RPC interface

[jira] [Assigned] (SPARK-5124) Standardize internal RPC interface

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5124: --- Assignee: Apache Spark (was: Shixiong Zhu) Standardize internal RPC interface

[jira] [Assigned] (SPARK-5494) SparkSqlSerializer Ignores KryoRegistrators

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5494: --- Assignee: Apache Spark SparkSqlSerializer Ignores KryoRegistrators

[jira] [Assigned] (SPARK-5494) SparkSqlSerializer Ignores KryoRegistrators

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5494: --- Assignee: (was: Apache Spark) SparkSqlSerializer Ignores KryoRegistrators

[jira] [Updated] (SPARK-5946) Add Python API for Kafka direct stream

2015-03-28 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-5946: - Target Version/s: 1.4.0 Add Python API for Kafka direct stream

[jira] [Assigned] (SPARK-6369) InsertIntoHiveTable should use logic from SparkHadoopWriter

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6369: --- Assignee: Apache Spark (was: Cheng Lian) InsertIntoHiveTable should use logic from

[jira] [Assigned] (SPARK-6369) InsertIntoHiveTable should use logic from SparkHadoopWriter

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6369: --- Assignee: Cheng Lian (was: Apache Spark) InsertIntoHiveTable should use logic from

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-28 Thread Nan Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385616#comment-14385616 ] Nan Zhu commented on SPARK-6592: also cc: [~lian cheng] [~marmbrus] API of Row trait

[jira] [Commented] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385617#comment-14385617 ] Reynold Xin commented on SPARK-6592: Can you try change that line to

[jira] [Created] (SPARK-6591) Python data source load options should auto convert common types into strings

2015-03-28 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-6591: -- Summary: Python data source load options should auto convert common types into strings Key: SPARK-6591 URL: https://issues.apache.org/jira/browse/SPARK-6591 Project:

[jira] [Updated] (SPARK-6591) Python data source load options should auto convert common types into strings

2015-03-28 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6591: --- Labels: DataFrame DataSource (was: ) Python data source load options should auto convert common

[jira] [Created] (SPARK-6592) API of Row trait should be presented in Scala doc

2015-03-28 Thread Nan Zhu (JIRA)
Nan Zhu created SPARK-6592: -- Summary: API of Row trait should be presented in Scala doc Key: SPARK-6592 URL: https://issues.apache.org/jira/browse/SPARK-6592 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2973) Use LocalRelation for all ExecutedCommands, avoid job for take/collect()

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385606#comment-14385606 ] Apache Spark commented on SPARK-2973: - User 'scwf' has created a pull request for this

[jira] [Updated] (SPARK-6575) Add configuration to disable schema merging while converting metastore Parquet tables

2015-03-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6575: -- Description: Consider a metastore Parquet table that # doesn't have schema evolution issue # has lots

[jira] [Updated] (SPARK-6590) Make DataFrame.where accept a string conditionExpr

2015-03-28 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-6590: Priority: Minor (was: Major) Make DataFrame.where accept a string conditionExpr

[jira] [Created] (SPARK-6590) Make DataFrame.where accept a string conditionExpr

2015-03-28 Thread Yin Huai (JIRA)
Yin Huai created SPARK-6590: --- Summary: Make DataFrame.where accept a string conditionExpr Key: SPARK-6590 URL: https://issues.apache.org/jira/browse/SPARK-6590 Project: Spark Issue Type:

[jira] [Commented] (SPARK-6589) SQLUserDefinedType failed in spark-shell

2015-03-28 Thread Benyi Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385499#comment-14385499 ] Benyi Wang commented on SPARK-6589: --- I found a method to fix this issue. But I still

[jira] [Created] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-28 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-6586: -- Summary: Add the capability of retrieving original logical plan of DataFrame Key: SPARK-6586 URL: https://issues.apache.org/jira/browse/SPARK-6586 Project: Spark

[jira] [Commented] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385261#comment-14385261 ] Apache Spark commented on SPARK-6586: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-6586) Add the capability of retrieving original logical plan of DataFrame

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6586: --- Assignee: Apache Spark Add the capability of retrieving original logical plan of DataFrame

[jira] [Resolved] (SPARK-4941) Yarn cluster mode does not upload all needed jars to driver node (Spark 1.2.0)

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4941. -- Resolution: Cannot Reproduce OK, we can reopen if this if typos etc are ruled out, and it is

[jira] [Resolved] (SPARK-6552) expose start-slave.sh to user and update outdated doc

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6552. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5205

[jira] [Commented] (SPARK-6571) MatrixFactorizationModel created by load fails on predictAll

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385414#comment-14385414 ] Apache Spark commented on SPARK-6571: - User 'mengxr' has created a pull request for

[jira] [Updated] (SPARK-6581) Metadata is missing when saving parquet file using hadoop 1.0.4

2015-03-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6581: -- Target Version/s: 1.4.0 Metadata is missing when saving parquet file using hadoop 1.0.4

[jira] [Updated] (SPARK-6570) Spark SQL arrays: explode() fails and cannot save array type to Parquet

2015-03-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6570: -- Target Version/s: 1.4.0 Spark SQL arrays: explode() fails and cannot save array type to Parquet

[jira] [Updated] (SPARK-6529) Word2Vec transformer

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6529: - Fix Version/s: (was: 1.4.0) Word2Vec transformer Key:

[jira] [Updated] (SPARK-6209) ExecutorClassLoader can leak connections after failing to load classes from the REPL class server

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6209: - Fix Version/s: (was: 1.3.1) (was: 1.4.0) ExecutorClassLoader can leak

[jira] [Updated] (SPARK-6350) Make mesosExecutorCores configurable in mesos fine-grained mode

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6350: - Fix Version/s: (was: 1.3.1) (was: 1.4.0) Make mesosExecutorCores configurable

[jira] [Updated] (SPARK-6530) ChiSqSelector transformer

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6530: - Fix Version/s: (was: 1.4.0) ChiSqSelector transformer -

[jira] [Updated] (SPARK-6528) IDF transformer

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6528: - Fix Version/s: (was: 1.4.0) IDF transformer --- Key: SPARK-6528

[jira] [Updated] (SPARK-6194) collect() in PySpark will cause memory leak in JVM

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6194: - Fix Version/s: (was: 1.3.1) (was: 1.4.0) (was: 1.2.2)

[jira] [Updated] (SPARK-6323) Large rank matrix factorization with Nonlinear loss and constraints

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6323: - Fix Version/s: (was: 1.4.0) Large rank matrix factorization with Nonlinear loss and constraints

[jira] [Updated] (SPARK-6582) Support ssl for this AvroSink in Spark Streaming External

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6582: - Component/s: Streaming (Components please) Support ssl for this AvroSink in Spark Streaming External

[jira] [Updated] (SPARK-6060) List type missing for catalyst's package.scala

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6060: - Fix Version/s: (was: 1.3.0) List type missing for catalyst's package.scala

[jira] [Updated] (SPARK-5880) Change log level of batch pruning string in InMemoryColumnarTableScan from Info to Debug

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5880: - Fix Version/s: (was: 1.3.0) Change log level of batch pruning string in InMemoryColumnarTableScan

[jira] [Updated] (SPARK-5684) Key not found exception is thrown in case location of added partition to a parquet table is different than a path containing the partition values

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5684: - Fix Version/s: (was: 1.3.0) Key not found exception is thrown in case location of added partition to

[jira] [Resolved] (SPARK-4558) History Server waits ~10s before starting up

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-4558. -- Resolution: Duplicate History Server waits ~10s before starting up

[jira] [Updated] (SPARK-2253) [Core] Disable partial aggregation automatically when reduction factor is low

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-2253: - Fix Version/s: (was: 1.3.0) [Core] Disable partial aggregation automatically when reduction factor

[jira] [Resolved] (SPARK-6128) Update Spark Streaming Guide for Spark 1.3

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6128. -- Resolution: Fixed Update Spark Streaming Guide for Spark 1.3

[jira] [Updated] (SPARK-6582) Support ssl for this AvroSink in Spark Streaming External

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6582: - Fix Version/s: (was: 1.4.0) Support ssl for this AvroSink in Spark Streaming External

[jira] [Updated] (SPARK-6194) collect() in PySpark will cause memory leak in JVM

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6194: - Target Version/s: 1.3.0, 1.0.3, 1.1.2, 1.2.2 (was: 1.0.3, 1.1.2, 1.2.2, 1.3.0) Fix Version/s:

[jira] [Updated] (SPARK-6209) ExecutorClassLoader can leak connections after failing to load classes from the REPL class server

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6209: - Fix Version/s: 1.4.0 1.3.1 Oops, my bulk change shouldn't have caught this one. I see

[jira] [Updated] (SPARK-6006) Optimize count distinct in case of high cardinality columns

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6006: - Fix Version/s: (was: 1.3.0) Optimize count distinct in case of high cardinality columns

[jira] [Updated] (SPARK-5720) `Create Table Like` in HiveContext need support `like registered temporary table`

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5720: - Fix Version/s: (was: 1.3.0) `Create Table Like` in HiveContext need support `like registered

[jira] [Updated] (SPARK-5192) Parquet fails to parse schema contains '\r'

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5192: - Fix Version/s: (was: 1.3.0) Parquet fails to parse schema contains '\r'

[jira] [Updated] (SPARK-5264) Support `drop temporary table [if exists]` DDL command

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5264: - Fix Version/s: (was: 1.3.0) Support `drop temporary table [if exists]` DDL command

[jira] [Updated] (SPARK-4752) Classifier based on artificial neural network

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-4752: - Fix Version/s: (was: 1.3.0) Classifier based on artificial neural network

[jira] [Updated] (SPARK-5362) Gradient and Optimizer to support generic output (instead of label) and data batches

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5362: - Fix Version/s: (was: 1.3.0) Gradient and Optimizer to support generic output (instead of label) and

[jira] [Resolved] (SPARK-5522) Accelerate the History Server start

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5522. -- Resolution: Fixed Looks resolved by https://github.com/apache/spark/pull/4525 but just never got

[jira] [Assigned] (SPARK-6470) Allow Spark apps to put YARN node labels in their requests

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6470: --- Assignee: Sandy Ryza (was: Apache Spark) Allow Spark apps to put YARN node labels in their

[jira] [Commented] (SPARK-6470) Allow Spark apps to put YARN node labels in their requests

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385363#comment-14385363 ] Apache Spark commented on SPARK-6470: - User 'sryza' has created a pull request for

[jira] [Assigned] (SPARK-6470) Allow Spark apps to put YARN node labels in their requests

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6470: --- Assignee: Apache Spark (was: Sandy Ryza) Allow Spark apps to put YARN node labels in their

[jira] [Created] (SPARK-6587) Inferring schema for case class hierarchy fails with mysterious message

2015-03-28 Thread Spiro Michaylov (JIRA)
Spiro Michaylov created SPARK-6587: -- Summary: Inferring schema for case class hierarchy fails with mysterious message Key: SPARK-6587 URL: https://issues.apache.org/jira/browse/SPARK-6587 Project:

[jira] [Updated] (SPARK-2426) Quadratic Minimization for MLlib ALS

2015-03-28 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Debasish Das updated SPARK-2426: Affects Version/s: (was: 1.3.0) 1.4.0 Quadratic Minimization for MLlib

[jira] [Created] (SPARK-6588) Private VPC's and subnets currently don't work with the Spark ec2 script

2015-03-28 Thread Michelangelo D'Agostino (JIRA)
Michelangelo D'Agostino created SPARK-6588: -- Summary: Private VPC's and subnets currently don't work with the Spark ec2 script Key: SPARK-6588 URL: https://issues.apache.org/jira/browse/SPARK-6588

[jira] [Resolved] (SPARK-6588) Private VPC's and subnets currently don't work with the Spark ec2 script

2015-03-28 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6588. -- Resolution: Duplicate Also SPARK-5246, SPARK-6220. Have a look at the existing JIRAs and see if you

[jira] [Commented] (SPARK-6588) Private VPC's and subnets currently don't work with the Spark ec2 script

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385435#comment-14385435 ] Apache Spark commented on SPARK-6588: - User 'mdagost' has created a pull request for

[jira] [Assigned] (SPARK-5894) Add PolynomialMapper

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5894: --- Assignee: Apache Spark Add PolynomialMapper Key:

[jira] [Commented] (SPARK-5894) Add PolynomialMapper

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385446#comment-14385446 ] Apache Spark commented on SPARK-5894: - User 'yinxusen' has created a pull request for

[jira] [Assigned] (SPARK-5894) Add PolynomialMapper

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5894: --- Assignee: (was: Apache Spark) Add PolynomialMapper

[jira] [Created] (SPARK-6582) Support ssl for this AvroSink in Spark Streaming External

2015-03-28 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-6582: --- Summary: Support ssl for this AvroSink in Spark Streaming External Key: SPARK-6582 URL: https://issues.apache.org/jira/browse/SPARK-6582 Project: Spark Issue

[jira] [Created] (SPARK-6583) Support aggregated function in order by

2015-03-28 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-6583: Summary: Support aggregated function in order by Key: SPARK-6583 URL: https://issues.apache.org/jira/browse/SPARK-6583 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-6584) Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of partition's executor location.

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6584: --- Assignee: Apache Spark Provide ExecutorPrefixTaskLocation to support the rdd which can be

[jira] [Commented] (SPARK-6584) Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of partition's executor location.

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385221#comment-14385221 ] Apache Spark commented on SPARK-6584: - User 'SaintBacchus' has created a pull request

[jira] [Assigned] (SPARK-6584) Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of partition's executor location.

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6584: --- Assignee: (was: Apache Spark) Provide ExecutorPrefixTaskLocation to support the rdd

[jira] [Assigned] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6464: --- Assignee: (was: Apache Spark) Add a new transformation of rdd named processCoalesce

[jira] [Assigned] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6464: --- Assignee: Apache Spark Add a new transformation of rdd named processCoalesce which was

[jira] [Assigned] (SPARK-5338) Support cluster mode with Mesos

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5338: --- Assignee: (was: Apache Spark) Support cluster mode with Mesos

[jira] [Created] (SPARK-6584) Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of partition's executor location.

2015-03-28 Thread SaintBacchus (JIRA)
SaintBacchus created SPARK-6584: --- Summary: Provide ExecutorPrefixTaskLocation to support the rdd which can be aware of partition's executor location. Key: SPARK-6584 URL:

[jira] [Assigned] (SPARK-5338) Support cluster mode with Mesos

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5338: --- Assignee: Apache Spark Support cluster mode with Mesos ---

[jira] [Assigned] (SPARK-6585) FileServerSuite.test (HttpFileServer should not work with SSL when the server is untrusted) failed is some evn.

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6585: --- Assignee: Apache Spark FileServerSuite.test (HttpFileServer should not work with SSL when

[jira] [Assigned] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5277: --- Assignee: Apache Spark SparkSqlSerializer does not register user specified KryoRegistrators

[jira] [Commented] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385172#comment-14385172 ] Apache Spark commented on SPARK-5277: - User 'mhseiden' has created a pull request for

[jira] [Assigned] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5277: --- Assignee: (was: Apache Spark) SparkSqlSerializer does not register user specified

[jira] [Commented] (SPARK-6577) SparseMatrix should be supported in PySpark

2015-03-28 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385183#comment-14385183 ] Joseph K. Bradley commented on SPARK-6577: -- Good point. [~mengxr], do we want to

[jira] [Assigned] (SPARK-6585) FileServerSuite.test (HttpFileServer should not work with SSL when the server is untrusted) failed is some evn.

2015-03-28 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6585: --- Assignee: (was: Apache Spark) FileServerSuite.test (HttpFileServer should not work with

[jira] [Updated] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

2015-03-28 Thread Max Seiden (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Seiden updated SPARK-5277: -- Affects Version/s: (was: 1.2.0) 1.2.1 1.3.0

[jira] [Updated] (SPARK-6464) Add a new transformation of rdd named processCoalesce which was particularly to deal with the small and cached rdd

2015-03-28 Thread SaintBacchus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SaintBacchus updated SPARK-6464: Affects Version/s: (was: 1.3.0) 1.4.0 Add a new transformation of rdd

[jira] [Created] (SPARK-6585) FileServerSuite.test (HttpFileServer should not work with SSL when the server is untrusted) failed is some evn.

2015-03-28 Thread June (JIRA)
June created SPARK-6585: --- Summary: FileServerSuite.test (HttpFileServer should not work with SSL when the server is untrusted) failed is some evn. Key: SPARK-6585 URL: https://issues.apache.org/jira/browse/SPARK-6585

[jira] [Commented] (SPARK-6577) SparseMatrix should be supported in PySpark

2015-03-28 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385223#comment-14385223 ] Manoj Kumar commented on SPARK-6577: Ah, I just noticed that SciPy is an optional