[jira] [Resolved] (SPARK-6113) Stabilize DecisionTree and ensembles APIs

2015-04-25 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-6113. -- Resolution: Fixed Issue resolved by pull request 5626

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-25 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512649#comment-14512649 ] Marcelo Vanzin commented on SPARK-7108: --- The way I read the documentation,

[jira] [Updated] (SPARK-7111) Add a tracker to track the direct (receiver-less) streams

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7111: - Component/s: Streaming Add a tracker to track the direct (receiver-less) streams

[jira] [Updated] (SPARK-7112) Add a tracker to track the direct streams

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7112: - Component/s: Streaming Add a tracker to track the direct streams

[jira] [Updated] (SPARK-7113) Add the direct stream related information to the streaming listener and web UI

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7113: - Component/s: Streaming Add the direct stream related information to the streaming listener and web UI

[jira] [Updated] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7107: - Component/s: PySpark Add parameter for zookeeper.znode.parent to hbase_inputformat.py

[jira] [Updated] (SPARK-5722) Infer_schema_type incorrect for Integers in pyspark

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5722: - Assignee: Don Drake Infer_schema_type incorrect for Integers in pyspark

[jira] [Updated] (SPARK-5651) Support 'create db.table' in HiveContext

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5651: - Assignee: Yadong Qi Support 'create db.table' in HiveContext

[jira] [Updated] (SPARK-5712) Semicolon at end of a comment line

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5712: - Assignee: Adrian Wang Semicolon at end of a comment line --

[jira] [Updated] (SPARK-5756) Analyzer should not throw scala.NotImplementedError for illegitimate sql

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5756: - Assignee: Fei Wang Analyzer should not throw scala.NotImplementedError for illegitimate sql

[jira] [Updated] (SPARK-5758) Use LongType as the default type for integers in JSON schema inference.

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5758: - Assignee: Yin Huai Use LongType as the default type for integers in JSON schema inference.

[jira] [Updated] (SPARK-5789) Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing errors.

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5789: - Assignee: Yin Huai Throw a better error message if JsonRDD.parseJson encounters unrecoverable parsing

[jira] [Updated] (SPARK-5498) [SPARK-SQL]when the partition schema does not match table schema,it throws java.lang.ClassCastException and so on

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5498: - Assignee: jeanlyn [SPARK-SQL]when the partition schema does not match table schema,it throws

[jira] [Updated] (SPARK-5404) Statistic of Logical Plan is too aggresive

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5404: - Assignee: Cheng Hao Statistic of Logical Plan is too aggresive

[jira] [Updated] (SPARK-5277) SparkSqlSerializer does not register user specified KryoRegistrators

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5277: - Assignee: Max Seiden SparkSqlSerializer does not register user specified KryoRegistrators

[jira] [Updated] (SPARK-911) Support map pruning on sorted (K, V) RDD's

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-911: Assignee: Aaron Support map pruning on sorted (K, V) RDD's --

[jira] [Updated] (SPARK-6779) Move shared params to param.shared and use code gen

2015-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6779: - Assignee: Xiangrui Meng Move shared params to param.shared and use code gen

[jira] [Resolved] (SPARK-6779) Move shared params to param.shared and use code gen

2015-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6779. -- Resolution: Fixed Fix Version/s: 1.4.0 Move shared params to param.shared and

[jira] [Updated] (SPARK-5935) Accept MapType in the schema provided to a JSON dataset.

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5935: - Assignee: Yin Huai Accept MapType in the schema provided to a JSON dataset.

[jira] [Updated] (SPARK-5908) Hive udtf with single alias should be resolved correctly

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5908: - Assignee: Liang-Chi Hsieh Hive udtf with single alias should be resolved correctly

[jira] [Updated] (SPARK-5911) Make Column.cast(to: String) support fixed precision and scale decimal type

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5911: - Assignee: Yin Huai Make Column.cast(to: String) support fixed precision and scale decimal type

[jira] [Updated] (SPARK-7107) Add parameter for zookeeper.znode.parent to hbase_inputformat.py

2015-04-25 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-7107: --- Component/s: Examples Add parameter for zookeeper.znode.parent to hbase_inputformat.py

[jira] [Updated] (SPARK-5926) [SQL] DataFrame.explain() return false result for DDL command

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5926: - Assignee: Yanbo Liang [SQL] DataFrame.explain() return false result for DDL command

[jira] [Updated] (SPARK-5909) Add a clearCache command to Spark SQL's cache manager

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5909: - Assignee: Yin Huai Add a clearCache command to Spark SQL's cache manager

[jira] [Updated] (SPARK-5203) union with different decimal type report error

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5203: - Assignee: guowei union with different decimal type report error

[jira] [Updated] (SPARK-5068) When the path not found in the hdfs,we can't get the result

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5068: - Assignee: dongxu When the path not found in the hdfs,we can't get the result

[jira] [Updated] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7108: --- Summary: spark.local.dir is no longer honored in Standalone mode (was: Setting

[jira] [Created] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

2015-04-25 Thread Sean Owen (JIRA)
Sean Owen created SPARK-7145: Summary: commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency Key: SPARK-7145 URL: https://issues.apache.org/jira/browse/SPARK-7145

[jira] [Updated] (SPARK-5852) Fail to convert a newly created empty metastore parquet table to a data source parquet table.

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5852: - Assignee: Yin Huai Fail to convert a newly created empty metastore parquet table to a data source

[jira] [Updated] (SPARK-5862) Only transformUp the given plan once in HiveMetastoreCatalog

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5862: - Assignee: Liang-Chi Hsieh Only transformUp the given plan once in HiveMetastoreCatalog

[jira] [Resolved] (SPARK-7000) spark.ml Prediction abstractions should reside in ml.prediction subpackage

2015-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-7000. -- Resolution: Not A Problem spark.ml Prediction abstractions should reside in

[jira] [Commented] (SPARK-7000) spark.ml Prediction abstractions should reside in ml.prediction subpackage

2015-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512828#comment-14512828 ] Joseph K. Bradley commented on SPARK-7000: -- Decision after conferring with

[jira] [Resolved] (SPARK-6989) Spark 1.3 REPL for Scala 2.11 (2.11.2) fails to start, emitting various arcane compiler errors

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-6989. -- Resolution: Cannot Reproduce Spark 1.3 REPL for Scala 2.11 (2.11.2) fails to start, emitting various

[jira] [Resolved] (SPARK-7124) Add functions to check for file and directory existence

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7124. -- Resolution: Not A Problem Add functions to check for file and directory existence

[jira] [Updated] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-7141: - Description: Using {{saveAsTextFile(s3://bucket/prefix}} actually adds an empty

[jira] [Reopened] (SPARK-6752) Allow StreamingContext to be recreated from checkpoint and existing SparkContext

2015-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-6752: I had to revert this because it caused test failures with the Hadoop 1.0 build. To reproduce

[jira] [Commented] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512719#comment-14512719 ] Apache Spark commented on SPARK-7145: - User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7145: --- Assignee: Apache Spark (was: Sean Owen) commons-lang (2.x) classes used instead of

[jira] [Assigned] (SPARK-7145) commons-lang (2.x) classes used instead of commons-lang3 (3.x); commons-io used without dependency

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7145: --- Assignee: Sean Owen (was: Apache Spark) commons-lang (2.x) classes used instead of

[jira] [Commented] (SPARK-6752) Allow StreamingContext to be recreated from checkpoint and existing SparkContext

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512620#comment-14512620 ] Sean Owen commented on SPARK-6752: -- It's an issue with the version of Commons Lang (2.x).

[jira] [Commented] (SPARK-7143) Add BM25 Estimator

2015-04-25 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512765#comment-14512765 ] Joseph K. Bradley commented on SPARK-7143: -- Do you have some references to recent

[jira] [Updated] (SPARK-5817) UDTF column names didn't set properly

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5817: - Assignee: Cheng Hao UDTF column names didn't set properly --

[jira] [Updated] (SPARK-5824) CTAS should set null format in hive-0.13.1

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5824: - Assignee: Adrian Wang CTAS should set null format in hive-0.13.1

[jira] [Updated] (SPARK-5833) Adds REFRESH TABLE command to refresh external data sources tables

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5833: - Assignee: Cheng Lian Adds REFRESH TABLE command to refresh external data sources tables

[jira] [Updated] (SPARK-5840) HiveContext cannot be serialized due to tuple extraction

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5840: - Assignee: Reynold Xin HiveContext cannot be serialized due to tuple extraction

[jira] [Updated] (SPARK-5794) add jar should return 0

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5794: - Assignee: Adrian Wang add jar should return 0 --- Key: SPARK-5794

[jira] [Updated] (SPARK-5780) The loggings of Python unittests are noisy and scaring in

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5780: - Assignee: Davies Liu The loggings of Python unittests are noisy and scaring in

[jira] [Updated] (SPARK-5626) Spurious test failures due to NullPointerException in EasyMock test code

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5626: - Assignee: Josh Rosen Spurious test failures due to NullPointerException in EasyMock test code

[jira] [Resolved] (SPARK-7092) Update spark scala version to 2.11.6

2015-04-25 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7092. -- Resolution: Fixed Fix Version/s: 1.4.0 Issue resolved by pull request 5662

[jira] [Commented] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512794#comment-14512794 ] Eric O. LEBIGOT (EOL) commented on SPARK-7141: -- Ah, thanks: it's good to know

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-04-25 Thread Debasish Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512843#comment-14512843 ] Debasish Das commented on SPARK-5992: - Did someone compared algebird LSH with spark

[jira] [Created] (SPARK-7146) Should ML sharedParams be a public API?

2015-04-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7146: Summary: Should ML sharedParams be a public API? Key: SPARK-7146 URL: https://issues.apache.org/jira/browse/SPARK-7146 Project: Spark Issue Type:

[jira] [Created] (SPARK-7147) Enforce Params.validate by making it abstract

2015-04-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7147: Summary: Enforce Params.validate by making it abstract Key: SPARK-7147 URL: https://issues.apache.org/jira/browse/SPARK-7147 Project: Spark Issue

[jira] [Created] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

2015-04-25 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-7148: Summary: Configure Parquet block size (row group size) for ML model import/export Key: SPARK-7148 URL: https://issues.apache.org/jira/browse/SPARK-7148

[jira] [Commented] (SPARK-5023) In Web UI job history, the total job duration is incorrect (much smaller than the sum of its stages)

2015-04-25 Thread Eran Medan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512869#comment-14512869 ] Eran Medan commented on SPARK-5023: --- I don't think this is a duplicate, the information

[jira] [Created] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Eric O. LEBIGOT (EOL) (JIRA)
Eric O. LEBIGOT (EOL) created SPARK-7141: Summary: saveAsTextFile() on S3 first creates empty prefix Key: SPARK-7141 URL: https://issues.apache.org/jira/browse/SPARK-7141 Project: Spark

[jira] [Updated] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-7141: - Description: Using {{saveAsTextFile(s3://bucket/prefix}} actually adds an empty

[jira] [Updated] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-7141: - Description: Using {{saveAsTextFile(s3://bucket/prefix}} actually adds an empty

[jira] [Updated] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Eric O. LEBIGOT (EOL) (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric O. LEBIGOT (EOL) updated SPARK-7141: - Description: Using {{saveAsTextFile(s3://bucket/prefix}} actually adds an empty

[jira] [Comment Edited] (SPARK-7108) Setting spark.local.dir in driver no longer overrides the standalone worker's local directory setting

2015-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512280#comment-14512280 ] Patrick Wendell edited comment on SPARK-7108 at 4/25/15 6:01 AM:

[jira] [Comment Edited] (SPARK-7108) Setting spark.local.dir in driver no longer overrides the standalone worker's local directory setting

2015-04-25 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512280#comment-14512280 ] Patrick Wendell edited comment on SPARK-7108 at 4/25/15 6:02 AM:

[jira] [Commented] (SPARK-7118) Add coalesce Spark SQL function to PySpark API

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512320#comment-14512320 ] Apache Spark commented on SPARK-7118: - User 'ogirardot' has created a pull request for

[jira] [Assigned] (SPARK-5891) Add Binarizer

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5891: --- Assignee: Apache Spark Add Binarizer - Key: SPARK-5891

[jira] [Assigned] (SPARK-6333) saveAsObjectFile support for compression codec

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6333: --- Assignee: (was: Apache Spark) saveAsObjectFile support for compression codec

[jira] [Commented] (SPARK-5891) Add Binarizer

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512361#comment-14512361 ] Apache Spark commented on SPARK-5891: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-5891) Add Binarizer

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5891: --- Assignee: (was: Apache Spark) Add Binarizer - Key:

[jira] [Updated] (SPARK-2750) Add Https support for Web UI

2015-04-25 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-2750: Attachment: exception on yarn when https enabled.txt Add Https support for Web UI

[jira] [Assigned] (SPARK-6333) saveAsObjectFile support for compression codec

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6333: --- Assignee: Apache Spark saveAsObjectFile support for compression codec

[jira] [Created] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

2015-04-25 Thread Yash Datta (JIRA)
Yash Datta created SPARK-7142: - Summary: Minor enhancement to BooleanSimplification Optimizer rule Key: SPARK-7142 URL: https://issues.apache.org/jira/browse/SPARK-7142 Project: Spark Issue

[jira] [Assigned] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7142: --- Assignee: Apache Spark Minor enhancement to BooleanSimplification Optimizer rule

[jira] [Assigned] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7142: --- Assignee: (was: Apache Spark) Minor enhancement to BooleanSimplification Optimizer rule

[jira] [Commented] (SPARK-7142) Minor enhancement to BooleanSimplification Optimizer rule

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512487#comment-14512487 ] Apache Spark commented on SPARK-7142: - User 'saucam' has created a pull request for

[jira] [Commented] (SPARK-7141) saveAsTextFile() on S3 first creates empty prefix

2015-04-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512573#comment-14512573 ] Liang-Chi Hsieh commented on SPARK-7141: The double slash issue is caused by the

[jira] [Commented] (SPARK-6980) Akka timeout exceptions indicate which conf controls them

2015-04-25 Thread Harsh Gupta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512575#comment-14512575 ] Harsh Gupta commented on SPARK-6980: [~imranr] [~bryanc] Hi. I tried a simple

[jira] [Created] (SPARK-7143) Add BM25 Estimator

2015-04-25 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-7143: -- Summary: Add BM25 Estimator Key: SPARK-7143 URL: https://issues.apache.org/jira/browse/SPARK-7143 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-7143) Add BM25 Estimator

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7143: --- Assignee: Apache Spark Add BM25 Estimator -- Key:

[jira] [Assigned] (SPARK-7143) Add BM25 Estimator

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7143: --- Assignee: (was: Apache Spark) Add BM25 Estimator --

[jira] [Commented] (SPARK-7143) Add BM25 Estimator

2015-04-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14512578#comment-14512578 ] Apache Spark commented on SPARK-7143: - User 'viirya' has created a pull request for

[jira] [Created] (SPARK-7144) SPARK-6784

2015-04-25 Thread Yin Huai (JIRA)
Yin Huai created SPARK-7144: --- Summary: SPARK-6784 Key: SPARK-7144 URL: https://issues.apache.org/jira/browse/SPARK-7144 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Resolved] (SPARK-7144) SPARK-6784

2015-04-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-7144. - Resolution: Invalid oops... SPARK-6784 -- Key: SPARK-7144

[jira] [Updated] (SPARK-5456) Decimal Type comparison issue

2015-04-25 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-5456: Priority: Blocker (was: Major) Target Version/s: 1.4.0 Decimal Type comparison issue