[jira] [Created] (SPARK-3295) [Spark SQL] schemaRdd1 ++ schemaRdd2 does not return another SchemaRdd

2014-08-29 Thread Evan Chan (JIRA)
Evan Chan created SPARK-3295: Summary: [Spark SQL] schemaRdd1 ++ schemaRdd2 does not return another SchemaRdd Key: SPARK-3295 URL: https://issues.apache.org/jira/browse/SPARK-3295 Project: Spark

[jira] [Assigned] (SPARK-3212) Improve the clarity of caching semantics

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-3212: --- Assignee: Michael Armbrust Improve the clarity of caching semantics

[jira] [Resolved] (SPARK-3241) NumberFormat.getInstance() in SparkHiveHadoopWriter is not threadsafe

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3241. - Resolution: Not a Problem NumberFormat.getInstance() in SparkHiveHadoopWriter is not

[jira] [Created] (SPARK-3296) spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes

2014-08-29 Thread wangfei (JIRA)
wangfei created SPARK-3296: -- Summary: spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes Key: SPARK-3296 URL: https://issues.apache.org/jira/browse/SPARK-3296 Project:

[jira] [Commented] (SPARK-3296) spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114958#comment-14114958 ] Apache Spark commented on SPARK-3296: - User 'scwf' has created a pull request for this

[jira] [Created] (SPARK-3297) [Spark SQL][UI] SchemaRDD toString with many columns messes up Storage tab display

2014-08-29 Thread Evan Chan (JIRA)
Evan Chan created SPARK-3297: Summary: [Spark SQL][UI] SchemaRDD toString with many columns messes up Storage tab display Key: SPARK-3297 URL: https://issues.apache.org/jira/browse/SPARK-3297 Project:

[jira] [Created] (SPARK-3299) [SQL] Public API in SQLContext to list tables

2014-08-29 Thread Evan Chan (JIRA)
Evan Chan created SPARK-3299: Summary: [SQL] Public API in SQLContext to list tables Key: SPARK-3299 URL: https://issues.apache.org/jira/browse/SPARK-3299 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-2419) Misc updates to streaming programming guide

2014-08-29 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2419: - Description: This JIRA collects together a number of small issues that should be added to the

[jira] [Updated] (SPARK-3246) Support weighted SVMWithSGD for classification of unbalanced dataset

2014-08-29 Thread mahesh bhole (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mahesh bhole updated SPARK-3246: Priority: Major (was: Minor) Support weighted SVMWithSGD for classification of unbalanced

[jira] [Updated] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-08-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated SPARK-2633: - Attachment: (was: Spark listener enhancement for Hive on Spark job monitor and

[jira] [Updated] (SPARK-2633) enhance spark listener API to gather more spark job information

2014-08-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated SPARK-2633: - Attachment: Spark listener enhancement for Hive on Spark job monitor and statistic.docx

[jira] [Closed] (SPARK-3245) spark insert into hbase class not serialize

2014-08-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-3245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 刘勇 closed SPARK-3245. - spark insert into hbase class not serialize Key:

[jira] [Created] (SPARK-3300) The old buffer in ColumnBuilder should clear after copying its content

2014-08-29 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-3300: -- Summary: The old buffer in ColumnBuilder should clear after copying its content Key: SPARK-3300 URL: https://issues.apache.org/jira/browse/SPARK-3300 Project:

[jira] [Commented] (SPARK-3300) The old buffer in ColumnBuilder should clear after copying its content

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115048#comment-14115048 ] Apache Spark commented on SPARK-3300: - User 'viirya' has created a pull request for

[jira] [Created] (SPARK-3301) The spark version in the welcome message of pyspark is not correct

2014-08-29 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3301: -- Summary: The spark version in the welcome message of pyspark is not correct Key: SPARK-3301 URL: https://issues.apache.org/jira/browse/SPARK-3301 Project: Spark

[jira] [Commented] (SPARK-3301) The spark version in the welcome message of pyspark is not correct

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115057#comment-14115057 ] Apache Spark commented on SPARK-3301: - User 'witgo' has created a pull request for

[jira] [Created] (SPARK-3302) The wrong version information in SparkContext

2014-08-29 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-3302: -- Summary: The wrong version information in SparkContext Key: SPARK-3302 URL: https://issues.apache.org/jira/browse/SPARK-3302 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3302) The wrong version information in SparkContext

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115060#comment-14115060 ] Apache Spark commented on SPARK-3302: - User 'witgo' has created a pull request for

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115088#comment-14115088 ] Qiping Li commented on SPARK-3272: -- Hi Joseph, sorry for the late reply, I still think we

[jira] [Commented] (SPARK-3302) The wrong version information in SparkContext

2014-08-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115126#comment-14115126 ] Sean Owen commented on SPARK-3302: -- This duplicates at least one of

[jira] [Commented] (SPARK-3250) More Efficient Sampling

2014-08-29 Thread RJ Nowling (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115213#comment-14115213 ] RJ Nowling commented on SPARK-3250: --- Very clever! Once it's verified to sample

[jira] [Commented] (SPARK-3301) The spark version in the welcome message of pyspark is not correct

2014-08-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115302#comment-14115302 ] Guoqiang Li commented on SPARK-3301: I do not think this is a duplicate.But we may be

[jira] [Updated] (SPARK-3300) No need to call clear in ensureFreeSpace and shorten build() in ColumnBuilder

2014-08-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-3300: --- Description: The function ensureFreeSpace in object ColumnBuilder doesn't need to call

[jira] [Updated] (SPARK-3300) No need to call clear() in ensureFreeSpace and shorten build() in ColumnBuilder

2014-08-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-3300: --- Summary: No need to call clear() in ensureFreeSpace and shorten build() in ColumnBuilder

[jira] [Created] (SPARK-3303) SparkContextSchedulerCreationSuite test failed when mesos native lib is set

2014-08-29 Thread wangfei (JIRA)
wangfei created SPARK-3303: -- Summary: SparkContextSchedulerCreationSuite test failed when mesos native lib is set Key: SPARK-3303 URL: https://issues.apache.org/jira/browse/SPARK-3303 Project: Spark

[jira] [Updated] (SPARK-3303) SparkContextSchedulerCreationSuite test failed when mesos native lib is set

2014-08-29 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-3303: --- Description: run test with the master branch with this command sbt/sbt -Pyarn -Phadoop-2.3

[jira] [Created] (SPARK-3304) ApplicationMaster's Finish status is wrong when uncaught exception is thrown from ReporterThread

2014-08-29 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3304: - Summary: ApplicationMaster's Finish status is wrong when uncaught exception is thrown from ReporterThread Key: SPARK-3304 URL: https://issues.apache.org/jira/browse/SPARK-3304

[jira] [Updated] (SPARK-3303) SparkContextSchedulerCreationSuite test failed when mesos native lib is set

2014-08-29 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei updated SPARK-3303: --- Description: run test with the master branch with this command sbt/sbt -Phive test-only

[jira] [Commented] (SPARK-3304) ApplicationMaster's Finish status is wrong when uncaught exception is thrown from ReporterThread

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115318#comment-14115318 ] Apache Spark commented on SPARK-3304: - User 'sarutak' has created a pull request for

[jira] [Commented] (SPARK-3303) SparkContextSchedulerCreationSuite test failed when mesos native lib is set

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115319#comment-14115319 ] Apache Spark commented on SPARK-3303: - User 'scwf' has created a pull request for this

[jira] [Commented] (SPARK-3305) Remove unused import from UI classes.

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115338#comment-14115338 ] Apache Spark commented on SPARK-3305: - User 'sarutak' has created a pull request for

[jira] [Created] (SPARK-3305) Remove unused import from UI classes.

2014-08-29 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-3305: - Summary: Remove unused import from UI classes. Key: SPARK-3305 URL: https://issues.apache.org/jira/browse/SPARK-3305 Project: Spark Issue Type:

[jira] [Created] (SPARK-3306) Addition of external resource dependency in executors

2014-08-29 Thread Yan (JIRA)
Yan created SPARK-3306: -- Summary: Addition of external resource dependency in executors Key: SPARK-3306 URL: https://issues.apache.org/jira/browse/SPARK-3306 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-3307) Fix doc string of SparkContext.broadcast()

2014-08-29 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3307: - Summary: Fix doc string of SparkContext.broadcast() Key: SPARK-3307 URL: https://issues.apache.org/jira/browse/SPARK-3307 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3308) Ability to read JSON Arrays as tables

2014-08-29 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-3308: --- Summary: Ability to read JSON Arrays as tables Key: SPARK-3308 URL: https://issues.apache.org/jira/browse/SPARK-3308 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3309) Put all public API in __all__

2014-08-29 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3309: - Summary: Put all public API in __all__ Key: SPARK-3309 URL: https://issues.apache.org/jira/browse/SPARK-3309 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-3307) Fix doc string of SparkContext.broadcast()

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115563#comment-14115563 ] Apache Spark commented on SPARK-3307: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-3310) Directly use currentTable without unnecessary implicit conversion

2014-08-29 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-3310: -- Summary: Directly use currentTable without unnecessary implicit conversion Key: SPARK-3310 URL: https://issues.apache.org/jira/browse/SPARK-3310 Project: Spark

[jira] [Commented] (SPARK-3310) Directly use currentTable without unnecessary implicit conversion

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115627#comment-14115627 ] Apache Spark commented on SPARK-3310: - User 'viirya' has created a pull request for

[jira] [Commented] (SPARK-922) Update Spark AMI to Python 2.7

2014-08-29 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115636#comment-14115636 ] Nicholas Chammas commented on SPARK-922: FYI, I believe the line to install numpy

[jira] [Resolved] (SPARK-3307) Fix doc string of SparkContext.broadcast()

2014-08-29 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-3307. --- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2202

[jira] [Commented] (SPARK-3177) Yarn-alpha ClientBaseSuite Unit test failed

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115665#comment-14115665 ] Apache Spark commented on SPARK-3177: - User 'chesterxgchen' has created a pull request

[jira] [Created] (SPARK-3311) SparkFiles.get doesn't work in local mode

2014-08-29 Thread holdenk (JIRA)
holdenk created SPARK-3311: -- Summary: SparkFiles.get doesn't work in local mode Key: SPARK-3311 URL: https://issues.apache.org/jira/browse/SPARK-3311 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-3309) Put all public API in __all__

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115679#comment-14115679 ] Apache Spark commented on SPARK-3309: - User 'davies' has created a pull request for

[jira] [Created] (SPARK-3312) Add a groupByKey which returns a special GroupBy object like in pandas

2014-08-29 Thread holdenk (JIRA)
holdenk created SPARK-3312: -- Summary: Add a groupByKey which returns a special GroupBy object like in pandas Key: SPARK-3312 URL: https://issues.apache.org/jira/browse/SPARK-3312 Project: Spark

[jira] [Created] (SPARK-3313) Add to GraphX library: transitive closure of a graph

2014-08-29 Thread Rajiv Abraham (JIRA)
Rajiv Abraham created SPARK-3313: Summary: Add to GraphX library: transitive closure of a graph Key: SPARK-3313 URL: https://issues.apache.org/jira/browse/SPARK-3313 Project: Spark Issue

[jira] [Created] (SPARK-3314) Script creation of AMIs

2014-08-29 Thread holdenk (JIRA)
holdenk created SPARK-3314: -- Summary: Script creation of AMIs Key: SPARK-3314 URL: https://issues.apache.org/jira/browse/SPARK-3314 Project: Spark Issue Type: Improvement Components: EC2

[jira] [Updated] (SPARK-3313) Add to GraphX library: transitive closure of a graph

2014-08-29 Thread Rajiv Abraham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajiv Abraham updated SPARK-3313: - Description: Hi, Would it be useful if I implement a library function to determine the

[jira] [Created] (SPARK-3315) Support hyperparameter tuning

2014-08-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-3315: Summary: Support hyperparameter tuning Key: SPARK-3315 URL: https://issues.apache.org/jira/browse/SPARK-3315 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115757#comment-14115757 ] Joseph K. Bradley commented on SPARK-3272: -- Hi Qiping, No worries; we are on

[jira] [Updated] (SPARK-3234) SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line options

2014-08-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3234: -- Summary: SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line

[jira] [Updated] (SPARK-3234) SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line options

2014-08-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3234: -- Description: In {{make-distribution.sh}}, {{SPARK_HADOOP_VERSION}} is determined by {{\-\-hadoop}},

[jira] [Updated] (SPARK-3234) SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line options

2014-08-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3234: -- Description: In {{make-distribution.sh}}, {{SPARK_HADOOP_VERSION}} is determined by {{\-\-hadoop}},

[jira] [Updated] (SPARK-3234) SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line options

2014-08-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-3234: -- Description: In {{make-distribution.sh}}, {{SPARK_HADOOP_VERSION}} is determined by {{\-\-hadoop}},

[jira] [Created] (SPARK-3316) Spark driver will not exit after python program finished

2014-08-29 Thread Davies Liu (JIRA)
Davies Liu created SPARK-3316: - Summary: Spark driver will not exit after python program finished Key: SPARK-3316 URL: https://issues.apache.org/jira/browse/SPARK-3316 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3286) Cannot view ApplicationMaster UI when Yarn’s url scheme is https

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115795#comment-14115795 ] Apache Spark commented on SPARK-3286: - User 'benoyantony' has created a pull request

[jira] [Updated] (SPARK-2706) Enable Spark to support Hive 0.13

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-2706: Assignee: Zhan Zhang Enable Spark to support Hive 0.13 -

[jira] [Created] (SPARK-3317) The loss of regularization in Updater should use the oldWeights

2014-08-29 Thread DB Tsai (JIRA)
DB Tsai created SPARK-3317: -- Summary: The loss of regularization in Updater should use the oldWeights Key: SPARK-3317 URL: https://issues.apache.org/jira/browse/SPARK-3317 Project: Spark Issue

[jira] [Commented] (SPARK-3317) The loss of regularization in Updater should use the oldWeights

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115857#comment-14115857 ] Apache Spark commented on SPARK-3317: - User 'dbtsai' has created a pull request for

[jira] [Commented] (SPARK-3311) SparkFiles.get doesn't work in local mode

2014-08-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115890#comment-14115890 ] holdenk commented on SPARK-3311: Note: this works if you add a file under ./ but not

[jira] [Commented] (SPARK-3109) Sql query with OR condition should be handled above PhysicalOperation layer

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115904#comment-14115904 ] Michael Armbrust commented on SPARK-3109: - I don't believe this optimization is

[jira] [Reopened] (SPARK-2890) Spark SQL should allow SELECT with duplicated columns

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-2890: - Assignee: Michael Armbrust There are cases where this does actually make it impossible

[jira] [Commented] (SPARK-3234) SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line options

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115942#comment-14115942 ] Apache Spark commented on SPARK-3234: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-2890) Spark SQL should allow SELECT with duplicated columns

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115944#comment-14115944 ] Apache Spark commented on SPARK-2890: - User 'marmbrus' has created a pull request for

[jira] [Closed] (SPARK-3311) SparkFiles.get doesn't work in local mode

2014-08-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed SPARK-3311. -- Resolution: Fixed turns out the comment was just out of date, I'll fix the comment in another PR so

[jira] [Created] (SPARK-3318) The documentation for addFiles is wrong

2014-08-29 Thread holdenk (JIRA)
holdenk created SPARK-3318: -- Summary: The documentation for addFiles is wrong Key: SPARK-3318 URL: https://issues.apache.org/jira/browse/SPARK-3318 Project: Spark Issue Type: Documentation

[jira] [Resolved] (SPARK-2813) Implement SQRT() directly in Spark SQL

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-2813. - Resolution: Fixed Fix Version/s: (was: 1.1.0) 1.1.1

[jira] [Resolved] (SPARK-3234) SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh command line options

2014-08-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3234. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2208

[jira] [Resolved] (SPARK-3198) Remove the id property from the TreeNode API

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3198. - Resolution: Fixed Fix Version/s: 1.2.0 1.1.1 Remove the id

[jira] [Resolved] (SPARK-3269) SparkSQLOperationManager.getNextRowSet OOMs when a large maxRows is set

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3269. - Resolution: Fixed Fix Version/s: 1.1.0 SparkSQLOperationManager.getNextRowSet

[jira] [Resolved] (SPARK-3291) TestcaseName in createQueryTest should not contain :

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3291. - Resolution: Fixed Fix Version/s: 1.1.1 TestcaseName in createQueryTest should

[jira] [Resolved] (SPARK-3173) Timestamp support in the parser

2014-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-3173. - Resolution: Fixed Fix Version/s: 1.1.1 Timestamp support in the parser

[jira] [Commented] (SPARK-1919) In Windows, Spark shell cannot load classes in spark.jars (--jars)

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115981#comment-14115981 ] Apache Spark commented on SPARK-1919: - User 'andrewor14' has created a pull request

[jira] [Commented] (SPARK-2731) Update Tachyon dependency to 0.5.0

2014-08-29 Thread Haoyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115984#comment-14115984 ] Haoyuan Li commented on SPARK-2731: --- And this

[jira] [Commented] (SPARK-2703) Make Tachyon related unit tests execute without deploying a Tachyon system locally.

2014-08-29 Thread Haoyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115992#comment-14115992 ] Haoyuan Li commented on SPARK-2703: --- Should add this into the pom file: dependency

[jira] [Commented] (SPARK-2731) Update Tachyon dependency to 0.5.0

2014-08-29 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116005#comment-14116005 ] Henry Saputra commented on SPARK-2731: -- That was quick =P Update Tachyon dependency

[jira] [Closed] (SPARK-2731) Update Tachyon dependency to 0.5.0

2014-08-29 Thread Henry Saputra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra closed SPARK-2731. Resolution: Duplicate Update Tachyon dependency to 0.5.0 --

[jira] [Commented] (SPARK-3287) When ResourceManager High Availability is enabled, ApplicationMaster webUI is not displayed.

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116023#comment-14116023 ] Apache Spark commented on SPARK-3287: - User 'benoyantony' has created a pull request

[jira] [Commented] (SPARK-3094) Support run pyspark in PyPy

2014-08-29 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116026#comment-14116026 ] Nicholas Chammas commented on SPARK-3094: - This is super cool. If [PyPy grows to

[jira] [Created] (SPARK-3319) Resolve spark.jars, spark.files, and spark.submit.pyFiles etc.

2014-08-29 Thread Andrew Or (JIRA)
Andrew Or created SPARK-3319: Summary: Resolve spark.jars, spark.files, and spark.submit.pyFiles etc. Key: SPARK-3319 URL: https://issues.apache.org/jira/browse/SPARK-3319 Project: Spark Issue

[jira] [Created] (SPARK-3320) Batched in-memory column buffer building doesn't work for SchemaRDDs with empty partitions

2014-08-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-3320: - Summary: Batched in-memory column buffer building doesn't work for SchemaRDDs with empty partitions Key: SPARK-3320 URL: https://issues.apache.org/jira/browse/SPARK-3320

[jira] [Commented] (SPARK-3320) Batched in-memory column buffer building doesn't work for SchemaRDDs with empty partitions

2014-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116109#comment-14116109 ] Apache Spark commented on SPARK-3320: - User 'liancheng' has created a pull request for

[jira] [Resolved] (SPARK-3296) spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes

2014-08-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-3296. -- Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 2193

[jira] [Updated] (SPARK-3296) spark-example should be run-example in head notation of DenseKMeans and SparseNaiveBayes

2014-08-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-3296: - Assignee: wangfei spark-example should be run-example in head notation of DenseKMeans and

[jira] [Commented] (SPARK-2890) Spark SQL should allow SELECT with duplicated columns

2014-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116169#comment-14116169 ] Yin Huai commented on SPARK-2890: - Do we also want to handle ambiguity introduced by join?

[jira] [Reopened] (SPARK-3010) fix redundant conditional

2014-08-29 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei reopened SPARK-3010: fix redundant conditional - Key: SPARK-3010 URL:

[jira] [Commented] (SPARK-3088) noisy messages when run tests

2014-08-29 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116191#comment-14116191 ] wangfei commented on SPARK-3088: we should output stderr. noisy messages when run tests

[jira] [Closed] (SPARK-3088) noisy messages when run tests

2014-08-29 Thread wangfei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangfei closed SPARK-3088. -- Resolution: Fixed noisy messages when run tests - Key:

[jira] [Updated] (SPARK-3257) Enable :cp to add JARs in spark-shell (Scala 2.11)

2014-08-29 Thread Matei Zaharia (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matei Zaharia updated SPARK-3257: - Assignee: Heather Miller Enable :cp to add JARs in spark-shell (Scala 2.11)

[jira] [Created] (SPARK-3321) Defining a class within python main script

2014-08-29 Thread Shawn Guo (JIRA)
Shawn Guo created SPARK-3321: Summary: Defining a class within python main script Key: SPARK-3321 URL: https://issues.apache.org/jira/browse/SPARK-3321 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3321) Defining a class within python main script

2014-08-29 Thread Shawn Guo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shawn Guo updated SPARK-3321: - Description: *leftOuterJoin(self, other, numPartitions=None)* Perform a left outer join of self and

[jira] [Commented] (SPARK-2895) Support mapPartitionsWithContext in Spark Java API

2014-08-29 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116221#comment-14116221 ] Chengxiang Li commented on SPARK-2895: -- pull

[jira] [Updated] (SPARK-2636) Expose job ID in JobWaiter API

2014-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2636: --- Target Version/s: 1.2.0 Expose job ID in JobWaiter API --

[jira] [Commented] (SPARK-2207) Add minimum information gain and minimum instances per node as training parameters for decision tree.

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116245#comment-14116245 ] Qiping Li commented on SPARK-2207: -- As Joseph in

[jira] [Updated] (SPARK-2636) Expose job ID in JobWaiter API

2014-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2636: --- Assignee: Chengxiang Li Expose job ID in JobWaiter API --

[jira] [Updated] (SPARK-2895) Support mapPartitionsWithContext in Spark Java API

2014-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-2895: --- Assignee: Chengxiang Li Support mapPartitionsWithContext in Spark Java API

[jira] [Commented] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116247#comment-14116247 ] Qiping Li commented on SPARK-3272: -- Hi Joseph, I have clarified in

[jira] [Comment Edited] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116247#comment-14116247 ] Qiping Li edited comment on SPARK-3272 at 8/30/14 5:41 AM: --- Hi

[jira] [Comment Edited] (SPARK-3272) Calculate prediction for nodes separately from calculating information gain for splits in decision tree

2014-08-29 Thread Qiping Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116247#comment-14116247 ] Qiping Li edited comment on SPARK-3272 at 8/30/14 5:42 AM: --- Hi

[jira] [Created] (SPARK-3322) Log a ConnectionManager error when the application ends

2014-08-29 Thread wangfei (JIRA)
wangfei created SPARK-3322: -- Summary: Log a ConnectionManager error when the application ends Key: SPARK-3322 URL: https://issues.apache.org/jira/browse/SPARK-3322 Project: Spark Issue Type: Bug

  1   2   >