[jira] [Commented] (SPARK-11585) AssociationRules should generates all association rules with consequents of arbitrary length

2015-11-08 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996174#comment-14996174 ] zhengruifeng commented on SPARK-11585: -- I have implemented it based on Apriori's Rul

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996168#comment-14996168 ] Sean Owen commented on SPARK-11583: --- Yes, I understand the idea of a 'compressed' bitse

[jira] [Created] (SPARK-11585) AssociationRules should generates all association rules with consequents of arbitrary length

2015-11-08 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-11585: Summary: AssociationRules should generates all association rules with consequents of arbitrary length Key: SPARK-11585 URL: https://issues.apache.org/jira/browse/SPARK-11585

[jira] [Created] (SPARK-11584) The attribute of temporay table shows false

2015-11-08 Thread Jay (JIRA)
Jay created SPARK-11584: --- Summary: The attribute of temporay table shows false Key: SPARK-11584 URL: https://issues.apache.org/jira/browse/SPARK-11584 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11494) Expose R-like summary statistics in SparkR::glm for linear regression

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996162#comment-14996162 ] Apache Spark commented on SPARK-11494: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-5968) Parquet warning in spark-shell

2015-11-08 Thread swetha k (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996160#comment-14996160 ] swetha k commented on SPARK-5968: - [~marmbrus] How is this issue resolved? I still see th

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Kent Yao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996147#comment-14996147 ] Kent Yao commented on SPARK-11583: -- [~srowen] MapStatus stores BlockManagerId where it l

[jira] [Assigned] (SPARK-11582) pmml version attribute missing in the root node

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11582: Assignee: Apache Spark > pmml version attribute missing in the root node > ---

[jira] [Assigned] (SPARK-11582) pmml version attribute missing in the root node

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11582: Assignee: (was: Apache Spark) > pmml version attribute missing in the root node >

[jira] [Commented] (SPARK-11582) pmml version attribute missing in the root node

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996126#comment-14996126 ] Apache Spark commented on SPARK-11582: -- User 'fazlan-nazeem' has created a pull requ

[jira] [Commented] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996124#comment-14996124 ] Apache Spark commented on SPARK-11581: -- User 'bharatl' has created a pull request fo

[jira] [Assigned] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11581: Assignee: Apache Spark > Example mllib code in documentation incorrectly computes MSE > --

[jira] [Assigned] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11581: Assignee: (was: Apache Spark) > Example mllib code in documentation incorrectly comput

[jira] [Commented] (SPARK-11570) ambiguous hostname resolving during startup

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996122#comment-14996122 ] Sean Owen commented on SPARK-11570: --- Hm, OK then sounds like SPARK-10149. The answer is

[jira] [Updated] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11581: -- Labels: starter (was: ) Agree, do you want to make a PR to fix it? I'm tempted to zap it quickly in an

[jira] [Commented] (SPARK-11577) Handle code review comments for SPARK-11188

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996110#comment-14996110 ] Sean Owen commented on SPARK-11577: --- Can you attach this to SPARK-11188 please and clos

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996109#comment-14996109 ] Sean Owen commented on SPARK-11583: --- [~Qin Yao] but you're just re-describing a sparse

[jira] [Assigned] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11583: Assignee: (was: Apache Spark) > Make MapStatus use less memory uage >

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996098#comment-14996098 ] Apache Spark commented on SPARK-11583: -- User 'yaooqinn' has created a pull request f

[jira] [Assigned] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11583: Assignee: Apache Spark > Make MapStatus use less memory uage > ---

[jira] [Created] (SPARK-11583) Make MapStatus use less memory uage

2015-11-08 Thread Kent Yao (JIRA)
Kent Yao created SPARK-11583: Summary: Make MapStatus use less memory uage Key: SPARK-11583 URL: https://issues.apache.org/jira/browse/SPARK-11583 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-11188) Elide stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996091#comment-14996091 ] Apache Spark commented on SPARK-11188: -- User 'dilipbiswal' has created a pull reques

[jira] [Updated] (SPARK-11577) Handle code review comments for SPARK-11188

2015-11-08 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dilip Biswal updated SPARK-11577: - Summary: Handle code review comments for SPARK-11188 (was: Suppress stacktraces in bin/spark-sql

[jira] [Commented] (SPARK-8545) PMML improvement umbrella

2015-11-08 Thread Fazlan Nazeem (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996089#comment-14996089 ] Fazlan Nazeem commented on SPARK-8545: -- The current pmml models generated do not spec

[jira] [Commented] (SPARK-11582) pmml version attribute missing in the root node

2015-11-08 Thread Fazlan Nazeem (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996081#comment-14996081 ] Fazlan Nazeem commented on SPARK-11582: --- I have sent a pull request to fix the issu

[jira] [Commented] (SPARK-8545) PMML improvement umbrella

2015-11-08 Thread Fazlan Nazeem (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996080#comment-14996080 ] Fazlan Nazeem commented on SPARK-8545: -- The current pmml models generated do not spec

[jira] [Created] (SPARK-11582) pmml version attribute missing in the root node

2015-11-08 Thread Fazlan Nazeem (JIRA)
Fazlan Nazeem created SPARK-11582: - Summary: pmml version attribute missing in the root node Key: SPARK-11582 URL: https://issues.apache.org/jira/browse/SPARK-11582 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-11453) append data to partitioned table will messes up the result

2015-11-08 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-11453. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9408 [https://github.com/a

[jira] [Resolved] (SPARK-11564) Dataset Java API

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11564. - Resolution: Fixed Fix Version/s: 1.6.0 > Dataset Java API > > >

[jira] [Commented] (SPARK-11564) Dataset Java API

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996041#comment-14996041 ] Apache Spark commented on SPARK-11564: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-9830) Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9830: --- Assignee: Apache Spark (was: Yin Huai) > Remove AggregateExpression1 and Aggregate Operator

[jira] [Assigned] (SPARK-9830) Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9830: --- Assignee: Yin Huai (was: Apache Spark) > Remove AggregateExpression1 and Aggregate Operator

[jira] [Commented] (SPARK-9830) Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996031#comment-14996031 ] Apache Spark commented on SPARK-9830: - User 'yhuai' has created a pull request for thi

[jira] [Commented] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14996026#comment-14996026 ] Hyukjin Kwon commented on SPARK-10113: -- [~lian cheng] Just to double check.., Could

[jira] [Updated] (SPARK-11574) Spark should support StatsD sink out of box

2015-11-08 Thread Xiaofeng Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaofeng Lin updated SPARK-11574: - Affects Version/s: (was: 1.5.1) 1.5.2 > Spark should support StatsD si

[jira] [Updated] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Brian Webb (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brian Webb updated SPARK-11581: --- Priority: Trivial (was: Major) > Example mllib code in documentation incorrectly computes MSE >

[jira] [Created] (SPARK-11581) Example mllib code in documentation incorrectly computes MSE

2015-11-08 Thread Brian Webb (JIRA)
Brian Webb created SPARK-11581: -- Summary: Example mllib code in documentation incorrectly computes MSE Key: SPARK-11581 URL: https://issues.apache.org/jira/browse/SPARK-11581 Project: Spark Iss

[jira] [Comment Edited] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995992#comment-14995992 ] Hyukjin Kwon edited comment on SPARK-10113 at 11/9/15 3:50 AM:

[jira] [Commented] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995992#comment-14995992 ] Hyukjin Kwon commented on SPARK-10113: -- I think I can work on this but we need to ma

[jira] [Commented] (SPARK-11497) PySpark RowMatrix Constructor Has Type Erasure Issue

2015-11-08 Thread Mike Dusenberry (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995990#comment-14995990 ] Mike Dusenberry commented on SPARK-11497: - So far, I've only encountered it as an

[jira] [Updated] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-08 Thread Yadong Qi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yadong Qi updated SPARK-11580: -- Description: I do the SQL as below: {code} cache table src as select * from src distribute by key; sele

[jira] [Created] (SPARK-11580) Just do final aggregation when there is no Exchange

2015-11-08 Thread Yadong Qi (JIRA)
Yadong Qi created SPARK-11580: - Summary: Just do final aggregation when there is no Exchange Key: SPARK-11580 URL: https://issues.apache.org/jira/browse/SPARK-11580 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-11579) Method SGDOptimizer and LBFGSOptimizer in FeedForwardTrainer should not create new optimizer every time they got invoked

2015-11-08 Thread yuhao yang (JIRA)
yuhao yang created SPARK-11579: -- Summary: Method SGDOptimizer and LBFGSOptimizer in FeedForwardTrainer should not create new optimizer every time they got invoked Key: SPARK-11579 URL: https://issues.apache.org/jira/

[jira] [Assigned] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11578: Assignee: Apache Spark (was: Michael Armbrust) > User facing api for typed aggregation >

[jira] [Commented] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995968#comment-14995968 ] Apache Spark commented on SPARK-11578: -- User 'marmbrus' has created a pull request f

[jira] [Assigned] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11578: Assignee: Michael Armbrust (was: Apache Spark) > User facing api for typed aggregation >

[jira] [Created] (SPARK-11578) User facing api for typed aggregation

2015-11-08 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-11578: Summary: User facing api for typed aggregation Key: SPARK-11578 URL: https://issues.apache.org/jira/browse/SPARK-11578 Project: Spark Issue Type: Sub

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-08 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995954#comment-14995954 ] Sun Rui commented on SPARK-11339: - yes > Document the list of functions in R base packag

[jira] [Comment Edited] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995922#comment-14995922 ] Hyukjin Kwon edited comment on SPARK-9557 at 11/9/15 2:24 AM: --

[jira] [Assigned] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9557: --- Assignee: Apache Spark (was: Cheng Lian) > Refactor ParquetFilterSuite and remove old Parque

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995942#comment-14995942 ] Apache Spark commented on SPARK-9557: - User 'HyukjinKwon' has created a pull request f

[jira] [Assigned] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9557: --- Assignee: Cheng Lian (was: Apache Spark) > Refactor ParquetFilterSuite and remove old Parque

[jira] [Closed] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-11-08 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Alexander Spitzer closed SPARK-11415. - Resolution: Not A Problem > Catalyst DateType Shifts Input Data by Local

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-11-08 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995934#comment-14995934 ] Russell Alexander Spitzer commented on SPARK-11415: --- I re-read a bunch

[jira] [Commented] (SPARK-11568) confuse configuration: spark.local.dir

2015-11-08 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995930#comment-14995930 ] xukun commented on SPARK-11568: --- spark-default.xml is client configuration. I think executo

[jira] [Comment Edited] (SPARK-11568) confuse configuration: spark.local.dir

2015-11-08 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995930#comment-14995930 ] xukun edited comment on SPARK-11568 at 11/9/15 2:04 AM: spark-def

[jira] [Assigned] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11562: Assignee: Apache Spark > Provide user an option to init SQLContext or HiveContext in spark

[jira] [Commented] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995928#comment-14995928 ] Apache Spark commented on SPARK-11562: -- User 'xguo27' has created a pull request for

[jira] [Assigned] (SPARK-11562) Provide user an option to init SQLContext or HiveContext in spark shell

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11562: Assignee: (was: Apache Spark) > Provide user an option to init SQLContext or HiveConte

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995922#comment-14995922 ] Hyukjin Kwon commented on SPARK-9557: - But I would like to just add a just little corr

[jira] [Commented] (SPARK-11415) Catalyst DateType Shifts Input Data by Local Timezone

2015-11-08 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995915#comment-14995915 ] Russell Alexander Spitzer commented on SPARK-11415: --- Looks like there a

[jira] [Commented] (SPARK-9557) Refactor ParquetFilterSuite and remove old ParquetFilters code

2015-11-08 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995912#comment-14995912 ] Hyukjin Kwon commented on SPARK-9557: - This is done by https://github.com/apache/spark

[jira] [Commented] (SPARK-11570) ambiguous hostname resolving during startup

2015-11-08 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995905#comment-14995905 ] Konstantin Boudnik commented on SPARK-11570: Doing what the script does might

[jira] [Resolved] (SPARK-4359) Empty classifier in "avro-mapred" is misinterpreted in SBT

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-4359. --- Resolution: Incomplete > Empty classifier in "avro-mapred" is misinterpreted in SBT >

[jira] [Resolved] (SPARK-6783) Add timing and test output for PR tests

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-6783. --- Resolution: Incomplete > Add timing and test output for PR tests > ---

[jira] [Resolved] (SPARK-5866) pyspark read from s3

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5866. --- Resolution: Incomplete > pyspark read from s3 > > > Key: SPARK-58

[jira] [Commented] (SPARK-11081) Shade Jersey dependency to work around the compatibility issue with Jersey2

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995883#comment-14995883 ] Josh Rosen commented on SPARK-11081: I wonder how much work it would be to just remov

[jira] [Resolved] (SPARK-5541) Allow running Maven or SBT in run-tests

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-5541. --- Resolution: Fixed Assignee: (was: Nicholas Chammas) Fix Version/s: 1.4.0 Resolving

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995880#comment-14995880 ] Josh Rosen commented on SPARK-3873: --- The upstream Scalastyle patch has been merged but w

[jira] [Resolved] (SPARK-7521) Allow all required release credentials to be specified with env vars

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7521. --- Resolution: Fixed Resolving as fixed now that the new release scripts have been merged into Spark. >

[jira] [Updated] (SPARK-9884) Submission scripts are broken on ec2 clusters started with spark-ec2 with private IP's

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9884: -- Component/s: (was: Project Infra) > Submission scripts are broken on ec2 clusters started with spark

[jira] [Assigned] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-4216: - Assignee: Josh Rosen > Eliminate duplicate Jenkins GitHub posts from AMPLab > ---

[jira] [Closed] (SPARK-4216) Eliminate duplicate Jenkins GitHub posts from AMPLab

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen closed SPARK-4216. - Resolution: Won't Fix Closing as "Won't Fix" for now because I don't think that this JIRA is actionable a

[jira] [Resolved] (SPARK-9110) Refactor dev/tests/* scripts into Python

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9110. --- Resolution: Won't Fix > Refactor dev/tests/* scripts into Python > ---

[jira] [Commented] (SPARK-9110) Refactor dev/tests/* scripts into Python

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995877#comment-14995877 ] Josh Rosen commented on SPARK-9110: --- Meh, probably not super important. Those scripts th

[jira] [Resolved] (SPARK-7016) Refactor dev/run-tests(-jenkins) from Bash to Python

2015-11-08 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-7016. --- Resolution: Done > Refactor dev/run-tests(-jenkins) from Bash to Python >

[jira] [Commented] (SPARK-11530) Return eigenvalues with PCA model

2015-11-08 Thread Maciej Szymkiewicz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995874#comment-14995874 ] Maciej Szymkiewicz commented on SPARK-11530: It should actually target MLlib,

[jira] [Assigned] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11577: Assignee: Apache Spark > Suppress stacktraces in bin/spark-sql for AnalysisExceptions > --

[jira] [Commented] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995860#comment-14995860 ] Apache Spark commented on SPARK-11577: -- User 'dilipbiswal' has created a pull reques

[jira] [Assigned] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11577: Assignee: (was: Apache Spark) > Suppress stacktraces in bin/spark-sql for AnalysisExce

[jira] [Created] (SPARK-11577) Suppress stacktraces in bin/spark-sql for AnalysisExceptions

2015-11-08 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-11577: Summary: Suppress stacktraces in bin/spark-sql for AnalysisExceptions Key: SPARK-11577 URL: https://issues.apache.org/jira/browse/SPARK-11577 Project: Spark

[jira] [Assigned] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11573: Assignee: Apache Spark > correct 'reflective access of structural type member method shoul

[jira] [Commented] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995859#comment-14995859 ] Apache Spark commented on SPARK-11573: -- User 'gliptak' has created a pull request fo

[jira] [Assigned] (SPARK-11573) correct 'reflective access of structural type member method should be enabled' Scala warnings

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11573: Assignee: (was: Apache Spark) > correct 'reflective access of structural type member m

[jira] [Commented] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995838#comment-14995838 ] Apache Spark commented on SPARK-9865: - User 'felixcheung' has created a pull request f

[jira] [Assigned] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9865: --- Assignee: (was: Apache Spark) > Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

[jira] [Assigned] (SPARK-9865) Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9865: --- Assignee: Apache Spark > Flaky SparkR test: test_sparkSQL.R: sample on a DataFrame >

[jira] [Commented] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995834#comment-14995834 ] Apache Spark commented on SPARK-10838: -- User 'gatorsmile' has created a pull request

[jira] [Commented] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995835#comment-14995835 ] Apache Spark commented on SPARK-11576: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11576: Assignee: (was: Apache Spark) > [SQL] Incorrect results when using the nested self-joi

[jira] [Assigned] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11576: Assignee: Apache Spark > [SQL] Incorrect results when using the nested self-join > ---

[jira] [Assigned] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10838: Assignee: Apache Spark > Repeat to join one DataFrame twice,there will be AnalysisExceptio

[jira] [Assigned] (SPARK-10838) Repeat to join one DataFrame twice,there will be AnalysisException.

2015-11-08 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10838: Assignee: (was: Apache Spark) > Repeat to join one DataFrame twice,there will be Analy

[jira] [Created] (SPARK-11576) [SQL] Incorrect results when using the nested self-join

2015-11-08 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11576: --- Summary: [SQL] Incorrect results when using the nested self-join Key: SPARK-11576 URL: https://issues.apache.org/jira/browse/SPARK-11576 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11575) HiveContext fails to initialize under Java/Windows

2015-11-08 Thread Ali Beydoun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995815#comment-14995815 ] Ali Beydoun commented on SPARK-11575: - Thanks for pointing out that thread. I've alre

[jira] [Commented] (SPARK-11339) Document the list of functions in R base package that are masked by functions with same name in SparkR

2015-11-08 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995810#comment-14995810 ] Felix Cheung commented on SPARK-11339: -- [~sunrui] [~shivaram] Is this the list? {co

[jira] [Resolved] (SPARK-11554) add map/flatMap to GroupedDataset

2015-11-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11554. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9521 [http

[jira] [Updated] (SPARK-11554) add map/flatMap to GroupedDataset

2015-11-08 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11554: - Assignee: Wenchen Fan > add map/flatMap to GroupedDataset > -

[jira] [Commented] (SPARK-11575) HiveContext fails to initialize under Java/Windows

2015-11-08 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995802#comment-14995802 ] Sean Owen commented on SPARK-11575: --- There have been a few discussions on this, soundin

[jira] [Updated] (SPARK-6932) A Prototype of Parameter Server

2015-11-08 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6932: --- Target Version/s: (was: 2+) > A Prototype of Parameter Server > --- > >

  1   2   >