[jira] [Commented] (SPARK-13337) DataFrame join-on-columns function should support null-safe equal

2016-02-21 Thread Zhong Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156579#comment-15156579 ] Zhong Wang commented on SPARK-13337: Unfortunately no... I use the join-on-columns function to

[jira] [Commented] (SPARK-13418) SQL generation for uncorrelated scalar subqueries

2016-02-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156534#comment-15156534 ] Cheng Lian commented on SPARK-13418: Summary of offline discussion with [~rxin]: Moving {{.sql}} to

[jira] [Commented] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156531#comment-15156531 ] Apache Spark commented on SPARK-13429: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13429: Assignee: Apache Spark > Unify Logistic Regression convergence tolerance of ML & MLlib >

[jira] [Assigned] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13429: Assignee: (was: Apache Spark) > Unify Logistic Regression convergence tolerance of ML

[jira] [Updated] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13429: Description: In order to provide better and consistent result, let's change the default value of

[jira] [Updated] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13429: Description: In order to provide better and consistent result, let's change the default value of

[jira] [Updated] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13429: Description: In order to provide better and consistent result, let's change the default value of

[jira] [Created] (SPARK-13429) Unify Logistic Regression convergence tolerance of ML & MLlib

2016-02-21 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-13429: --- Summary: Unify Logistic Regression convergence tolerance of ML & MLlib Key: SPARK-13429 URL: https://issues.apache.org/jira/browse/SPARK-13429 Project: Spark

[jira] [Commented] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2016-02-21 Thread Ovidiu Marcu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156499#comment-15156499 ] Ovidiu Marcu commented on SPARK-3650: - Is it possible to apply this fix to a 1.5 version? > Triangle

[jira] [Closed] (SPARK-12669) Organize options for default values

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12669. --- Resolution: Won't Fix Alright I'm going to close this as won't fix. I am not sure the gained clarity

[jira] [Commented] (SPARK-13379) MLlib LogisticRegressionWithLBFGS swaps L1 and L2 incorrectly

2016-02-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156469#comment-15156469 ] DB Tsai commented on SPARK-13379: - [~srowen] Thanks. I updated the title as you suggested. > MLlib

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS swaps L1 and L2 incorrectly

2016-02-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-13379: Summary: MLlib LogisticRegressionWithLBFGS swaps L1 and L2 incorrectly (was: MLlib

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-13379: Assignee: Yanbo Liang > MLlib LogisticRegressionWithLBFGS set regularization incorrectly >

[jira] [Resolved] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-13379. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11258

[jira] [Commented] (SPARK-13428) Pushdown Aggregate Functions in Sort into Aggregate

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156457#comment-15156457 ] Apache Spark commented on SPARK-13428: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13428) Pushdown Aggregate Functions in Sort into Aggregate

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13428: Assignee: (was: Apache Spark) > Pushdown Aggregate Functions in Sort into Aggregate >

[jira] [Assigned] (SPARK-13428) Pushdown Aggregate Functions in Sort into Aggregate

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13428: Assignee: Apache Spark > Pushdown Aggregate Functions in Sort into Aggregate >

[jira] [Updated] (SPARK-13428) Pushdown Aggregate Functions in Sort into Aggregate

2016-02-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13428: Description: Spark SQL is unable to resolve the following query. {code} sql( """

[jira] [Created] (SPARK-13428) Pushdown Aggregate Functions in Sort into Aggregate

2016-02-21 Thread Xiao Li (JIRA)
Xiao Li created SPARK-13428: --- Summary: Pushdown Aggregate Functions in Sort into Aggregate Key: SPARK-13428 URL: https://issues.apache.org/jira/browse/SPARK-13428 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13427) Support USING clause in JOIN

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156448#comment-15156448 ] Apache Spark commented on SPARK-13427: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-13427) Support USING clause in JOIN

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13427: Assignee: (was: Apache Spark) > Support USING clause in JOIN >

[jira] [Assigned] (SPARK-13427) Support USING clause in JOIN

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13427: Assignee: Apache Spark > Support USING clause in JOIN > > >

[jira] [Created] (SPARK-13427) Support USING clause in JOIN

2016-02-21 Thread Dilip Biswal (JIRA)
Dilip Biswal created SPARK-13427: Summary: Support USING clause in JOIN Key: SPARK-13427 URL: https://issues.apache.org/jira/browse/SPARK-13427 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13425) Documentation for CSV datasource options

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156445#comment-15156445 ] Reynold Xin commented on SPARK-13425: - I'd wait a little bit and do it at the end when we know what

[jira] [Assigned] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13426: Assignee: (was: Apache Spark) > Remove the support of SIMR cluster manager >

[jira] [Commented] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156441#comment-15156441 ] Apache Spark commented on SPARK-13426: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13426: Assignee: Apache Spark > Remove the support of SIMR cluster manager >

[jira] [Commented] (SPARK-13425) Documentation for CSV datasource options

2016-02-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156433#comment-15156433 ] Hyukjin Kwon commented on SPARK-13425: -- Could I maybe try this as well (based on json documentation

[jira] [Commented] (SPARK-12669) Organize options for default values

2016-02-21 Thread Mohit Jaggi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156430#comment-15156430 ] Mohit Jaggi commented on SPARK-12669: - IMHO, dozen is still a lot and other APIs in spark(not other

[jira] [Updated] (SPARK-12420) Have a built-in CSV data source implementation

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12420: Description: CSV is the most common data format in the "small data" world. It is often the first

[jira] [Updated] (SPARK-12420) Have a built-in CSV data source implementation

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12420: Description: CSV is the most common data format in the "small data" world. It is often the first

[jira] [Resolved] (SPARK-13381) Support for loading CSV with a single function call

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13381. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 > Support for

[jira] [Resolved] (SPARK-13321) Support nested UNION in parser

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13321. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 > Support

[jira] [Commented] (SPARK-13331) Spark network encryption optimization

2016-02-21 Thread Dong Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156410#comment-15156410 ] Dong Chen commented on SPARK-13331: --- Hi, [~srowen], what do you think about above comment? Thanks. >

[jira] [Issue Comment Deleted] (SPARK-13183) Bytebuffers occupy a large amount of heap memory

2016-02-21 Thread dylanzhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dylanzhou updated SPARK-13183: -- Comment: was deleted (was: [~srowen] i donot know this is a memory leak problem, i get heap memory

[jira] [Closed] (SPARK-13183) Bytebuffers occupy a large amount of heap memory

2016-02-21 Thread dylanzhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dylanzhou closed SPARK-13183. - Resolution: Fixed > Bytebuffers occupy a large amount of heap memory >

[jira] [Updated] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13426: Description: Currently there's not so many users who will use SIMR to run Spark, especially in a

[jira] [Updated] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-13426: Issue Type: Sub-task (was: Bug) Parent: SPARK-11806 > Remove the support of SIMR cluster

[jira] [Commented] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156366#comment-15156366 ] Reynold Xin commented on SPARK-13426: - +1 > Remove the support of SIMR cluster manager >

[jira] [Created] (SPARK-13426) Remove the support of SIMR cluster manager

2016-02-21 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-13426: --- Summary: Remove the support of SIMR cluster manager Key: SPARK-13426 URL: https://issues.apache.org/jira/browse/SPARK-13426 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

2016-02-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13114: - Issue Type: Sub-task (was: Bug) Parent: SPARK-12420 >

[jira] [Updated] (SPARK-13137) NullPoingException in schema inference for CSV when the first line is empty

2016-02-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13137: - Issue Type: Sub-task (was: Bug) Parent: SPARK-12420 > NullPoingException in schema

[jira] [Resolved] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-3650. Resolution: Fixed Assignee: Robin East Fix Version/s: 2.0.0 > Triangle Count

[jira] [Updated] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3650: --- Labels: releasenotes (was: release) > Triangle Count handles reverse edges incorrectly >

[jira] [Updated] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3650: --- Labels: release (was: ) > Triangle Count handles reverse edges incorrectly >

[jira] [Resolved] (SPARK-13410) unionAll AnalysisException with DataFrames containing UDT columns.

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13410. - Resolution: Fixed Assignee: Franklyn Dsouza Fix Version/s: 2.0.0 > unionAll

[jira] [Commented] (SPARK-12669) Organize options for default values

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156333#comment-15156333 ] Reynold Xin commented on SPARK-12669: - I'm not sure if we need to namespace this. There isn't that

[jira] [Updated] (SPARK-13425) Documentation for CSV datasource options

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13425: Issue Type: Sub-task (was: Documentation) Parent: SPARK-12420 > Documentation for CSV

[jira] [Updated] (SPARK-13381) Support for loading CSV with a single function call

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13381: Issue Type: Sub-task (was: Improvement) Parent: SPARK-12420 > Support for loading CSV

[jira] [Updated] (SPARK-13425) Documentation for CSV datasource options

2016-02-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13425: - Description: As said https://github.com/apache/spark/pull/11262#discussion_r53508815, CSV

[jira] [Created] (SPARK-13425) Documentation for CSV datasource options

2016-02-21 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-13425: Summary: Documentation for CSV datasource options Key: SPARK-13425 URL: https://issues.apache.org/jira/browse/SPARK-13425 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13271) Better error message if 'path' is not specified

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13271. - Resolution: Fixed Fix Version/s: 2.0.0 > Better error message if 'path' is not specified

[jira] [Resolved] (SPARK-13405) Flaky test: o.a.s.sql.util.ContinuousQueryListenerSuite.event ordering

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13405. - Resolution: Fixed Fix Version/s: 2.0.0 > Flaky test:

[jira] [Resolved] (SPARK-13075) Native database/table system catalog

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13075. - Resolution: Fixed Fix Version/s: 2.0.0 > Native database/table system catalog >

[jira] [Resolved] (SPARK-13080) Implementation of the internal catalog API using Hive

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13080. - Resolution: Fixed Fix Version/s: 2.0.0 > Implementation of the internal catalog API using

[jira] [Assigned] (SPARK-13424) Improve test coverage of EnsureRequirements

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13424: Assignee: Apache Spark > Improve test coverage of EnsureRequirements >

[jira] [Assigned] (SPARK-13424) Improve test coverage of EnsureRequirements

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13424: Assignee: (was: Apache Spark) > Improve test coverage of EnsureRequirements >

[jira] [Commented] (SPARK-13424) Improve test coverage of EnsureRequirements

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156252#comment-15156252 ] Apache Spark commented on SPARK-13424: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13137) NullPoingException in schema inference for CSV when the first line is empty

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13137. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 >

[jira] [Created] (SPARK-13424) Improve test coverage of EnsureRequirements

2016-02-21 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13424: - Summary: Improve test coverage of EnsureRequirements Key: SPARK-13424 URL: https://issues.apache.org/jira/browse/SPARK-13424 Project: Spark Issue

[jira] [Commented] (SPARK-13080) Implementation of the internal catalog API using Hive

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156224#comment-15156224 ] Apache Spark commented on SPARK-13080: -- User 'rxin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13136) Data exchange (shuffle, broadcast) should only be handled by the exchange operator

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13136. - Resolution: Fixed Assignee: Herman van Hovell Fix Version/s: 2.0.0 > Data

[jira] [Resolved] (SPARK-13420) Rename Subquery logical plan to SubqueryAlias

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13420. - Resolution: Fixed Fix Version/s: 2.0.0 > Rename Subquery logical plan to SubqueryAlias >

[jira] [Assigned] (SPARK-13423) Static analysis fixes for 2.x

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13423: Assignee: Apache Spark (was: Sean Owen) > Static analysis fixes for 2.x >

[jira] [Assigned] (SPARK-13423) Static analysis fixes for 2.x

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13423: Assignee: Sean Owen (was: Apache Spark) > Static analysis fixes for 2.x >

[jira] [Commented] (SPARK-13423) Static analysis fixes for 2.x

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156131#comment-15156131 ] Apache Spark commented on SPARK-13423: -- User 'srowen' has created a pull request for this issue:

[jira] [Updated] (SPARK-10561) Provide tooling for auto-generating Spark SQL reference manual

2016-02-21 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-10561: --- Description: Here is the discussion thread: http://search-hadoop.com/m/q3RTtcD20F1o62xE Richard Hillegas

[jira] [Created] (SPARK-13423) Static analysis fixes for 2.x

2016-02-21 Thread Sean Owen (JIRA)
Sean Owen created SPARK-13423: - Summary: Static analysis fixes for 2.x Key: SPARK-13423 URL: https://issues.apache.org/jira/browse/SPARK-13423 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-13422) Use HashedRelation instead of HashSet in Left Semi Joins

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13422: Assignee: Apache Spark > Use HashedRelation instead of HashSet in Left Semi Joins >

[jira] [Assigned] (SPARK-13422) Use HashedRelation instead of HashSet in Left Semi Joins

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13422: Assignee: (was: Apache Spark) > Use HashedRelation instead of HashSet in Left Semi

[jira] [Commented] (SPARK-13422) Use HashedRelation instead of HashSet in Left Semi Joins

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156112#comment-15156112 ] Apache Spark commented on SPARK-13422: -- User 'xguo27' has created a pull request for this issue:

[jira] [Commented] (SPARK-7481) Add Hadoop 2.6+ profile to pull in object store FS accessors

2016-02-21 Thread Yardena (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156101#comment-15156101 ] Yardena commented on SPARK-7481: +1, please add this. lib/* approach would be great, or a profile like

[jira] [Updated] (SPARK-13310) Missing Sorting Columns in Generate

2016-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13310: -- Assignee: Xiao Li > Missing Sorting Columns in Generate > --- > >

[jira] [Updated] (SPARK-12799) Simplify various string output for expressions

2016-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-12799: -- Assignee: Cheng Lian > Simplify various string output for expressions >

[jira] [Updated] (SPARK-13248) Remove depecrated Streaming APIs

2016-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13248: -- Assignee: Luciano Resende Priority: Minor (was: Major) > Remove depecrated Streaming APIs >

[jira] [Resolved] (SPARK-13248) Remove depecrated Streaming APIs

2016-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13248. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11139

[jira] [Resolved] (SPARK-12799) Simplify various string output for expressions

2016-02-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12799. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10757

[jira] [Updated] (SPARK-13421) Make output of a SparkPlan configurable

2016-02-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-13421: -- Description: A SparkPlan currently outputs a iterator of {{InternalRow}}'s. This works

[jira] [Created] (SPARK-13422) Use HashedRelation instead of HashSet in Left Semi Joins

2016-02-21 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13422: - Summary: Use HashedRelation instead of HashSet in Left Semi Joins Key: SPARK-13422 URL: https://issues.apache.org/jira/browse/SPARK-13422 Project: Spark

[jira] [Created] (SPARK-13421) Make output of a SparkPlan configurable

2016-02-21 Thread Herman van Hovell (JIRA)
Herman van Hovell created SPARK-13421: - Summary: Make output of a SparkPlan configurable Key: SPARK-13421 URL: https://issues.apache.org/jira/browse/SPARK-13421 Project: Spark Issue

[jira] [Commented] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155991#comment-15155991 ] Apache Spark commented on SPARK-3650: - User 'insidedctm' has created a pull request for this issue:

[jira] [Updated] (SPARK-13416) Add positive check for option 'numIter' in StronglyConnectedComponents

2016-02-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13416: -- Priority: Trivial (was: Minor) Issue Type: Improvement (was: Bug) > Add positive check for

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization map as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization map as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization mapping as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regParam setting as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: We should correct MLlib LogisticRegressionWithLBFGS regularization setting as:

[jira] [Updated] (SPARK-13379) MLlib LogisticRegressionWithLBFGS set regularization incorrectly

2016-02-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-13379: Description: MLlib LogisticRegressionWithLBFGS set regularization incorrectly, we should (was:

[jira] [Resolved] (SPARK-13416) Add positive check for option 'numIter' in StronglyConnectedComponents

2016-02-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13416. - Resolution: Fixed Assignee: zhengruifeng Fix Version/s: 2.0.0 > Add positive

[jira] [Assigned] (SPARK-13420) Rename Subquery logical plan to SubqueryAlias

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13420: Assignee: Reynold Xin (was: Apache Spark) > Rename Subquery logical plan to

[jira] [Commented] (SPARK-13420) Rename Subquery logical plan to SubqueryAlias

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155943#comment-15155943 ] Apache Spark commented on SPARK-13420: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13420) Rename Subquery logical plan to SubqueryAlias

2016-02-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13420: Assignee: Apache Spark (was: Reynold Xin) > Rename Subquery logical plan to