[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240047#comment-15240047 ] Apache Spark commented on SPARK-14560: -- User 'squito' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14560) Cooperative Memory Management for Spillables

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14560: Assignee: Apache Spark (was: Imran Rashid) > Cooperative Memory Management for

[jira] [Assigned] (SPARK-14560) Cooperative Memory Management for Spillables

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14560: Assignee: Imran Rashid (was: Apache Spark) > Cooperative Memory Management for

[jira] [Commented] (SPARK-10574) HashingTF should use MurmurHash3

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240044#comment-15240044 ] Joseph K. Bradley commented on SPARK-10574: --- Yeah, I'd like to prioritize switching to

[jira] [Commented] (SPARK-14209) Application failure during preemption.

2016-04-13 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240040#comment-15240040 ] Miles Crawford commented on SPARK-14209: Just had a very similar error when a host was lost:

[jira] [Created] (SPARK-14608) transformSchema needs better documentation

2016-04-13 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14608: - Summary: transformSchema needs better documentation Key: SPARK-14608 URL: https://issues.apache.org/jira/browse/SPARK-14608 Project: Spark Issue

[jira] [Updated] (SPARK-14445) Show columns/partitions

2016-04-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Assignee: Dilip Biswal > Show columns/partitions > --- > > Key:

[jira] [Updated] (SPARK-14445) Support native execution of SHOW COLUMNS and SHOW PARTITIONS command

2016-04-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-14118 > Support native execution of

[jira] [Updated] (SPARK-14445) Show columns/partitions

2016-04-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Summary: Show columns/partitions (was: show columns/partitions) > Show columns/partitions >

[jira] [Updated] (SPARK-14445) show columns/partitions

2016-04-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14445: -- Summary: show columns/partitions (was: Support native execution of SHOW COLUMNS and SHOW PARTITIONS

[jira] [Commented] (SPARK-13434) Reduce Spark RandomForest memory footprint

2016-04-13 Thread Shirish Tatikonda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15240020#comment-15240020 ] Shirish Tatikonda commented on SPARK-13434: --- [~josephkb] Just curious if there is any plan set

[jira] [Resolved] (SPARK-14472) Cleanup PySpark-ML Java wrapper classes so that JavaWrapper will inherit from JavaCallable

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14472. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12304

[jira] [Resolved] (SPARK-13089) spark.ml Naive Bayes user guide

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-13089. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11015

[jira] [Resolved] (SPARK-14509) Add python CountVectorizerExample

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14509. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11917

[jira] [Created] (SPARK-14607) Partition pruning is case sensitive even with HiveContext

2016-04-13 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14607: -- Summary: Partition pruning is case sensitive even with HiveContext Key: SPARK-14607 URL: https://issues.apache.org/jira/browse/SPARK-14607 Project: Spark Issue

[jira] [Resolved] (SPARK-14375) Unit test for spark.ml KMeansSummary

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14375. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12254

[jira] [Resolved] (SPARK-14461) GLM training summaries should provide solver

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14461. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12253

[jira] [Resolved] (SPARK-10386) Model import/export for PrefixSpan

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10386. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10664

[jira] [Assigned] (SPARK-14605) Python spark.ml classes should use unicode uid

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14605: Assignee: Joseph K. Bradley (was: Apache Spark) > Python spark.ml classes should use

[jira] [Assigned] (SPARK-14605) Python spark.ml classes should use unicode uid

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14605: Assignee: Apache Spark (was: Joseph K. Bradley) > Python spark.ml classes should use

[jira] [Commented] (SPARK-14605) Python spark.ml classes should use unicode uid

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239945#comment-15239945 ] Apache Spark commented on SPARK-14605: -- User 'jkbradley' has created a pull request for this issue:

[jira] [Resolved] (SPARK-14581) Improve filter push down

2016-04-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-14581. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12342

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

2016-04-13 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239927#comment-15239927 ] Steve Loughran commented on SPARK-11157: thanks. Although it's not directly a YARN bug, where

[jira] [Commented] (SPARK-14548) Support !> and !< operator in Spark SQL

2016-04-13 Thread Jia Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239894#comment-15239894 ] Jia Li commented on SPARK-14548: Microsoft SQL Server, IBM DB2 and Sybase Adaptive Server support them.

[jira] [Created] (SPARK-14606) Different maxBins value for categorical and continuous features in RandomForest implementation.

2016-04-13 Thread Rahul Tanwani (JIRA)
Rahul Tanwani created SPARK-14606: - Summary: Different maxBins value for categorical and continuous features in RandomForest implementation. Key: SPARK-14606 URL: https://issues.apache.org/jira/browse/SPARK-14606

[jira] [Updated] (SPARK-14499) Add tests to make sure drop partitions of an external table will not delete data

2016-04-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-14499: -- Assignee: Xiao Li > Add tests to make sure drop partitions of an external table will not delete >

[jira] [Assigned] (SPARK-14441) Consolidate DDL tests

2016-04-13 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or reassigned SPARK-14441: - Assignee: Andrew Or > Consolidate DDL tests > - > > Key:

[jira] [Created] (SPARK-14605) Python spark.ml classes should use unicode uid

2016-04-13 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14605: - Summary: Python spark.ml classes should use unicode uid Key: SPARK-14605 URL: https://issues.apache.org/jira/browse/SPARK-14605 Project: Spark

[jira] [Commented] (SPARK-12154) Upgrade to Jersey 2

2016-04-13 Thread David Wood (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239871#comment-15239871 ] David Wood commented on SPARK-12154: Just some experience noted here. I'm running tomcat 7 with

[jira] [Closed] (SPARK-14590) Update pull request template with link to jira

2016-04-13 Thread Luciano Resende (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luciano Resende closed SPARK-14590. --- Resolution: Won't Fix > Update pull request template with link to jira >

[jira] [Commented] (SPARK-14489) RegressionEvaluator returns NaN for ALS in Spark ml

2016-04-13 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239847#comment-15239847 ] Nick Pentreath commented on SPARK-14489: In the live setting you definitely want to recommend

[jira] [Commented] (SPARK-14299) Scala ML examples code merge and clean up

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239802#comment-15239802 ] Apache Spark commented on SPARK-14299: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Commented] (SPARK-14571) Log instrumentation in ALS

2016-04-13 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239794#comment-15239794 ] Timothy Hunter commented on SPARK-14571: SPARK-14568 has been merged, so it should easy to follow

[jira] [Resolved] (SPARK-6725) Model export/import for Pipeline API (Scala)

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-6725. -- Resolution: Fixed Fix Version/s: 2.0.0 I'm marking this complete since we now

[jira] [Resolved] (SPARK-13783) Model export/import for spark.ml: GBTs

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-13783. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12230

[jira] [Commented] (SPARK-14570) Log instrumentation in Random forests

2016-04-13 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239775#comment-15239775 ] Timothy Hunter commented on SPARK-14570: SPARK-14568 has been merged, so it should easy to follow

[jira] [Resolved] (SPARK-14598) Can spark-mllib upgrade to Jersey 2.x

2016-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14598. --- Resolution: Duplicate Have a look through JIRA first please > Can spark-mllib upgrade to Jersey 2.x

[jira] [Commented] (SPARK-14569) Log instrumentation in KMeans

2016-04-13 Thread Timothy Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239751#comment-15239751 ] Timothy Hunter commented on SPARK-14569: SPARK-14568 has been merged, so it should easy to follow

[jira] [Created] (SPARK-14604) Modify design of ML model summaries

2016-04-13 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-14604: - Summary: Modify design of ML model summaries Key: SPARK-14604 URL: https://issues.apache.org/jira/browse/SPARK-14604 Project: Spark Issue Type:

[jira] [Updated] (SPARK-14461) GLM training summaries should provide solver

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14461: -- Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target

[jira] [Resolved] (SPARK-14388) Create Table

2016-04-13 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14388. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12271

[jira] [Resolved] (SPARK-14568) Log instrumentation in logistic regression as a first task

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-14568. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12331

[jira] [Commented] (SPARK-14603) SessionCatalog needs to check if a metadata operation is valid

2016-04-13 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239718#comment-15239718 ] Xiao Li commented on SPARK-14603: - Sure, will do it. Thanks! > SessionCatalog needs to check if a

[jira] [Assigned] (SPARK-14601) Minor doc/usage changes related to removal of Spark assembly

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14601: Assignee: Apache Spark > Minor doc/usage changes related to removal of Spark assembly >

[jira] [Commented] (SPARK-14601) Minor doc/usage changes related to removal of Spark assembly

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239710#comment-15239710 ] Apache Spark commented on SPARK-14601: -- User 'markgrover' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14601) Minor doc/usage changes related to removal of Spark assembly

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14601: Assignee: (was: Apache Spark) > Minor doc/usage changes related to removal of Spark

[jira] [Commented] (SPARK-11157) Allow Spark to be built without assemblies

2016-04-13 Thread Sebastian Kochman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239708#comment-15239708 ] Sebastian Kochman commented on SPARK-11157: --- I have filed a Spark bug:

[jira] [Created] (SPARK-14602) [YARN+Windows] Setting SPARK_YARN_CACHE_FILES exceeds command line length limit on Windows

2016-04-13 Thread Sebastian Kochman (JIRA)
Sebastian Kochman created SPARK-14602: - Summary: [YARN+Windows] Setting SPARK_YARN_CACHE_FILES exceeds command line length limit on Windows Key: SPARK-14602 URL:

[jira] [Created] (SPARK-14603) SessionCatalog needs to check if a metadata operation is valid

2016-04-13 Thread Yin Huai (JIRA)
Yin Huai created SPARK-14603: Summary: SessionCatalog needs to check if a metadata operation is valid Key: SPARK-14603 URL: https://issues.apache.org/jira/browse/SPARK-14603 Project: Spark

[jira] [Created] (SPARK-14601) Minor doc/usage changes related to removal of Spark assembly

2016-04-13 Thread Mark Grover (JIRA)
Mark Grover created SPARK-14601: --- Summary: Minor doc/usage changes related to removal of Spark assembly Key: SPARK-14601 URL: https://issues.apache.org/jira/browse/SPARK-14601 Project: Spark

[jira] [Commented] (SPARK-14600) Push predicates through Expand

2016-04-13 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239688#comment-15239688 ] Davies Liu commented on SPARK-14600: cc [~cloud_fan] > Push predicates through Expand >

[jira] [Commented] (SPARK-14306) PySpark ml.classification OneVsRest support export/import

2016-04-13 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239678#comment-15239678 ] Xusen Yin commented on SPARK-14306: --- Yes, but blocked by this

[jira] [Commented] (SPARK-14389) OOM during BroadcastNestedLoopJoin

2016-04-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239687#comment-15239687 ] Cheng Lian commented on SPARK-14389: Exception thrown by UnsafeRow.copy() inside BNL join doesn't

[jira] [Created] (SPARK-14600) Push predicates through Expand

2016-04-13 Thread Davies Liu (JIRA)
Davies Liu created SPARK-14600: -- Summary: Push predicates through Expand Key: SPARK-14600 URL: https://issues.apache.org/jira/browse/SPARK-14600 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-14599) BaggedPoint should support weighted instances.

2016-04-13 Thread Seth Hendrickson (JIRA)
Seth Hendrickson created SPARK-14599: Summary: BaggedPoint should support weighted instances. Key: SPARK-14599 URL: https://issues.apache.org/jira/browse/SPARK-14599 Project: Spark Issue

[jira] [Commented] (SPARK-14599) BaggedPoint should support weighted instances.

2016-04-13 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239685#comment-15239685 ] Seth Hendrickson commented on SPARK-14599: -- I will submit a PR for this shortly. > BaggedPoint

[jira] [Commented] (SPARK-14598) Can spark-mllib upgrade to Jersey 2.x

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239682#comment-15239682 ] Joseph K. Bradley commented on SPARK-14598: --- I don't think MLlib uses Jersey, but core does.

[jira] [Updated] (SPARK-14598) Can spark-mllib upgrade to Jersey 2.x

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-14598: -- Component/s: (was: MLlib) Spark Core Build > Can

[jira] [Commented] (SPARK-14306) PySpark ml.classification OneVsRest support export/import

2016-04-13 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239673#comment-15239673 ] Joseph K. Bradley commented on SPARK-14306: --- Ping! Are you still working on this? > PySpark

[jira] [Commented] (SPARK-14495) Distinct aggregation cannot be used in the having clause

2016-04-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239674#comment-15239674 ] Cheng Lian commented on SPARK-14495: This ticket is for branch-1.6. > Distinct aggregation cannot be

[jira] [Commented] (SPARK-13253) Error aliasing array columns.

2016-04-13 Thread Rakesh Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239668#comment-15239668 ] Rakesh Chalasani commented on SPARK-13253: -- Hi [~cloud_fan], just checked it on master. This is

[jira] [Closed] (SPARK-13253) Error aliasing array columns.

2016-04-13 Thread Rakesh Chalasani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Chalasani closed SPARK-13253. Resolution: Resolved > Error aliasing array columns. > - > >

[jira] [Commented] (SPARK-14516) Clustering evaluator

2016-04-13 Thread Ahmed Kamal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239652#comment-15239652 ] Ahmed Kamal commented on SPARK-14516: - I will go through the Mlib code to familiarize myself with its

[jira] [Created] (SPARK-14598) Can spark-mllib upgrade to Jersey 2.x

2016-04-13 Thread David Wood (JIRA)
David Wood created SPARK-14598: -- Summary: Can spark-mllib upgrade to Jersey 2.x Key: SPARK-14598 URL: https://issues.apache.org/jira/browse/SPARK-14598 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13753) Column nullable is derived incorrectly

2016-04-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239637#comment-15239637 ] Cheng Lian commented on SPARK-13753: [~jingweilu] Could you please provide the schema of tables

[jira] [Commented] (SPARK-14463) read.text broken for partitioned tables

2016-04-13 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239630#comment-15239630 ] Reynold Xin commented on SPARK-14463: - The problem is that the return type is String, and as a result

[jira] [Commented] (SPARK-14463) read.text broken for partitioned tables

2016-04-13 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239617#comment-15239617 ] Cheng Lian commented on SPARK-14463: Seems that this is because {{buildReader()}} doesn't append

[jira] [Commented] (SPARK-14139) Dataset loses nullability in operations with RowEncoder

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239613#comment-15239613 ] Apache Spark commented on SPARK-14139: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-14585) Provide accessor methods for Pipeline stages

2016-04-13 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239595#comment-15239595 ] yuhao yang commented on SPARK-14585: I think you basically have implemented it... > Provide accessor

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-04-13 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239573#comment-15239573 ] Imran Rashid commented on SPARK-14560: -- Here's a reproduction. This could almost certainly be pared

[jira] [Commented] (SPARK-14434) User guide doc and examples for GaussianMixture in spark.ml

2016-04-13 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239563#comment-15239563 ] Miao Wang commented on SPARK-14434: --- I will work on this once I commit [SPARK-14433] PySpark ml

[jira] [Commented] (SPARK-14560) Cooperative Memory Management for Spillables

2016-04-13 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239559#comment-15239559 ] Imran Rashid commented on SPARK-14560: -- After some doing some more testing, I realized my "fix"

[jira] [Commented] (SPARK-14433) PySpark ml GaussianMixture

2016-04-13 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239549#comment-15239549 ] Miao Wang commented on SPARK-14433: --- Coding 70% completed. Designing test cases. > PySpark ml

[jira] [Commented] (SPARK-14388) Create Table

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239535#comment-15239535 ] Apache Spark commented on SPARK-14388: -- User 'yhuai' has created a pull request for this issue:

[jira] [Commented] (SPARK-14154) Simplify the implementation for Kolmogorov–Smirnov test

2016-04-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239531#comment-15239531 ] Xiangrui Meng commented on SPARK-14154: --- [~yuhaoyan] Thanks for the benchmark! I reverted the

[jira] [Closed] (SPARK-14154) Simplify the implementation for Kolmogorov–Smirnov test

2016-04-13 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-14154. - Resolution: Not A Problem Fix Version/s: (was: 2.0.0) > Simplify the implementation

[jira] [Updated] (SPARK-14572) Update Config Doc to specify -Xms in extraJavaOptions

2016-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14572: -- Priority: Trivial (was: Minor) Fix Version/s: (was: 2.0.0) > Update Config Doc to

[jira] [Assigned] (SPARK-14572) Update Config Doc to specify -Xms in extraJavaOptions

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14572: Assignee: (was: Apache Spark) > Update Config Doc to specify -Xms in extraJavaOptions

[jira] [Commented] (SPARK-14572) Update Config Doc to specify -Xms in extraJavaOptions

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239486#comment-15239486 ] Apache Spark commented on SPARK-14572: -- User 'dhruve' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14572) Update Config Doc to specify -Xms in extraJavaOptions

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14572: Assignee: Apache Spark > Update Config Doc to specify -Xms in extraJavaOptions >

[jira] [Commented] (SPARK-11879) Checkpoint support for DataFrame/Dataset

2016-04-13 Thread Cristian Opris (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239438#comment-15239438 ] Cristian Opris commented on SPARK-11879: Any chance this will be supported given the new SQL on

[jira] [Assigned] (SPARK-14592) Create table like

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14592: Assignee: (was: Apache Spark) > Create table like > - > >

[jira] [Assigned] (SPARK-14592) Create table like

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14592: Assignee: Apache Spark > Create table like > - > > Key:

[jira] [Commented] (SPARK-14592) Create table like

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239437#comment-15239437 ] Apache Spark commented on SPARK-14592: -- User 'viirya' has created a pull request for this issue:

[jira] [Commented] (SPARK-14407) Hide HadoopFsRelation related data source API to execution package

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239424#comment-15239424 ] Apache Spark commented on SPARK-14407: -- User 'liancheng' has created a pull request for this issue:

[jira] [Updated] (SPARK-14565) RandomForest should use parseInt and parseDouble for feature subset size instead of regexes

2016-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14565: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) > RandomForest should use

[jira] [Assigned] (SPARK-14565) RandomForest should use parseInt and parseDouble for feature subset size instead of regexes

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14565: Assignee: Apache Spark (was: Yong Tang) > RandomForest should use parseInt and

[jira] [Commented] (SPARK-14565) RandomForest should use parseInt and parseDouble for feature subset size instead of regexes

2016-04-13 Thread Yong Tang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239396#comment-15239396 ] Yong Tang commented on SPARK-14565: --- Hi [~mengxr], I created a pull request to change regex to parseInt

[jira] [Commented] (SPARK-14565) RandomForest should use parseInt and parseDouble for feature subset size instead of regexes

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239388#comment-15239388 ] Apache Spark commented on SPARK-14565: -- User 'yongtang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-14565) RandomForest should use parseInt and parseDouble for feature subset size instead of regexes

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14565: Assignee: Yong Tang (was: Apache Spark) > RandomForest should use parseInt and

[jira] [Updated] (SPARK-14537) [CORE] SparkContext init hangs if master removes application before backend is ready.

2016-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14537: -- Assignee: Charles Allen > [CORE] SparkContext init hangs if master removes application before backend

[jira] [Resolved] (SPARK-14537) [CORE] SparkContext init hangs if master removes application before backend is ready.

2016-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-14537. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12301

[jira] [Assigned] (SPARK-14154) Simplify the implementation for Kolmogorov–Smirnov test

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14154: Assignee: yuhao yang (was: Apache Spark) > Simplify the implementation for

[jira] [Assigned] (SPARK-14154) Simplify the implementation for Kolmogorov–Smirnov test

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14154: Assignee: Apache Spark (was: yuhao yang) > Simplify the implementation for

[jira] [Commented] (SPARK-13925) Expose R-like summary statistics in SparkR::glm for more family and link functions

2016-04-13 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239345#comment-15239345 ] Yanbo Liang commented on SPARK-13925: - I'm working on it. > Expose R-like summary statistics in

[jira] [Updated] (SPARK-13768) Set hive conf failed use --hiveconf when beeline connect to thriftserver

2016-04-13 Thread Weizhong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weizhong updated SPARK-13768: - Description: 1. Start thriftserver 2. ./bin/beeline -u '...' --hiveconf

[jira] [Comment Edited] (SPARK-13253) Error aliasing array columns.

2016-04-13 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239307#comment-15239307 ] Wenchen Fan edited comment on SPARK-13253 at 4/13/16 2:15 PM: -- Hi

[jira] [Commented] (SPARK-13253) Error aliasing array columns.

2016-04-13 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239307#comment-15239307 ] Wenchen Fan commented on SPARK-13253: - Hi [~rakeshchalasani] , can you try it again? I can't

[jira] [Commented] (SPARK-14154) Simplify the implementation for Kolmogorov–Smirnov test

2016-04-13 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239209#comment-15239209 ] Sean Owen commented on SPARK-14154: --- Ahhh... I see. My fault, I also reviewed and merged it but didn't

[jira] [Commented] (SPARK-13363) Aggregator not working with DataFrame

2016-04-13 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15239182#comment-15239182 ] Apache Spark commented on SPARK-13363: -- User 'cloud-fan' has created a pull request for this issue:

<    1   2   3   >