[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-22 Thread Venu Palvai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157132#comment-15157132 ] Venu Palvai commented on SPARK-13219: - We have written custom code to handle this through custom

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157097#comment-15157097 ] Sean Owen commented on SPARK-13431: --- Hm I think you're right about that. I also don't see why it would

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157104#comment-15157104 ] Kazuaki Ishizaki commented on SPARK-13431: -- According to AMPLAB's Jenkins, the first failure

[jira] [Comment Edited] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157129#comment-15157129 ] Stavros Kontopoulos edited comment on SPARK-13431 at 2/22/16 3:31 PM:

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157202#comment-15157202 ] Herman van Hovell commented on SPARK-13431: --- [~kiszk] Are you building with Maven or SBT? >

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157208#comment-15157208 ] Kazuaki Ishizaki commented on SPARK-13431: -- I am using mvn, and executed the following command

[jira] [Commented] (SPARK-12532) Join-key Pushdown via Predicate Transitivity

2016-02-22 Thread Venu Palvai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157125#comment-15157125 ] Venu Palvai commented on SPARK-12532: - There is another ticket that is requesting for a similar

[jira] [Commented] (SPARK-13433) The standalone server should limit the count of cores and memory for running Drivers

2016-02-22 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157121#comment-15157121 ] lichenglin commented on SPARK-13433: What I mean is We should set a limit on the total cores for

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157200#comment-15157200 ] Herman van Hovell commented on SPARK-13431: --- Test are currently passing and the if you call

[jira] [Commented] (SPARK-13435) Add Weighted Cohen's kappa to MulticlassMetrics

2016-02-22 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157015#comment-15157015 ] zhengruifeng commented on SPARK-13435: -- I dont think so. Recently, many Competitions use quadratic

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157182#comment-15157182 ] Kazuaki Ishizaki commented on SPARK-13431: -- I succeeded to build Spark by commenting out lines

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Iulian Dragos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157213#comment-15157213 ] Iulian Dragos commented on SPARK-13431: --- Sbt assembly is using a different library, I think it's

[jira] [Commented] (SPARK-13026) Umbrella: Allow user to specify initial model when training

2016-02-22 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157921#comment-15157921 ] holdenk commented on SPARK-13026: - oh wait we can't make subtasks under SPARK-11136 since it is already a

[jira] [Assigned] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12723: Assignee: Apache Spark > Comprehensive SQL generation support for expressions >

[jira] [Commented] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157960#comment-15157960 ] Apache Spark commented on SPARK-12723: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12723: Assignee: (was: Apache Spark) > Comprehensive SQL generation support for expressions

[jira] [Assigned] (SPARK-13440) Option fields in Datasets cause analysis exceptions when resolving columns

2016-02-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reassigned SPARK-13440: Assignee: Michael Armbrust > Option fields in Datasets cause analysis exceptions

[jira] [Created] (SPARK-13441) NullPointerException when either HADOOP_CONF_DIR or YARN_CONF_DIR is not readable

2016-02-22 Thread Terence Yim (JIRA)
Terence Yim created SPARK-13441: --- Summary: NullPointerException when either HADOOP_CONF_DIR or YARN_CONF_DIR is not readable Key: SPARK-13441 URL: https://issues.apache.org/jira/browse/SPARK-13441

[jira] [Created] (SPARK-13442) Make type inference recognize boolean types

2016-02-22 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-13442: Summary: Make type inference recognize boolean types Key: SPARK-13442 URL: https://issues.apache.org/jira/browse/SPARK-13442 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13016) Replace example code in mllib-dimensionality-reduction.md using include_example

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13016. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11132

[jira] [Created] (SPARK-13440) Option fields in Datasets cause analysis exceptions when resolving columns

2016-02-22 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-13440: -- Summary: Option fields in Datasets cause analysis exceptions when resolving columns Key: SPARK-13440 URL: https://issues.apache.org/jira/browse/SPARK-13440 Project:

[jira] [Commented] (SPARK-13219) Pushdown predicate propagation in SparkSQL with join

2016-02-22 Thread Abhinav Chawade (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158046#comment-15158046 ] Abhinav Chawade commented on SPARK-13219: - [~velvia] You can find the patch

[jira] [Resolved] (SPARK-13422) Use HashedRelation instead of HashSet in Left Semi Joins

2016-02-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13422. - Resolution: Fixed Assignee: Xiu (Joe) Guo Fix Version/s: 2.0.0 > Use

[jira] [Commented] (SPARK-13442) Make type inference recognize boolean types

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158060#comment-15158060 ] Apache Spark commented on SPARK-13442: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-13442) Make type inference recognize boolean types

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13442: Assignee: Apache Spark > Make type inference recognize boolean types >

[jira] [Assigned] (SPARK-13442) Make type inference recognize boolean types

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13442: Assignee: (was: Apache Spark) > Make type inference recognize boolean types >

[jira] [Updated] (SPARK-13443) MLlib documentation displays Math Processing Error

2016-02-22 Thread Stephanie Bodoff (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephanie Bodoff updated SPARK-13443: - Attachment: Screen Shot 2016-02-22 at 5.09.30 PM.png > MLlib documentation displays Math

[jira] [Created] (SPARK-13443) MLlib documentation displays Math Processing Error

2016-02-22 Thread Stephanie Bodoff (JIRA)
Stephanie Bodoff created SPARK-13443: Summary: MLlib documentation displays Math Processing Error Key: SPARK-13443 URL: https://issues.apache.org/jira/browse/SPARK-13443 Project: Spark

[jira] [Commented] (SPARK-13241) add long--formatted timestamps to org.apache.spark.status.api.v1.ApplicationAttemptInfo

2016-02-22 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158069#comment-15158069 ] Alex Bozarth commented on SPARK-13241: -- I have a fix for this in the works, PR will come sometime

[jira] [Updated] (SPARK-12546) Writing to partitioned parquet table can fail with OOM

2016-02-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12546: - Labels: releasenotes (was: ) > Writing to partitioned parquet table can fail with OOM >

[jira] [Resolved] (SPARK-12546) Writing to partitioned parquet table can fail with OOM

2016-02-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12546. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-13012) Replace example code in ml-guide.md using include_example

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13012. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11053

[jira] [Commented] (SPARK-13433) The standalone server should limit the count of cores and memory for running Drivers

2016-02-22 Thread lichenglin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157801#comment-15157801 ] lichenglin commented on SPARK-13433: I know the property 'spark.dirver.cores' What I want to limit

[jira] [Created] (SPARK-13438) Remove dash from save output paths

2016-02-22 Thread Peter Ableda (JIRA)
Peter Ableda created SPARK-13438: Summary: Remove dash from save output paths Key: SPARK-13438 URL: https://issues.apache.org/jira/browse/SPARK-13438 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-13398) Move away from deprecated ThreadPoolTaskSupport

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157734#comment-15157734 ] Apache Spark commented on SPARK-13398: -- User 'holdenk' has created a pull request for this issue:

[jira] [Updated] (SPARK-13439) Document that spark.mesos.uris is comma-separated

2016-02-22 Thread Michael Gummelt (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Gummelt updated SPARK-13439: Description:

[jira] [Assigned] (SPARK-13436) Add parameter drop to subsetting operator [

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13436: Assignee: Apache Spark > Add parameter drop to subsetting operator [ >

[jira] [Assigned] (SPARK-13436) Add parameter drop to subsetting operator [

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13436: Assignee: (was: Apache Spark) > Add parameter drop to subsetting operator [ >

[jira] [Commented] (SPARK-13436) Add parameter drop to subsetting operator [

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157867#comment-15157867 ] Apache Spark commented on SPARK-13436: -- User 'mgummelt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13390) Java Spark createDataFrame with List parameter bug

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13390: Assignee: Shixiong Zhu (was: Apache Spark) > Java Spark createDataFrame with List

[jira] [Assigned] (SPARK-13390) Java Spark createDataFrame with List parameter bug

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13390: Assignee: Apache Spark (was: Shixiong Zhu) > Java Spark createDataFrame with List

[jira] [Commented] (SPARK-13390) Java Spark createDataFrame with List parameter bug

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157872#comment-15157872 ] Apache Spark commented on SPARK-13390: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Oliver Pierson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Pierson updated SPARK-13444: --- Description: In certain circumstances, QuantileDiscretizer fails to calculate the correct

[jira] [Updated] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Oliver Pierson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Pierson updated SPARK-13444: --- Description: In certain circumstances, QuantileDiscretizer fails to calculate the correct

[jira] [Resolved] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-13295. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11179

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13322: -- Shepherd: Xiangrui Meng > AFTSurvivalRegression should support feature standardization >

[jira] [Updated] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13295: -- Assignee: Narine Kokhlikyan > ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158132#comment-15158132 ] Dongjoon Hyun commented on SPARK-11381: --- Hi, @yinxusen . I'm interested this. May I assign it to

[jira] [Comment Edited] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158132#comment-15158132 ] Dongjoon Hyun edited comment on SPARK-11381 at 2/23/16 1:55 AM: Hi,

[jira] [Resolved] (SPARK-11624) Spark SQL CLI will set sessionstate twice

2016-02-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11624. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Resolved] (SPARK-11972) [Spark SQL] the value of 'hiveconf' parameter in CLI can't be got after enter spark-sql session

2016-02-22 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11972. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158174#comment-15158174 ] Dongjoon Hyun commented on SPARK-11381: --- Thank you! > Replace example code in

[jira] [Commented] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

2016-02-22 Thread Matt McKnight (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158098#comment-15158098 ] Matt McKnight commented on SPARK-11102: --- The error message is generated from Hadoop:

[jira] [Comment Edited] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

2016-02-22 Thread Matt McKnight (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158098#comment-15158098 ] Matt McKnight edited comment on SPARK-11102 at 2/23/16 1:39 AM: The error

[jira] [Commented] (SPARK-12919) Implement dapply() on DataFrame in SparkR

2016-02-22 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158112#comment-15158112 ] Sun Rui commented on SPARK-12919: - working on this. > Implement dapply() on DataFrame in SparkR >

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158136#comment-15158136 ] Xusen Yin commented on SPARK-11381: --- Yes, pls go ahead. 2016年2月22日星期一,Dongjoon Hyun (JIRA)

[jira] [Assigned] (SPARK-13440) Option fields in Datasets cause analysis exceptions when resolving columns

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13440: Assignee: Michael Armbrust (was: Apache Spark) > Option fields in Datasets cause

[jira] [Commented] (SPARK-13440) Option fields in Datasets cause analysis exceptions when resolving columns

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158145#comment-15158145 ] Apache Spark commented on SPARK-13440: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158176#comment-15158176 ] Dongjoon Hyun commented on SPARK-11381: --- Oh, I have not permission here. Sorry, I was confused,

[jira] [Comment Edited] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158176#comment-15158176 ] Dongjoon Hyun edited comment on SPARK-11381 at 2/23/16 2:38 AM: Oh, I

[jira] [Updated] (SPARK-13295) ML/MLLIB: AFTSurvivalRegression: Improve AFTAggregator - Avoid creating new instances of arrays/vectors for each record

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13295: -- Shepherd: Yanbo Liang Target Version/s: 2.0.0 > ML/MLLIB: AFTSurvivalRegression:

[jira] [Updated] (SPARK-13322) AFTSurvivalRegression should support feature standardization

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-13322: -- Issue Type: Improvement (was: Bug) > AFTSurvivalRegression should support feature

[jira] [Updated] (SPARK-6761) Approximate quantile

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6761: - Assignee: Liang-Chi Hsieh > Approximate quantile > > > Key:

[jira] [Updated] (SPARK-6761) Approximate quantile

2016-02-22 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6761: - Shepherd: Timothy Hunter > Approximate quantile > > > Key:

[jira] [Resolved] (SPARK-13298) DAG visualization does not render correctly for jobs

2016-02-22 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-13298. --- Resolution: Fixed Fix Version/s: 2.0.0 1.6.1 > DAG visualization does not

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-02-22 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158109#comment-15158109 ] Sun Rui commented on SPARK-12922: - [~Narine], yes this depends on

[jira] [Assigned] (SPARK-13440) Option fields in Datasets cause analysis exceptions when resolving columns

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13440: Assignee: Apache Spark (was: Michael Armbrust) > Option fields in Datasets cause

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-22 Thread wziyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158167#comment-15158167 ] wziyong commented on SPARK-13289: - I pull the latest code,and I also met the problem like yours.Did you

[jira] [Commented] (SPARK-12639) Improve Explain for DataSources with Handled Predicate Pushdowns

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158171#comment-15158171 ] Apache Spark commented on SPARK-12639: -- User 'RussellSpitzer' has created a pull request for this

[jira] [Commented] (SPARK-13391) Use Apache Arrow as In-memory columnar store implementation

2016-02-22 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157309#comment-15157309 ] Wes McKinney commented on SPARK-13391: -- I published some analysis on this subject:

[jira] [Comment Edited] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157297#comment-15157297 ] Kazuaki Ishizaki edited comment on SPARK-13431 at 2/22/16 5:17 PM: --- The

[jira] [Commented] (SPARK-10001) Allow Ctrl-C in spark-shell to kill running job

2016-02-22 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157316#comment-15157316 ] Ryan Blue commented on SPARK-10001: --- Sorry about suggesting to fork the discussion. I just want to

[jira] [Commented] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-02-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157302#comment-15157302 ] Xiao Li commented on SPARK-12723: - Let me add the test cases to check if all the expressions can be

[jira] [Commented] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-02-22 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157373#comment-15157373 ] Narine Kokhlikyan commented on SPARK-12922: --- thanks, for creating this jira, [~sunrui] Have you

[jira] [Commented] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157297#comment-15157297 ] Kazuaki Ishizaki commented on SPARK-13431: -- The size of a static initializer method of

[jira] [Comment Edited] (SPARK-12922) Implement gapply() on DataFrame in SparkR

2016-02-22 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157373#comment-15157373 ] Narine Kokhlikyan edited comment on SPARK-12922 at 2/22/16 5:47 PM:

[jira] [Created] (SPARK-13445) Seleting "data" with window function does not work unless aliased (using PARTITION BY)

2016-02-22 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-13445: --- Summary: Seleting "data" with window function does not work unless aliased (using PARTITION BY) Key: SPARK-13445 URL: https://issues.apache.org/jira/browse/SPARK-13445

[jira] [Commented] (SPARK-13197) When trying to select from the data frame which contains the columns with . in it, it is throwing exception.

2016-02-22 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158312#comment-15158312 ] Wenchen Fan commented on SPARK-13197: - I think it's not a bug, but a wrong usage. You should use

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158336#comment-15158336 ] Xusen Yin commented on SPARK-11381: --- Fixed > Replace example code in mllib-linear-methods.md using

[jira] [Updated] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-11381: -- Description: This is similar to SPARK-11289 but for the example code in mllib-linear-methods.md.

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-22 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158355#comment-15158355 ] Kai Jiang commented on SPARK-13289: --- same > Word2Vec generate infinite distances when numIterations>5

[jira] [Commented] (SPARK-8360) Streaming DataFrames

2016-02-22 Thread Linbo (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158377#comment-15158377 ] Linbo commented on SPARK-8360: -- Spark 2.0 on April/May > Streaming DataFrames > > >

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158309#comment-15158309 ] Dongjoon Hyun commented on SPARK-11381: --- Could anyone fix the content of this issue? It seems that

[jira] [Closed] (SPARK-13197) When trying to select from the data frame which contains the columns with . in it, it is throwing exception.

2016-02-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-13197. --- Resolution: Not A Problem As [~cloud_fan] said, this is by design. Please use backticks to quote

[jira] [Updated] (SPARK-13431) Maven build fails due to: Method code too large! in Catalyst

2016-02-22 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-13431: Component/s: (was: Optimizer) > Maven build fails due to: Method code too large! in Catalyst >

[jira] [Commented] (SPARK-11381) Replace example code in mllib-linear-methods.md using include_example

2016-02-22 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158350#comment-15158350 ] Dongjoon Hyun commented on SPARK-11381: --- Oh, fast! Thank you. > Replace example code in

[jira] [Resolved] (SPARK-12723) Comprehensive SQL generation support for expressions

2016-02-22 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12723. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > Comprehensive SQL

[jira] [Comment Edited] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-22 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158355#comment-15158355 ] Kai Jiang edited comment on SPARK-13289 at 2/23/16 6:21 AM: same. Spark-13431

[jira] [Commented] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157398#comment-15157398 ] Apache Spark commented on SPARK-12941: -- User 'thomastechs' has created a pull request for this

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-22 Thread Qi Dai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157401#comment-15157401 ] Qi Dai commented on SPARK-13289: Do you have a runable distribution of the latest master somewhere? I

[jira] [Commented] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-02-22 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157405#comment-15157405 ] Jayadevan M commented on SPARK-12941: - Working with [~thomastechs] for creating oracle docker suite

[jira] [Commented] (SPARK-12941) Spark-SQL JDBC Oracle dialect fails to map string datatypes to Oracle VARCHAR datatype

2016-02-22 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157410#comment-15157410 ] Thomas Sebastian commented on SPARK-12941: -- Submitting the PR with [~jayadevan.m] > Spark-SQL

[jira] [Commented] (SPARK-13289) Word2Vec generate infinite distances when numIterations>5

2016-02-22 Thread Russell Alexander Spitzer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158213#comment-15158213 ] Russell Alexander Spitzer commented on SPARK-13289: --- same > Word2Vec generate infinite

[jira] [Commented] (SPARK-3630) Identify cause of Kryo+Snappy PARSING_ERROR

2016-02-22 Thread cupid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158201#comment-15158201 ] cupid commented on SPARK-3630: -- Hi Josh, I was able to reproduce this error, this error happened when the

[jira] [Commented] (SPARK-13436) Add parameter drop to subsetting operator [

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158202#comment-15158202 ] Apache Spark commented on SPARK-13436: -- User 'olarayej' has created a pull request for this issue:

[jira] [Created] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Oliver Pierson (JIRA)
Oliver Pierson created SPARK-13444: -- Summary: QuantileDiscretizer chooses bad splits on large DataFrames Key: SPARK-13444 URL: https://issues.apache.org/jira/browse/SPARK-13444 Project: Spark

[jira] [Commented] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Oliver Pierson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158235#comment-15158235 ] Oliver Pierson commented on SPARK-13444: I've made the changes in my local fork and can put

[jira] [Assigned] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13444: Assignee: (was: Apache Spark) > QuantileDiscretizer chooses bad splits on large

[jira] [Commented] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Oliver Pierson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158245#comment-15158245 ] Oliver Pierson commented on SPARK-13444: PR submitted > QuantileDiscretizer chooses bad splits

[jira] [Assigned] (SPARK-13444) QuantileDiscretizer chooses bad splits on large DataFrames

2016-02-22 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13444: Assignee: Apache Spark > QuantileDiscretizer chooses bad splits on large DataFrames >

<    1   2   3   >