[jira] [Updated] (SPARK-14639) Add `bround` function in Python/R.

2016-04-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14639: -- Description: This issue aims to expose Scala `bround` function in Python/R API. `bround` funct

[jira] [Updated] (SPARK-14639) Add `bround` function in Python/R.

2016-04-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-14639: -- Description: This issue aims to expose Scala `bround` function in Python/R API. `bround` funct

[jira] [Assigned] (SPARK-14640) @DeveloperApi on PythonUserDefinedType

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14640: Assignee: (was: Apache Spark) > @DeveloperApi on PythonUserDefinedType > -

[jira] [Assigned] (SPARK-14640) @DeveloperApi on PythonUserDefinedType

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14640: Assignee: Apache Spark > @DeveloperApi on PythonUserDefinedType >

[jira] [Commented] (SPARK-14640) @DeveloperApi on PythonUserDefinedType

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241759#comment-15241759 ] Apache Spark commented on SPARK-14640: -- User 'joan38' has created a pull request for

[jira] [Created] (SPARK-14640) @DeveloperApi on PythonUserDefinedType

2016-04-14 Thread Joan Goyeau (JIRA)
Joan Goyeau created SPARK-14640: --- Summary: @DeveloperApi on PythonUserDefinedType Key: SPARK-14640 URL: https://issues.apache.org/jira/browse/SPARK-14640 Project: Spark Issue Type: Task

[jira] [Created] (SPARK-14639) Add `bround` function in Python/R.

2016-04-14 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14639: - Summary: Add `bround` function in Python/R. Key: SPARK-14639 URL: https://issues.apache.org/jira/browse/SPARK-14639 Project: Spark Issue Type: Improvement

[jira] [Comment Edited] (SPARK-14352) approxQuantile should support multi columns

2016-04-14 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241729#comment-15241729 ] Nick Pentreath edited comment on SPARK-14352 at 4/14/16 7:02 PM: --

[jira] [Commented] (SPARK-14352) approxQuantile should support multi columns

2016-04-14 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241729#comment-15241729 ] Nick Pentreath commented on SPARK-14352: This duplicates SPARK-14432 - which did

[jira] [Resolved] (SPARK-13967) Add binary toggle Param to PySpark CountVectorizer

2016-04-14 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath resolved SPARK-13967. Resolution: Fixed Fix Version/s: 2.0.0 > Add binary toggle Param to PySpark CountVec

[jira] [Commented] (SPARK-14638) Threads of Spark Streaming (with Kafka) looses sight of the executor classpath

2016-04-14 Thread Younos Aboulnaga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241714#comment-15241714 ] Younos Aboulnaga commented on SPARK-14638: -- But the same code works when used in

[jira] [Commented] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241701#comment-15241701 ] Apache Spark commented on SPARK-11834: -- User 'JeremyNixon' has created a pull reques

[jira] [Assigned] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11834: Assignee: Xiangrui Meng (was: Apache Spark) > Ignore thresholds in LogisticRegression and

[jira] [Assigned] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11834: Assignee: Apache Spark (was: Xiangrui Meng) > Ignore thresholds in LogisticRegression and

[jira] [Resolved] (SPARK-14592) Create table like

2016-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14592. --- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 Target V

[jira] [Resolved] (SPARK-14558) In ClosureCleaner, clean the outer pointer if it's a REPL line object

2016-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14558. --- Resolution: Fixed Fix Version/s: 2.0.0 Target Version/s: 2.0.0 > In ClosureCleaner,

[jira] [Resolved] (SPARK-14617) Remove deprecated APIs in TaskMetrics

2016-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14617. --- Resolution: Fixed > Remove deprecated APIs in TaskMetrics > - > >

[jira] [Resolved] (SPARK-14619) Track internal accumulators (metrics) by stage attempt rather than stage

2016-04-14 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-14619. --- Resolution: Fixed > Track internal accumulators (metrics) by stage attempt rather than stage > --

[jira] [Resolved] (SPARK-14612) Consolidate the version of dependencies in mllib and mllib-local into one place

2016-04-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-14612. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12390 [https://github.com/ap

[jira] [Updated] (SPARK-14612) Consolidate the version of dependencies in mllib and mllib-local into one place

2016-04-14 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-14612: Assignee: Sean Owen > Consolidate the version of dependencies in mllib and mllib-local into one > place >

[jira] [Commented] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241583#comment-15241583 ] Jeremy commented on SPARK-11834: To follow up, both setThreshold() and setThresholds() cl

[jira] [Commented] (SPARK-14638) Threads of Spark Streaming (with Kafka) looses sight of the executor classpath

2016-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241562#comment-15241562 ] Sean Owen commented on SPARK-14638: --- It doesn't actually mean the class wasn't found --

[jira] [Commented] (SPARK-12279) Requesting a HBase table with kerberos is not working

2016-04-14 Thread Younos Aboulnaga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241548#comment-15241548 ] Younos Aboulnaga commented on SPARK-12279: -- I think this might be caused by a mo

[jira] [Created] (SPARK-14638) Threads of Spark Streaming (with Kafka) looses sight of the executor classpath

2016-04-14 Thread Younos Aboulnaga (JIRA)
Younos Aboulnaga created SPARK-14638: Summary: Threads of Spark Streaming (with Kafka) looses sight of the executor classpath Key: SPARK-14638 URL: https://issues.apache.org/jira/browse/SPARK-14638

[jira] [Updated] (SPARK-14638) Threads of Spark Streaming (with Kafka) looses sight of the executor classpath

2016-04-14 Thread Younos Aboulnaga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Younos Aboulnaga updated SPARK-14638: - Environment: > uname -a Linux HOSTNAME 3.13.0-74-generic #118-Ubuntu SMP Thu Dec 17 22:52

[jira] [Commented] (SPARK-14577) spark.sql.codegen.maxCaseBranches config option

2016-04-14 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241534#comment-15241534 ] Dongjoon Hyun commented on SPARK-14577: --- Hi, [~rxin] Could you take a look when you

[jira] [Comment Edited] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241511#comment-15241511 ] Jeremy edited comment on SPARK-11834 at 4/14/16 5:16 PM: - Looking

[jira] [Resolved] (SPARK-14625) TaskUIData and ExecutorUIData shouldn't be case classes

2016-04-14 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14625. - Resolution: Fixed Fix Version/s: 2.0.0 > TaskUIData and ExecutorUIData shouldn't be case c

[jira] [Comment Edited] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241511#comment-15241511 ] Jeremy edited comment on SPARK-11834 at 4/14/16 5:10 PM: - Looking

[jira] [Commented] (SPARK-14637) object expressions cleanup

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241522#comment-15241522 ] Apache Spark commented on SPARK-14637: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-14637) object expressions cleanup

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14637: Assignee: Apache Spark (was: Wenchen Fan) > object expressions cleanup >

[jira] [Assigned] (SPARK-14637) object expressions cleanup

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14637: Assignee: Wenchen Fan (was: Apache Spark) > object expressions cleanup >

[jira] [Created] (SPARK-14637) object expressions cleanup

2016-04-14 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-14637: --- Summary: object expressions cleanup Key: SPARK-14637 URL: https://issues.apache.org/jira/browse/SPARK-14637 Project: Spark Issue Type: Improvement Co

[jira] [Comment Edited] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241511#comment-15241511 ] Jeremy edited comment on SPARK-11834 at 4/14/16 5:03 PM: - Looking

[jira] [Commented] (SPARK-11834) Ignore thresholds in LogisticRegression and update documentation

2016-04-14 Thread Jeremy (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241511#comment-15241511 ] Jeremy commented on SPARK-11834: Looking into this JIRA, checkThresholdConsistency() and

[jira] [Updated] (SPARK-13745) Support columnar in memory representation on Big Endian platforms

2016-04-14 Thread Tim Preece (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Preece updated SPARK-13745: --- Affects Version/s: 2.0.0 > Support columnar in memory representation on Big Endian platforms > --

[jira] [Resolved] (SPARK-14125) View related commands

2016-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14125. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12324 [https://github.com/

[jira] [Comment Edited] (SPARK-13857) Feature parity for ALS ML with MLLIB

2016-04-14 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241360#comment-15241360 ] Nick Pentreath edited comment on SPARK-13857 at 4/14/16 3:33 PM: --

[jira] [Comment Edited] (SPARK-14597) Streaming Listener timing metrics should include time spent in JobGenerator's graph.generateJobs

2016-04-14 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241358#comment-15241358 ] Mario Briggs edited comment on SPARK-14597 at 4/14/16 3:32 PM:

[jira] [Commented] (SPARK-13857) Feature parity for ALS ML with MLLIB

2016-04-14 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241360#comment-15241360 ] Nick Pentreath commented on SPARK-13857: For now I won't do this, but later we co

[jira] [Commented] (SPARK-14597) Streaming Listener timing metrics should include time spent in JobGenerator's graph.generateJobs

2016-04-14 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241358#comment-15241358 ] Mario Briggs commented on SPARK-14597: -- I think there is an opportunity to merge bot

[jira] [Resolved] (SPARK-14572) Update Config Doc to specify -Xms in extraJavaOptions

2016-04-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-14572. --- Resolution: Fixed Fix Version/s: 2.0.0 > Update Config Doc to specify -Xms in extraJav

[jira] [Updated] (SPARK-14572) Update Config Doc to specify -Xms in extraJavaOptions

2016-04-14 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated SPARK-14572: -- Assignee: Dhruve Ashar > Update Config Doc to specify -Xms in extraJavaOptions > --

[jira] [Updated] (SPARK-14518) Support Comment in CREATE VIEW

2016-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-14518: - Assignee: Xiao Li > Support Comment in CREATE VIEW > -- > > K

[jira] [Resolved] (SPARK-14518) Support Comment in CREATE VIEW

2016-04-14 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-14518. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12288 [https://github.com/

[jira] [Assigned] (SPARK-5929) Pyspark: Register a pip requirements file with spark_context

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5929: --- Assignee: (was: Apache Spark) > Pyspark: Register a pip requirements file with spark_cont

[jira] [Commented] (SPARK-5929) Pyspark: Register a pip requirements file with spark_context

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241307#comment-15241307 ] Apache Spark commented on SPARK-5929: - User 'buckhx' has created a pull request for th

[jira] [Assigned] (SPARK-5929) Pyspark: Register a pip requirements file with spark_context

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5929: --- Assignee: Apache Spark > Pyspark: Register a pip requirements file with spark_context > -

[jira] [Reopened] (SPARK-5929) Pyspark: Register a pip requirements file with spark_context

2016-04-14 Thread buckhx (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] buckhx reopened SPARK-5929: --- I've got a pull request open that also exposes sc.addPyPackage() that allows for arbitrary python packages to be

[jira] [Assigned] (SPARK-13745) Support columnar in memory representation on Big Endian platforms

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13745: Assignee: Apache Spark > Support columnar in memory representation on Big Endian platforms

[jira] [Assigned] (SPARK-13745) Support columnar in memory representation on Big Endian platforms

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13745: Assignee: (was: Apache Spark) > Support columnar in memory representation on Big Endia

[jira] [Commented] (SPARK-13745) Support columnar in memory representation on Big Endian platforms

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241263#comment-15241263 ] Apache Spark commented on SPARK-13745: -- User 'robbinspg' has created a pull request

[jira] [Updated] (SPARK-14636) Spark should fail fast if executor/driver memory is too small for the StaticMemoryManager

2016-04-14 Thread Peter Ableda (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Ableda updated SPARK-14636: - Description: When users are using the legacy ("--conf spark.memory.useLegacyMode=true") memory m

[jira] [Commented] (SPARK-14629) Add support for custom scala style rules

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241252#comment-15241252 ] Apache Spark commented on SPARK-14629: -- User 'lw-lin' has created a pull request for

[jira] [Assigned] (SPARK-14629) Add support for custom scala style rules

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14629: Assignee: Apache Spark > Add support for custom scala style rules > --

[jira] [Assigned] (SPARK-14629) Add support for custom scala style rules

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14629: Assignee: (was: Apache Spark) > Add support for custom scala style rules > ---

[jira] [Commented] (SPARK-14630) Code style: public abstract methods should have explicit return types

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241253#comment-15241253 ] Apache Spark commented on SPARK-14630: -- User 'lw-lin' has created a pull request for

[jira] [Assigned] (SPARK-14636) Spark should fail fast if executor/driver memory is too small for the StaticMemoryManager

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14636: Assignee: (was: Apache Spark) > Spark should fail fast if executor/driver memory is to

[jira] [Commented] (SPARK-14636) Spark should fail fast if executor/driver memory is too small for the StaticMemoryManager

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241227#comment-15241227 ] Apache Spark commented on SPARK-14636: -- User 'peterableda' has created a pull reques

[jira] [Assigned] (SPARK-14636) Spark should fail fast if executor/driver memory is too small for the StaticMemoryManager

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14636: Assignee: Apache Spark > Spark should fail fast if executor/driver memory is too small for

[jira] [Created] (SPARK-14636) Spark should fail fast if executor/driver memory is too small for the StaticMemoryManager

2016-04-14 Thread Peter Ableda (JIRA)
Peter Ableda created SPARK-14636: Summary: Spark should fail fast if executor/driver memory is too small for the StaticMemoryManager Key: SPARK-14636 URL: https://issues.apache.org/jira/browse/SPARK-14636

[jira] [Created] (SPARK-14635) Documentation and Examples for TF-IDF only refer to HashingTF

2016-04-14 Thread Nick Pentreath (JIRA)
Nick Pentreath created SPARK-14635: -- Summary: Documentation and Examples for TF-IDF only refer to HashingTF Key: SPARK-14635 URL: https://issues.apache.org/jira/browse/SPARK-14635 Project: Spark

[jira] [Commented] (SPARK-14632) randomSplit method fails on dataframes with maps in schema

2016-04-14 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241181#comment-15241181 ] Michael ZieliƄski commented on SPARK-14632: --- FYI, this bug was introduced only

[jira] [Assigned] (SPARK-14634) Add BisectingKMeansSummary

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14634: Assignee: (was: Apache Spark) > Add BisectingKMeansSummary > -

[jira] [Assigned] (SPARK-14634) Add BisectingKMeansSummary

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14634: Assignee: Apache Spark > Add BisectingKMeansSummary > -- > >

[jira] [Commented] (SPARK-14634) Add BisectingKMeansSummary

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241155#comment-15241155 ] Apache Spark commented on SPARK-14634: -- User 'zhengruifeng' has created a pull reque

[jira] [Created] (SPARK-14634) Add BisectingKMeansSummary

2016-04-14 Thread zhengruifeng (JIRA)
zhengruifeng created SPARK-14634: Summary: Add BisectingKMeansSummary Key: SPARK-14634 URL: https://issues.apache.org/jira/browse/SPARK-14634 Project: Spark Issue Type: Bug Componen

[jira] [Commented] (SPARK-14516) Clustering evaluator

2016-04-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241132#comment-15241132 ] zhengruifeng commented on SPARK-14516: -- [~josephkb] [~akamal] > Clustering evaluato

[jira] [Comment Edited] (SPARK-14516) Clustering evaluator

2016-04-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241127#comment-15241127 ] zhengruifeng edited comment on SPARK-14516 at 4/14/16 1:18 PM:

[jira] [Commented] (SPARK-13925) Expose R-like summary statistics in SparkR::glm for more family and link functions

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241129#comment-15241129 ] Apache Spark commented on SPARK-13925: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-13925) Expose R-like summary statistics in SparkR::glm for more family and link functions

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13925: Assignee: (was: Apache Spark) > Expose R-like summary statistics in SparkR::glm for mo

[jira] [Assigned] (SPARK-13925) Expose R-like summary statistics in SparkR::glm for more family and link functions

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13925: Assignee: Apache Spark > Expose R-like summary statistics in SparkR::glm for more family a

[jira] [Commented] (SPARK-14516) Clustering evaluator

2016-04-14 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241127#comment-15241127 ] zhengruifeng commented on SPARK-14516: -- the document for api is [here](https://docs

[jira] [Resolved] (SPARK-14106) history server application cache doesn't detect that apps are completed

2016-04-14 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-14106. Resolution: Not A Bug Understanding this more, its coming from the history provider's view

[jira] [Commented] (SPARK-14633) Use more readable format to show memory bytes in Error Message

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241085#comment-15241085 ] Apache Spark commented on SPARK-14633: -- User 'peterableda' has created a pull reques

[jira] [Assigned] (SPARK-14633) Use more readable format to show memory bytes in Error Message

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14633: Assignee: Apache Spark > Use more readable format to show memory bytes in Error Message >

[jira] [Assigned] (SPARK-14633) Use more readable format to show memory bytes in Error Message

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14633: Assignee: (was: Apache Spark) > Use more readable format to show memory bytes in Error

[jira] [Commented] (SPARK-14633) Use more readable format to show memory bytes in Error Message

2016-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241082#comment-15241082 ] Sean Owen commented on SPARK-14633: --- Yes trivial fix to cast that var to a long for pur

[jira] [Created] (SPARK-14633) Use more readable format to show memory bytes in Error Message

2016-04-14 Thread Peter Ableda (JIRA)
Peter Ableda created SPARK-14633: Summary: Use more readable format to show memory bytes in Error Message Key: SPARK-14633 URL: https://issues.apache.org/jira/browse/SPARK-14633 Project: Spark

[jira] [Created] (SPARK-14632) randomSplit method fails on dataframes with maps in schema

2016-04-14 Thread Stefano Costantini (JIRA)
Stefano Costantini created SPARK-14632: -- Summary: randomSplit method fails on dataframes with maps in schema Key: SPARK-14632 URL: https://issues.apache.org/jira/browse/SPARK-14632 Project: Spark

[jira] [Assigned] (SPARK-14631) "drop database cascade" needs to unregister functions for HiveExternalCatalog

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14631: Assignee: (was: Apache Spark) > "drop database cascade" needs to unregister functions

[jira] [Assigned] (SPARK-14631) "drop database cascade" needs to unregister functions for HiveExternalCatalog

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14631: Assignee: Apache Spark > "drop database cascade" needs to unregister functions for HiveExt

[jira] [Commented] (SPARK-14631) "drop database cascade" needs to unregister functions for HiveExternalCatalog

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15241014#comment-15241014 ] Apache Spark commented on SPARK-14631: -- User 'adrian-wang' has created a pull reques

[jira] [Created] (SPARK-14631) "drop database cascade" needs to unregister functions for HiveExternalCatalog

2016-04-14 Thread Adrian Wang (JIRA)
Adrian Wang created SPARK-14631: --- Summary: "drop database cascade" needs to unregister functions for HiveExternalCatalog Key: SPARK-14631 URL: https://issues.apache.org/jira/browse/SPARK-14631 Project:

[jira] [Closed] (SPARK-13107) [Spark SQL]'hiveconf' parameters in Beeline command can't be got after enter Beeline session

2016-04-14 Thread William Zhou (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] William Zhou closed SPARK-13107. Resolution: Not A Problem > [Spark SQL]'hiveconf' parameters in Beeline command can't be got after

[jira] [Assigned] (SPARK-14612) Consolidate the version of dependencies in mllib and mllib-local into one place

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14612: Assignee: (was: Apache Spark) > Consolidate the version of dependencies in mllib and m

[jira] [Commented] (SPARK-14612) Consolidate the version of dependencies in mllib and mllib-local into one place

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240954#comment-15240954 ] Apache Spark commented on SPARK-14612: -- User 'srowen' has created a pull request for

[jira] [Assigned] (SPARK-14612) Consolidate the version of dependencies in mllib and mllib-local into one place

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14612: Assignee: Apache Spark > Consolidate the version of dependencies in mllib and mllib-local

[jira] [Updated] (SPARK-14612) Consolidate the version of dependencies in mllib and mllib-local into one place

2016-04-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14612: -- Priority: Trivial (was: Major) I'll take this one, it's trivial > Consolidate the version of dependen

[jira] [Assigned] (SPARK-14630) Code style: public abstract methods should have explicit return types

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14630: Assignee: (was: Apache Spark) > Code style: public abstract methods should have explic

[jira] [Commented] (SPARK-14630) Code style: public abstract methods should have explicit return types

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240872#comment-15240872 ] Apache Spark commented on SPARK-14630: -- User 'lw-lin' has created a pull request for

[jira] [Assigned] (SPARK-14630) Code style: public abstract methods should have explicit return types

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14630: Assignee: Apache Spark > Code style: public abstract methods should have explicit return t

[jira] [Commented] (SPARK-14525) DataFrameWriter's save method should delegate to jdbc for jdbc datasource

2016-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240859#comment-15240859 ] Takeshi Yamamuro commented on SPARK-14525: -- You mean you'd like to make `df.wri

[jira] [Created] (SPARK-14630) Code style: public abstract methods should have explicit return types

2016-04-14 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14630: - Summary: Code style: public abstract methods should have explicit return types Key: SPARK-14630 URL: https://issues.apache.org/jira/browse/SPARK-14630 Project: Spark

[jira] [Commented] (SPARK-14629) Add support for custom scala style rules

2016-04-14 Thread Liwei Lin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240839#comment-15240839 ] Liwei Lin commented on SPARK-14629: --- will soon submit a patch, but I'd might need some

[jira] [Created] (SPARK-14629) Add support for custom scala style rules

2016-04-14 Thread Liwei Lin (JIRA)
Liwei Lin created SPARK-14629: - Summary: Add support for custom scala style rules Key: SPARK-14629 URL: https://issues.apache.org/jira/browse/SPARK-14629 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-14627) Avoid shilfting encoder when delta is zero

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14627: Assignee: Apache Spark > Avoid shilfting encoder when delta is zero >

[jira] [Comment Edited] (SPARK-13801) DataFrame.col should return unresolved attribute

2016-04-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15240828#comment-15240828 ] Takeshi Yamamuro edited comment on SPARK-13801 at 4/14/16 9:00 AM:

[jira] [Assigned] (SPARK-14627) Avoid shilfting encoder when delta is zero

2016-04-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14627: Assignee: (was: Apache Spark) > Avoid shilfting encoder when delta is zero > -

[jira] [Closed] (SPARK-14627) Avoid shilfting encoder when delta is zero

2016-04-14 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh closed SPARK-14627. --- Resolution: Won't Fix > Avoid shilfting encoder when delta is zero >

<    1   2   3   >