[jira] [Updated] (SPARK-6747) Throw an AnalysisException when unsupported Java list types used in Hive UDF

2015-07-06 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Description: The current implementation can't handle List<> as a return type in Hive UDF and

[jira] [Updated] (SPARK-6747) Throw an AnalysisException when unsupported Java list types used in Hive UDF

2015-07-06 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-6747: Summary: Throw an AnalysisException when unsupported Java list types used in Hive UDF (was:

[jira] [Resolved] (SPARK-8463) No suitable driver found for write.jdbc

2015-07-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8463. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 > No suitable driver found fo

[jira] [Updated] (SPARK-8849) expose multiclass scores in LogisticRegression

2015-07-06 Thread Asher Krim (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asher Krim updated SPARK-8849: -- Component/s: MLlib > expose multiclass scores in LogisticRegression > --

[jira] [Resolved] (SPARK-8588) Could not use concat with UDF in where clause

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8588. - Resolution: Fixed > Could not use concat with UDF in where clause > --

[jira] [Assigned] (SPARK-8852) spark-streaming-flume-assembly packages too many dependencies

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8852: --- Assignee: (was: Apache Spark) > spark-streaming-flume-assembly packages too many dependen

[jira] [Commented] (SPARK-8852) spark-streaming-flume-assembly packages too many dependencies

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615919#comment-14615919 ] Apache Spark commented on SPARK-8852: - User 'vanzin' has created a pull request for th

[jira] [Assigned] (SPARK-8852) spark-streaming-flume-assembly packages too many dependencies

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8852: --- Assignee: Apache Spark > spark-streaming-flume-assembly packages too many dependencies >

[jira] [Commented] (SPARK-6487) Add sequential pattern mining algorithm to Spark MLlib

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615911#comment-14615911 ] Xiangrui Meng commented on SPARK-6487: -- Had an offline discussion with [~Zhang JiaJin

[jira] [Updated] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8072: Assignee: Animesh Baranawal > Better AnalysisException for writing DataFrame with identicall

[jira] [Resolved] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8072. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7013 [https:/

[jira] [Commented] (SPARK-8851) in Yarn client mode, Client.scala does not login even when credentials are specified

2015-07-06 Thread Hari Shreedharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615895#comment-14615895 ] Hari Shreedharan commented on SPARK-8851: - I am currently confirming that this is

[jira] [Updated] (SPARK-6487) Add sequential pattern mining algorithm to Spark MLlib

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6487: - Assignee: Zhang JiaJin > Add sequential pattern mining algorithm to Spark MLlib >

[jira] [Created] (SPARK-8852) spark-streaming-flume-assembly packages too many dependencies

2015-07-06 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-8852: - Summary: spark-streaming-flume-assembly packages too many dependencies Key: SPARK-8852 URL: https://issues.apache.org/jira/browse/SPARK-8852 Project: Spark

[jira] [Created] (SPARK-8851) in Yarn client mode, Client.scala does not login even when credentials are specified

2015-07-06 Thread Hari Shreedharan (JIRA)
Hari Shreedharan created SPARK-8851: --- Summary: in Yarn client mode, Client.scala does not login even when credentials are specified Key: SPARK-8851 URL: https://issues.apache.org/jira/browse/SPARK-8851

[jira] [Updated] (SPARK-8690) Add a setting to disable SparkSQL parquet schema merge by using datasource API

2015-07-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8690: -- Assignee: thegiive > Add a setting to disable SparkSQL parquet schema merge by using datasource > API

[jira] [Updated] (SPARK-8841) Fix partition pruning percentage log message

2015-07-06 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8841: -- Assignee: Steve Lindemann > Fix partition pruning percentage log message > -

[jira] [Resolved] (SPARK-8765) Flaky PySpark PowerIterationClustering test

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8765. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7177 [https://githu

[jira] [Updated] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-07-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-6707: - Assignee: Ankur Chauhan > Mesos Scheduler should allow the user to specify constraints based on slave > a

[jira] [Updated] (SPARK-8656) Spark Standalone master json API's worker number is not match web UI number

2015-07-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8656: - Assignee: thegiive > Spark Standalone master json API's worker number is not match web UI number > ---

[jira] [Reopened] (SPARK-7212) Frequent pattern mining for sequential item sets

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng reopened SPARK-7212: -- > Frequent pattern mining for sequential item sets > ---

[jira] [Resolved] (SPARK-7212) Frequent pattern mining for sequential item sets

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7212. -- Resolution: Won't Fix Fix Version/s: (was: 1.5.0) > Frequent pattern mining for seque

[jira] [Resolved] (SPARK-7212) Frequent pattern mining for sequential item sets

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7212. -- Resolution: Fixed Issue resolved by pull request 7240 [https://github.com/apache/spark/pull/7240

[jira] [Closed] (SPARK-6707) Mesos Scheduler should allow the user to specify constraints based on slave attributes

2015-07-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-6707. Resolution: Fixed Fix Version/s: 1.5.0 > Mesos Scheduler should allow the user to specify constraints

[jira] [Closed] (SPARK-8656) Spark Standalone master json API's worker number is not match web UI number

2015-07-06 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8656. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 > Spark Standalone master js

[jira] [Assigned] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-07-06 Thread Mridul Muralidharan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mridul Muralidharan reassigned SPARK-8297: -- Assignee: Mridul Muralidharan > Scheduler backend is not notified in case node

[jira] [Commented] (SPARK-8646) PySpark does not run on YARN

2015-07-06 Thread Juliet Hougland (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615809#comment-14615809 ] Juliet Hougland commented on SPARK-8646: [~davies] Please look at the logs I have

[jira] [Commented] (SPARK-8850) Turn unsafe mode on by default

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615782#comment-14615782 ] Apache Spark commented on SPARK-8850: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8850: --- Assignee: Apache Spark (was: Reynold Xin) > Turn unsafe mode on by default > ---

[jira] [Assigned] (SPARK-8850) Turn unsafe mode on by default

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8850: --- Assignee: Reynold Xin (was: Apache Spark) > Turn unsafe mode on by default > ---

[jira] [Created] (SPARK-8850) Turn unsafe mode on by default

2015-07-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8850: -- Summary: Turn unsafe mode on by default Key: SPARK-8850 URL: https://issues.apache.org/jira/browse/SPARK-8850 Project: Spark Issue Type: Task Component

[jira] [Updated] (SPARK-8845) ML use of Breeze optimization: use adjustedValue not value?

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8845: - Assignee: DB Tsai > ML use of Breeze optimization: use adjustedValue not value? >

[jira] [Updated] (SPARK-8845) ML use of Breeze optimization: use adjustedValue not value?

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8845: - Shepherd: Joseph K. Bradley > ML use of Breeze optimization: use adjustedValue not value?

[jira] [Commented] (SPARK-8677) Decimal divide operation throws ArithmeticException

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615761#comment-14615761 ] Michael Armbrust commented on SPARK-8677: - Can you open another JIRA for the new i

[jira] [Assigned] (SPARK-8845) ML use of Breeze optimization: use adjustedValue not value?

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8845: --- Assignee: (was: Apache Spark) > ML use of Breeze optimization: use adjustedValue not valu

[jira] [Assigned] (SPARK-8845) ML use of Breeze optimization: use adjustedValue not value?

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8845: --- Assignee: Apache Spark > ML use of Breeze optimization: use adjustedValue not value? > --

[jira] [Commented] (SPARK-8845) ML use of Breeze optimization: use adjustedValue not value?

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615759#comment-14615759 ] Apache Spark commented on SPARK-8845: - User 'dbtsai' has created a pull request for th

[jira] [Updated] (SPARK-8794) Column pruning isn't applied beneath sample

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8794: Shepherd: Michael Armbrust Assignee: Liang-Chi Hsieh > Column pruning isn't applied bene

[jira] [Updated] (SPARK-8450) PySpark write.parquet raises Unsupported datatype DecimalType()

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8450: Target Version/s: 1.5.0 > PySpark write.parquet raises Unsupported datatype DecimalType() >

[jira] [Resolved] (SPARK-4485) Add broadcast outer join to optimize left outer join and right outer join

2015-07-06 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4485. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7162 [https:/

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615695#comment-14615695 ] Joseph K. Bradley commented on SPARK-5556: -- Right, I don't think there has been m

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615678#comment-14615678 ] Joseph K. Bradley commented on SPARK-5133: -- Definitely. Please look at the list

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-06 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615675#comment-14615675 ] Shivaram Venkataraman commented on SPARK-8596: -- I think you can move the /etc

[jira] [Created] (SPARK-8849) expose multiclass scores in LogisticRegression

2015-07-06 Thread Asher Krim (JIRA)
Asher Krim created SPARK-8849: - Summary: expose multiclass scores in LogisticRegression Key: SPARK-8849 URL: https://issues.apache.org/jira/browse/SPARK-8849 Project: Spark Issue Type: New Featur

[jira] [Commented] (SPARK-8846) Maintain binary compatibility for in function

2015-07-06 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615664#comment-14615664 ] Yu Ishikawa commented on SPARK-8846: Alright. I'll work this issue. > Maintain binary

[jira] [Commented] (SPARK-8818) In should not take Any not Column

2015-07-06 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615659#comment-14615659 ] Yu Ishikawa commented on SPARK-8818: I'm happy to hear that. Thank you for closing thi

[jira] [Commented] (SPARK-8457) Documentation for N-Gram feature transformer

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615628#comment-14615628 ] Apache Spark commented on SPARK-8457: - User 'feynmanliang' has created a pull request

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-07-06 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615616#comment-14615616 ] Pedro Rodriguez commented on SPARK-5556: I am still interested, but was unsure of

[jira] [Updated] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-5556: - Target Version/s: (was: 1.5.0) > Latent Dirichlet Allocation (LDA) using Gibbs sampler

[jira] [Commented] (SPARK-5556) Latent Dirichlet Allocation (LDA) using Gibbs sampler

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615610#comment-14615610 ] Joseph K. Bradley commented on SPARK-5556: -- [~pedrorodriguez] I'm going to remove

[jira] [Comment Edited] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-06 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615553#comment-14615553 ] Neelesh Srinivas Salian edited comment on SPARK-8743 at 7/6/15 8:36 PM:

[jira] [Updated] (SPARK-8178) date/time function: quarter

2015-07-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8178: --- Description: quarter(timestamp): int Returns the quarter of the year for a date, timestamp, or string

[jira] [Resolved] (SPARK-8784) Add python API for hex/unhex

2015-07-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8784. Resolution: Fixed > Add python API for hex/unhex > > >

[jira] [Commented] (SPARK-8540) KMeans-based outlier detection

2015-07-06 Thread Venkata Vineel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615596#comment-14615596 ] Venkata Vineel commented on SPARK-8540: --- [~josephkb] Yes, I looked there, but there

[jira] [Resolved] (SPARK-7114) parse error for DataFrame.filter after aggregate

2015-07-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-7114. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > parse error for DataF

[jira] [Resolved] (SPARK-8837) support using keyword in column name

2015-07-06 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8837. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > support using keyword

[jira] [Updated] (SPARK-8018) KMeans should accept initial cluster centers as param

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8018: - Target Version/s: 1.5.0 > KMeans should accept initial cluster centers as param >

[jira] [Updated] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8481: - Affects Version/s: (was: 1.4.0) Target Version/s: 1.5.0 > GaussianMixtureModel pr

[jira] [Updated] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8703: - Target Version/s: 1.5.0 > Add CountVectorizer as a ml transformer to convert document to w

[jira] [Updated] (SPARK-8092) OneVsRest doesn't allow flexibility in label/ feature column renaming

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8092: - Target Version/s: 1.5.0 > OneVsRest doesn't allow flexibility in label/ feature column ren

[jira] [Updated] (SPARK-8092) OneVsRest doesn't allow flexibility in label/ feature column renaming

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8092: - Shepherd: Joseph K. Bradley > OneVsRest doesn't allow flexibility in label/ feature column

[jira] [Updated] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-07-06 Thread Andrew Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Lee updated SPARK-6882: -- Affects Version/s: 1.4.0 > Spark ThriftServer2 Kerberos failed encountering > java.lang.IllegalArgument

[jira] [Commented] (SPARK-6882) Spark ThriftServer2 Kerberos failed encountering java.lang.IllegalArgumentException: Unknown auth type: null Allowed values are: [auth-int, auth-conf, auth]

2015-07-06 Thread Andrew Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615571#comment-14615571 ] Andrew Lee commented on SPARK-6882: --- Hi [~WangTaoTheTonic], I'm still getting the same e

[jira] [Updated] (SPARK-6259) Python API for LDA

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-6259: - Shepherd: Joseph K. Bradley > Python API for LDA > -- > >

[jira] [Updated] (SPARK-7879) KMeans API for spark.ml Pipelines

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-7879: - Shepherd: Joseph K. Bradley > KMeans API for spark.ml Pipelines >

[jira] [Updated] (SPARK-8539) LinearRegressionSummary class for storing LR training stats

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8539: - Shepherd: Joseph K. Bradley > LinearRegressionSummary class for storing LR training stats

[jira] [Updated] (SPARK-8538) LinearRegressionResults class for storing LR results on data

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8538: - Shepherd: Joseph K. Bradley > LinearRegressionResults class for storing LR results on data

[jira] [Updated] (SPARK-8481) GaussianMixtureModel predict accepting single vector

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8481: - Shepherd: Joseph K. Bradley > GaussianMixtureModel predict accepting single vector > -

[jira] [Updated] (SPARK-8703) Add CountVectorizer as a ml transformer to convert document to words count vector

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8703: - Shepherd: Joseph K. Bradley > Add CountVectorizer as a ml transformer to convert document

[jira] [Updated] (SPARK-8018) KMeans should accept initial cluster centers as param

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8018: - Shepherd: Joseph K. Bradley > KMeans should accept initial cluster centers as param >

[jira] [Comment Edited] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-06 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615553#comment-14615553 ] Neelesh Srinivas Salian edited comment on SPARK-8743 at 7/6/15 8:06 PM:

[jira] [Commented] (SPARK-8743) Deregister Codahale metrics for streaming when StreamingContext is closed

2015-07-06 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615553#comment-14615553 ] Neelesh Srinivas Salian commented on SPARK-8743: [~tdas] should have a PR

[jira] [Updated] (SPARK-8539) LinearRegressionSummary class for storing LR training stats

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8539: - Assignee: Feynman Liang > LinearRegressionSummary class for storing LR training stats > --

[jira] [Updated] (SPARK-8538) LinearRegressionResults class for storing LR results on data

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8538: - Assignee: Feynman Liang > LinearRegressionResults class for storing LR results on data > -

[jira] [Updated] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5016: - Target Version/s: 1.5.0 > GaussianMixtureEM should distribute matrix inverse for large numFeatures

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-06 Thread Venkata Vineel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615528#comment-14615528 ] Venkata Vineel commented on SPARK-5133: --- [~josephkb] If you don't mind, can you ple

[jira] [Updated] (SPARK-5016) GaussianMixtureEM should distribute matrix inverse for large numFeatures, k

2015-07-06 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5016: - Assignee: Feynman Liang > GaussianMixtureEM should distribute matrix inverse for large numFeatures

[jira] [Commented] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615522#comment-14615522 ] Apache Spark commented on SPARK-8297: - User 'mridulm' has created a pull request for t

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-06 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615523#comment-14615523 ] Vincent Warmerdam edited comment on SPARK-8596 at 7/6/15 7:49 PM: --

[jira] [Comment Edited] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-06 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615523#comment-14615523 ] Vincent Warmerdam edited comment on SPARK-8596 at 7/6/15 7:48 PM: --

[jira] [Assigned] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8297: --- Assignee: Apache Spark > Scheduler backend is not notified in case node fails in YARN > -

[jira] [Commented] (SPARK-8596) Install and configure RStudio server on Spark EC2

2015-07-06 Thread Vincent Warmerdam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615523#comment-14615523 ] Vincent Warmerdam commented on SPARK-8596: -- 1. true. made commit: https://github

[jira] [Assigned] (SPARK-8297) Scheduler backend is not notified in case node fails in YARN

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8297: --- Assignee: (was: Apache Spark) > Scheduler backend is not notified in case node fails in Y

[jira] [Created] (SPARK-8847) String concatination with column in SparkR

2015-07-06 Thread Amar Gondaliya (JIRA)
Amar Gondaliya created SPARK-8847: - Summary: String concatination with column in SparkR Key: SPARK-8847 URL: https://issues.apache.org/jira/browse/SPARK-8847 Project: Spark Issue Type: New Fe

[jira] [Created] (SPARK-8848) Write Parquet LISTs and MAPs conforming to Parquet format spec

2015-07-06 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-8848: - Summary: Write Parquet LISTs and MAPs conforming to Parquet format spec Key: SPARK-8848 URL: https://issues.apache.org/jira/browse/SPARK-8848 Project: Spark Issue

[jira] [Commented] (SPARK-8843) DStream transform function receives null instead of RDD

2015-07-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615510#comment-14615510 ] Tathagata Das commented on SPARK-8843: -- If you are creating a custom DStream, which r

[jira] [Closed] (SPARK-8843) DStream transform function receives null instead of RDD

2015-07-06 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das closed SPARK-8843. Resolution: Not A Problem > DStream transform function receives null instead of RDD > --

[jira] [Created] (SPARK-8846) Maintain binary compatibility for in function

2015-07-06 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-8846: -- Summary: Maintain binary compatibility for in function Key: SPARK-8846 URL: https://issues.apache.org/jira/browse/SPARK-8846 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-5133) Feature Importance for Decision Tree (Ensembles)

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615507#comment-14615507 ] Joseph K. Bradley commented on SPARK-5133: -- [~yalamart] I see you're looking into

[jira] [Commented] (SPARK-6001) K-Means clusterer should return the assignments of input points to clusters

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615502#comment-14615502 ] Joseph K. Bradley commented on SPARK-6001: -- [~yalamart] This should probably be

[jira] [Commented] (SPARK-8832) insertInto() throws error in sparkR

2015-07-06 Thread Amar Gondaliya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615499#comment-14615499 ] Amar Gondaliya commented on SPARK-8832: --- Hi Shivaram, I have not checked in Scala/P

[jira] [Commented] (SPARK-8832) insertInto() throws error in sparkR

2015-07-06 Thread Amar Gondaliya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615500#comment-14615500 ] Amar Gondaliya commented on SPARK-8832: --- Hi Shivaram, I have not checked in Scala/P

[jira] [Issue Comment Deleted] (SPARK-8832) insertInto() throws error in sparkR

2015-07-06 Thread Amar Gondaliya (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amar Gondaliya updated SPARK-8832: -- Comment: was deleted (was: Hi Shivaram, I have not checked in Scala/Python. But unionAll worked

[jira] [Commented] (SPARK-8540) KMeans-based outlier detection

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615497#comment-14615497 ] Joseph K. Bradley commented on SPARK-8540: -- If this is your first Spark contribut

[jira] [Commented] (SPARK-6885) Decision trees: predict class probabilities

2015-07-06 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615494#comment-14615494 ] Joseph K. Bradley commented on SPARK-6885: -- This is still blocking on other JIRAs

[jira] [Commented] (SPARK-8457) Documentation for N-Gram feature transformer

2015-07-06 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615493#comment-14615493 ] Feynman Liang commented on SPARK-8457: -- I'm working on this > Documentation for N-Gr

[jira] [Assigned] (SPARK-6123) Parquet reader should use the schema of every file to create converter

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6123: --- Assignee: Apache Spark > Parquet reader should use the schema of every file to create convert

[jira] [Commented] (SPARK-6775) Simplify CatalystConverter class hierarchy and pass in Parquet schema

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615491#comment-14615491 ] Apache Spark commented on SPARK-6775: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-6123) Parquet reader should use the schema of every file to create converter

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6123: --- Assignee: (was: Apache Spark) > Parquet reader should use the schema of every file to cre

[jira] [Commented] (SPARK-6123) Parquet reader should use the schema of every file to create converter

2015-07-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14615490#comment-14615490 ] Apache Spark commented on SPARK-6123: - User 'liancheng' has created a pull request for

<    1   2   3   4   >