[jira] [Commented] (SPARK-10384) Univariate statistics as UDAFs

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003190#comment-15003190 ] Xiangrui Meng commented on SPARK-10384: --- I marked this JIRA as resolved. Approximat

[jira] [Resolved] (SPARK-10384) Univariate statistics as UDAFs

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10384. --- Resolution: Fixed Fix Version/s: 1.6.0 > Univariate statistics as UDAFs >

[jira] [Resolved] (SPARK-11420) Updating Stddev support with Imperative Aggregate

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11420. --- Resolution: Fixed Fix Version/s: 1.6.0 > Updating Stddev support with Imperative Aggre

[jira] [Commented] (SPARK-11665) Support other distance metrics for bisecting k-means

2015-11-12 Thread Jun Zheng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003186#comment-15003186 ] Jun Zheng commented on SPARK-11665: --- In bisecting k-means and regular k-means, the dist

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003185#comment-15003185 ] Imran Rashid commented on SPARK-11583: -- [~lemire] after reading a couple of comments

[jira] [Commented] (SPARK-11392) GroupedIterator's hasNext is not idempotent

2015-11-12 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003184#comment-15003184 ] Nakul Jindal commented on SPARK-11392: -- Sorry, it's been a while since I last worked

[jira] [Commented] (SPARK-10848) Applied JSON Schema Works for json RDD but not when loading json file

2015-11-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003178#comment-15003178 ] Xin Wu commented on SPARK-10848: With rdd created in the application, as following: {code

[jira] [Commented] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-12 Thread Zee Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003170#comment-15003170 ] Zee Chen commented on SPARK-11390: -- Test output: {code} sqlContext.setConf("spark.sql.pa

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-12 Thread Daniel Lemire (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003144#comment-15003144 ] Daniel Lemire commented on SPARK-11583: --- [~irashid] Sounds great. Should the code

[jira] [Assigned] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11390: Assignee: Apache Spark > Query plan with/without filterPushdown indistinguishable > --

[jira] [Assigned] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11390: Assignee: (was: Apache Spark) > Query plan with/without filterPushdown indistinguishab

[jira] [Commented] (SPARK-11390) Query plan with/without filterPushdown indistinguishable

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003110#comment-15003110 ] Apache Spark commented on SPARK-11390: -- User 'zeocio' has created a pull request for

[jira] [Created] (SPARK-11714) Make Spark on Mesos honor port restrictions

2015-11-12 Thread Charles Allen (JIRA)
Charles Allen created SPARK-11714: - Summary: Make Spark on Mesos honor port restrictions Key: SPARK-11714 URL: https://issues.apache.org/jira/browse/SPARK-11714 Project: Spark Issue Type: Imp

[jira] [Commented] (SPARK-11664) Add methods to get bisecting k-means cluster structure

2015-11-12 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003085#comment-15003085 ] Yu Ishikawa commented on SPARK-11664: - [~srowen] thank you for letting me know. I int

[jira] [Commented] (SPARK-11583) Make MapStatus use less memory uage

2015-11-12 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003084#comment-15003084 ] Imran Rashid commented on SPARK-11583: -- [~lemire] I thought Kent Yao's analysis was

[jira] [Updated] (SPARK-11668) R style summary stats in GLM package SparkR

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11668: -- Priority: Minor (was: Major) Fix Version/s: (was: 1.5.1) Please don't set fix version; an

[jira] [Updated] (SPARK-11712) Refactor spark.ml LDAModel to be abstract

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11712: -- Fix Version/s: (was: 1.6.0) > Refactor spark.ml LDAModel to be abstract > -

[jira] [Resolved] (SPARK-11655) SparkLauncherBackendSuite leaks child processes

2015-11-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11655. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 1.6.0 > SparkLaun

[jira] [Updated] (SPARK-11665) Support other distance metrics for bisecting k-means

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11665: -- Fix Version/s: (was: 1.6.0) > Support other distance metrics for bisecting k-means > --

[jira] [Updated] (SPARK-11669) Python interface to SparkR GLM module

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11669: -- Target Version/s: 1.5.1, 1.5.0 (was: 1.5.0, 1.5.1) Priority: Minor (was: Major) Fix

[jira] [Updated] (SPARK-11664) Add methods to get bisecting k-means cluster structure

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11664: -- Fix Version/s: (was: 1.6.0) > Add methods to get bisecting k-means cluster structure >

[jira] [Updated] (SPARK-11666) Find the best `k` by cutting bisecting k-means cluster tree without recomputation

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11666: -- Fix Version/s: (was: 1.6.0) > Find the best `k` by cutting bisecting k-means cluster tree without

[jira] [Commented] (SPARK-11664) Add methods to get bisecting k-means cluster structure

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003077#comment-15003077 ] Sean Owen commented on SPARK-11664: --- [~yuu.ishik...@gmail.com] you set "Fix version" on

[jira] [Updated] (SPARK-11703) Improve the docker-mesos image

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11703: -- Component/s: Mesos > Improve the docker-mesos image > -- > >

[jira] [Updated] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11707: -- Component/s: Spark Core > StreamCorruptedException if authentication is enabled > -

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003073#comment-15003073 ] Sean Owen commented on SPARK-11707: --- Isn't this likely some kind of misconfiguration lo

[jira] [Updated] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11679: -- Component/s: SQL > When invoking method " apply(fields: java.util.List[StructField])" in > "StructType

[jira] [Updated] (SPARK-11396) datetime function: to_unix_timestamp

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11396: -- Assignee: Adrian Wang > datetime function: to_unix_timestamp > > >

[jira] [Updated] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11191: -- Assignee: Cheng Lian > [1.5] Can't create UDF's using hive thrift service > ---

[jira] [Resolved] (SPARK-11687) Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and reduceLeftOption

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11687. --- Resolution: Won't Fix > Mixed usage of fold and foldLeft, reduce and reduceLeft and reduceOption and

[jira] [Resolved] (SPARK-11702) Guava ClassLoading Issue When Using Different Hive Metastore Version

2015-11-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11702. --- Resolution: Not A Problem Yes, you've described the situation as it stands and it's on-purpose. You'v

[jira] [Commented] (SPARK-8459) Add import/export to spark.mllib bisecting k-means

2015-11-12 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003015#comment-15003015 ] Yu Ishikawa commented on SPARK-8459: I'm working on this issue. > Add import/export t

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

2015-11-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002988#comment-15002988 ] Marcelo Vanzin commented on SPARK-11617: [~raynow] I don't know your github alias

[jira] [Commented] (SPARK-11637) Alias do not work with udf with * parameter

2015-11-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002986#comment-15002986 ] Xiao Li commented on SPARK-11637: - The fix is ready. Will submit a PR soon. > Alias do

[jira] [Assigned] (SPARK-11703) Improve the docker-mesos image

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11703: Assignee: (was: Apache Spark) > Improve the docker-mesos image > -

[jira] [Commented] (SPARK-11703) Improve the docker-mesos image

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002985#comment-15002985 ] Apache Spark commented on SPARK-11703: -- User 'lmtjalves' has created a pull request

[jira] [Assigned] (SPARK-11703) Improve the docker-mesos image

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11703: Assignee: Apache Spark > Improve the docker-mesos image > -- >

[jira] [Created] (SPARK-11713) Initial RDD for updateStateByKey for pyspark

2015-11-12 Thread David Watson (JIRA)
David Watson created SPARK-11713: Summary: Initial RDD for updateStateByKey for pyspark Key: SPARK-11713 URL: https://issues.apache.org/jira/browse/SPARK-11713 Project: Spark Issue Type: New

[jira] [Resolved] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu resolved SPARK-11699. Resolution: Duplicate Same as SPARK-11290 > TrackStateRDDSuite fails on Jenkins builds > -

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-11-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002959#comment-15002959 ] Michael Armbrust commented on SPARK-11246: -- When building the cache, we are goin

[jira] [Commented] (SPARK-11246) [1.5] Table cache for Parquet broken in 1.5

2015-11-12 Thread Gurgen Tumanyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002954#comment-15002954 ] Gurgen Tumanyan commented on SPARK-11246: - Hi [~yhuai] I am running into an issu

[jira] [Assigned] (SPARK-11712) Refactor spark.ml LDAModel to be abstract

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11712: Assignee: Joseph K. Bradley (was: Apache Spark) > Refactor spark.ml LDAModel to be abstra

[jira] [Commented] (SPARK-11712) Refactor spark.ml LDAModel to be abstract

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002940#comment-15002940 ] Apache Spark commented on SPARK-11712: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-11712) Refactor spark.ml LDAModel to be abstract

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11712: Assignee: Apache Spark (was: Joseph K. Bradley) > Refactor spark.ml LDAModel to be abstra

[jira] [Created] (SPARK-11712) Refactor spark.ml LDAModel to be abstract

2015-11-12 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-11712: - Summary: Refactor spark.ml LDAModel to be abstract Key: SPARK-11712 URL: https://issues.apache.org/jira/browse/SPARK-11712 Project: Spark Issue Typ

[jira] [Commented] (SPARK-11672) Flaky test: ml.JavaDefaultReadWriteSuite

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002918#comment-15002918 ] Apache Spark commented on SPARK-11672: -- User 'mengxr' has created a pull request for

[jira] [Created] (SPARK-11711) Finalizer memory leak is pyspark

2015-11-12 Thread David Watson (JIRA)
David Watson created SPARK-11711: Summary: Finalizer memory leak is pyspark Key: SPARK-11711 URL: https://issues.apache.org/jira/browse/SPARK-11711 Project: Spark Issue Type: Bug Co

[jira] [Resolved] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10113. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9646 [http

[jira] [Updated] (SPARK-10113) Support for unsigned Parquet logical types

2015-11-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10113: - Assignee: Hyukjin Kwon > Support for unsigned Parquet logical types > ---

[jira] [Commented] (SPARK-11710) Document new memory management model

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002867#comment-15002867 ] Apache Spark commented on SPARK-11710: -- User 'andrewor14' has created a pull request

[jira] [Assigned] (SPARK-11710) Document new memory management model

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11710: Assignee: Apache Spark (was: Andrew Or) > Document new memory management model >

[jira] [Assigned] (SPARK-11710) Document new memory management model

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11710: Assignee: Andrew Or (was: Apache Spark) > Document new memory management model >

[jira] [Created] (SPARK-11710) Document new memory management model

2015-11-12 Thread Andrew Or (JIRA)
Andrew Or created SPARK-11710: - Summary: Document new memory management model Key: SPARK-11710 URL: https://issues.apache.org/jira/browse/SPARK-11710 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11709) Include call site info in SparkContext.assertNotStopped

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11709: Assignee: Apache Spark (was: Xiangrui Meng) > Include call site info in SparkContext.asse

[jira] [Resolved] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11191. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9664 [http

[jira] [Assigned] (SPARK-11709) Include call site info in SparkContext.assertNotStopped

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11709: Assignee: Xiangrui Meng (was: Apache Spark) > Include call site info in SparkContext.asse

[jira] [Commented] (SPARK-11709) Include call site info in SparkContext.assertNotStopped

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002841#comment-15002841 ] Apache Spark commented on SPARK-11709: -- User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-11612) Model export/import for spark.ml: Pipeline and PipelineModel

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11612: Assignee: Joseph K. Bradley (was: Apache Spark) > Model export/import for spark.ml: Pipel

[jira] [Commented] (SPARK-11612) Model export/import for spark.ml: Pipeline and PipelineModel

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002834#comment-15002834 ] Apache Spark commented on SPARK-11612: -- User 'jkbradley' has created a pull request

[jira] [Assigned] (SPARK-11612) Model export/import for spark.ml: Pipeline and PipelineModel

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11612: Assignee: Apache Spark (was: Joseph K. Bradley) > Model export/import for spark.ml: Pipel

[jira] [Created] (SPARK-11709) Include call site info in SparkContext.assertNotStopped

2015-11-12 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-11709: - Summary: Include call site info in SparkContext.assertNotStopped Key: SPARK-11709 URL: https://issues.apache.org/jira/browse/SPARK-11709 Project: Spark Iss

[jira] [Created] (SPARK-11708) 20-25% performance regression in TeraSort

2015-11-12 Thread Nishkam Ravi (JIRA)
Nishkam Ravi created SPARK-11708: Summary: 20-25% performance regression in TeraSort Key: SPARK-11708 URL: https://issues.apache.org/jira/browse/SPARK-11708 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11699: Assignee: Apache Spark > TrackStateRDDSuite fails on Jenkins builds >

[jira] [Commented] (SPARK-11654) add reduce to GroupedDataset

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002795#comment-15002795 ] Apache Spark commented on SPARK-11654: -- User 'marmbrus' has created a pull request f

[jira] [Assigned] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11699: Assignee: (was: Apache Spark) > TrackStateRDDSuite fails on Jenkins builds > -

[jira] [Commented] (SPARK-11699) TrackStateRDDSuite fails on Jenkins builds

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002794#comment-15002794 ] Apache Spark commented on SPARK-11699: -- User 'tedyu' has created a pull request for

[jira] [Updated] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11707: -- Description: When authentication (and encryption) is enabled (at least in standalone mo

[jira] [Updated] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jacek Lewandowski updated SPARK-11707: -- Description: When authentication is enabled (at least in standalone mode), the followin

[jira] [Created] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
Jacek Lewandowski created SPARK-11707: - Summary: StreamCorruptedException if authentication is enabled Key: SPARK-11707 URL: https://issues.apache.org/jira/browse/SPARK-11707 Project: Spark

[jira] [Commented] (SPARK-11441) HadoopFsRelation is not scalable in number of files read/written

2015-11-12 Thread koert kuipers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002751#comment-15002751 ] koert kuipers commented on SPARK-11441: --- going over the code base it seems that the

[jira] [Commented] (SPARK-11108) OneHotEncoder should support other numeric input types

2015-11-12 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002704#comment-15002704 ] Seth Hendrickson commented on SPARK-11108: -- I can work on this if it's still ope

[jira] [Commented] (SPARK-11697) Spark submit can't load user config file using Standalone cluster

2015-11-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002705#comment-15002705 ] Marcelo Vanzin commented on SPARK-11697: {code}new java.io.File(configFile){code}

[jira] [Commented] (SPARK-11697) Spark submit can't load user config file using Standalone cluster

2015-11-12 Thread Sam Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002688#comment-15002688 ] Sam Fang commented on SPARK-11697: -- I just defined a configFile instead of passing as ap

[jira] [Commented] (SPARK-11311) spark cannot describe temporary functions

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002624#comment-15002624 ] Apache Spark commented on SPARK-11311: -- User 'liancheng' has created a pull request

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002623#comment-15002623 ] Apache Spark commented on SPARK-11191: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10086: Assignee: Apache Spark > Flaky StreamingKMeans test in PySpark > -

[jira] [Commented] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002620#comment-15002620 ] Apache Spark commented on SPARK-10086: -- User 'BryanCutler' has created a pull reques

[jira] [Assigned] (SPARK-10086) Flaky StreamingKMeans test in PySpark

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10086: Assignee: (was: Apache Spark) > Flaky StreamingKMeans test in PySpark > --

[jira] [Commented] (SPARK-11706) Streaming Python tests cannot report failures

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002613#comment-15002613 ] Apache Spark commented on SPARK-11706: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-11706) Streaming Python tests cannot report failures

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11706: Assignee: (was: Apache Spark) > Streaming Python tests cannot report failures > --

[jira] [Assigned] (SPARK-11706) Streaming Python tests cannot report failures

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11706: Assignee: Apache Spark > Streaming Python tests cannot report failures > -

[jira] [Updated] (SPARK-11706) Streaming Python tests cannot report failures

2015-11-12 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-11706: - Affects Version/s: 1.5.2 > Streaming Python tests cannot report failures > --

[jira] [Created] (SPARK-11706) Streaming Python tests cannot report failures

2015-11-12 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-11706: Summary: Streaming Python tests cannot report failures Key: SPARK-11706 URL: https://issues.apache.org/jira/browse/SPARK-11706 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11705) Eliminate unnecessary Cartesian Join

2015-11-12 Thread Zhan Zhang (JIRA)
Zhan Zhang created SPARK-11705: -- Summary: Eliminate unnecessary Cartesian Join Key: SPARK-11705 URL: https://issues.apache.org/jira/browse/SPARK-11705 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11704) Optimize the Cartesian Join

2015-11-12 Thread Zhan Zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhan Zhang updated SPARK-11704: --- Issue Type: Improvement (was: Bug) > Optimize the Cartesian Join > --- > >

[jira] [Created] (SPARK-11704) Optimize the Cartesian Join

2015-11-12 Thread Zhan Zhang (JIRA)
Zhan Zhang created SPARK-11704: -- Summary: Optimize the Cartesian Join Key: SPARK-11704 URL: https://issues.apache.org/jira/browse/SPARK-11704 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-11290) Implement trackStateByKey for improved state management

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002543#comment-15002543 ] Apache Spark commented on SPARK-11290: -- User 'zsxwing' has created a pull request fo

[jira] [Commented] (SPARK-11697) Spark submit can't load user config file using Standalone cluster

2015-11-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002536#comment-15002536 ] Marcelo Vanzin commented on SPARK-11697: Can you show the code you're using to re

[jira] [Commented] (SPARK-11640) shading packages in spark-assembly jar

2015-11-12 Thread PJ Fanning (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002537#comment-15002537 ] PJ Fanning commented on SPARK-11640: [~sowen] Thanks - the hadoop-provided profile do

[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Description: I have created a java webapp trying to abstractly Run some Spa

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2015-11-12 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002505#comment-15002505 ] Thomas Graves commented on SPARK-11701: --- I'm not exactly sure if this is same issue

[jira] [Updated] (SPARK-11595) "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" and "hdfs:/"

2015-11-12 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11595: - Fix Version/s: 1.5.3 > "ADD JAR" doesn't work if the given path contains URL scheme like "file:/" > and

[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Description: I have created a java webapp trying to abstractly Run some Spa

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Study Hsueh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002462#comment-15002462 ] Study Hsueh commented on SPARK-11191: - I think this is a Spark ThriftServer issue, no

[jira] [Commented] (SPARK-11637) Alias do not work with udf with * parameter

2015-11-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002460#comment-15002460 ] Xiao Li commented on SPARK-11637: - After using hiveContext, I can reproduce your problem:

[jira] [Commented] (SPARK-11703) Improve the docker-mesos image

2015-11-12 Thread Luis Alves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15002441#comment-15002441 ] Luis Alves commented on SPARK-11703: I've done a pull request for this: https://gith

[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Priority: Major (was: Minor) > Possible memory leak at SparkContext jobPro

[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Attachment: SparkMemoryLeakAfterLotsOfRunsWithinTheSameContext.png

[jira] [Created] (SPARK-11703) Improve the docker-mesos image

2015-11-12 Thread Luis Alves (JIRA)
Luis Alves created SPARK-11703: -- Summary: Improve the docker-mesos image Key: SPARK-11703 URL: https://issues.apache.org/jira/browse/SPARK-11703 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-11700) Possible memory leak at SparkContext jobProgressListener stageIdToData map

2015-11-12 Thread Kostas papageorgopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas papageorgopoulos updated SPARK-11700: Description: I have created a java webapp trying to abstractly Run some Spa

<    1   2   3   >