[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020509#comment-15020509 ] Sean Owen commented on SPARK-11853: --- Can you produce a minimal example? In general this works fine; you

[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-21 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020545#comment-15020545 ] sam commented on SPARK-11853: - OK, I'll look into that next week and see if I can put together a minimal

[jira] [Updated] (SPARK-11826) Subtract BlockMatrix

2015-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11826: -- Priority: Minor (was: Major) What is the motivation for this? This is not a general-purpose matrix

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

2015-11-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020569#comment-15020569 ] Xiao Li commented on SPARK-11894: - The bug is now narrowed down to the function call of

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

2015-11-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020586#comment-15020586 ] Xiao Li commented on SPARK-11894: - After reading the generated code. I suspect the bug is caused by the

[jira] [Commented] (SPARK-11861) Feature importances for decision trees

2015-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020455#comment-15020455 ] Sean Owen commented on SPARK-11861: --- OK so this is about exposing some already-implemented result as an

[jira] [Commented] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

2015-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020520#comment-15020520 ] Sean Owen commented on SPARK-11782: --- [~j4nu5] I don't understand your last comment; if you spark-submit

[jira] [Updated] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11902: -- Priority: Trivial (was: Minor) Issue Type: Improvement (was: Bug) > Unhandled case in

[jira] [Commented] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020563#comment-15020563 ] Apache Spark commented on SPARK-11859: -- User 'toddwan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11859: Assignee: (was: Apache Spark) > Regex for master URL for Mesos accepts incorrect

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

2015-11-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020601#comment-15020601 ] Xiao Li commented on SPARK-11894: - [~marmbrus] [~rxin] [~cloud_fan] I am stuck in this again. To be

[jira] [Commented] (SPARK-11892) Model export/import for spark.ml: OneVsRest

2015-11-21 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020440#comment-15020440 ] Xusen Yin commented on SPARK-11892: --- I'll take this. > Model export/import for spark.ml: OneVsRest >

[jira] [Assigned] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11902: Assignee: Apache Spark > Unhandled case in VectorAssembler#transform >

[jira] [Assigned] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11902: Assignee: (was: Apache Spark) > Unhandled case in VectorAssembler#transform >

[jira] [Commented] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020479#comment-15020479 ] Apache Spark commented on SPARK-11902: -- User 'BenFradet' has created a pull request for this issue:

[jira] [Commented] (SPARK-11892) Model export/import for spark.ml: OneVsRest

2015-11-21 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020458#comment-15020458 ] Xusen Yin commented on SPARK-11892: --- The OneVsRest is dependent on SPARK-6791 since I need the

[jira] [Assigned] (SPARK-11859) Regex for master URL for Mesos accepts incorrect zk:// prefix

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11859: Assignee: Apache Spark > Regex for master URL for Mesos accepts incorrect zk:// prefix >

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

2015-11-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020603#comment-15020603 ] Xiao Li commented on SPARK-11894: - BTW, I also try the dataFrame on the above join statement. The result

[jira] [Created] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

2015-11-21 Thread Xiao Li (JIRA)
Xiao Li created SPARK-11905: --- Summary: [SQL] Support Persist/Cache and Unpersist in Dataset APIs Key: SPARK-11905 URL: https://issues.apache.org/jira/browse/SPARK-11905 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11896) [SQL] Support Sample in Dataset APIs

2015-11-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11896: Summary: [SQL] Support Sample in Dataset APIs (was: [SQL] Add Sample to DataSet APIs ) > [SQL] Support

[jira] [Commented] (SPARK-11861) Feature importances for decision trees

2015-11-21 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020829#comment-15020829 ] Seth Hendrickson commented on SPARK-11861: -- It so happens that the feature importance

[jira] [Commented] (SPARK-11778) HiveContext.read.table does not support user-specified database names

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020861#comment-15020861 ] Apache Spark commented on SPARK-11778: -- User 'huaxingao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11905: Assignee: (was: Apache Spark) > [SQL] Support Persist/Cache and Unpersist in Dataset

[jira] [Assigned] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11905: Assignee: Apache Spark > [SQL] Support Persist/Cache and Unpersist in Dataset APIs >

[jira] [Commented] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020779#comment-15020779 ] Apache Spark commented on SPARK-11905: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-11906) Speculation Tasks Cause ProgressBar UI Overflow

2015-11-21 Thread Sen Fang (JIRA)
Sen Fang created SPARK-11906: Summary: Speculation Tasks Cause ProgressBar UI Overflow Key: SPARK-11906 URL: https://issues.apache.org/jira/browse/SPARK-11906 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11826) Subtract BlockMatrix

2015-11-21 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020719#comment-15020719 ] Ehsan Mohyedin Kermani commented on SPARK-11826: My main (major) motivation is related to

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020729#comment-15020729 ] Nicholas Chammas commented on SPARK-11903: -- Also, we could just leave the option in there and

[jira] [Created] (SPARK-11904) pyspark reduceByKeyAndWindow with invFunc=None requires checkpointing

2015-11-21 Thread David Tolpin (JIRA)
David Tolpin created SPARK-11904: Summary: pyspark reduceByKeyAndWindow with invFunc=None requires checkpointing Key: SPARK-11904 URL: https://issues.apache.org/jira/browse/SPARK-11904 Project: Spark

[jira] [Commented] (SPARK-11904) pyspark reduceByKeyAndWindow with invFunc=None requires checkpointing

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020755#comment-15020755 ] Apache Spark commented on SPARK-11904: -- User 'dtolpin' has created a pull request for this issue:

[jira] [Created] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-11903: Summary: Deprecate make-distribution.sh --skip-java-test Key: SPARK-11903 URL: https://issues.apache.org/jira/browse/SPARK-11903 Project: Spark

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020730#comment-15020730 ] Marcelo Vanzin commented on SPARK-11903: Ah, I thought that without that option tests would be

[jira] [Commented] (SPARK-11904) pyspark reduceByKeyAndWindow with invFunc=None requires checkpointing

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020740#comment-15020740 ] Apache Spark commented on SPARK-11904: -- User 'dtolpin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11904) pyspark reduceByKeyAndWindow with invFunc=None requires checkpointing

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11904: Assignee: (was: Apache Spark) > pyspark reduceByKeyAndWindow with invFunc=None

[jira] [Assigned] (SPARK-11904) pyspark reduceByKeyAndWindow with invFunc=None requires checkpointing

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11904: Assignee: Apache Spark > pyspark reduceByKeyAndWindow with invFunc=None requires

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-21 Thread Ryan Williams (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020742#comment-15020742 ] Ryan Williams commented on SPARK-5784: -- sorry [~anubhavk], I haven't looked at this in a while and

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

2015-11-21 Thread Anubhav Kale (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020745#comment-15020745 ] Anubhav Kale commented on SPARK-5784: - I was able to build and use this. Let me know if I should share

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020726#comment-15020726 ] Marcelo Vanzin commented on SPARK-11903: We use that option in our internal builds. I'd rather

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020725#comment-15020725 ] Nicholas Chammas commented on SPARK-11903: -- cc [~pwendell] and [~srowen] - Y'all probably know

[jira] [Resolved] (SPARK-11899) API audit for GroupedDataset

2015-11-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11899. - Resolution: Fixed Fix Version/s: 1.6.0 > API audit for GroupedDataset >

[jira] [Commented] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020728#comment-15020728 ] Nicholas Chammas commented on SPARK-11903: -- Oh, could you elaborate a bit? From what I

[jira] [Updated] (SPARK-11905) [SQL] Support Persist/Cache and Unpersist in Dataset APIs

2015-11-21 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-11905: Issue Type: Improvement (was: Bug) > [SQL] Support Persist/Cache and Unpersist in Dataset APIs >

[jira] [Comment Edited] (SPARK-11826) Subtract BlockMatrix

2015-11-21 Thread Ehsan Mohyedin Kermani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020719#comment-15020719 ] Ehsan Mohyedin Kermani edited comment on SPARK-11826 at 11/21/15 10:03 PM:

[jira] [Updated] (SPARK-11903) Deprecate make-distribution.sh --skip-java-test

2015-11-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-11903: - Description: The {{\-\-skip-java-test}} option to {{make-distribution.sh}} [does not

[jira] [Assigned] (SPARK-11901) API audit for Aggregator

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11901: Assignee: Apache Spark > API audit for Aggregator > > >

[jira] [Assigned] (SPARK-11901) API audit for Aggregator

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11901: Assignee: (was: Apache Spark) > API audit for Aggregator > >

[jira] [Commented] (SPARK-11901) API audit for Aggregator

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020320#comment-15020320 ] Apache Spark commented on SPARK-11901: -- User 'rxin' has created a pull request for this issue:

[jira] [Commented] (SPARK-11853) java.lang.ClassNotFoundException with spray-json on EMR

2015-11-21 Thread sam (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020381#comment-15020381 ] sam commented on SPARK-11853: - spark-submit --master yarn-client --class my.class.Main my.jar --my --jar

[jira] [Assigned] (SPARK-11891) Model export/import for RFormula and RFormulaModel

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11891: Assignee: (was: Apache Spark) > Model export/import for RFormula and RFormulaModel >

[jira] [Commented] (SPARK-11891) Model export/import for RFormula and RFormulaModel

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020325#comment-15020325 ] Apache Spark commented on SPARK-11891: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-11901) API audit for Aggregator

2015-11-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11901. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.6.0 > API audit for

[jira] [Assigned] (SPARK-11891) Model export/import for RFormula and RFormulaModel

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11891: Assignee: Apache Spark > Model export/import for RFormula and RFormulaModel >

[jira] [Commented] (SPARK-8233) misc function: hash

2015-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15020324#comment-15020324 ] Apache Spark commented on SPARK-8233: - User 'viirya' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-6725) Model export/import for Pipeline API

2015-11-21 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-6725: - Comment: was deleted (was: Unlike other models in ML package extend from XXXParams as with their

[jira] [Created] (SPARK-11901) API audit for Aggregator

2015-11-21 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-11901: --- Summary: API audit for Aggregator Key: SPARK-11901 URL: https://issues.apache.org/jira/browse/SPARK-11901 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-11900) Add since version for all encoders

2015-11-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-11900: --- Assignee: Reynold Xin > Add since version for all encoders >

[jira] [Resolved] (SPARK-11900) Add since version for all encoders

2015-11-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-11900. - Resolution: Fixed Fix Version/s: 1.6.0 > Add since version for all encoders >

[jira] [Created] (SPARK-11902) Unhandled case in VectorAssembler#transform

2015-11-21 Thread Benjamin Fradet (JIRA)
Benjamin Fradet created SPARK-11902: --- Summary: Unhandled case in VectorAssembler#transform Key: SPARK-11902 URL: https://issues.apache.org/jira/browse/SPARK-11902 Project: Spark Issue