[jira] [Assigned] (SPARK-12570) DecisionTreeRegressor: provide variance of prediction: user guide update

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12570: Assignee: Apache Spark > DecisionTreeRegressor: provide variance of prediction: user

[jira] [Commented] (SPARK-12570) DecisionTreeRegressor: provide variance of prediction: user guide update

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082631#comment-15082631 ] Apache Spark commented on SPARK-12570: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12570) DecisionTreeRegressor: provide variance of prediction: user guide update

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12570: Assignee: (was: Apache Spark) > DecisionTreeRegressor: provide variance of

[jira] [Commented] (SPARK-12623) map key_values to values

2016-01-05 Thread Elazar Gershuni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082639#comment-15082639 ] Elazar Gershuni commented on SPARK-12623: - That does not answer the question/feature request.

[jira] [Assigned] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12644: Assignee: Nong Li (was: Apache Spark) > Vectorize/Batch decode parquet >

[jira] [Assigned] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12644: Assignee: Apache Spark (was: Nong Li) > Vectorize/Batch decode parquet >

[jira] [Commented] (SPARK-12644) Vectorize/Batch decode parquet

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082629#comment-15082629 ] Apache Spark commented on SPARK-12644: -- User 'nongli' has created a pull request for this issue:

[jira] [Commented] (SPARK-12623) map key_values to values

2016-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082739#comment-15082739 ] Sean Owen commented on SPARK-12623: --- There is a {{preservesPartitioning}} flag on some API methods that

[jira] [Commented] (SPARK-12630) Make Parameter Descriptions Consistent for PySpark MLlib Classification

2016-01-05 Thread Vijay Kiran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082764#comment-15082764 ] Vijay Kiran commented on SPARK-12630: - I've made the changes, after I run the tests, I'll open a PR.

[jira] [Updated] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12645: Description: Add hash function for SparkR (was: SparkR add function hash for DataFrame) > SparkR

[jira] [Assigned] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12645: Assignee: Apache Spark > SparkR support hash function > - >

[jira] [Assigned] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12645: Assignee: (was: Apache Spark) > SparkR support hash function >

[jira] [Created] (SPARK-12646) Support _HOST in kerberos principal for connecting to secure cluster

2016-01-05 Thread Hari Krishna Dara (JIRA)
Hari Krishna Dara created SPARK-12646: - Summary: Support _HOST in kerberos principal for connecting to secure cluster Key: SPARK-12646 URL: https://issues.apache.org/jira/browse/SPARK-12646

[jira] [Resolved] (SPARK-12641) Remove unused code related to Hadoop 0.23

2016-01-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12641. - Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 > Remove unused

[jira] [Commented] (SPARK-12622) spark-submit fails on executors when jar has a space in it

2016-01-05 Thread Adrian Bridgett (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082653#comment-15082653 ] Adrian Bridgett commented on SPARK-12622: - Ajesh - that'd be a good improvement (I raised the

[jira] [Commented] (SPARK-12401) Add support for enums in postgres

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082659#comment-15082659 ] Apache Spark commented on SPARK-12401: -- User 'maropu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12401) Add support for enums in postgres

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12401: Assignee: (was: Apache Spark) > Add support for enums in postgres >

[jira] [Commented] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2016-01-05 Thread Lunen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082687#comment-15082687 ] Lunen commented on SPARK-12403: --- I've managed to get in contact with the people who develops the Spark ODBC

[jira] [Updated] (SPARK-12645) SparkR add function hash

2016-01-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12645: Summary: SparkR add function hash (was: SparkR add function hash) > SparkR add function hash >

[jira] [Updated] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12645: Summary: SparkR support hash function (was: SparkR add function hash ) > SparkR support hash

[jira] [Comment Edited] (SPARK-12623) map key_values to values

2016-01-05 Thread Elazar Gershuni (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082639#comment-15082639 ] Elazar Gershuni edited comment on SPARK-12623 at 1/5/16 8:41 AM: - That

[jira] [Commented] (SPARK-12632) Make Parameter Descriptions Consistent for PySpark MLlib FPM and Recommendation

2016-01-05 Thread somil deshmukh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082643#comment-15082643 ] somil deshmukh commented on SPARK-12632: I would like to work on this > Make Parameter

[jira] [Updated] (SPARK-11806) Spark 2.0 deprecations and removals

2016-01-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11806: Description: This is an umbrella ticket to track things we are deprecating and removing in Spark

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

2016-01-05 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082674#comment-15082674 ] Mario Briggs commented on SPARK-12177: -- implemented here -

[jira] [Resolved] (SPARK-12403) "Simba Spark ODBC Driver 1.0" not working with 1.5.2 anymore

2016-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-12403. --- Resolution: Not A Problem OK, but as far as I can tell from this conversation it's an issue with a

[jira] [Created] (SPARK-12645) SparkR add function hash

2016-01-05 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12645: --- Summary: SparkR add function hash Key: SPARK-12645 URL: https://issues.apache.org/jira/browse/SPARK-12645 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-12645) SparkR support hash function

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082732#comment-15082732 ] Apache Spark commented on SPARK-12645: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Commented] (SPARK-7831) Mesos dispatcher doesn't deregister as a framework from Mesos when stopped

2016-01-05 Thread Nilanjan Raychaudhuri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083142#comment-15083142 ] Nilanjan Raychaudhuri commented on SPARK-7831: -- I am working on a possible fix for this. I

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083311#comment-15083311 ] Daniel Darabos commented on SPARK-11293: I have a somewhat contrived example that still leaks in

[jira] [Created] (SPARK-12651) mllib deprecation messages mention non-existent version 1.7.0

2016-01-05 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created SPARK-12651: -- Summary: mllib deprecation messages mention non-existent version 1.7.0 Key: SPARK-12651 URL: https://issues.apache.org/jira/browse/SPARK-12651 Project: Spark

[jira] [Commented] (SPARK-12431) add local checkpointing to GraphX

2016-01-05 Thread David Youd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083419#comment-15083419 ] David Youd commented on SPARK-12431: Since localCheckpoint() was partially implemented, but in a way

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

2016-01-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083326#comment-15083326 ] Daniel Darabos commented on SPARK-11293: Sorry, my example was overly complicated. This one

[jira] [Commented] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2016-01-05 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083397#comment-15083397 ] kevin yu commented on SPARK-12648: -- I can recreate the problem, I will look into this issue. Thanks.

[jira] [Assigned] (SPARK-12649) support reading bucketed table

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12649: Assignee: (was: Apache Spark) > support reading bucketed table >

[jira] [Commented] (SPARK-12649) support reading bucketed table

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083208#comment-15083208 ] Apache Spark commented on SPARK-12649: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12649) support reading bucketed table

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12649: Assignee: Apache Spark > support reading bucketed table > --

[jira] [Created] (SPARK-12648) UDF with Option[Double] throws ClassCastException

2016-01-05 Thread Mikael Valot (JIRA)
Mikael Valot created SPARK-12648: Summary: UDF with Option[Double] throws ClassCastException Key: SPARK-12648 URL: https://issues.apache.org/jira/browse/SPARK-12648 Project: Spark Issue

[jira] [Created] (SPARK-12649) support reading bucketed table

2016-01-05 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-12649: --- Summary: support reading bucketed table Key: SPARK-12649 URL: https://issues.apache.org/jira/browse/SPARK-12649 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-12650) No means to specify Xmx settings for SparkSubmit in yarn-cluster mode

2016-01-05 Thread John Vines (JIRA)
John Vines created SPARK-12650: -- Summary: No means to specify Xmx settings for SparkSubmit in yarn-cluster mode Key: SPARK-12650 URL: https://issues.apache.org/jira/browse/SPARK-12650 Project: Spark

[jira] [Commented] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-01-05 Thread Anson Abraham (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083258#comment-15083258 ] Anson Abraham commented on SPARK-11227: --- I am having this issue as well, in my environment. But

[jira] [Commented] (SPARK-12609) Make R to JVM timeout configurable

2016-01-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083506#comment-15083506 ] Felix Cheung commented on SPARK-12609: -- It looks like the timeout to socketConnection is merely the

[jira] [Commented] (SPARK-12521) DataFrame Partitions in java does not work

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083556#comment-15083556 ] Apache Spark commented on SPARK-12521: -- User 'xguo27' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-05 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves reassigned SPARK-12654: - Assignee: Thomas Graves > sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on

[jira] [Commented] (SPARK-12426) Docker JDBC integration tests are failing again

2016-01-05 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083482#comment-15083482 ] Mark Grover commented on SPARK-12426: - Sean and Josh, I got to the bottom of this. This is because

[jira] [Created] (SPARK-12652) Upgrade py4j to the incoming version 0.9.1

2016-01-05 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-12652: Summary: Upgrade py4j to the incoming version 0.9.1 Key: SPARK-12652 URL: https://issues.apache.org/jira/browse/SPARK-12652 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-12577) better support of parentheses in partition by and order by clause of window function's over clause

2016-01-05 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083590#comment-15083590 ] Thomas Sebastian commented on SPARK-12577: -- Hi Reynold, Would you share some thoughts on how did

[jira] [Updated] (SPARK-12317) Support configurate value for AUTO_BROADCASTJOIN_THRESHOLD and SHUFFLE_TARGET_POSTSHUFFLE_INPUT_SIZE with unit(e.g. kb/mb/gb) in SQLConf

2016-01-05 Thread kevin yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kevin yu updated SPARK-12317: - Summary: Support configurate value for AUTO_BROADCASTJOIN_THRESHOLD and

[jira] [Closed] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-4036. Resolution: Later > Add Conditional Random Fields (CRF) algorithm to Spark MLlib >

[jira] [Resolved] (SPARK-12438) Add SQLUserDefinedType support for encoder

2016-01-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12438. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10390

[jira] [Resolved] (SPARK-12615) Remove some deprecated APIs in RDD/SparkContext

2016-01-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-12615. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10569

[jira] [Closed] (SPARK-12098) Cross validator with multi-arm bandit search

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-12098. - Resolution: Later > Cross validator with multi-arm bandit search >

[jira] [Commented] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083631#comment-15083631 ] Joseph K. Bradley commented on SPARK-2344: -- Hi everyone, thanks a lot for your work and

[jira] [Commented] (SPARK-12651) mllib deprecation messages mention non-existent version 1.7.0

2016-01-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083474#comment-15083474 ] Sean Owen commented on SPARK-12651: --- I've got this covered in SPARK-12618 /

[jira] [Commented] (SPARK-4036) Add Conditional Random Fields (CRF) algorithm to Spark MLlib

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083604#comment-15083604 ] Joseph K. Bradley commented on SPARK-4036: -- [~hujiayin] Thanks very much for your work on this,

[jira] [Commented] (SPARK-3872) Rewrite the test for ActorInputStream.

2016-01-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083632#comment-15083632 ] Josh Rosen commented on SPARK-3872: --- Is this now "Won't Fix" for 2.0? > Rewrite the test for

[jira] [Resolved] (SPARK-12643) Set lib directory for antlr

2016-01-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-12643. - Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 2.0.0 > Set lib

[jira] [Commented] (SPARK-12098) Cross validator with multi-arm bandit search

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083610#comment-15083610 ] Joseph K. Bradley commented on SPARK-12098: --- [~yinxusen] Thanks for your work on this, but I

[jira] [Closed] (SPARK-2344) Add Fuzzy C-Means algorithm to MLlib

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-2344. Resolution: Later > Add Fuzzy C-Means algorithm to MLlib >

[jira] [Created] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-05 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-12654: - Summary: sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop Key: SPARK-12654 URL: https://issues.apache.org/jira/browse/SPARK-12654 Project:

[jira] [Commented] (SPARK-7128) Add generic bagging algorithm to spark.ml

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083671#comment-15083671 ] Joseph K. Bradley commented on SPARK-7128: -- But [~fliang] if you have a chance, then it'd be a

[jira] [Resolved] (SPARK-12439) Fix toCatalystArray and MapObjects

2016-01-05 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12439. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10391

[jira] [Comment Edited] (SPARK-12577) better support of parentheses in partition by and order by clause of window function's over clause

2016-01-05 Thread Thomas Sebastian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083590#comment-15083590 ] Thomas Sebastian edited comment on SPARK-12577 at 1/5/16 7:41 PM: -- Hi

[jira] [Commented] (SPARK-8108) Build Hive module by default (i.e. remove -Phive profile)

2016-01-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083645#comment-15083645 ] Josh Rosen commented on SPARK-8108: --- +1 on this change; it'd let us simplify certain build scripts.

[jira] [Commented] (SPARK-12654) sc.wholeTextFiles with spark.hadoop.cloneConf=true fails on secure Hadoop

2016-01-05 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083643#comment-15083643 ] Thomas Graves commented on SPARK-12654: --- So the bug here is that WholeTextFileRDD.getPartitions

[jira] [Updated] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-05 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Pivovarov updated SPARK-12655: Description: Looks like Graph does not clean all RDDs from the cache on unpersist

[jira] [Created] (SPARK-12655) GraphX does not unpersist RDDs

2016-01-05 Thread Alexander Pivovarov (JIRA)
Alexander Pivovarov created SPARK-12655: --- Summary: GraphX does not unpersist RDDs Key: SPARK-12655 URL: https://issues.apache.org/jira/browse/SPARK-12655 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-11696) MLLIB:Optimization - Extend optimizer output for GradientDescent and LBFGS

2016-01-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley closed SPARK-11696. - Resolution: Won't Fix [~Narine] I just commented on your PR about this, but I'd like to

[jira] [Assigned] (SPARK-12295) Manage the memory used by window function

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12295: Assignee: Apache Spark > Manage the memory used by window function >

[jira] [Assigned] (SPARK-12295) Manage the memory used by window function

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12295: Assignee: (was: Apache Spark) > Manage the memory used by window function >

[jira] [Commented] (SPARK-12295) Manage the memory used by window function

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15083707#comment-15083707 ] Apache Spark commented on SPARK-12295: -- User 'davies' has created a pull request for this issue:

[jira] [Commented] (SPARK-12662) Add document to randomSplit to explain the sampling depends on the ordering of the rows in a partition

2016-01-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085007#comment-15085007 ] Reynold Xin commented on SPARK-12662: - Yea [~yhuai] and I talked offline and thought just adding a

[jira] [Updated] (SPARK-12671) Improve tests for better coverage

2016-01-05 Thread Hossein Falaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hossein Falaki updated SPARK-12671: --- Affects Version/s: 2.0.0 > Improve tests for better coverage >

[jira] [Created] (SPARK-12671) Improve tests for better coverage

2016-01-05 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-12671: -- Summary: Improve tests for better coverage Key: SPARK-12671 URL: https://issues.apache.org/jira/browse/SPARK-12671 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7924) Consolidate example code in MLlib

2016-01-05 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085175#comment-15085175 ] Xusen Yin commented on SPARK-7924: -- [~mengxr] One reminder, don't we merge the

[jira] [Commented] (SPARK-11139) Make SparkContext.stop() exception-safe

2016-01-05 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085172#comment-15085172 ] Felix Cheung commented on SPARK-11139: -- it looks like this might have been resolved by

[jira] [Commented] (SPARK-12665) Remove deprecated and unused classes

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084999#comment-15084999 ] Apache Spark commented on SPARK-12665: -- User 'sarutak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-12665) Remove deprecated and unused classes

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12665: Assignee: Apache Spark > Remove deprecated and unused classes >

[jira] [Assigned] (SPARK-12665) Remove deprecated and unused classes

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12665: Assignee: (was: Apache Spark) > Remove deprecated and unused classes >

[jira] [Resolved] (SPARK-12393) Add read.text and write.text for SparkR

2016-01-05 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12393. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Created] (SPARK-12670) Use spark internal utilities wherever possible

2016-01-05 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-12670: -- Summary: Use spark internal utilities wherever possible Key: SPARK-12670 URL: https://issues.apache.org/jira/browse/SPARK-12670 Project: Spark Issue

[jira] [Created] (SPARK-12668) Renaming CSV options to be similar to Pandas and R

2016-01-05 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-12668: -- Summary: Renaming CSV options to be similar to Pandas and R Key: SPARK-12668 URL: https://issues.apache.org/jira/browse/SPARK-12668 Project: Spark

[jira] [Created] (SPARK-12669) Organize options for default values

2016-01-05 Thread Hossein Falaki (JIRA)
Hossein Falaki created SPARK-12669: -- Summary: Organize options for default values Key: SPARK-12669 URL: https://issues.apache.org/jira/browse/SPARK-12669 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-12666) spark-shell --packages cannot load artifacts which are publishLocal'd by SBT

2016-01-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-12666: --- Description: Symptom: I cloned the latest master of {{spark-redshift}}, then used {{sbt

[jira] [Commented] (SPARK-12433) Make parts of the core Spark testing API public to assist developers making their own tests.

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085050#comment-15085050 ] Apache Spark commented on SPARK-12433: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-12098) Cross validator with multi-arm bandit search

2016-01-05 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085075#comment-15085075 ] Xusen Yin commented on SPARK-12098: --- [~josephkb] I understand that. I'll try to publish it as a Spark

[jira] [Commented] (SPARK-12422) Binding Spark Standalone Master to public IP fails

2016-01-05 Thread Tommy Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084913#comment-15084913 ] Tommy Yu commented on SPARK-12422: -- Hi For docker images, can you please check /etc/hosts file and

[jira] [Commented] (SPARK-3873) Scala style: check import ordering

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084613#comment-15084613 ] Apache Spark commented on SPARK-3873: - User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-12563) "No suitable driver" when calling JdbcUtils.saveTable in isolation

2016-01-05 Thread Sonya Huang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15084963#comment-15084963 ] Sonya Huang commented on SPARK-12563: - Thanks [~jayadevan.m]. It looks like right after you posted

[jira] [Commented] (SPARK-11607) Update MLlib website for 1.6

2016-01-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085045#comment-15085045 ] Xiangrui Meng commented on SPARK-11607: --- Listed bisecting k-means and accelerated failure time

[jira] [Created] (SPARK-12667) Remove block manager's internal "external block store" API

2016-01-05 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-12667: --- Summary: Remove block manager's internal "external block store" API Key: SPARK-12667 URL: https://issues.apache.org/jira/browse/SPARK-12667 Project: Spark

[jira] [Assigned] (SPARK-12420) Have a built-in CSV data source implementation

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12420: Assignee: Apache Spark > Have a built-in CSV data source implementation >

[jira] [Assigned] (SPARK-12420) Have a built-in CSV data source implementation

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12420: Assignee: (was: Apache Spark) > Have a built-in CSV data source implementation >

[jira] [Commented] (SPARK-12420) Have a built-in CSV data source implementation

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085097#comment-15085097 ] Apache Spark commented on SPARK-12420: -- User 'falaki' has created a pull request for this issue:

[jira] [Commented] (SPARK-11139) Make SparkContext.stop() exception-safe

2016-01-05 Thread Jayadevan M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15085135#comment-15085135 ] Jayadevan M commented on SPARK-11139: - [~felixcheung] Is this issue resolved ? If yes can you tell

[jira] [Updated] (SPARK-12454) Add ExpressionDescription to expressions that are registered in FunctionRegistry

2016-01-05 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-12454: - Summary: Add ExpressionDescription to expressions that are registered in FunctionRegistry (was: Add

[jira] [Assigned] (SPARK-12433) Make parts of the core Spark testing API public to assist developers making their own tests.

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12433: Assignee: Apache Spark > Make parts of the core Spark testing API public to assist

[jira] [Assigned] (SPARK-12433) Make parts of the core Spark testing API public to assist developers making their own tests.

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12433: Assignee: (was: Apache Spark) > Make parts of the core Spark testing API public to

[jira] [Closed] (SPARK-12433) Make parts of the core Spark testing API public to assist developers making their own tests.

2016-01-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-12433. --- Resolution: Won't Fix Sorry I don't think we should have this. This is bad for API evolution and

[jira] [Assigned] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12436: Assignee: (was: Apache Spark) > If all values of a JSON field is null, JSON's

[jira] [Assigned] (SPARK-12436) If all values of a JSON field is null, JSON's inferSchema should return NullType instead of StringType

2016-01-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12436: Assignee: Apache Spark > If all values of a JSON field is null, JSON's inferSchema should

  1   2   3   >