[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341167#comment-15341167 ] Bo Meng commented on SPARK-16084: - Ok! I will do next time by sending to the mailing list if it is a doc

[jira] [Closed] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weijie.tong closed SPARK-16068. --- > ml model import jpmml which includes wrong jaxb-impl version 2.2.7 >

[jira] [Commented] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341153#comment-15341153 ] weijie.tong commented on SPARK-16068: - ok > ml model import jpmml which includes wrong jaxb-impl

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341145#comment-15341145 ] Sean Owen commented on SPARK-16084: --- This is covered in

[jira] [Commented] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341144#comment-15341144 ] Sean Owen commented on SPARK-16085: --- I can't reproduce this. I have Spark 1.6 here and running in

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341142#comment-15341142 ] Shivaram Venkataraman commented on SPARK-16088: --- Why don't we convert these also to the

[jira] [Commented] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341141#comment-15341141 ] Bo Meng commented on SPARK-16084: - [~sowen] Please let me know how to handle it next time if I am not

[jira] [Resolved] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16068. --- Resolution: Not A Problem No, updating JPMML in the 1.6.x line could potentially cause an app to

[jira] [Updated] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-16084: -- Priority: Trivial (was: Minor) Issue Type: Improvement (was: Bug) This doesn't need a JIRA >

[jira] [Commented] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341126#comment-15341126 ] Felix Cheung commented on SPARK-16088: -- Not clear what should be the right behavior but

[jira] [Commented] (SPARK-13792) Limit logging of bad records

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341123#comment-15341123 ] Apache Spark commented on SPARK-13792: -- User 'rxin' has created a pull request for this issue:

[jira] [Updated] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Description: Since they uses SparkContext? > Deprecate setJobGroup, clearJobGroup,

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2016-06-20 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341121#comment-15341121 ] Takeshi Yamamuro commented on SPARK-10186: -- What's the schema of `xyz`? what's the types that

[jira] [Updated] (SPARK-16088) Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16088: - Summary: Deprecate setJobGroup, clearJobGroup, cancelJobGroup from SparkR API (was: Remove

[jira] [Commented] (SPARK-15746) SchemaUtils.checkColumnType with VectorUDT prints instance details in error message

2016-06-20 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341110#comment-15341110 ] Miao Wang commented on SPARK-15746: --- Just noticed your reply. I will start work on it. >

[jira] [Comment Edited] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340001#comment-15340001 ] Yin Huai edited comment on SPARK-16032 at 6/21/16 5:11 AM: --- I am attaching a

[jira] [Resolved] (SPARK-16025) Document OFF_HEAP storage level in 2.0

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16025. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.0.0 > Document OFF_HEAP

[jira] [Resolved] (SPARK-16044) input_file_name() returns empty strings in data sources based on NewHadoopRDD.

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16044. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16074. - Resolution: Fixed Fix Version/s: 2.0.0 > Expose VectorUDT/MatrixUDT in a public API >

[jira] [Resolved] (SPARK-16058) JDBC Source: Wrong Results when lowerBound is larger than upperBound in Column Partitioning

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16058. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > JDBC Source: Wrong

[jira] [Resolved] (SPARK-16056) java.lang.ArithmeticException when numPartitions is zero in JDBC source

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16056. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 >

[jira] [Resolved] (SPARK-16057) JDBC source: Wrong Partition Generation when numPartitions is More than the number of rows between upper and lower bounds

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16057. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.0.0 > JDBC source: Wrong

[jira] [Resolved] (SPARK-13792) Limit logging of bad records

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13792. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 2.0.0 > Limit logging of

[jira] [Commented] (SPARK-10186) Add support for more postgres column types

2016-06-20 Thread Nipun Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341070#comment-15341070 ] Nipun Agarwal commented on SPARK-10186: --- I run spark in pyspark as ./bin/pyspark --packages

[jira] [Commented] (SPARK-15863) Update SQL programming guide for Spark 2.0

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341065#comment-15341065 ] Apache Spark commented on SPARK-15863: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341036#comment-15341036 ] Apache Spark commented on SPARK-16088: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16088: Assignee: (was: Apache Spark) > Remove setJobGroup, clearJobGroup, cancelJobGroup

[jira] [Assigned] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16088: Assignee: Apache Spark > Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR

[jira] [Created] (SPARK-16088) Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API

2016-06-20 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-16088: Summary: Remove setJobGroup, clearJobGroup, cancelJobGroup from SparkR API Key: SPARK-16088 URL: https://issues.apache.org/jira/browse/SPARK-16088 Project: Spark

[jira] [Resolved] (SPARK-15294) Add pivot functionality to SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-15294. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s:

[jira] [Reopened] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] weijie.tong reopened SPARK-16068: - wish to exclude the jaxb-impl artifact in ML pom.xml > ml model import jpmml which includes wrong

[jira] [Commented] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341023#comment-15341023 ] weijie.tong commented on SPARK-16068: - Now ,I exclude the jaxb-impl artifact in the ML model pom.xml

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341021#comment-15341021 ] Yin Huai commented on SPARK-16032: -- [~rdblue] Thank you for your feedback. Those are great input for the

[jira] [Assigned] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15894: Assignee: Takeshi Yamamuro (was: Apache Spark) > Add doc to control #partition for input

[jira] [Commented] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15341016#comment-15341016 ] Apache Spark commented on SPARK-15894: -- User 'maropu' has created a pull request for this issue:

[jira] [Resolved] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-16086. Resolution: Fixed Fix Version/s: 1.6.2 1.5.3 2.0.0

[jira] [Assigned] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15894: Assignee: Apache Spark (was: Takeshi Yamamuro) > Add doc to control #partition for input

[jira] [Assigned] (SPARK-7159) Support multiclass logistic regression in spark.ml

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7159: --- Assignee: DB Tsai (was: Apache Spark) > Support multiclass logistic regression in spark.ml

[jira] [Commented] (SPARK-7159) Support multiclass logistic regression in spark.ml

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340987#comment-15340987 ] Apache Spark commented on SPARK-7159: - User 'sethah' has created a pull request for this issue:

[jira] [Assigned] (SPARK-7159) Support multiclass logistic regression in spark.ml

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7159: --- Assignee: Apache Spark (was: DB Tsai) > Support multiclass logistic regression in spark.ml

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340966#comment-15340966 ] Wenchen Fan commented on SPARK-16032: - > The pre-insert checks currently live in the

[jira] [Updated] (SPARK-15894) Add doc to control #partition for input files

2016-06-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-15894: --- Assignee: Takeshi Yamamuro > Add doc to control #partition for input files >

[jira] [Commented] (SPARK-16068) ml model import jpmml which includes wrong jaxb-impl version 2.2.7

2016-06-20 Thread weijie.tong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340949#comment-15340949 ] weijie.tong commented on SPARK-16068: - hi Sean Owen,at least I think we maybe need to update JPMML to

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340929#comment-15340929 ] Ryan Blue commented on SPARK-16032: --- Overall, I'm *-1* on these changes going into Spark 2.0. Looking

[jira] [Commented] (SPARK-13792) Limit logging of bad records

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340885#comment-15340885 ] Apache Spark commented on SPARK-13792: -- User 'rxin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11227: Assignee: Apache Spark > Spark1.5+ HDFS HA mode throw java.net.UnknownHostException:

[jira] [Assigned] (SPARK-11227) Spark1.5+ HDFS HA mode throw java.net.UnknownHostException: nameservice1

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11227: Assignee: (was: Apache Spark) > Spark1.5+ HDFS HA mode throw

[jira] [Updated] (SPARK-13510) Shuffle may throw FetchFailedException: Direct buffer memory

2016-06-20 Thread Hong Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Shen updated SPARK-13510: -- Attachment: spark-13510.diff Add FetchStream for shuffle, if the fetch file is bigger than

[jira] [Updated] (SPARK-15968) HiveMetastoreCatalog does not correctly validate partitioned metastore relation when searching the internal table cache

2016-06-20 Thread Michael Allman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Allman updated SPARK-15968: --- Description: The {{getCached}} method of {{HiveMetastoreCatalog}} computes

[jira] [Commented] (SPARK-16032) Audit semantics of various insertion operations related to partitioned tables

2016-06-20 Thread Ryan Blue (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340797#comment-15340797 ] Ryan Blue commented on SPARK-16032: --- I'm going to put review comments here because the PRs are already

[jira] [Assigned] (SPARK-15574) Python meta-algorithms in Scala

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15574: Assignee: Apache Spark > Python meta-algorithms in Scala >

[jira] [Commented] (SPARK-15574) Python meta-algorithms in Scala

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340788#comment-15340788 ] Apache Spark commented on SPARK-15574: -- User 'yinxusen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-15574) Python meta-algorithms in Scala

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-15574: Assignee: (was: Apache Spark) > Python meta-algorithms in Scala >

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: SPARK-16087.dump.log Attaching thread dump > Spark Hangs When Using Union With

[jira] [Commented] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Jonathan Kelly (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340722#comment-15340722 ] Jonathan Kelly commented on SPARK-16080: [~vanzin], thank you very much for the quick fix! You

[jira] [Updated] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16086: --- Description: {code} >>> sqlContext.registerFunction("f", lambda : "a") >>> sqlContext.sql("select

[jira] [Commented] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340713#comment-15340713 ] Apache Spark commented on SPARK-16086: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16086: Assignee: Apache Spark (was: Davies Liu) > Python UDF failed when there is no arguments

[jira] [Assigned] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16086: Assignee: Davies Liu (was: Apache Spark) > Python UDF failed when there is no arguments

[jira] [Updated] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-16086: --- Affects Version/s: 1.5.2 > Python UDF failed when there is no arguments >

[jira] [Resolved] (SPARK-16009) DataFrameRead.json(path) compatibility broken with Spark 1.6

2016-06-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-16009. -- Resolution: Fixed Fix Version/s: 2.0.0 > DataFrameRead.json(path) compatibility broken

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: SPARK-16087.log Attaching output from running this sample. You can see that it

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: part-0 > Spark Hangs When Using Union With Persisted Hadoop RDD >

[jira] [Updated] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Conaway updated SPARK-16087: -- Attachment: part-1 > Spark Hangs When Using Union With Persisted Hadoop RDD >

[jira] [Created] (SPARK-16087) Spark Hangs When Using Union With Persisted Hadoop RDD

2016-06-20 Thread Kevin Conaway (JIRA)
Kevin Conaway created SPARK-16087: - Summary: Spark Hangs When Using Union With Persisted Hadoop RDD Key: SPARK-16087 URL: https://issues.apache.org/jira/browse/SPARK-16087 Project: Spark

[jira] [Resolved] (SPARK-16079) PySpark ML classification missing import of DecisionTreeRegressionModel for GBTClassificationModel

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-16079. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13787

[jira] [Updated] (SPARK-16079) PySpark ML classification missing import of DecisionTreeRegressionModel for GBTClassificationModel

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16079: -- Assignee: Bryan Cutler > PySpark ML classification missing import of

[jira] [Updated] (SPARK-16079) PySpark ML classification missing import of DecisionTreeRegressionModel for GBTClassificationModel

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-16079: -- Affects Version/s: 2.0.0 > PySpark ML classification missing import of

[jira] [Commented] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

2016-06-20 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340642#comment-15340642 ] Xiangrui Meng commented on SPARK-16074: --- Picked option 2) because we don't have any Java source

[jira] [Created] (SPARK-16086) Python UDF failed when there is no arguments

2016-06-20 Thread Davies Liu (JIRA)
Davies Liu created SPARK-16086: -- Summary: Python UDF failed when there is no arguments Key: SPARK-16086 URL: https://issues.apache.org/jira/browse/SPARK-16086 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

2016-06-20 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated SPARK-16085: --- Affects Version/s: 1.6.1 > Spark stand-alone ui redirects to RM application master UI for

[jira] [Created] (SPARK-16085) Spark stand-alone ui redirects to RM application master UI for yarn-client mode

2016-06-20 Thread Yesha Vora (JIRA)
Yesha Vora created SPARK-16085: -- Summary: Spark stand-alone ui redirects to RM application master UI for yarn-client mode Key: SPARK-16085 URL: https://issues.apache.org/jira/browse/SPARK-16085 Project:

[jira] [Assigned] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16080: Assignee: Apache Spark > Config archive not properly added to YARN classpath >

[jira] [Assigned] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16080: Assignee: (was: Apache Spark) > Config archive not properly added to YARN classpath >

[jira] [Commented] (SPARK-16080) Config archive not properly added to YARN classpath

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340602#comment-15340602 ] Apache Spark commented on SPARK-16080: -- User 'vanzin' has created a pull request for this issue:

[jira] [Updated] (SPARK-16084) Minor javadoc issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Meng updated SPARK-16084: Summary: Minor javadoc issue with "Describe" table in the parser (was: Minor issue with "Describe" table

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: 27814004000_spark_heap_2016-06-17_12-05.hprof.gz > spark HistoryServer memory

[jira] [Assigned] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16084: Assignee: Apache Spark > Minor issue with "Describe" table in the parser >

[jira] [Assigned] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16084: Assignee: (was: Apache Spark) > Minor issue with "Describe" table in the parser >

[jira] [Commented] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340597#comment-15340597 ] Apache Spark commented on SPARK-16084: -- User 'bomeng' has created a pull request for this issue:

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: spark-spark-org.apache.spark.deploy.history.HistoryServer-1-testbic1on5l.out.4

[jira] [Updated] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-20 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narine Kokhlikyan updated SPARK-16082: -- Description: Currently when we generate R documentation for dapply and dapplyCollect

[jira] [Updated] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sudhakar Thota updated SPARK-16083: --- Attachment: 27814.004.000.sparkhistoryservermemory.log.1 > spark HistoryServer memory

[jira] [Created] (SPARK-16084) Minor issue with "Describe" table in the parser

2016-06-20 Thread Bo Meng (JIRA)
Bo Meng created SPARK-16084: --- Summary: Minor issue with "Describe" table in the parser Key: SPARK-16084 URL: https://issues.apache.org/jira/browse/SPARK-16084 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-16083) spark HistoryServer memory increases until gets killed by OS.

2016-06-20 Thread Sudhakar Thota (JIRA)
Sudhakar Thota created SPARK-16083: -- Summary: spark HistoryServer memory increases until gets killed by OS. Key: SPARK-16083 URL: https://issues.apache.org/jira/browse/SPARK-16083 Project: Spark

[jira] [Created] (SPARK-16082) Refactor dapply's/dapplyCollect's documentation - remove duplicated comments

2016-06-20 Thread Narine Kokhlikyan (JIRA)
Narine Kokhlikyan created SPARK-16082: - Summary: Refactor dapply's/dapplyCollect's documentation - remove duplicated comments Key: SPARK-16082 URL: https://issues.apache.org/jira/browse/SPARK-16082

[jira] [Commented] (SPARK-16074) Expose VectorUDT/MatrixUDT in a public API

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340528#comment-15340528 ] Apache Spark commented on SPARK-16074: -- User 'mengxr' has created a pull request for this issue:

[jira] [Updated] (SPARK-16061) The property "spark.streaming.stateStore.maintenanceInterval" should be renamed to "spark.sql.streaming.stateStore.maintenanceInterval"

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16061: Affects Version/s: (was: 2.1.0) (was: 2.0.0) > The property

[jira] [Updated] (SPARK-16061) The property "spark.streaming.stateStore.maintenanceInterval" should be renamed to "spark.sql.streaming.stateStore.maintenanceInterval"

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16061: Target Version/s: (was: 2.1.0) > The property "spark.streaming.stateStore.maintenanceInterval"

[jira] [Resolved] (SPARK-16061) The property "spark.streaming.stateStore.maintenanceInterval" should be renamed to "spark.sql.streaming.stateStore.maintenanceInterval"

2016-06-20 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16061. - Resolution: Fixed Assignee: Kousuke Saruta Fix Version/s: 2.0.0 > The property

[jira] [Resolved] (SPARK-15982) Harmonize the behavior of DataFrameReader.text/csv/json/parquet/orc

2016-06-20 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15982. -- Resolution: Fixed Fix Version/s: 2.0.0 > Harmonize the behavior of

[jira] [Resolved] (SPARK-15863) Update SQL programming guide for Spark 2.0

2016-06-20 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-15863. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 13592

[jira] [Created] (SPARK-16081) Disallow using "l" as variable name

2016-06-20 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-16081: --- Summary: Disallow using "l" as variable name Key: SPARK-16081 URL: https://issues.apache.org/jira/browse/SPARK-16081 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-6836) RDD APIs missing in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-6836. -- Resolution: Won't Fix Marking this as resolved as the RDD API is no longer

[jira] [Resolved] (SPARK-12144) Support more external data source API in SparkR

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-12144. --- Resolution: Fixed Fix Version/s: 1.6.0 Resolving the umbrella as

[jira] [Commented] (SPARK-16077) Python UDF may fail because of six

2016-06-20 Thread Bill Chambers (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340459#comment-15340459 ] Bill Chambers commented on SPARK-16077: --- [~davies] was this one the one that I had reported? >

[jira] [Commented] (SPARK-16077) Python UDF may fail because of six

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340454#comment-15340454 ] Apache Spark commented on SPARK-16077: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-16077) Python UDF may fail because of six

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16077: Assignee: (was: Apache Spark) > Python UDF may fail because of six >

[jira] [Assigned] (SPARK-16077) Python UDF may fail because of six

2016-06-20 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16077: Assignee: Apache Spark > Python UDF may fail because of six >

[jira] [Resolved] (SPARK-14995) Add "since" tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-14995. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s:

  1   2   3   >