[jira] [Commented] (SPARK-19217) Offer easy cast from vector to array

2017-01-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823007#comment-15823007 ] Takeshi Yamamuro commented on SPARK-19217: -- Would it be better that `cast` support this

[jira] [Commented] (SPARK-19208) MaxAbsScaler and MinMaxScaler are very inefficient

2017-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822762#comment-15822762 ] Sean Owen commented on SPARK-19208: --- The super sparse high-dimensional cases don't seem like cases

[jira] [Commented] (SPARK-3249) Fix links in ScalaDoc that cause warning messages in `sbt/sbt unidoc`

2017-01-14 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822750#comment-15822750 ] Sean Owen commented on SPARK-3249: -- Yes, I remember someone else reported there may be new unidoc

[jira] [Commented] (SPARK-18570) Consider supporting other R formula operators

2017-01-14 Thread Krishna Kalyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822922#comment-15822922 ] Krishna Kalyan commented on SPARK-18570: Thanks [~yanboliang] [~felixcheung], We could start by

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

2017-01-14 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822934#comment-15822934 ] Nicholas Chammas commented on SPARK-18492: -- I suppose the "correct" solution is to make code

[jira] [Created] (SPARK-19224) [PYSPARK] Python tests organization

2017-01-14 Thread Saikat Kanjilal (JIRA)
Saikat Kanjilal created SPARK-19224: --- Summary: [PYSPARK] Python tests organization Key: SPARK-19224 URL: https://issues.apache.org/jira/browse/SPARK-19224 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

2017-01-14 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822939#comment-15822939 ] Nicholas Chammas commented on SPARK-18492: -- Oh, it looks like this issue is duplicated by

[jira] [Commented] (SPARK-18492) GeneratedIterator grows beyond 64 KB

2017-01-14 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15822940#comment-15822940 ] Nicholas Chammas commented on SPARK-18492: -- Actually, on second look, I'm not entirely sure

[jira] [Resolved] (SPARK-19221) Add winutils binaries to Path in AppVeyor for Hadoop libraries to call native libraries properly

2017-01-14 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-19221. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.2.0

[jira] [Resolved] (SPARK-19151) DataFrameWriter.saveAsTable should work with hive format with overwrite mode

2017-01-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19151. - Resolution: Fixed Fix Version/s: 2.2.0 > DataFrameWriter.saveAsTable should work with hive format

[jira] [Updated] (SPARK-19151) DataFrameWriter.saveAsTable should work with hive format with overwrite mode

2017-01-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-19151: Assignee: Song Jun > DataFrameWriter.saveAsTable should work with hive format with overwrite mode >

[jira] [Commented] (SPARK-19222) Limit Query Performance issue

2017-01-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823005#comment-15823005 ] Takeshi Yamamuro commented on SPARK-19222: -- In those cases, "sample + select" is not enough?

[jira] [Updated] (SPARK-17237) DataFrame fill after pivot causing org.apache.spark.sql.AnalysisException

2017-01-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17237: Fix Version/s: 2.0.3 > DataFrame fill after pivot causing org.apache.spark.sql.AnalysisException >

[jira] [Updated] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

2017-01-14 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17458: Fix Version/s: 2.0.3 > Alias specified for aggregates in a pivot are not honored >

[jira] [Updated] (SPARK-10890) "Column count does not match; SQL statement:" error in JDBCWriteSuite

2017-01-14 Thread Christian Kadner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Kadner updated SPARK-10890: - Description: I get the following error when I run the following test... mvn

[jira] [Closed] (SPARK-19005) Keep column ordering when a schema is explicitly specified

2017-01-14 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro closed SPARK-19005. Resolution: Won't Fix > Keep column ordering when a schema is explicitly specified >

[jira] [Commented] (SPARK-17458) Alias specified for aggregates in a pivot are not honored

2017-01-14 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823010#comment-15823010 ] Apache Spark commented on SPARK-17458: -- User 'maropu' has created a pull request for this issue:

[jira] [Created] (SPARK-19225) Spark SQL round constant double return null

2017-01-14 Thread discipleforteen (JIRA)
discipleforteen created SPARK-19225: --- Summary: Spark SQL round constant double return null Key: SPARK-19225 URL: https://issues.apache.org/jira/browse/SPARK-19225 Project: Spark Issue