[jira] [Assigned] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18176: Assignee: Apache Spark > Kafka010 .createRDD() scala API should expect scala Map >

[jira] [Assigned] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18176: Assignee: (was: Apache Spark) > Kafka010 .createRDD() scala API should expect scala

[jira] [Commented] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621075#comment-15621075 ] Apache Spark commented on SPARK-18176: -- User 'lw-lin' has created a pull request for this issue:

[jira] [Updated] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

[ https://issues.apache.org/jira/browse/SPARK-18176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liwei Lin updated SPARK-18176: -- Description: Thoughout {{external/kafka-010}}, Java APIs are expecting {{java.lang.Maps}} and Scala

[jira] [Created] (SPARK-18176) Kafka010 .createRDD() scala API should expect scala Map

Liwei Lin created SPARK-18176: - Summary: Kafka010 .createRDD() scala API should expect scala Map Key: SPARK-18176 URL: https://issues.apache.org/jira/browse/SPARK-18176 Project: Spark Issue

[jira] [Commented] (SPARK-17791) Join reordering using star schema detection

[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15621070#comment-15621070 ] Zhenhua Wang commented on SPARK-17791: -- Hi Ioana, The current implementation is NOT ready because we

[jira] [Updated] (SPARK-17952) SparkSession createDataFrame method throws exception for nested JavaBeans

[ https://issues.apache.org/jira/browse/SPARK-17952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Baghel updated SPARK-17952: Summary: SparkSession createDataFrame method throws exception for nested JavaBeans (was: Java

[jira] [Assigned] (SPARK-18175) Improve the test case coverage of implicit type casting

[ https://issues.apache.org/jira/browse/SPARK-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18175: Assignee: Apache Spark > Improve the test case coverage of implicit type casting >

[jira] [Assigned] (SPARK-18175) Improve the test case coverage of implicit type casting

[ https://issues.apache.org/jira/browse/SPARK-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18175: Assignee: (was: Apache Spark) > Improve the test case coverage of implicit type

[jira] [Commented] (SPARK-18175) Improve the test case coverage of implicit type casting

[ https://issues.apache.org/jira/browse/SPARK-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620930#comment-15620930 ] Apache Spark commented on SPARK-18175: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Created] (SPARK-18175) Improve the test case coverage of implicit type casting

Xiao Li created SPARK-18175: --- Summary: Improve the test case coverage of implicit type casting Key: SPARK-18175 URL: https://issues.apache.org/jira/browse/SPARK-18175 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16740) joins.LongToUnsafeRowMap crashes with NegativeArraySizeException

[ https://issues.apache.org/jira/browse/SPARK-16740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620885#comment-15620885 ] Harish commented on SPARK-16740: Thank you. I downloaded the 2.0.2 snapshot with 2.7 Hadoop (i think its

[jira] [Commented] (SPARK-12648) UDF with Option[Double] throws ClassCastException

[ https://issues.apache.org/jira/browse/SPARK-12648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620882#comment-15620882 ] Grant Neale commented on SPARK-12648: - This works for single, argument UDFs. However, one may want

[jira] [Commented] (SPARK-16740) joins.LongToUnsafeRowMap crashes with NegativeArraySizeException

[ https://issues.apache.org/jira/browse/SPARK-16740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620813#comment-15620813 ] Dongjoon Hyun commented on SPARK-16740: --- Hi, [~harishk15] Yep. The patch is still there in

[jira] [Commented] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

[ https://issues.apache.org/jira/browse/SPARK-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620785#comment-15620785 ] Xiao Li commented on SPARK-18174: - Yeah. Your concern is right. The impact of implicit type casting is

[jira] [Resolved] (SPARK-18110) Missing parameter in Python for RandomForest regression and classification

[ https://issues.apache.org/jira/browse/SPARK-18110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-18110. -- Resolution: Fixed Fix Version/s: 2.1.0 > Missing parameter in Python for RandomForest

[jira] [Resolved] (SPARK-16137) Random Forest wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-16137. -- Resolution: Fixed Assignee: Felix Cheung Target Version/s: 2.1.0 >

[jira] [Updated] (SPARK-16137) Random Forest wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-16137: - Fix Version/s: 2.1.0 > Random Forest wrapper in SparkR > --- > >

[jira] [Updated] (SPARK-17919) Make timeout to RBackend configurable in SparkR

[ https://issues.apache.org/jira/browse/SPARK-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-17919: - Fix Version/s: 2.1.0 > Make timeout to RBackend configurable in SparkR >

[jira] [Commented] (SPARK-15616) Metastore relation should fallback to HDFS size of partitions that are involved in Query if statistics are not available.

[ https://issues.apache.org/jira/browse/SPARK-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620750#comment-15620750 ] Franck Tago commented on SPARK-15616: - SO was not able to use the changes for the following reasons

[jira] [Resolved] (SPARK-17919) Make timeout to RBackend configurable in SparkR

[ https://issues.apache.org/jira/browse/SPARK-17919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung resolved SPARK-17919. -- Resolution: Fixed Assignee: Hossein Falaki > Make timeout to RBackend configurable in

[jira] [Commented] (SPARK-16740) joins.LongToUnsafeRowMap crashes with NegativeArraySizeException

[ https://issues.apache.org/jira/browse/SPARK-16740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620711#comment-15620711 ] Harish commented on SPARK-16740: is this fix is available in 2.0.2 snapshot?. Please confirm >

[jira] [Commented] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

[ https://issues.apache.org/jira/browse/SPARK-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620685#comment-15620685 ] Herman van Hovell commented on SPARK-18174: --- [~smilegator] Won't this create a regression for

[jira] [Resolved] (SPARK-18106) Analyze Table accepts a garbage identifier at the end

[ https://issues.apache.org/jira/browse/SPARK-18106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18106. --- Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.1.0 >

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620657#comment-15620657 ] Saikat Kanjilal commented on SPARK-9487: Added org.apache.spark.mllib unitTest changes to pull

[jira] [Comment Edited] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620613#comment-15620613 ] Saikat Kanjilal edited comment on SPARK-9487 at 10/30/16 9:46 PM: --

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620613#comment-15620613 ] Saikat Kanjilal commented on SPARK-9487: [~srowen] Yes I read through that and adjusted the PR

[jira] [Comment Edited] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620613#comment-15620613 ] Saikat Kanjilal edited comment on SPARK-9487 at 10/30/16 9:40 PM: --

[jira] [Assigned] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9487: --- Assignee: (was: Apache Spark) > Use the same num. worker threads in Scala/Python unit

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620610#comment-15620610 ] Apache Spark commented on SPARK-9487: - User 'skanjila' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9487: --- Assignee: Apache Spark > Use the same num. worker threads in Scala/Python unit tests >

[jira] [Comment Edited] (SPARK-17791) Join reordering using star schema detection

[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620517#comment-15620517 ] Ioana Delaney edited comment on SPARK-17791 at 10/30/16 8:22 PM: -

[jira] [Commented] (SPARK-17791) Join reordering using star schema detection

[ https://issues.apache.org/jira/browse/SPARK-17791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620517#comment-15620517 ] Ioana Delaney commented on SPARK-17791: --- [~ron8hu] I appreciate your comment. Thank you. I agree

[jira] [Resolved] (SPARK-18103) Rename *FileCatalog to *FileProvider

[ https://issues.apache.org/jira/browse/SPARK-18103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18103. - Resolution: Fixed Assignee: Eric Liang Fix Version/s: 2.1.0 > Rename

[jira] [Assigned] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

[ https://issues.apache.org/jira/browse/SPARK-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18174: Assignee: (was: Apache Spark) > Avoid Implicit Type Cast in Arguments of Expressions

[jira] [Commented] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

[ https://issues.apache.org/jira/browse/SPARK-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620431#comment-15620431 ] Apache Spark commented on SPARK-18174: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

[ https://issues.apache.org/jira/browse/SPARK-18174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18174: Assignee: Apache Spark > Avoid Implicit Type Cast in Arguments of Expressions Extending

[jira] [Created] (SPARK-18174) Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression

Xiao Li created SPARK-18174: --- Summary: Avoid Implicit Type Cast in Arguments of Expressions Extending String2StringExpression Key: SPARK-18174 URL: https://issues.apache.org/jira/browse/SPARK-18174

[jira] [Assigned] (SPARK-3261) KMeans clusterer can return duplicate cluster centers

[ https://issues.apache.org/jira/browse/SPARK-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-3261: Assignee: Sean Owen > KMeans clusterer can return duplicate cluster centers >

[jira] [Updated] (SPARK-18170) Confusing error message when using rangeBetween without specifying an "orderBy"

[ https://issues.apache.org/jira/browse/SPARK-18170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18170: -- Target Version/s: (was: 2.0.1) > Confusing error message when using rangeBetween without specifying

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620402#comment-15620402 ] Sean Owen commented on SPARK-9487: -- Again have a look at

[jira] [Commented] (SPARK-9487) Use the same num. worker threads in Scala/Python unit tests

[ https://issues.apache.org/jira/browse/SPARK-9487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620392#comment-15620392 ] Saikat Kanjilal commented on SPARK-9487: PR attached here:

[jira] [Assigned] (SPARK-18173) data source tables should support truncating partition

[ https://issues.apache.org/jira/browse/SPARK-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18173: Assignee: Wenchen Fan (was: Apache Spark) > data source tables should support truncating

[jira] [Commented] (SPARK-18173) data source tables should support truncating partition

[ https://issues.apache.org/jira/browse/SPARK-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620290#comment-15620290 ] Apache Spark commented on SPARK-18173: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18173) data source tables should support truncating partition

[ https://issues.apache.org/jira/browse/SPARK-18173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18173: Assignee: Apache Spark (was: Wenchen Fan) > data source tables should support truncating

[jira] [Created] (SPARK-18173) data source tables should support truncating partition

Wenchen Fan created SPARK-18173: --- Summary: data source tables should support truncating partition Key: SPARK-18173 URL: https://issues.apache.org/jira/browse/SPARK-18173 Project: Spark Issue

[jira] [Resolved] (SPARK-18043) Java example for Broadcasting

[ https://issues.apache.org/jira/browse/SPARK-18043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18043. --- Resolution: Not A Problem > Java example for Broadcasting > - > >

[jira] [Commented] (SPARK-16522) [MESOS] Spark application throws exception on exit

[ https://issues.apache.org/jira/browse/SPARK-16522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15620225#comment-15620225 ] Harish commented on SPARK-16522: I am getting same error in spark 2.0.2 snapshot. Standalone submission.

[jira] [Resolved] (SPARK-18146) Avoid using Union to chain together create table and repair partition commands

[ https://issues.apache.org/jira/browse/SPARK-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18146. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15665

[jira] [Updated] (SPARK-18146) Avoid using Union to chain together create table and repair partition commands

[ https://issues.apache.org/jira/browse/SPARK-18146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-18146: Assignee: Eric Liang > Avoid using Union to chain together create table and repair partition

[jira] [Comment Edited] (SPARK-16648) LAST_VALUE(FALSE) OVER () throws IndexOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-16648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613656#comment-15613656 ] Emlyn Corrin edited comment on SPARK-16648 at 10/30/16 10:07 AM: - Edit:

[jira] [Created] (SPARK-18172) AnalysisException in first/last during aggregation

Emlyn Corrin created SPARK-18172: Summary: AnalysisException in first/last during aggregation Key: SPARK-18172 URL: https://issues.apache.org/jira/browse/SPARK-18172 Project: Spark Issue

[jira] [Resolved] (SPARK-3261) KMeans clusterer can return duplicate cluster centers

[ https://issues.apache.org/jira/browse/SPARK-3261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-3261. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15450

[jira] [Updated] (SPARK-18170) Confusing error message when using rangeBetween without specifying an "orderBy"

[ https://issues.apache.org/jira/browse/SPARK-18170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18170: -- Issue Type: Improvement (was: Bug) > Confusing error message when using rangeBetween without

[jira] [Resolved] (SPARK-18162) SparkEnv.get.metricsSystem in spark-shell results in error: missing or invalid dependency detected while loading class file 'MetricsSystem.class'

[ https://issues.apache.org/jira/browse/SPARK-18162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18162. --- Resolution: Not A Problem > SparkEnv.get.metricsSystem in spark-shell results in error: missing or

[jira] [Assigned] (SPARK-18171) Show correct framework address in mesos master web ui when the advertised address is used

[ https://issues.apache.org/jira/browse/SPARK-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18171: Assignee: (was: Apache Spark) > Show correct framework address in mesos master web ui

[jira] [Assigned] (SPARK-18171) Show correct framework address in mesos master web ui when the advertised address is used

[ https://issues.apache.org/jira/browse/SPARK-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18171: Assignee: Apache Spark > Show correct framework address in mesos master web ui when the

[jira] [Commented] (SPARK-18171) Show correct framework address in mesos master web ui when the advertised address is used

[ https://issues.apache.org/jira/browse/SPARK-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15619520#comment-15619520 ] Apache Spark commented on SPARK-18171: -- User 'lins05' has created a pull request for this issue:

[jira] [Updated] (SPARK-18171) Show correct framework address in mesos master web ui when the advertised address is used

[ https://issues.apache.org/jira/browse/SPARK-18171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Lin updated SPARK-18171: -- Description: In [[SPARK-4563]] we added the support for the driver to advertise a different

[jira] [Created] (SPARK-18171) Show correct framework address in mesos master web ui when the advertised address is used

Shuai Lin created SPARK-18171: - Summary: Show correct framework address in mesos master web ui when the advertised address is used Key: SPARK-18171 URL: https://issues.apache.org/jira/browse/SPARK-18171

[jira] [Created] (SPARK-18170) Confusing error message when using rangeBetween without specifying an "orderBy"

Weiluo Ren created SPARK-18170: -- Summary: Confusing error message when using rangeBetween without specifying an "orderBy" Key: SPARK-18170 URL: https://issues.apache.org/jira/browse/SPARK-18170 Project: