[jira] [Commented] (SPARK-8474) [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the defaul

[ https://issues.apache.org/jira/browse/SPARK-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593273#comment-14593273 ] Dibyendu Bhattacharya commented on SPARK-8474: -- I got this problem just once.

[jira] [Commented] (SPARK-5836) Highlight in Spark documentation that by default Spark does not delete its temporary files

[ https://issues.apache.org/jira/browse/SPARK-5836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593293#comment-14593293 ] Apache Spark commented on SPARK-5836: - User 'srowen' has created a pull request for

[jira] [Updated] (SPARK-8397) Allow custom configuration for TestHive

[ https://issues.apache.org/jira/browse/SPARK-8397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8397: - Assignee: Punya Biswal Allow custom configuration for TestHive ---

[jira] [Updated] (SPARK-8394) HistoryServer doesn't read kerberos opts from config

[ https://issues.apache.org/jira/browse/SPARK-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8394: - Assignee: Marcelo Vanzin HistoryServer doesn't read kerberos opts from config

[jira] [Updated] (SPARK-8314) improvement in performance of MLUtils.appendBias

[ https://issues.apache.org/jira/browse/SPARK-8314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8314: - Assignee: Roger Menezes improvement in performance of MLUtils.appendBias

[jira] [Updated] (SPARK-6265) PySpark GLMs missing doc for intercept, weights

[ https://issues.apache.org/jira/browse/SPARK-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-6265: - Assignee: Yanbo Liang PySpark GLMs missing doc for intercept, weights

[jira] [Updated] (SPARK-7199) Add date and timestamp support to UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7199: - Assignee: Liang-Chi Hsieh Add date and timestamp support to UnsafeRow

[jira] [Updated] (SPARK-7067) Can't resolve nested column in ORDER BY

[ https://issues.apache.org/jira/browse/SPARK-7067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7067: - Assignee: Wenchen Fan Can't resolve nested column in ORDER BY ---

[jira] [Updated] (SPARK-7471) DAG visualization: show call site information

[ https://issues.apache.org/jira/browse/SPARK-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7471: - Target Version/s: 1.5.0 (was: 1.4.0) DAG visualization: show call site information

[jira] [Updated] (SPARK-7349) DAG visualization: add legend to explain the content

[ https://issues.apache.org/jira/browse/SPARK-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7349: - Target Version/s: 1.5.0 (was: 1.4.0) DAG visualization: add legend to explain the content

[jira] [Updated] (SPARK-7463) DAG visualization improvements

[ https://issues.apache.org/jira/browse/SPARK-7463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7463: - Target Version/s: 1.5.0 (was: 1.4.0, 1.5.0) DAG visualization improvements

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7348: - Target Version/s: 1.5.0 (was: 1.4.0) DAG visualization: add links to RDD page

[jira] [Updated] (SPARK-7465) DAG visualization: RDD dependencies not always shown

[ https://issues.apache.org/jira/browse/SPARK-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7465: - Target Version/s: 1.5.0 (was: 1.4.0) DAG visualization: RDD dependencies not always shown

[jira] [Updated] (SPARK-8435) Cannot create tables in an specific database using a provider

[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8435: - Component/s: SQL Cannot create tables in an specific database using a provider

[jira] [Updated] (SPARK-8465) ScalaReflectionException with DataFrames in 1.4

[ https://issues.apache.org/jira/browse/SPARK-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8465: - Component/s: SQL ScalaReflectionException with DataFrames in 1.4

[jira] [Updated] (SPARK-8413) DirectParquetOutputCommitter doesn't clean up the file on task failure

[ https://issues.apache.org/jira/browse/SPARK-8413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8413: - Component/s: SQL DirectParquetOutputCommitter doesn't clean up the file on task failure

[jira] [Created] (SPARK-8478) Harmonize UDF-related code to use uniformly UDF instead of Udf

Benjamin Fradet created SPARK-8478: -- Summary: Harmonize UDF-related code to use uniformly UDF instead of Udf Key: SPARK-8478 URL: https://issues.apache.org/jira/browse/SPARK-8478 Project: Spark

[jira] [Comment Edited] (SPARK-8356) Reconcile callUDF and callUdf

[ https://issues.apache.org/jira/browse/SPARK-8356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593362#comment-14593362 ] Benjamin Fradet edited comment on SPARK-8356 at 6/19/15 12:02 PM:

[jira] [Updated] (SPARK-7563) OutputCommitCoordinator.stop() should only be executed in driver

[ https://issues.apache.org/jira/browse/SPARK-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7563: - Target Version/s: 1.3.2 Fix Version/s: 1.4.0 OutputCommitCoordinator.stop() should only be

[jira] [Reopened] (SPARK-7265) Improving documentation for Spark SQL Hive support

[ https://issues.apache.org/jira/browse/SPARK-7265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-7265: -- Assignee: Jihong MA Improving documentation for Spark SQL Hive support

[jira] [Updated] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8471: - Assignee: Feynman Liang Implement Discrete Cosine Transform feature transformer

[jira] [Commented] (SPARK-7814) Turn code generation on by default

[ https://issues.apache.org/jira/browse/SPARK-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593095#comment-14593095 ] Reynold Xin commented on SPARK-7814: Let's continue the discussion in SPARK-8461.

[jira] [Updated] (SPARK-6954) ExecutorAllocationManager can end up requesting a negative number of executors

[ https://issues.apache.org/jira/browse/SPARK-6954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-6954: Summary: ExecutorAllocationManager can end up requesting a negative number of executors (was:

[jira] [Updated] (SPARK-8320) Add example in streaming programming guide that shows union of multiple input streams

[ https://issues.apache.org/jira/browse/SPARK-8320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8320: - Assignee: Neelesh Srinivas Salian Add example in streaming programming guide that shows union of

[jira] [Updated] (SPARK-8332) NoSuchMethodError: com.fasterxml.jackson.module.scala.deser.BigDecimalDeserializer

[ https://issues.apache.org/jira/browse/SPARK-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8332: - Fix Version/s: (was: 1.4.1) [~ogirardot] Don't set Fix version; this isn't resolved. (Right?)

[jira] [Comment Edited] (SPARK-7148) Configure Parquet block size (row group size) for ML model import/export

[ https://issues.apache.org/jira/browse/SPARK-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593265#comment-14593265 ] Yanbo Liang edited comment on SPARK-7148 at 6/19/15 9:44 AM: -

[jira] [Commented] (SPARK-8417) spark-class has illegal statement

[ https://issues.apache.org/jira/browse/SPARK-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593163#comment-14593163 ] Sean Owen commented on SPARK-8417: -- It's this bit: {code} # The launcher library will

[jira] [Commented] (SPARK-7169) Allow to specify metrics configuration more flexibly

[ https://issues.apache.org/jira/browse/SPARK-7169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593165#comment-14593165 ] Jacek Lewandowski commented on SPARK-7169: -- [~vanzin] its fix version is set to

[jira] [Commented] (SPARK-8072) Better AnalysisException for writing DataFrame with identically named columns

[ https://issues.apache.org/jira/browse/SPARK-8072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593180#comment-14593180 ] Animesh Baranawal commented on SPARK-8072: -- For the AnalysisException message, is

[jira] [Commented] (SPARK-8474) [STREAMING] Kafka DirectStream API stops receiving messages if collective size of the messages specified in spark.streaming.kafka.maxRatePerPartition exceeds the defaul

[ https://issues.apache.org/jira/browse/SPARK-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593285#comment-14593285 ] Dibyendu Bhattacharya commented on SPARK-8474: -- Yes , right .. May be this

[jira] [Commented] (SPARK-8475) SparkSubmit with Ivy jars is very slow to load with no internet access

[ https://issues.apache.org/jira/browse/SPARK-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593158#comment-14593158 ] Sean Owen commented on SPARK-8475: -- For what it's worth, I like option 1. SparkSubmit

[jira] [Assigned] (SPARK-8463) No suitable driver found for write.jdbc

[ https://issues.apache.org/jira/browse/SPARK-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8463: --- Assignee: Apache Spark No suitable driver found for write.jdbc

[jira] [Commented] (SPARK-8463) No suitable driver found for write.jdbc

[ https://issues.apache.org/jira/browse/SPARK-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593261#comment-14593261 ] Apache Spark commented on SPARK-8463: - User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-8463) No suitable driver found for write.jdbc

[ https://issues.apache.org/jira/browse/SPARK-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8463: --- Assignee: (was: Apache Spark) No suitable driver found for write.jdbc

[jira] [Updated] (SPARK-7860) Spark SQL join two table with different datatype compare condition

[ https://issues.apache.org/jira/browse/SPARK-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-7860: - Target Version/s: (was: 1.3.1) @guofeng don't set target version please. 1.3.1 was released already

[jira] [Comment Edited] (SPARK-8039) OOM when using DataFrame join operation

[ https://issues.apache.org/jira/browse/SPARK-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593309#comment-14593309 ] Sean Owen edited comment on SPARK-8039 at 6/19/15 10:36 AM:

[jira] [Updated] (SPARK-8039) OOM when using DataFrame join operation

[ https://issues.apache.org/jira/browse/SPARK-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8039: - Target Version/s: (was: 1.3.0) @guofeng don't set target version please. 1.3.0 was released already

[jira] [Created] (SPARK-8481) GaussianMixtureModel predict accepting single vector

Dariusz Kobylarz created SPARK-8481: --- Summary: GaussianMixtureModel predict accepting single vector Key: SPARK-8481 URL: https://issues.apache.org/jira/browse/SPARK-8481 Project: Spark

[jira] [Assigned] (SPARK-8481) GaussianMixtureModel predict accepting single vector

[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8481: --- Assignee: (was: Apache Spark) GaussianMixtureModel predict accepting single vector

[jira] [Comment Edited] (SPARK-8337) KafkaUtils.createDirectStream for python is lacking API/feature parity with the Scala/Java version

[ https://issues.apache.org/jira/browse/SPARK-8337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592736#comment-14592736 ] Sean Owen edited comment on SPARK-8337 at 6/19/15 2:30 PM: ---

[jira] [Issue Comment Deleted] (SPARK-8481) GaussianMixtureModel predict accepting single vector

[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dariusz Kobylarz updated SPARK-8481: Comment: was deleted (was: PR: https://github.com/apache/spark/pull/6906)

[jira] [Assigned] (SPARK-8481) GaussianMixtureModel predict accepting single vector

[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8481: --- Assignee: Apache Spark GaussianMixtureModel predict accepting single vector

[jira] [Commented] (SPARK-8481) GaussianMixtureModel predict accepting single vector

[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593491#comment-14593491 ] Dariusz Kobylarz commented on SPARK-8481: - PR:

[jira] [Commented] (SPARK-8481) GaussianMixtureModel predict accepting single vector

[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593489#comment-14593489 ] Apache Spark commented on SPARK-8481: - User 'dkobylarz' has created a pull request for

[jira] [Created] (SPARK-8483) Remove commons-lang3 depedency from flume-sink

Hari Shreedharan created SPARK-8483: --- Summary: Remove commons-lang3 depedency from flume-sink Key: SPARK-8483 URL: https://issues.apache.org/jira/browse/SPARK-8483 Project: Spark Issue

[jira] [Closed] (SPARK-8151) Pipeline components should correctly implement copy

[ https://issues.apache.org/jira/browse/SPARK-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-8151. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Pipeline components should

[jira] [Commented] (SPARK-8417) spark-class has illegal statement

[ https://issues.apache.org/jira/browse/SPARK-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593650#comment-14593650 ] jweinste commented on SPARK-8417: - I saw this issue when running local on mac.. But the

[jira] [Commented] (SPARK-6813) SparkR style guide

[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593584#comment-14593584 ] Shivaram Venkataraman commented on SPARK-6813: -- [~yuu.ishik...@gmail.com]

[jira] [Commented] (SPARK-8431) Add in operator to DataFrame Column in SparkR

[ https://issues.apache.org/jira/browse/SPARK-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593612#comment-14593612 ] Shivaram Venkataraman commented on SPARK-8431: -- Hmm I am not sure we need a

[jira] [Updated] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

[ https://issues.apache.org/jira/browse/SPARK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8468: - Target Version/s: 1.4.1, 1.5.0 Cross-validation with RegressionEvaluator prefers higher RMSE

[jira] [Updated] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

[ https://issues.apache.org/jira/browse/SPARK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8468: - Assignee: Liang-Chi Hsieh Cross-validation with RegressionEvaluator prefers higher RMSE

[jira] [Closed] (SPARK-8150) IDFModel must implement copy

[ https://issues.apache.org/jira/browse/SPARK-8150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-8150. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Assignee: Xiangrui

[jira] [Closed] (SPARK-8123) Bucketizer must implement copy

[ https://issues.apache.org/jira/browse/SPARK-8123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-8123. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 Bucketizer must implement

[jira] [Comment Edited] (SPARK-8417) spark-class has illegal statement

[ https://issues.apache.org/jira/browse/SPARK-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593650#comment-14593650 ] jweinste edited comment on SPARK-8417 at 6/19/15 5:13 PM: -- I saw

[jira] [Created] (SPARK-8482) Add M4 instances support

Pradeep Chhetri created SPARK-8482: -- Summary: Add M4 instances support Key: SPARK-8482 URL: https://issues.apache.org/jira/browse/SPARK-8482 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-8468) Cross-validation with RegressionEvaluator prefers higher RMSE

[ https://issues.apache.org/jira/browse/SPARK-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593637#comment-14593637 ] Joseph K. Bradley commented on SPARK-8468: -- You're definitely correct---thanks

[jira] [Closed] (SPARK-8087) PipelineModel.copy didn't copy the stages

[ https://issues.apache.org/jira/browse/SPARK-8087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng closed SPARK-8087. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 PipelineModel.copy didn't

[jira] [Updated] (SPARK-8484) Add TrainValidationSplit to ml.tuning

[ https://issues.apache.org/jira/browse/SPARK-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8484: - Assignee: (was: Xiangrui Meng) Add TrainValidationSplit to ml.tuning

[jira] [Created] (SPARK-8484) Add TrainValidationSplit to ml.tuning

Xiangrui Meng created SPARK-8484: Summary: Add TrainValidationSplit to ml.tuning Key: SPARK-8484 URL: https://issues.apache.org/jira/browse/SPARK-8484 Project: Spark Issue Type: New Feature

[jira] [Assigned] (SPARK-8482) Add M4 instances support

[ https://issues.apache.org/jira/browse/SPARK-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8482: --- Assignee: Apache Spark Add M4 instances support

[jira] [Closed] (SPARK-8451) SparkSubmitSuite never checks for process exit code

[ https://issues.apache.org/jira/browse/SPARK-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8451. Resolution: Fixed Fix Version/s: 1.5.0 1.4.1 1.3.2

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593709#comment-14593709 ] Andrew Or commented on SPARK-7287: -- + and spend some time to actually rewrite it. Flaky

[jira] [Updated] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yana Kadiyska updated SPARK-1403: - Target Version/s: 1.5.0 Spark on Mesos does not set Thread's context class loader

[jira] [Commented] (SPARK-1403) Spark on Mesos does not set Thread's context class loader

[ https://issues.apache.org/jira/browse/SPARK-1403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593725#comment-14593725 ] Yana Kadiyska commented on SPARK-1403: -- [~pwendell] at your convenience can you

[jira] [Resolved] (SPARK-8368) ClassNotFoundException in closure for map

[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8368. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6891

[jira] [Updated] (SPARK-8368) ClassNotFoundException in closure for map

[ https://issues.apache.org/jira/browse/SPARK-8368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8368: Fix Version/s: 1.4.1 ClassNotFoundException in closure for map

[jira] [Commented] (SPARK-8482) Add M4 instances support

[ https://issues.apache.org/jira/browse/SPARK-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593675#comment-14593675 ] Apache Spark commented on SPARK-8482: - User 'pradeepchhetri' has created a pull

[jira] [Assigned] (SPARK-8482) Add M4 instances support

[ https://issues.apache.org/jira/browse/SPARK-8482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8482: --- Assignee: (was: Apache Spark) Add M4 instances support

[jira] [Resolved] (SPARK-8476) Setters inc/decDiskBytesSpilled in TaskMetrics should also be private.

[ https://issues.apache.org/jira/browse/SPARK-8476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8476. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Takuya Ueshin Setters

[jira] [Closed] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-7180. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 SerializationDebugger

[jira] [Commented] (SPARK-8477) Add in operator to DataFrame Column in Python

[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593704#comment-14593704 ] Yu Ishikawa commented on SPARK-8477: [~rxin] I have a question about implementing this

[jira] [Commented] (SPARK-8477) Add in operator to DataFrame Column in Python

[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593706#comment-14593706 ] Reynold Xin commented on SPARK-8477: [~davies] what would you recommend? Add in

[jira] [Updated] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8090: - Priority: Major (was: Minor) SerializationDebugger does not handle classes with writeReplace correctly

[jira] [Commented] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593707#comment-14593707 ] Andrew Or commented on SPARK-7287: -- I'm going to keep this open for a while since we

[jira] [Updated] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7180: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) SerializationDebugger fails with ArrayOutOfBoundsException

[jira] [Updated] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8090: - Fix Version/s: 1.4.1 SerializationDebugger does not handle classes with writeReplace correctly

[jira] [Updated] (SPARK-8465) ScalaReflectionException with DataFrames in 1.4

[ https://issues.apache.org/jira/browse/SPARK-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Urso McDaniel updated SPARK-8465: -- Description: We are seeing class exceptions when converting to a DataFrame. Anyone out

[jira] [Commented] (SPARK-6813) SparkR style guide

[ https://issues.apache.org/jira/browse/SPARK-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593655#comment-14593655 ] Shivaram Venkataraman commented on SPARK-6813: -- FWIW I think the basic things

[jira] [Resolved] (SPARK-8207) math function: bin

[ https://issues.apache.org/jira/browse/SPARK-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8207. --- Resolution: Fixed math function: bin -- Key: SPARK-8207

[jira] [Updated] (SPARK-8471) Implement Discrete Cosine Transform feature transformer

[ https://issues.apache.org/jira/browse/SPARK-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-8471: - Description: Discrete cosine transform (DCT) is an invertible matrix transformation commonly

[jira] [Resolved] (SPARK-8234) misc function: md5

[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8234. Resolution: Fixed Fix Version/s: 1.5.0 Assignee: Qian, Shilei misc function: md5

[jira] [Updated] (SPARK-8234) misc function: md5

[ https://issues.apache.org/jira/browse/SPARK-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8234: --- Labels: missing-python (was: ) misc function: md5 -- Key:

[jira] [Closed] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8090. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 (was: 1.4.1)

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Target Version/s: (was: 1.4.1) SerializationDebugger does not handle classes with writeObject method

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Priority: Major (was: Minor) SerializationDebugger does not handle classes with writeObject method

[jira] [Closed] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or closed SPARK-8091. Resolution: Fixed Fix Version/s: 1.5.0 Target Version/s: 1.5.0 SerializationDebugger does

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) SerializationDebugger does not handle classes with

[jira] [Updated] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-7180: - Fix Version/s: 1.4.1 SerializationDebugger fails with ArrayOutOfBoundsException

[jira] [Updated] (SPARK-8090) SerializationDebugger does not handle classes with writeReplace correctly

[ https://issues.apache.org/jira/browse/SPARK-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8090: - Target Version/s: 1.4.1, 1.5.0 (was: 1.5.0) SerializationDebugger does not handle classes with

[jira] [Updated] (SPARK-8091) SerializationDebugger does not handle classes with writeObject method

[ https://issues.apache.org/jira/browse/SPARK-8091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-8091: - Fix Version/s: 1.4.1 SerializationDebugger does not handle classes with writeObject method

[jira] [Resolved] (SPARK-8058) Add tests for SPARK-7853 and SPARK-8020

[ https://issues.apache.org/jira/browse/SPARK-8058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-8058. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6891

[jira] [Updated] (SPARK-4118) Create python bindings for Streaming KMeans

[ https://issues.apache.org/jira/browse/SPARK-4118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-4118: - Assignee: Manoj Kumar Create python bindings for Streaming KMeans

[jira] [Commented] (SPARK-8477) Add in operator to DataFrame Column in Python

[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593850#comment-14593850 ] Davies Liu commented on SPARK-8477: --- I think we can use the upper case `In`, or another

[jira] [Commented] (SPARK-8477) Add in operator to DataFrame Column in Python

[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593866#comment-14593866 ] Apache Spark commented on SPARK-8477: - User 'yu-iskw' has created a pull request for

[jira] [Assigned] (SPARK-8477) Add in operator to DataFrame Column in Python

[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8477: --- Assignee: (was: Apache Spark) Add in operator to DataFrame Column in Python

[jira] [Assigned] (SPARK-8477) Add in operator to DataFrame Column in Python

[ https://issues.apache.org/jira/browse/SPARK-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8477: --- Assignee: Apache Spark Add in operator to DataFrame Column in Python

[jira] [Resolved] (SPARK-8461) ClassNotFoundException when code generation is enabled

[ https://issues.apache.org/jira/browse/SPARK-8461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8461. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 6898

[jira] [Updated] (SPARK-8093) Spark 1.4 branch's new JSON schema inference has changed the behavior of handling inner empty JSON object.

[ https://issues.apache.org/jira/browse/SPARK-8093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-8093: Assignee: Nathan Howell Spark 1.4 branch's new JSON schema inference has changed the behavior of

[jira] [Updated] (SPARK-8481) GaussianMixtureModel predict accepting single vector

[ https://issues.apache.org/jira/browse/SPARK-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8481: - Target Version/s: (was: 1.4.0) Fix Version/s: (was: 1.4.1) [~siaroslaw] you should not set

[jira] [Resolved] (SPARK-7968) Rename minPartitions to maxPartitions in wholeTextFiles/binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-7968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-7968. -- Resolution: Not A Problem Rename minPartitions to maxPartitions in wholeTextFiles/binaryFiles

<    1   2   3   4   >