[jira] [Commented] (SPARK-11120) maxNumExecutorFailures defaults to 3 under dynamic allocation

[ https://issues.apache.org/jira/browse/SPARK-11120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958762#comment-14958762 ] Sean Owen commented on SPARK-11120: --- Is this specific to dynamic allocation though? you could have the

[jira] [Created] (SPARK-11129) Link Spark WebUI in Mesos WebUI

Philipp Hoffmann created SPARK-11129: Summary: Link Spark WebUI in Mesos WebUI Key: SPARK-11129 URL: https://issues.apache.org/jira/browse/SPARK-11129 Project: Spark Issue Type: New

[jira] [Commented] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

[ https://issues.apache.org/jira/browse/SPARK-11128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958756#comment-14958756 ] Sean Owen commented on SPARK-11128: --- Is this a Spark problem? sounds like an issue between Hadoop and

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958823#comment-14958823 ] Kristina Plazonic commented on SPARK-10935: --- @Xusen, I'm almost done - should be done this

[jira] [Commented] (SPARK-9241) Supporting multiple DISTINCT columns

[ https://issues.apache.org/jira/browse/SPARK-9241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958758#comment-14958758 ] Herman van Hovell commented on SPARK-9241: -- We could implement this using GROUPING SETS. That is

[jira] [Assigned] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11129: Assignee: Apache Spark > Link Spark WebUI in Mesos WebUI >

[jira] [Commented] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958856#comment-14958856 ] Philipp Hoffmann commented on SPARK-11129: -- submitted a pull request > Link Spark WebUI in

[jira] [Assigned] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11129: Assignee: (was: Apache Spark) > Link Spark WebUI in Mesos WebUI >

[jira] [Commented] (SPARK-11129) Link Spark WebUI in Mesos WebUI

[ https://issues.apache.org/jira/browse/SPARK-11129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958858#comment-14958858 ] Apache Spark commented on SPARK-11129: -- User 'philipphoffmann' has created a pull request for this

[jira] [Resolved] (SPARK-10528) spark-shell throws java.lang.RuntimeException: The root scratch dir: /tmp/hive on HDFS should be writable.

[ https://issues.apache.org/jira/browse/SPARK-10528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10528. --- Resolution: Not A Problem This looks like an environment problem. > spark-shell throws

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958841#comment-14958841 ] Dominic Ricard commented on SPARK-11103: Setting the property

[jira] [Commented] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958397#comment-14958397 ] Jeff Zhang commented on SPARK-11125: Will create pull request soon. > Unreadable exception when

[jira] [Commented] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958408#comment-14958408 ] Apache Spark commented on SPARK-11126: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11126: Assignee: (was: Apache Spark) > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Commented] (SPARK-4226) SparkSQL - Add support for subqueries in predicates

[ https://issues.apache.org/jira/browse/SPARK-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958524#comment-14958524 ] Cheng Hao commented on SPARK-4226: -- [~nadenf] Actually I am working on it right now, and the first PR is

[jira] [Commented] (SPARK-6065) Optimize word2vec.findSynonyms speed

[ https://issues.apache.org/jira/browse/SPARK-6065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958585#comment-14958585 ] Franck Zhang commented on SPARK-6065: -- When I used the same dataset (text8 - around100mb), same

[jira] [Commented] (SPARK-11119) cleanup unsafe array and map

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958403#comment-14958403 ] Apache Spark commented on SPARK-9: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11119) cleanup unsafe array and map

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9: Assignee: (was: Apache Spark) > cleanup unsafe array and map >

[jira] [Assigned] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11125: Assignee: (was: Apache Spark) > Unreadable exception when running spark-sql without

[jira] [Assigned] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11125: Assignee: Apache Spark > Unreadable exception when running spark-sql without building

[jira] [Assigned] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11126: Assignee: Apache Spark > A memory leak in SQLListener._stageIdToStageMetrics >

[jira] [Commented] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

[ https://issues.apache.org/jira/browse/SPARK-11125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958441#comment-14958441 ] Apache Spark commented on SPARK-11125: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11119) cleanup unsafe array and map

[ https://issues.apache.org/jira/browse/SPARK-9?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9: Assignee: Apache Spark > cleanup unsafe array and map > > >

[jira] [Created] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

Shixiong Zhu created SPARK-11126: Summary: A memory leak in SQLListener._stageIdToStageMetrics Key: SPARK-11126 URL: https://issues.apache.org/jira/browse/SPARK-11126 Project: Spark Issue

[jira] [Commented] (SPARK-11097) Add connection established callback to lower level RPC layer so we don't need to check for new connections in NettyRpcHandler.receive

[ https://issues.apache.org/jira/browse/SPARK-11097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958447#comment-14958447 ] Reynold Xin commented on SPARK-11097: - Simplifies code and improves performance (no need to check

[jira] [Created] (SPARK-11128) strange NPE when writing in non-existing S3 bucket

mathieu despriee created SPARK-11128: Summary: strange NPE when writing in non-existing S3 bucket Key: SPARK-11128 URL: https://issues.apache.org/jira/browse/SPARK-11128 Project: Spark

[jira] [Created] (SPARK-11127) Upgrade Kinesis Client Library to the latest stable version

Xiangrui Meng created SPARK-11127: - Summary: Upgrade Kinesis Client Library to the latest stable version Key: SPARK-11127 URL: https://issues.apache.org/jira/browse/SPARK-11127 Project: Spark

[jira] [Commented] (SPARK-10893) Lag Analytic function broken

[ https://issues.apache.org/jira/browse/SPARK-10893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958520#comment-14958520 ] Herman van Hovell commented on SPARK-10893: --- A bug was found in the Window implementation. It

[jira] [Created] (SPARK-11125) Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set

Jeff Zhang created SPARK-11125: -- Summary: Unreadable exception when running spark-sql without building with -Phive-thriftserver and SPARK_PREPEND_CLASSES is set Key: SPARK-11125 URL:

[jira] [Commented] (SPARK-11103) Filter applied on Merged Parquet shema with new column fail with (java.lang.IllegalArgumentException: Column [column_name] was not found in schema!)

[ https://issues.apache.org/jira/browse/SPARK-11103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14958879#comment-14958879 ] Hyukjin Kwon commented on SPARK-11103: -- For me, I think Spark should appropriately set filters for

[jira] [Commented] (SPARK-10935) Avito Context Ad Clicks

[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959140#comment-14959140 ] Xusen Yin commented on SPARK-10935: --- OK, ping me if you need help. > Avito Context Ad Clicks >

[jira] [Commented] (SPARK-10729) word2vec model save for python

[ https://issues.apache.org/jira/browse/SPARK-10729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959097#comment-14959097 ] Jian Feng Zhang commented on SPARK-10729: - I can take this if no objections. > word2vec model

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959156#comment-14959156 ] Xusen Yin commented on SPARK-5874: -- How about adding a warm-start strategy in ML Estimator? I.e. update

[jira] [Comment Edited] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959571#comment-14959571 ] Pratik Khadloya edited comment on SPARK-2984 at 10/15/15 8:40 PM: -- Am

[jira] [Commented] (SPARK-2984) FileNotFoundException on _temporary directory

[ https://issues.apache.org/jira/browse/SPARK-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959571#comment-14959571 ] Pratik Khadloya commented on SPARK-2984: Am seeing the same issue on Spark 1.4.1. I am trying to

[jira] [Comment Edited] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959599#comment-14959599 ] Zhan Zhang edited comment on SPARK-11087 at 10/15/15 8:58 PM: -- [~patcharee]

[jira] [Updated] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

[ https://issues.apache.org/jira/browse/SPARK-11134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11134: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.launcher.LauncherBackendSuite >

[jira] [Commented] (SPARK-5874) How to improve the current ML pipeline API?

[ https://issues.apache.org/jira/browse/SPARK-5874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959589#comment-14959589 ] Joseph K. Bradley commented on SPARK-5874: -- Sure, that sounds good. Can you also please search

[jira] [Created] (SPARK-11137) Make StreamingContext.stop() exception-safe

Felix Cheung created SPARK-11137: Summary: Make StreamingContext.stop() exception-safe Key: SPARK-11137 URL: https://issues.apache.org/jira/browse/SPARK-11137 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11142) org.datanucleus is already registered

raicho created SPARK-11142: -- Summary: org.datanucleus is already registered Key: SPARK-11142 URL: https://issues.apache.org/jira/browse/SPARK-11142 Project: Spark Issue Type: Question

[jira] [Updated] (SPARK-11142) org.datanucleus is already registered

[ https://issues.apache.org/jira/browse/SPARK-11142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] raicho updated SPARK-11142: --- Priority: Minor (was: Major) > org.datanucleus is already registered >

[jira] [Commented] (SPARK-11136) Warm-start support for ML estimator

[ https://issues.apache.org/jira/browse/SPARK-11136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960063#comment-14960063 ] Xusen Yin commented on SPARK-11136: --- I have already linked all related issues. [~josephkb] Which kind

[jira] [Commented] (SPARK-10780) Set initialModel in KMeans in Pipelines API

[ https://issues.apache.org/jira/browse/SPARK-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960072#comment-14960072 ] Joseph K. Bradley commented on SPARK-10780: --- [~jayants] I agree with [~yinxusen]: The

[jira] [Commented] (SPARK-11136) Warm-start support for ML estimator

[ https://issues.apache.org/jira/browse/SPARK-11136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960073#comment-14960073 ] Joseph K. Bradley commented on SPARK-11136: --- We should definitely have it be a Param. I just

[jira] [Commented] (SPARK-11136) Warm-start support for ML estimator

[ https://issues.apache.org/jira/browse/SPARK-11136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960116#comment-14960116 ] Xusen Yin commented on SPARK-11136: --- Sure. And I will add more subtasks on this JIRA to indicate other

[jira] [Commented] (SPARK-11126) A memory leak in SQLListener._stageIdToStageMetrics

[ https://issues.apache.org/jira/browse/SPARK-11126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959876#comment-14959876 ] Nick Pritchard commented on SPARK-11126: Is there any workaround to avoid this memory leak? > A

[jira] [Commented] (SPARK-11109) move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException

[ https://issues.apache.org/jira/browse/SPARK-11109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959958#comment-14959958 ] Apache Spark commented on SPARK-11109: -- User 'gweidner' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11109) move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException

[ https://issues.apache.org/jira/browse/SPARK-11109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11109: Assignee: Apache Spark > move FsHistoryProvider off import >

[jira] [Assigned] (SPARK-11109) move FsHistoryProvider off import org.apache.hadoop.fs.permission.AccessControlException

[ https://issues.apache.org/jira/browse/SPARK-11109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11109: Assignee: (was: Apache Spark) > move FsHistoryProvider off import >

[jira] [Commented] (SPARK-9695) Add random seed Param to ML Pipeline

[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960034#comment-14960034 ] Yanbo Liang commented on SPARK-9695: I agree if users set pipeline stage's seed, it has higher

[jira] [Updated] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated SPARK-11102: --- Summary: Uninformative exception when specifing non-exist input for JSON data source (was:

[jira] [Commented] (SPARK-10780) Set initialModel in KMeans in Pipelines API

[ https://issues.apache.org/jira/browse/SPARK-10780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960041#comment-14960041 ] Xusen Yin commented on SPARK-10780: --- This belongs to the SPARK-11136. But we need to pay more

[jira] [Commented] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

[ https://issues.apache.org/jira/browse/SPARK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960119#comment-14960119 ] Klaus Ma commented on SPARK-11143: -- I also got a feedback from StackOverflow at

[jira] [Created] (SPARK-11139) Make SparkContext.stop() exception-safe

Felix Cheung created SPARK-11139: Summary: Make SparkContext.stop() exception-safe Key: SPARK-11139 URL: https://issues.apache.org/jira/browse/SPARK-11139 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2629) Improve performance of DStream.updateStateByKey

[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2629: - Target Version/s: 1.6.0 > Improve performance of DStream.updateStateByKey >

[jira] [Updated] (SPARK-2629) Improve performance of DStream.updateStateByKey

[ https://issues.apache.org/jira/browse/SPARK-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-2629: - Affects Version/s: 0.9.2 1.0.2 1.2.2

[jira] [Commented] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959897#comment-14959897 ] Apache Spark commented on SPARK-11102: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11102: Assignee: (was: Apache Spark) > Uninformative exception when specifing non-exist

[jira] [Assigned] (SPARK-11102) Uninformative exception when specifing non-exist input for JSON data source

[ https://issues.apache.org/jira/browse/SPARK-11102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11102: Assignee: Apache Spark > Uninformative exception when specifing non-exist input for JSON

[jira] [Updated] (SPARK-11127) Upgrade Kinesis Client Library to the latest stable version

[ https://issues.apache.org/jira/browse/SPARK-11127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11127: -- Assignee: Tathagata Das > Upgrade Kinesis Client Library to the latest stable version >

[jira] [Assigned] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10560: Assignee: Apache Spark > Make StreamingLogisticRegressionWithSGD Python API equals with

[jira] [Resolved] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11135. -- Resolution: Fixed Fix Version/s: 1.5.2 1.6.0 Issue resolved

[jira] [Assigned] (SPARK-11141) Batching of ReceivedBlockTrackerLogEvents for efficient WAL writes

[ https://issues.apache.org/jira/browse/SPARK-11141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11141: Assignee: (was: Apache Spark) > Batching of ReceivedBlockTrackerLogEvents for

[jira] [Commented] (SPARK-10513) Springleaf Marketing Response

[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959949#comment-14959949 ] Yanbo Liang commented on SPARK-10513: - [~josephkb] For 4: If a column of StringType has "" value (not

[jira] [Comment Edited] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959978#comment-14959978 ] Yanbo Liang edited comment on SPARK-8418 at 10/16/15 1:23 AM: -- [~josephkb] I

[jira] [Comment Edited] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959978#comment-14959978 ] Yanbo Liang edited comment on SPARK-8418 at 10/16/15 1:23 AM: -- [~josephkb] I

[jira] [Commented] (SPARK-5472) Add support for reading from and writing to a JDBC database

[ https://issues.apache.org/jira/browse/SPARK-5472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960052#comment-14960052 ] Jia Li commented on SPARK-5472: --- [~tmyklebu] Does your PR handle BINARY type? Thanks, > Add support for

[jira] [Commented] (SPARK-9695) Add random seed Param to ML Pipeline

[ https://issues.apache.org/jira/browse/SPARK-9695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14960080#comment-14960080 ] Joseph K. Bradley commented on SPARK-9695: -- {quote}I think we should store the whole pipeline and

[jira] [Updated] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

[ https://issues.apache.org/jira/browse/SPARK-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Klaus Ma updated SPARK-11143: - Description: I'm working on integration between Mesos & Spark. For now, I can start

[jira] [Created] (SPARK-11143) SparkMesosDispatcher can not launch driver in docker

Klaus Ma created SPARK-11143: Summary: SparkMesosDispatcher can not launch driver in docker Key: SPARK-11143 URL: https://issues.apache.org/jira/browse/SPARK-11143 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11138) Flaky pyspark test: test_add_py_file

Marcelo Vanzin created SPARK-11138: -- Summary: Flaky pyspark test: test_add_py_file Key: SPARK-11138 URL: https://issues.apache.org/jira/browse/SPARK-11138 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-11140) Replace file server in driver with RPC-based alternative

Marcelo Vanzin created SPARK-11140: -- Summary: Replace file server in driver with RPC-based alternative Key: SPARK-11140 URL: https://issues.apache.org/jira/browse/SPARK-11140 Project: Spark

[jira] [Assigned] (SPARK-11141) Batching of ReceivedBlockTrackerLogEvents for efficient WAL writes

[ https://issues.apache.org/jira/browse/SPARK-11141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11141: Assignee: Apache Spark > Batching of ReceivedBlockTrackerLogEvents for efficient WAL

[jira] [Commented] (SPARK-11141) Batching of ReceivedBlockTrackerLogEvents for efficient WAL writes

[ https://issues.apache.org/jira/browse/SPARK-11141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959939#comment-14959939 ] Apache Spark commented on SPARK-11141: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Created] (SPARK-11141) Batching of ReceivedBlockTrackerLogEvents for efficient WAL writes

Burak Yavuz created SPARK-11141: --- Summary: Batching of ReceivedBlockTrackerLogEvents for efficient WAL writes Key: SPARK-11141 URL: https://issues.apache.org/jira/browse/SPARK-11141 Project: Spark

[jira] [Comment Edited] (SPARK-10513) Springleaf Marketing Response

[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959949#comment-14959949 ] Yanbo Liang edited comment on SPARK-10513 at 10/16/15 12:45 AM:

[jira] [Commented] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959960#comment-14959960 ] Donam Kim commented on SPARK-10066: --- I have same problem with Spark 1.5.1 on HDP 2.3.1 > Can't create

[jira] [Commented] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959978#comment-14959978 ] Yanbo Liang commented on SPARK-8418: [~josephkb] I don't think RFormula is the best way to resolve

[jira] [Commented] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959892#comment-14959892 ] Apache Spark commented on SPARK-10560: -- User 'BryanCutler' has created a pull request for this

[jira] [Assigned] (SPARK-10560) Make StreamingLogisticRegressionWithSGD Python API equals with Scala one

[ https://issues.apache.org/jira/browse/SPARK-10560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10560: Assignee: (was: Apache Spark) > Make StreamingLogisticRegressionWithSGD Python API

[jira] [Comment Edited] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959978#comment-14959978 ] Yanbo Liang edited comment on SPARK-8418 at 10/16/15 1:26 AM: -- [~josephkb] I

[jira] [Comment Edited] (SPARK-8418) Add single- and multi-value support to ML Transformers

[ https://issues.apache.org/jira/browse/SPARK-8418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959978#comment-14959978 ] Yanbo Liang edited comment on SPARK-8418 at 10/16/15 1:43 AM: -- [~josephkb] I

[jira] [Updated] (SPARK-11136) Warm-start support for ML estimator

[ https://issues.apache.org/jira/browse/SPARK-11136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-11136: -- Description: The current implementation of Estimator does not support warm-start fitting, i.e.

[jira] [Commented] (SPARK-11087) spark.sql.orc.filterPushdown does not work, No ORC pushdown predicate

[ https://issues.apache.org/jira/browse/SPARK-11087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959599#comment-14959599 ] Zhan Zhang commented on SPARK-11087: [~patcharee] I try to duplicate your table as much as possible,

[jira] [Created] (SPARK-11134) Flaky test: o.a.s.launcher.LauncherBackendSuite

Andrew Or created SPARK-11134: - Summary: Flaky test: o.a.s.launcher.LauncherBackendSuite Key: SPARK-11134 URL: https://issues.apache.org/jira/browse/SPARK-11134 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11133) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11133. Resolution: Duplicate > Flaky test: o.a.s.launcher.LauncherServerSuite >

[jira] [Created] (SPARK-11133) Flaky test: o.a.s.launcher.LauncherServerSuite

Andrew Or created SPARK-11133: - Summary: Flaky test: o.a.s.launcher.LauncherServerSuite Key: SPARK-11133 URL: https://issues.apache.org/jira/browse/SPARK-11133 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11135: --- Summary: Exchange sort-planning logic incorrectly avoid sorts when existing ordering is subset of

[jira] [Created] (SPARK-11136) Warm-start support for ML estimator

Xusen Yin created SPARK-11136: - Summary: Warm-start support for ML estimator Key: SPARK-11136 URL: https://issues.apache.org/jira/browse/SPARK-11136 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-11133) Flaky test: o.a.s.launcher.LauncherServerSuite

[ https://issues.apache.org/jira/browse/SPARK-11133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11133: -- Labels: flaky-test (was: ) > Flaky test: o.a.s.launcher.LauncherServerSuite >

[jira] [Resolved] (SPARK-10515) When killing executor, the pending replacement executors will be lost

[ https://issues.apache.org/jira/browse/SPARK-10515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-10515. --- Resolution: Fixed Assignee: KaiXinXIaoLei Fix Version/s: 1.6.0

[jira] [Assigned] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11135: Assignee: Josh Rosen (was: Apache Spark) > Exchange sort-planning logic incorrectly

[jira] [Commented] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959735#comment-14959735 ] Apache Spark commented on SPARK-11135: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11135: Assignee: Apache Spark (was: Josh Rosen) > Exchange sort-planning logic incorrectly

[jira] [Updated] (SPARK-11135) Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty subset of required ordering

[ https://issues.apache.org/jira/browse/SPARK-11135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-11135: --- Summary: Exchange sort-planning logic incorrectly avoid sorts when existing ordering is non-empty

[jira] [Updated] (SPARK-5391) SparkSQL fails to create tables with custom JSON SerDe

[ https://issues.apache.org/jira/browse/SPARK-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5391: - Assignee: Davies Liu > SparkSQL fails to create tables with custom JSON SerDe >

[jira] [Updated] (SPARK-10829) Scan DataSource with predicate expression combine partition key and attributes doesn't work

[ https://issues.apache.org/jira/browse/SPARK-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10829: -- Assignee: Cheng Hao > Scan DataSource with predicate expression combine partition key and >

[jira] [Assigned] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6488: --- Assignee: Mike Dusenberry (was: Apache Spark) > Support addition/multiplication in

[jira] [Assigned] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-6488: --- Assignee: Apache Spark (was: Mike Dusenberry) > Support addition/multiplication in

[jira] [Commented] (SPARK-6488) Support addition/multiplication in PySpark's BlockMatrix

[ https://issues.apache.org/jira/browse/SPARK-6488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959534#comment-14959534 ] Apache Spark commented on SPARK-6488: - User 'dusenberrymw' has created a pull request for this issue:

  1   2   >