[jira] [Created] (SPARK-24493) Kerberos Ticket Renewal is failing in long running Spark job

2018-06-07 Thread Asif M (JIRA)
Asif M created SPARK-24493: -- Summary: Kerberos Ticket Renewal is failing in long running Spark job Key: SPARK-24493 URL: https://issues.apache.org/jira/browse/SPARK-24493 Project: Spark Issue

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Environment: (was: Spark version: spark-2.2.0) > Endless attempted task when TaskCommitDenied

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Shepherd: (was: Jiang Xingbo) > Endless attempted task when TaskCommitDenied exception >

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Attachment: retry_stage.png 螢幕快照 2018-05-16 上午11.10.57.png 螢幕快照

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Updated] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Jhe Li updated SPARK-24492: -- Description: Hi, when we run Spark application under spark-2.2.0 on AWS spot instance and output

[jira] [Created] (SPARK-24492) Endless attempted task when TaskCommitDenied exception

2018-06-07 Thread Yu-Jhe Li (JIRA)
Yu-Jhe Li created SPARK-24492: - Summary: Endless attempted task when TaskCommitDenied exception Key: SPARK-24492 URL: https://issues.apache.org/jira/browse/SPARK-24492 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-24482) Not able to run simple SOLR application

2018-06-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-24482. -- Resolution: Invalid It sounds like more specific to the thirdpart library. Let's leave this

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

2018-06-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505613#comment-16505613 ] Hyukjin Kwon commented on SPARK-24487: -- Why don't we leave this out as a thirdpaty library? > Add

[jira] [Commented] (SPARK-24487) Add support for RabbitMQ.

2018-06-07 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505608#comment-16505608 ] Saisai Shao commented on SPARK-24487: - What's the usage and purpose to integrate RabbitMQ to Spark?

[jira] [Assigned] (SPARK-24491) Support for requesting GPU resources on K8S

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24491: Assignee: Apache Spark > Support for requesting GPU resources on K8S >

[jira] [Assigned] (SPARK-24491) Support for requesting GPU resources on K8S

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24491: Assignee: (was: Apache Spark) > Support for requesting GPU resources on K8S >

[jira] [Commented] (SPARK-24491) Support for requesting GPU resources on K8S

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505518#comment-16505518 ] Apache Spark commented on SPARK-24491: -- User 'alexmilowski' has created a pull request for this

[jira] [Created] (SPARK-24491) Support for requesting GPU resources on K8S

2018-06-07 Thread Alex Milowski (JIRA)
Alex Milowski created SPARK-24491: - Summary: Support for requesting GPU resources on K8S Key: SPARK-24491 URL: https://issues.apache.org/jira/browse/SPARK-24491 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24490) Use WebUI.addStaticHandler in web UIs

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505366#comment-16505366 ] Apache Spark commented on SPARK-24490: -- User 'jaceklaskowski' has created a pull request for this

[jira] [Assigned] (SPARK-24490) Use WebUI.addStaticHandler in web UIs

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24490: Assignee: (was: Apache Spark) > Use WebUI.addStaticHandler in web UIs >

[jira] [Assigned] (SPARK-24490) Use WebUI.addStaticHandler in web UIs

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24490: Assignee: Apache Spark > Use WebUI.addStaticHandler in web UIs >

[jira] [Created] (SPARK-24490) Use WebUI.addStaticHandler in web UIs

2018-06-07 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-24490: --- Summary: Use WebUI.addStaticHandler in web UIs Key: SPARK-24490 URL: https://issues.apache.org/jira/browse/SPARK-24490 Project: Spark Issue Type:

[jira] [Commented] (SPARK-24447) Pyspark RowMatrix.columnSimilarities() loses spark context

2018-06-07 Thread Perry Chu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505335#comment-16505335 ] Perry Chu commented on SPARK-24447: --- Thanks for following up. I tried running on a fresh spark 2.3

[jira] [Assigned] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24489: Assignee: Apache Spark > No check for invalid input type of weight data in

[jira] [Assigned] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24489: Assignee: (was: Apache Spark) > No check for invalid input type of weight data in

[jira] [Commented] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505297#comment-16505297 ] Apache Spark commented on SPARK-24489: -- User 'shahidki31' has created a pull request for this

[jira] [Created] (SPARK-24489) No check for invalid input type of weight data in ml.PowerIterationClustering

2018-06-07 Thread shahid (JIRA)
shahid created SPARK-24489: -- Summary: No check for invalid input type of weight data in ml.PowerIterationClustering Key: SPARK-24489 URL: https://issues.apache.org/jira/browse/SPARK-24489 Project: Spark

[jira] [Assigned] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24488: Assignee: Apache Spark > Analyzer throws when generator is aliased multiple times >

[jira] [Assigned] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24488: Assignee: (was: Apache Spark) > Analyzer throws when generator is aliased multiple

[jira] [Commented] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505200#comment-16505200 ] Apache Spark commented on SPARK-24488: -- User 'bkrieger' has created a pull request for this issue:

[jira] [Commented] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Brandon Krieger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505198#comment-16505198 ] Brandon Krieger commented on SPARK-24488: - CC [~cloud_fan] [~r...@databricks.com] > Analyzer

[jira] [Commented] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Brandon Krieger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505199#comment-16505199 ] Brandon Krieger commented on SPARK-24488: - Made https://github.com/apache/spark/pull/21508 to

[jira] [Updated] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Brandon Krieger (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Krieger updated SPARK-24488: Description: Currently, the Analyzer throws an exception if your try to nest a generator.

[jira] [Commented] (SPARK-24486) Slow performance reading ArrayType columns

2018-06-07 Thread Luca Canali (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505192#comment-16505192 ] Luca Canali commented on SPARK-24486: - Thanks for your comment. In all 3 cases (spark 2.2.1, 2.3.0

[jira] [Created] (SPARK-24488) Analyzer throws when generator is aliased multiple times

2018-06-07 Thread Brandon Krieger (JIRA)
Brandon Krieger created SPARK-24488: --- Summary: Analyzer throws when generator is aliased multiple times Key: SPARK-24488 URL: https://issues.apache.org/jira/browse/SPARK-24488 Project: Spark

[jira] [Created] (SPARK-24487) Add support for RabbitMQ.

2018-06-07 Thread JIRA
Michał Jurkiewicz created SPARK-24487: - Summary: Add support for RabbitMQ. Key: SPARK-24487 URL: https://issues.apache.org/jira/browse/SPARK-24487 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-24359) SPIP: ML Pipelines in R

2018-06-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16505049#comment-16505049 ] Joseph K. Bradley commented on SPARK-24359: --- It sounds like everyone is agreed on the fact

[jira] [Commented] (SPARK-24481) GeneratedIteratorForCodegenStage1 grows beyond 64 KB

2018-06-07 Thread Andrew Conegliano (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504965#comment-16504965 ] Andrew Conegliano commented on SPARK-24481: --- Thanks Marco. Forgot to mention, this error

[jira] [Commented] (SPARK-24486) Slow performance reading ArrayType columns

2018-06-07 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504845#comment-16504845 ] Kazuaki Ishizaki commented on SPARK-24486: -- Thank you for reporting a problem. Could you please

[jira] [Commented] (SPARK-19526) Spark should raise an exception when it tries to read a Hive view but it doesn't have read access on the corresponding table(s)

2018-06-07 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504827#comment-16504827 ] Attila Zsolt Piros commented on SPARK-19526: I started working on this issue. > Spark

[jira] [Commented] (SPARK-24481) GeneratedIteratorForCodegenStage1 grows beyond 64 KB

2018-06-07 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504828#comment-16504828 ] Marco Gaido commented on SPARK-24481: - Thanks for reporting this. I am investigating more, but I

[jira] [Issue Comment Deleted] (SPARK-15064) Locale support in StopWordsRemover

2018-06-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-15064: -- Comment: was deleted (was: Yuhao will be OOF from May 29th to June 6th (annual leave and

[jira] [Assigned] (SPARK-24485) Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24485: Assignee: (was: Apache Spark) > Measure and log elapsed time for filesystem

[jira] [Commented] (SPARK-24485) Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504776#comment-16504776 ] Apache Spark commented on SPARK-24485: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Assigned] (SPARK-24485) Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24485: Assignee: Apache Spark > Measure and log elapsed time for filesystem operations in >

[jira] [Created] (SPARK-24486) Slow performance reading ArrayType columns

2018-06-07 Thread Luca Canali (JIRA)
Luca Canali created SPARK-24486: --- Summary: Slow performance reading ArrayType columns Key: SPARK-24486 URL: https://issues.apache.org/jira/browse/SPARK-24486 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-24474) Cores are left idle when there are a lot of stages to run

2018-06-07 Thread Al M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504730#comment-16504730 ] Al M commented on SPARK-24474: -- Sample code that reproduces this: {code:java} val builder =

[jira] [Commented] (SPARK-24434) Support user-specified driver and executor pod templates

2018-06-07 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504676#comment-16504676 ] Stavros Kontopoulos commented on SPARK-24434: - Thanx [~liyinan926] I will provide a design

[jira] [Created] (SPARK-24485) Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider

2018-06-07 Thread Jungtaek Lim (JIRA)
Jungtaek Lim created SPARK-24485: Summary: Measure and log elapsed time for filesystem operations in HDFSBackedStateStoreProvider Key: SPARK-24485 URL: https://issues.apache.org/jira/browse/SPARK-24485

[jira] [Commented] (SPARK-24183) add unit tests for ContinuousDataReader hook

2018-06-07 Thread Li Yuanjian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504614#comment-16504614 ] Li Yuanjian commented on SPARK-24183: - Hi [~joseph.torres], I notice currently we already have

[jira] [Updated] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading eigen values.

2018-06-07 Thread shahid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shahid updated SPARK-24484: --- Summary: Power Iteration Clustering is giving incorrect clustering results when there are mutiple leading

[jira] [Created] (SPARK-24484) Power Iteration Clustering is giving incorrect clustering results when mutiple leading eigen values.

2018-06-07 Thread shahid (JIRA)
shahid created SPARK-24484: -- Summary: Power Iteration Clustering is giving incorrect clustering results when mutiple leading eigen values. Key: SPARK-24484 URL: https://issues.apache.org/jira/browse/SPARK-24484

[jira] [Updated] (SPARK-24483) enableHiveSupport doesn't work with Spark 2.3 on EMR

2018-06-07 Thread Shaul Lahav (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shaul Lahav updated SPARK-24483: Description: I run a spark job on an EMR cluster when using the SparkSession.Builder to create a

[jira] [Created] (SPARK-24483) enableHiveSupport doesn't work with Spark 2.3 on EMR

2018-06-07 Thread Shaul Lahav (JIRA)
Shaul Lahav created SPARK-24483: --- Summary: enableHiveSupport doesn't work with Spark 2.3 on EMR Key: SPARK-24483 URL: https://issues.apache.org/jira/browse/SPARK-24483 Project: Spark Issue

[jira] [Created] (SPARK-24482) Not able to run simple SOLR application

2018-06-07 Thread Pravin Dahare (JIRA)
Pravin Dahare created SPARK-24482: - Summary: Not able to run simple SOLR application Key: SPARK-24482 URL: https://issues.apache.org/jira/browse/SPARK-24482 Project: Spark Issue Type:

[jira] [Updated] (SPARK-13587) Support virtualenv in PySpark

2018-06-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-13587: - Affects Version/s: 1.6.3 2.0.2 2.1.2

[jira] [Assigned] (SPARK-24457) Performance improvement while converting stringToTimestamp in DateTimeUtils

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24457: Assignee: (was: Apache Spark) > Performance improvement while converting

[jira] [Commented] (SPARK-24457) Performance improvement while converting stringToTimestamp in DateTimeUtils

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504431#comment-16504431 ] Apache Spark commented on SPARK-24457: -- User 'ssonker' has created a pull request for this issue:

[jira] [Assigned] (SPARK-24457) Performance improvement while converting stringToTimestamp in DateTimeUtils

2018-06-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24457: Assignee: Apache Spark > Performance improvement while converting stringToTimestamp in

[jira] [Updated] (SPARK-24474) Cores are left idle when there are a lot of stages to run

2018-06-07 Thread Al M (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Al M updated SPARK-24474: - Description: I've observed an issue happening consistently when: * A job contains a join of two datasets *

[jira] [Commented] (SPARK-24442) Add configuration parameter to adjust the numbers of records and the charters per row before truncation when a user runs.show()

2018-06-07 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504316#comment-16504316 ] Hyukjin Kwon commented on SPARK-24442: -- I meant please avoid setting "Fix Version/s" field when the